This Week in Databend #103
July 23, 2023 · 3 min read
Stay up to date with the latest weekly developments on Databend!
Databend is a modern cloud data warehouse, serving your massive-scale analytics needs at low cost and complexity. Open source alternative to Snowflake. Also available in the cloud: https://app.databend.com .
What's On In Databend
Stay connected with the latest news about Databend.
Creating Network Policies
Network Policies are used to manage access to Databend services. They can also be utilized to restrict access to a SQL user account based on users' IP addresses.
To create a set of network policies:
CREATE NETWORK POLICY <policy-name> ALLOWED_IP_LIST=(<allowed-ip>) BLOCKED_IP_LIST=(<blocked-ip>) COMMENT=<policy-comment>
To restrict access to a SQL user account:
CREATE USER <user-name> IDENTIFIED BY <user-password> WITH SET NETWORK POLICY=<policy-name>
--- OR ---
ALTER USER <user-name> WITH SET NETWORK POLICY=<policy-name>
If you are interested in learning more, please check out the resources listed below.
- PR #11988 | feat(query): Support create network policy
- PR #12137 | feat(query): Alter user support set/unset network policy
Discover some fascinating code snippets or projects that showcase our work or learning journey.
Profiling Table Scan
Databend now supports
wait_time for profiling table scans. This feature offers insights into time spent reading data from storage, assisting in determining whether a query is I/O or CPU bound.
If you are interested in learning more, please check out the resources listed below:
We have also made these improvements to Databend that we hope you will find helpful:
- Read document Docs | RECLUSTER TABLE to understand the updated reclustering mechanism.
- Read documents Docs | Fuse Engine and Docs | ALTER TABLE OPTION to learn the options available in Fuse Engine and how to modify them.
- Read document Docs | Vacuum Dropped Tables to learn about our latest enterprise feature and how it can help you save storage space.
What's Up Next
We're always open to cutting-edge technologies and innovative ideas. You're more than welcome to join the community and bring them to Databend.
Renaming TSV file format to Text
Databend supports a file format called TSV, which may mislead users into thinking that its only difference from CSV is the field delimiter.
In reality, TSV corresponds to the text format of MySQL/Hive/PostgreSQL and uses escaping instead of quoting to handle delimiters in values (MySQL text supports quoting but not by default). ClickHouse also uses it for transferring data to/from MySQL.
Therefore, we suggest renaming TSV to TEXT.
Please let us know if you're interested in contributing to this feature, or pick up a good first issue at https://link.databend.rs/i-m-feeling-lucky to get started.
We always open arms to everyone and can't wait to see how you'll help our community grow and thrive.
You can check the changelog of Databend Nightly for details about our latest developments.
🎉 Contributors 21 contributors
Thanks a lot to the contributors for their excellent work.
🎈Connect With Us
Databend is a cutting-edge, open-source cloud-native warehouse built with Rust, designed to handle massive-scale analytics.
Join the Databend Community to try, get help, and contribute!