Databend Open Source Weekly Issue 134

[Live broadcast preview] Will large models replace programmers? "

Databend is a modern cloud data warehouse. Designed for flexibility and efficiency to support your large-scale analysis needs. Free and open source. Experience the cloud service now: https://app.databend.cn .

What's On In Databend

Explore Databend's new developments this week and encounter Databend that is closer to your heart.

Support multi-statement transactions

Databend now supports basic multi-statement transaction support.

Uses of multi-statement transactions include:

Perform DML changes to multiple tables in a single transaction.
Perform changes to a single table in multiple stages based on intermediate calculations.

BEGIN;
INSERT INTO t_append_only VALUES(4), (5);
INSERT INTO t_consume_append_only_1 SELECT a FROM s_append_only;
INSERT INTO t_append_only VALUES(6), (7);
COMMIT;

If you'd like to learn more, feel free to contact the Databend team or check out the resources listed below.

PR #14562 | feat: support multi-statement transactions

Code Corner

Let’s explore code snippets or projects in Databend and the surrounding ecosystem.

crabml - Reimplementation of GGML in Rust

crabml is an ongoing experimental project, which is equivalent to reimplementing GGML using Rust. Efficient inference can be performed on cheap hardware.

Created by Flaneur2020 , a member of the Databend team , it currently supports inference of the Q8_0 quantified Llama 3B model.

Highlights

Here are some noteworthy events, maybe you can find something of interest.

SQLsmith supports generating binary and geometry type data.
Hash join is integrated with the new filter framework.
EXPLAINSupports exhaustive output mode ( verbose), which can provide more relationship attribute information and statistics.
Improve analyze table to support querying the incremental blocks of the fuse table.

What's Up Next

We are always open to cutting-edge technologies and innovative ideas, and welcome you to join the community and inject vitality into Databend.

Support PRQL dialect

The full name of PRQL is Pipelined Relational Query Language, pronounced "Prequel". PRQL is also readable and declarative; but unlike SQL, it supports abstract concepts such as variables and functions.

Here is a PRQL example:

from track_plays
filter plays > 10_000                # Readable numbers
filter (length | in 60..240)         # Ranges with `..`
filter recorded > @2008-01-01        # Simple date literals
filter released - recorded < 180days # Nice interval literals
sort {-length}                       # Concise order direction

PRQL can be prqlccompiled into general SQL that can be parsed by AST, and Databend plans to take advantage of this to provide support for PRQL.

Issue #14811 | Feature: prql dialect support

If you are interested in this topic, you can try to solve some of the problems or participate in discussions and PR reviews. Alternatively, you can click on https://link.databend.rs/im-feeling-lucky to pick a random question, good luck!

New Contributors

Meet new people in the community. Databend is a better place because of you.

@dracooooooo implemented DESC[RIBE] [TABLE] <name>support for statements, #14736 .

Changelog

Check out the changelog for Databend's daily builds to stay up to date on the latest developments.

Address: https://github.com/datafuselabs/databend/releases

Contributors

A big thank you to the contributors for their great work this week.

Connect With Us

Databend is an open source, flexible, low-cost, new data warehouse based on object storage that can also perform real-time analysis. We look forward to your attention and exploring cloud native data warehouse solutions together to create a new generation of open source Data Cloud.