Databend Open Source Weekly Issue 142

The open source China community team made its first live broadcast, telling the story behind the open source China community in the name of sharing."

Databend is a modern cloud data warehouse. Designed for flexibility and efficiency to support your large-scale analysis needs. Free and open source. Experience the cloud service now: https://app.databend.cn .

What's On In Databend

Explore Databend's new developments this week and encounter Databend that is closer to your heart.

Support WASM UDF

Databend now supports WASM UDF. Combined with CREATE FUNCTIONsyntax and powerful STAGE capabilities, WASM files can be loaded from the storage layer to enhance Databend's computing capabilities.

CREATE FUNCTION wasm_fibonacci (INT) RETURNS BIGINT LANGUAGE wasm HANDLER = 'wasm_fibonacci(int4)->int4' AS $$@data/udf/wasm/test10-udf-wasm-gcd/test10_udf_wasm_gcd.wasm.zst$$

select number, wasm_fibonacci(number) from numbers(5) where number > 0 order by 1;
----
1 1
2 1
3 2
4 3

If you'd like to learn more, feel free to contact the Databend team or check out the resources listed below.

PR #15107 | feat(query): 14925, support udf wasm

Code Corner

Let’s explore code snippets or projects in Databend and the surrounding ecosystem.

Learn about Databend’s search functions

Databend supports advanced full-text search capabilities and borrows design from Elasticsearch. Feel free to read the documentation to learn more.

SELECT *, score() FROM test WHERE QUERY('title:art^5 body:reading^1.2');

┌────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐
│           title           │                                      body                                      │  score()  │
├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────┼───────────┤
│ The Importance of Reading │ Reading is a crucial skill that opens up a world of knowledge and imagination. │ 1.3860708 │
│ The Art of Communication  │ Effective communication is crucial in everyday life.                           │ 7.1992116 │
└────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘

SELECT *, score() FROM test WHERE MATCH('title^5, body^1.2', 'reading everyday');

┌────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐
│           title           │                                      body                                      │  score()  │
├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────┼───────────┤
│ The Importance of Reading │ Reading is a crucial skill that opens up a world of knowledge and imagination. │  8.585282 │
│ The Art of Communication  │ Effective communication is crucial in everyday life.                           │ 1.8575745 │
└────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘

Docs | Full-Text Search Functions

Highlights

Here are some noteworthy events, maybe you can find something of interest.

Support using cte in delete.
Newly supported GEO functions: st_asgeojson, st_asewkb, st_aswkb, st_asewkt, st_aswkt, st_geohash, to_geometry, try_to_geometry.
Support functions map_keysand map_values.
Support TOP K syntax.
Inverted index supports JSON type data.

What's Up Next

We are always open to cutting-edge technologies and innovative ideas, and welcome you to join the community and inject vitality into Databend.

Supports direct connection to Power BI

Power BI is one of the most popular data analysis tools and has become a standard data analysis platform adopted by many enterprises. Therefore, it is extremely important to ensure that all data is accessible through Power BI.

Databend plans to support direct connection to Power BI for dynamic queries, which is more efficient and real-time than relying on batch ETL processes or CDC synchronization processes to better serve scenarios that require timely analysis or processing of large-scale data sets.

Issue #15342 | Feature: Support Power BI Connections

If you are interested in this topic, you can try to solve some of the problems or participate in discussions and PR reviews. Alternatively, you can click on https://link.databend.rs/im-feeling-lucky to pick a random question, good luck!

New Contributors

Meet new people in the community. Databend is a better place because of you.

@shamb0 implemented support for WASM UDF, #15107 .

Changelog

Check out the changelog for Databend's daily builds to stay up to date on the latest developments.

Address: https://github.com/datafuselabs/databend/releases

Contributors

A big thank you to the contributors for their great work this week.

Connect With Us

Databend is an open source, flexible, low-cost, new data warehouse based on object storage that can also perform real-time analysis. We look forward to your attention and exploring cloud native data warehouse solutions together to create a new generation of open source Data Cloud.