Apache DolphinScheduler April Briefing: Community Development and Technology Innovation Express

The open source China community team made its first live broadcast, telling the story behind the open source China community in the name of sharing."

Dear friends who love DolphinScheduler, the DolphinScheduler community monthly report for April has been updated! Important monthly updates of the DolphinScheduler community will be recorded here, please pay attention!

Merge Star of the Month

Thanks to the following friends for their wonderful contributions to Apache DolphinScheduler in April (listed in no particular order):

@alei1206,@caishunfeng,@qingwli,@sdhzwc, @ ruanwenjun ,@pegasas,@songwenyong,@privking,@zhongjiajie,@xinxingi,@Gallardot,@abzymeinsjtu,@DaqianLiao,@atjiucheng,@calvinjiang,@xxzuo,@pinkfloyds

Apache/dolphinscheduler function update and optimization

Fix

• [FIX] Fix inability to restore stopped instances @privking
• [Hotfix] Fix dsip name @ruanwenjun
• [Fix-15866][Doc] Update Taobao npm mirror address @xxzuo
• [Bug][Helm] Fix image.registry @Gallardot
• [Bug] In initialization mode, the QUARTZ table was not in the correct order. @ruanwenjun
• [Fix-15706] Optimization of SeaTunnel @xinxingi
• [Fix-15787] Reuse code to resolve complex SQL parsing exceptions in... @xinxinggi
• [Bug] [Common] Fix typo in common.properties @pegasas
• [Fix] Split cpuUsage into systemCpuUsage and jvmCpuUsage. @ruanwenjun
• [Bug] Fix dependency task logic @abzymeinsjtu

Improve

• [Improvement-15919][datasource] Optimize data source get name @sdhzwc
• [Improvement-15910][UI] A default value should be provided for custom parallelism assuming that in parallel execution mode. @calvinjiang
• [Improvement] Fix alert code smell @qingwli
• [Improvement][Audit] Change the time to creation time @qingwli
• [Improvement][Api] Remove useless batchUpdateUdfFunc method @qingwli
• [Improvement] Changed the default setting of python-gateway to false. @pinkfloyds
• [Improvement] Check for unusual characters @pinkfloyds
• [Improve] Fixed ProcessServiceImpltypo @qingwli
• [improvement-15760][datasource-plugin] Fix SQL task splitting error #15760 @songwenyong
• [Improvement] Add full resource name check @caishunfeng
• [Improvement-15744][parameter] Add update time and update user ID to project parameters @sdhzwc
• [Improvement-15713][api] List queries for data sources and UDF functions should use enum code values ​​instead of sequence numbers. @songwenyong
• [Improvement][Spark] Support local Spark cluster @pegasas

Others

• [TEST] Increase service test coverage for project preferences @abzymeinsjtu
• [DSIP-34] Set required_approving_review_count to 2 @ruanwenjun
• Concurrency fix: Automatically creating tennants could cause tasks to fail. @ruanwenjun
• In the Java task, the jar path is incorrect. @ruanwenjun
• [TEST] Increase the coverage of project parameter service testing @abzymeinsjtu
• Use workerNodeInfoWriteLock to update worker node information @DaqianLiao
• [DSIP-32][Master] Add fetch strategy for master pull command @ruanwenjun
• Fix kill dynamic task not terminating workflow instances waiting to run @ruanwenjun
• [DSIP-31] Reduce Hikari connection pool size @ruanwenjun
• Fixed an error that queryByTypeAndJobId could cause by returning too many results. @ruanwenjun
• 重構記錄审计日志的邏輯 @qingwli
• [DSIP-28] Do not scan the entire project beans under the classpath. @ruanwenjun
• Add DSIP template @ruanwenjun
• [TEST] Increase the coverage of log service @abzymeinsjtu
• Fix an error writing to the audit log that would cause requests to fail. @ruanwenjun
• Fix JDBC registry not working. @ruanwenjun
• Change SSH heartbeat type to .IGNORE @ruanwenjun
• In Apache SeaTunnel, it is prohibited to force the completion of task instances in running workflow instances. @ruanwenjun
• Bind process ID to CodeGenerator's build process @ruanwenjun
• Fix ErrorCommand missing some fields in Command @ruanwenjun
• [TEST] Increasing coverage of environmental services @abzymeinsjtu
• Remove unused caffeine cache @ruanwenjun
• Unable to build an instance of StreamingTaskTriggerResponse. @atjiucheng
• [TEST] Increase coverage of data source services @abzymeinsjtu
• [TEST] The coverage of early warning plug-in instance service is increased @abzymeinsjtu
• Remove dolphinscheduler-data-quality from dolphinscheduler-task-dataquality @ruanwenjun
• Directly use Quartz's API to initialize a scheduling task. @ruanwenjun
• [DSIP-24][RemoteLogging]支持 AbsRemoteLogHandler @pegasas
• [Worker] Fixed an issue where the remote child process is not accidentally killed when stopping a remote shell task #15570 @alei1206
• [DSIP-26][Audit log] Audit log improvement design @qingwli

apache/dolphinscheduler-sdk-python warehouse function update and optimization

• This issue is related to compatibility and latest version of Apache SeaTunnel. @zhongjiajie
• [This question is about encountering an unsupported version when updating setup-python. In Chinese, this can be expressed as: "Encountered an old version that setup-python does not support and needs to be updated." ]( https://github.com/apache/dolphinscheduler-sdk-python/pull/143 " This question is Regarding encountering an unsupported version when updating setup-python. In Chinese, this can be expressed as: "An old version of setup-python is not supported and needs to be updated." ") @zhongjiajie

apache/dolphinscheduler-website

Improve

• [Improvement] Add recommended stable version @xxzuo

This article is published by Beluga Open Source Technology !

A programmer born in the 1990s developed a video porting software and made over 7 million in less than a year. The ending was very punishing! High school students create their own open source programming language as a coming-of-age ceremony - sharp comments from netizens: Relying on RustDesk due to rampant fraud, domestic service Taobao (taobao.com) suspended domestic services and restarted web version optimization work Java 17 is the most commonly used Java LTS version Windows 10 market share Reaching 70%, Windows 11 continues to decline Open Source Daily | Google supports Hongmeng to take over; open source Rabbit R1; Android phones supported by Docker; Microsoft's anxiety and ambition; Haier Electric shuts down the open platform Apple releases M4 chip Google deletes Android universal kernel (ACK ) Support for RISC-V architecture Yunfeng resigned from Alibaba and plans to produce independent games on the Windows platform in the future

{{o.name}}

{{m.name}}