Hi all, Version 3.2.0 is nearly close and released during those days, but we can not upload it to Apache SVN because too big for our tarball, We created a Jira ticket to bump the svn limit for dolphinscheduler and it is still in discussion. I will follow up when it has a further update
On Thu, Jul 20, 2023 at 12:01 PM Jay Chung <zhongjiajie...@gmail.com> wrote: > > Hi all, > > I had cherry-picked some recent commits to the branch 3.2.0-prepare, > anyone who interested in checking 3.2.0 features could clone the > latest branch to have a look > > On Tue, Jun 20, 2023 at 3:34 PM Jay Chung <zhongjiajie...@gmail.com> wrote: > > > > Hi guys, > > > > I submit new PR[1] to remove test datasource in version 3.2.0, in [2] > > we introduce the test task and test datasource. It is a good feature > > to allow user run in test environment. > > > > But I find out we have to create test datasource before create the > > prod one. I think it make user confuse especial some one who do not > > use test environment. So I think we should remove it in version 3.2.0. > > > > If you have different idea, please let me know in this mail thread > > > > [1]: https://github.com/apache/dolphinscheduler/pull/14381 > > [2]: https://github.com/apache/dolphinscheduler/pull/11670 > > > > On Mon, Jun 19, 2023 at 2:59 PM Jay Chung <zhongjiajie...@gmail.com> wrote: > > > > > > Hi Community, > > > > > > I added a checklist for the version 3.2.0 release, everyone who > > > interested in the incoming version can participate in our test, the > > > detail checklist issue is in > > > https://github.com/apache/dolphinscheduler/issues/14372 > > > > > > On Mon, Jun 5, 2023 at 8:59 AM Kerwin Zhuang <zhuang.ker...@gmail.com> > > > wrote: > > > > > > > > Thanks Jay. > > > > > > > > Looking forward to the 3.2.0 release. > > > > > > > > -- > > > > Best Wish > > > > — Kerwin (zhuangchong) > > > > > > > > > > > > > > > > Jay Chung <zhongjia...@apache.org> 于2023年6月3日周六 20:01写道： > > > > > > > > > Hi all, > > > > > > > > > > I am here to propose Apache Dolphinscheduler version 3.2.0 plan to > > > > > release in July 2023 or August 2023. > > > > > > > > > > Actually, I already created a new branch named `3.2.0-prepare` for > > > > > it[1], including all features merged to branch dev after we release > > > > > 3.1.0(date Sep 28, 2022), including many interesting functional > > > > > additions and code base refactoring. > > > > > > > > > > Version 3.2.0 is WIP in testing and bug fixing now, anyone interested > > > > > to Dolphinscheduler or want to contribute to the latest version is > > > > > welcome to test it. You can checkout the 3.2.0-prepare[1] branch and > > > > > start the standalone server, or build tarball for cluster mode test > > > > > based on your wish. In this version, we need to test the core function > > > > > of dolphinscheduler like CURD of project, workflow, task and execute > > > > > them. we allow need to test the resource center carefully because it > > > > > changes a lot in this version. > > > > > > > > > > You can report dolpinscheduler issue[2] if you find any bugs. We have > > > > > a specific version for this incoming version name `3.2.0-prepare` in > > > > > the bugs reported template. > > > > > > > > > > And feel free to submit PR to fix bugs, whatever is reported by > > > > > others or > > > > > you > > > > > > > > > > Some of the functional features list for 3.2.0: > > > > > > > > > > * User friendly > > > > > * UI only: More hyperlinks jump between resource, adjustable > > > > > column > > > > > width > > > > > * Default tenant: Out of box run workflow by default tenant > > > > > * Run or rerun task in task instance > > > > > * Human readable json export result > > > > > * Cloud native > > > > > * Kubernetes Real-time log and custom label support > > > > > * Support KEDA autoscaler worker > > > > > * Support Terraform deploy to AWS > > > > > * Multi arch for zookeper and postgresql(all services are > > > > > supported > > > > > now) > > > > > * Resource center > > > > > * Refactor resource center, we use provider API to list and manage > > > > > resource now > > > > > * Allow resource re-upload now > > > > > * Datasource > > > > > * New datasource: > > > > > snowflake、databend、kyuubi、oceanbase、dameng、azuresql、starrocks、AWS > > > > > Athena > > > > > * Support access key for redshift datasource > > > > > * Tasks > > > > > * New tasks: azure datafactory、apache > > > > > linkis、Kubeflow、datasync、remote-shell、AWS Database Migration、Java Task > > > > > * Improve for exists: Add presto for datax, parameter passing for > > > > > python and http, sql task multiple sql delimiter, dependent depend > > > > > itself > > > > > * Introduce task cache for MLops or other long-run tasks > > > > > * Parameter > > > > > * Add new rule of build-in function > > > > > * Introduce file type parameter > > > > > * Startup parameters have the highest priority > > > > > * Logs: Introduce remote logs mechanism and support Google Cloud > > > > > Storage、S3、OSS up to now > > > > > * API: > > > > > * Introduce some new restful API(experimental), including > > > > > taskInstance、workflow state、workflowInstance、workflow and > > > > > schedule、task relation > > > > > * Can get task instance id when triggering workflow via API > > > > > * Registry: Introduce etcd, jdbc supported > > > > > > > > > > [1]: https://github.com/apache/dolphinscheduler/tree/3.2.0-prepare > > > > > [2]: https://github.com/apache/dolphinscheduler/issues/new/choose > > > > > > > > > > -- > > > > > Best Wish > > > > > —Jay Chung > > > > > > > > > > > > > > > > > -- > > > Best Wish > > > —Jay Chung > > > > > > > > -- > > Best Wish > > —Jay Chung > > > > -- > Best Wish > —Jay Chung -- Best Wish —Jay Chung
