Re: [ANNOUNCE] New Website of DolphinScheduler

2022-12-12 Thread Calvin Kirs
Well done! Thanks Amy. On Tue, Dec 13, 2022 at 2:30 PM Chufeng Gao wrote: > > Neat! Thanks Amy. > > Best Regards, > > Chufeng (Eric) Gao > > > On Mon, Dec 12, 2022 at 2:08 PM amy wang wrote: > > > > Hi all, > > > > I am delighted to tell you that the website of DolphinScheduler will be > > repla

Re: [DISCUSS]Create user mailing list

2022-10-20 Thread Calvin Kirs
+1 On Wed, Oct 19, 2022 at 3:59 AM Jiajie Zhong wrote: > > Hello everyone, > > I propose we dolphinscheduler create a user mail list for our users. > > The dev mailing list is mainly used by project developers to discuss > community development-related work, such as feature design, releases, > et

Re: [VOTE] Release Apache DolphinScheduler 3.1.0

2022-09-29 Thread Calvin Kirs
On Thu, Sep 29, 2022 at 10:01 AM Jiajie Zhong wrote: > > Hi calvin, > I think https://downloads.apache.org/dolphinscheduler/KEYS is the same > as https://dist.apache.org/repos/dist/release/dolphinscheduler/KEYS Yup, but that's the SVN address > > On Wed, Sep 28, 2022 at 5:4

Re: [VOTE] Release Apache DolphinScheduler 3.1.0

2022-09-28 Thread Calvin Kirs
On Wed, Sep 28, 2022 at 5:07 PM ShunFeng Cai wrote: > > Hi, jiajie > > Thanks for your reminder, I had removed the > https://dist.apache.org/repos/dist/dev/dolphinscheduler/KEYS and Add my > gpg key in > https://dist.apache.org/repos/dist/release/dolphinscheduler/KEYS, please > ckeck again. Hi, W

Re: Data Engineering Track at ApacheCon (October 3-6, New Orleans) - CFP ends 23rd of May !

2022-05-12 Thread Calvin Kirs
Hi Jarek, Thanks a lot, we've already had someone submit it. Looking forward to having a beer with you Jiajie Zhong 于2022年5月12日周四 12:11写道: > > Hi Jarek, > > Thanks for bringing this up, It's good to hear we have a separate > track in ApacheCon, and thank you and Ismaël Mejía organize. We > Dolph

[CVE-2022-25598]User registration interface security question

2022-03-29 Thread Calvin Kirs
Hi, Severity: low Affected version: all versions below 2.0.5. Description: Apache DolphinScheduler user registration interface is vulnerable to Regular express Denial of Service (ReDoS) attacks, Apache DolphinScheduler users should upgrade to version 2.0.5 or higher. Solution: Upgrade to 2.0.5 o

Re: [VOTE]Release Apache Dolphinscheduler 2.0.2 round3

2022-01-04 Thread Calvin Kirs
+1 binding 1. ASC checked 2. version correct 3. sha512 exists 4. License and Notice are there. 5. All files have license headers if necessary. leon bao 于2022年1月1日周六 00:26写道: > Hi guys: > This is a call for vote to release Apache DolphinScheduler > version 2.0.2 round3 thx > > > Release changes:

[ANN] Welcome to our new committer: Jiajie Zhong

2021-12-15 Thread Calvin Kirs
Hi Jiajie, Welcome you to join us as a new committer. The PMC for Apache DolphinScheduler has invited Jiajie to become a committer and we are pleased to announce that he has accepted. Being a committer enables easier contribution to the project and can merge PRs or close issues. This should enable

[ANN] Welcome to our new committer: Yizhi Wang

2021-12-15 Thread Calvin Kirs
Hi Yizhi, Welcome you to join us as a new committer. The PMC for Apache DolphinScheduler has invited Yizhi to become a committer and we are pleased to announce that he has accepted. Being a committer enables easier contribution to the project and can merge PRs or close issues. This should enable be

[ANN]Welcome to our new committer: Zhenxu Ke

2021-12-15 Thread Calvin Kirs
Hi Zhenxu, Welcome you to join us as a new committer. The PMC for Apache DolphinScheduler has invited Zhenxu to become a committer and we are pleased to announce that he has accepted. Being a committer enables easier contribution to the project and can merge PRs or close issues. This should enable

CVE-2021-27644: Apache DolphinScheduler: DolphinScheduler mysql jdbc connector parameters deserialize remote code execution

2021-11-01 Thread Calvin Kirs
Severity: low Description: In Apache DolphinScheduler before 1.3.6 versions, authorized users can use SQL injection in the data source center. (Only applicable to MySQL data source with internal login account password) Credit: This issue was discovered by Jinchen Sheng of Ant FG Security Lab

CVE-2021-27644: Apache DolphinScheduler: DolphinScheduler mysql jdbc connector parameters deserialize remote code execution

2021-11-01 Thread Calvin Kirs
Severity: low Description: In Apache DolphinScheduler before 1.3.6 versions, authorized users can use SQL injection in the data source center. (Only applicable to MySQL data source with internal login account password) Credit: This issue was discovered by Jinchen Sheng of Ant FG Security Lab

Re: 回复: [DISCUSS] Do not support not english issue or PR anymore

2021-10-08 Thread Calvin Kirs
Thank you very much for your reminder :) Sheng Wu 于2021年10月8日周五 下午8:03写道: > Considering our experiences of SkyWalking, which initiated in China too. > Please think from load of community. Another new language means 100% more > workload on document. > > Calvin Kirs 于2021年1

Re: 回复: [DISCUSS] Do not support not english issue or PR anymore

2021-10-08 Thread Calvin Kirs
hi, simsicon 于2021年10月8日周五 下午5:58写道: > Hi all, > > I understand the urge to eliminate the non-English usage of the project, > and I like to communicate technical problems in English, however I would > like to remind you guys that the project was born in China and still has a > lot of Chinese user

Re:About the source code

2021-08-02 Thread Calvin Kirs
Worker and Master communicate through Netty, and both queues are local queues. WorkerManagerThread gets TaskExecuteThread from workerExecuteQueue and executes it. TaskExecuteThread.run() performs AbstractTask.handle() processing, and after processing, calls NettyRemoteChannel in TaskCallbackServi

[ANN]Welcome to our new committer: Wenjun Ruan

2021-07-28 Thread Calvin Kirs
Hi Wenjun, Welcome you to join us as a new committer. The PMC for Apache DolphinScheduler has invited Wenjun Ruan to become a committer and we are pleased to announce that he has accepted. Being a committer enables easier contribution to the project and can merge PRs or close issues. This should

Re:Hello Dear

2021-07-28 Thread Calvin Kirs
hi, what problems did you encounter about dolphinscheduler? Best Wishes! CalvinKirs, Apache DolphinScheduler PMC On 07/27/2021 13:43,Stephany Burton wrote: If you are still using this email address please reply me

Re: [DISCUSS] About the problem of incorrect unit test coverage in the API module

2021-07-09 Thread Calvin Kirs
o your suggestion! Issue: #5781 <https://github.com/apache/dolphinscheduler/issues/5781> Calvin Kirs 于2021年7月2日周五 上午11:59写道: Yes, the reason is explained in [1]. No need to worry if prefortest does not contain test classes. Best Wishes! CalvinKirs, Apache DolphinScheduler PMC On 07/2/

Re: [GSoC]COMDEV-412 Apache DolphinScheduler Parameter coverage

2021-07-07 Thread Calvin Kirs
progress PR for this. > Then we will take it from there. > > Regards > Rumesh > > On Thu, Jul 1, 2021 at 11:58 AM Calvin Kirs wrote: > >> Hi Rumesh: >> >> The first evaluations will take place on July 13, >> I would like to know what is you

Re: [DISCUSS] About the problem of incorrect unit test coverage in the API module

2021-07-01 Thread Calvin Kirs
coverage in Demo. Thanks, Wenjun Ruan From: Calvin Kirs Date: Friday, July 2, 2021 at 11:25 AM To: dev@dolphinscheduler.apache.org Subject: Re: [DISCUSS] About the problem of incorrect unit test coverage in the API module External Email It would be nice to provide a clear context, otherwise I can

Re: [DISCUSS] About the problem of incorrect unit test coverage in the API module

2021-07-01 Thread Calvin Kirs
It would be nice to provide a clear context, otherwise I can only speculate. 1:It is possible that there is a problem with PowerMock, and there is no good solution for it. You can refer to [1]. Or avoid using the @Prefortest annotation. I don't know much about your specific problem, so I can't

Re: [GSoC]COMDEV-412 Apache DolphinScheduler Parameter coverage

2021-06-30 Thread Calvin Kirs
e.org > --- > > > On Mon, Jun 21, 2021 at 11:25 AM Calvin Kirs wrote: > > > Rumesh Perera 于2021年6月21日周一 上午4:42写道: > > > > > Hi Mentors/all, > > > > > > This is to initiate the design discussion currently I am working on. > This >

[DISCUSS]1.3.7 Release content and dev future.

2021-06-28 Thread Calvin Kirs
Hi guys: Currently, I searched the community for issues as well as 1.3.7 milestones,[1] and got the following, which I suggest guys discuss. 1.3.7 will start releasing after the development of the following tasks are completed 1:Start workflow support disables, enable. @wanghong 2:Worker l

Re: [DISCUSS]Task and resource scheduling plugins

2021-06-22 Thread Calvin Kirs
over design and development Shiwen Cheng / 程世文 DolphinScheduler Committer Mobile: (+86)15201523580 E-mail: chengshi...@apache.org Calvin Kirs 于2021年6月22日周二 下午7:19写道: For the moment, I agree with you. But from a plugin design perspective, the changes are split out for better scaling as well as

Re: [DISCUSS]Use K8s to realize the registry center

2021-06-22 Thread Calvin Kirs
Yes, I totally agree with you, so we can consider the first option first. Best Wishes! CalvinKirs, Apache DolphinScheduler PMC On 06/22/2021 19:11,Shiwen Cheng wrote: The 1st solution will be better. As for whether to use Service[1], we need further research. Take dubbo-go as an example. Becaus

Re: [DISCUSS]Task and resource scheduling plugins

2021-06-22 Thread Calvin Kirs
For the moment, I agree with you. But from a plugin design perspective, the changes are split out for better scaling as well as maintenance. Hadoop 1.x to 2.x did a similar job. Best Wishes! CalvinKirs, Apache DolphinScheduler PMC On 06/22/2021 18:52,Shiwen Cheng wrote: At present, this de

Re: [GSoC]COMDEV-412 Apache DolphinScheduler Parameter coverage

2021-06-20 Thread Calvin Kirs
ed we basically exit the Java runtime printing to the console > that parameter is mandatory to be supplied at startup. > > I don't think we need to, as a public approach, we don't need to care about specific businesses. > @Calvin Kirs Can you please provide example for the >

Re: [GSoC]COMDEV-412 Apache DolphinScheduler Parameter coverage

2021-06-15 Thread Calvin Kirs
Hi Rumesh, Do you have any problems that I can help you with? (BTW, the official coding period has started, so let's discuss it on the mailing list) Calvin Kirs 于2021年6月9日周三 下午4:11写道: > Hi Rumesh, > You need to pay extra attention to several points. > > Scalability: If we h

[DISCUSS] Create demo.dolphinscheduler.apache.org domain name

2021-05-23 Thread Calvin Kirs
Dear all, We currently have a demo server (106.75.43.194), which is used to provide product demonstrations to users. It is provided by @Lidong Dai . I hope to apply for a domain name ( demo.dolphinscheduler.apache.org) from the Apache Infrastructure team to bind this server. What do you think?

[Meetup]Apache DolphinScheduler & Apache ShardingSphere Global Online co-Meetup

2021-05-13 Thread Calvin Kirs
Hi, DolphinShcheduler community and ShardingSphere community guys, We will host Apache DolphinScheduler & Apache ShardingSphere Global Online co-Meetup on Saturday, May 15, 2021, 2:00 PM to 5:00 PM PDT It is the first time that Apache DolphinScheduler and Apache ShardingSphere have jointly orga

[Meetup]Apache DolphinScheduler & Apache ShardingSphere Global Online co-Meetup

2021-05-13 Thread Calvin Kirs
Hi, DolphinShcheduler community and ShardingSphere community guys, We will host Apache DolphinScheduler & Apache ShardingSphere Global Online co-Meetup on Saturday, May 15, 2021, 2:00 PM to 5:00 PM PDT It is the first time that Apache DolphinScheduler and Apache ShardingSphere have jointly orga

Re: [Disscussion] the quality of test code for DolphinScheduler needs to be improved

2020-07-07 Thread Kirs
good suggestion. Perhaps, we should sort out a list of related issues and label them so that contributors can get tasks. | | Kirs | | 邮箱:acm_mas...@163.com | Signature is customized by Netease Mail Master On 07/07/2020 19:11, lidong dai wrote: hi I think the quality of test code for

Re: [Discuss]RIP DolphinScheduler Community

2020-07-01 Thread Kirs
Very good, in addition, we better add some wrong examples and good cases | | Kirs | | ??acm_mas...@163.com | Signature is customized by Netease Mail Master On 07/02/2020 10:31, Yichao Yang wrote: Hi, I agree with you, and I also have some ideas about practice from learning Apache

[Discuss]RIP DolphinScheduler Community

2020-07-01 Thread Kirs
I read RIP-14 RocketMQ Community Operation Conventions, I think we also need to make such a specification, as follows 1:Test Standardized testing can reduce the cost of review and quickly find problems to confirm the problem, so the test code link is more important than the code itself to

Re: Enhanced load balancing

2020-06-23 Thread Kirs
thank you very much for your suggestion! I will provide default default parameters, users can configure according to the actual situation. | | Kirs | | acm_mas...@163.com | 签名由网易邮箱大师定制 On 06/23/2020 13:48,lidong dai wrote: good idea,you can refer this java class implementation

Enhanced load balancing

2020-06-22 Thread Kirs
balancing can also be left as an spi for users to expand. I sincerely hope to get everyone's suggestions, and then follow the time nodes to complete it. | | Kirs | | 邮箱:acm_mas...@163.com | Signature is customized by Netease Mail Master