*Hi guys,*

Here is the meeting summary.

*Community Roadmap Update and Progress*
The meeting discussed the development plan and roadmap of the community,
mentioning specific topics and proposals, such as adding new features,
monitoring, and task diagnostics. At the same time, the issue of "good
first issue" was also discussed, as well as how to increase the visibility
of the new issue list. In addition, the discussion also touched on the DSIP
for monitoring and task diagnostics, and how to cooperate with the front
end for interface design. Finally, it was decided to start with simple
numerical interface types and communicate details with the product later.

*Open Source Summer Community Activity Progress*
This week, four projects were publicized, but the number of student quotas
has not been determined.
Exploration and Practice of Optimization Packaging Method
Regarding the release progress of version 3.22, there is currently a
problem with the package size being too large. The current plan is to
comment out the infrequently used plugins (users can download them
themselves when using). Various packaging solutions were also discussed,
including placing the internal directories of services in the root
directory to share one directory, building a separate warehouse for
separate release, and dynamic loading. At the same time, the plan to put
all service internal directories into the root directory to share one
directory was also discussed to solve the redundancy problem. In addition,
the idea of executing a script after packaging the service to extract the
public package and thus reduce the volume was also mentioned.

*Task Scheduling and Trigger Handling*
The discussion mainly revolved around the definition and instantiation of
triggers, and how to use the existing framework for development. First,
triggers are regarded as a special type of task and loaded into the UI.
Next, the mechanism of distribution based on task parameters to workers was
discussed, as well as how to update tables and insert commands. At the same
time, the current issues with debugging and UI, and the relationship with
the timing function were mentioned. Finally, the relationship between
triggers and timing functions was discussed, and it was believed that they
are a one-to-many relationship, that is, a trigger can correspond to
multiple timing tasks.

The meeting discussed the compatibility issues between Worker and Task, and
how to avoid resource occupation. It was proposed to distribute the
triggered tasks to the Worker, process them on the Worker, and then define
a common interface in the task through the task interface. At the same
time, the idea of outputting the results of the trigger as A parents and
updating the status of the trigger was also discussed. Finally, regarding
the design of task plugins, it was concluded after discussion that there is
no need to make task plugins for triggers, but to make them directly into
logical task plugins.

*DolphinScheduler Security Model Draft*
The issue of the security model was discussed, and the draft is still being
written and will be synchronized at next month's meeting. Finally, the
issue of the host for the next meeting will continue to be presided over by
Xue Tong.


BTW, you can get the origin meeting video url from
https://www.bilibili.com/video/BV14Z421H7GR


Best Regards

---------------
Apache DolphinScheduler PMC Chair & Apache SeaTunnel PMC member
David
Linkedin: https://www.linkedin.com/in/davidzollo
Twitter: @WorkflowEasy <https://twitter.com/WorkflowEasy>
---------------


On Tue, May 21, 2024 at 8:46 PM David Zollo <davidzollo...@gmail.com> wrote:

> Hi guys,
>
> We will hold a community meeting at 20:00, May 29(GMT+8), organized by
> lenboo.
>
> Conference theme: DS Community May 2024 Conference
> Meeting address: Tencent Meeting
>
> Meeting time: May 29, 2024 20:00-21:00 (GMT+08:00)
> Meeting address: https://meeting.tencent.com/dm/rC7GQmeBb4MQ
> #Tencent Meeting: 601-804-233
> Tencent Document: https://docs.qq.com/doc/DQ3BGVHZ1bXp5R2FZ
> You can add your ideas to https://docs.qq.com/doc/DQ3BGVHZ1bXp5R2FZ At
> the community meeting for discussion
>
> By the way, if there are users from other time zones, please leave a
> message,
> we can choose a proper time for these time zones.
>
>
> Welcome to join us!
>
>
>
>
> Best Regards
>
> ---------------
> Apache DolphinScheduler PMC Chair & Apache SeaTunnel PMC member
> David
> Linkedin: https://www.linkedin.com/in/davidzollo
> Twitter: @WorkflowEasy <https://twitter.com/WorkflowEasy>
> ---------------
>

Reply via email to