June 7, 2023: Minutes of the Biweekly Meeting of Apache Linkis
1. Progress update on Apache Linkis 1.4.0 version – Presented by Guo Fei, Yue
Chao and Cheng Hui.
- The development work is in its final stages and several features have
already been completed.
2. Progress update on Apache Linkis 1.5.0 version – Presented by Yue Chao and
Cheng Jie.
- The roadmap for version 1.5.0 can be found at:
https://github.com/apache/linkis/projects/27.
3. QA knowledge base review – Presented by Hao Jinfu.
- Header information deemed unnecessary has been removed and documents have
been separated into Linkis, DSS, and others.
4. WDS version synchronization – Presented by Hao Jinfu.
- The overall WDS version is expected to be released in July, with the aim
to address previous issues.
5. Update on Apache Linkis community operations – Presented by Li Wen.
(1) Status of data growth: 35+ Issues/PR, 20+ Stars/Forks, 50+ Community
Users/Sandbox Experiences, and 40+ Public Account followers.
(2) Operational matters:
- Content publishing: "The Open Source World of WeBank and a
Generation", "Exploration and Practice of Apache Linkis Integrated with
OceanBase", and "CCF GLCC2023 Student Registration is Now Open, Let's Open the
Door to the Open Source World with Linkis and DSS".
- Events: A joint event with OceanBase is scheduled for the evening of
June 13th and has already been promoted.
- The community CDH version mirror is currently undergoing acceptance
testing and is expected to be completed in July.
6. Selection of the host for the next meeting – Presented by Wang Heping.
7. Implementation of Linkis integration testing based on git action – Presented
by --Xia Chen.
Current progress:
- Phase one: The service deployment and verification based on git action is
80% completed. The automatic construction of images, docker deployment, and
service launch have been implemented for shell and Python engines. Basic
validation of these engines is already completed.
- Examples:
https://github.com/apache/linkis/actions/runs/5189223163/jobs/9353917765,
https://github.com/apache/linkis/actions/runs/5176401876/jobs/9325171636.
- Opportunities for improvement, with welcome participation from interested
contributors:
- Pod service log upload (via git action tool): facilitating issue
identification when exceptions arise.
- Support for other key engines such as Spark, Hive and Flink, based on
the previous LDH pattern.
- Optimization of build cache: caching basic packages of the LDH
pattern (such as apache-hive-3.1.3-bin.tar.gz) to minimize time spent
downloading during each build.
- Recently introduced module dependencies such as
github/actions/kind-action which require permission to use. An official ticket
may need to be unlocked.
- Consideration of incorporating JMeter-like action tools, such as
https://github.com/marketplace/actions/perfaction-for-jmeter, to integrate
testing for commonly used interfaces.
8. Synchronization of community development and testing environment planning –
Presented by --Hao Jinfu.
- This includes:
1. Open Source Summer Program.
2. Github network speed issues within the community environment.
3. Slow website access speed.
4. Testing support with a deficiency of manpower.
5. Community sandbox environment.
6. Version compatibility with various open-source components.
2023-06-07 Apache Linkis 双周例会会议纪要
1.Apache Linkis 1.4.0版本进展。 —— 郭飞兄/越超兄/呈辉兄
--已经进入收尾工作，部分特性已经完成
2.Apache Linkis 1.5.0版本进展。 —— 越超兄/程杰
--版本计划：https://github.com/apache/linkis/projects/27
3.QA 知识库Review ——郝金福
--清理不必要头部信息，拆封linkis，dss+其他两个文档
4.WDS版本同步 ——郝金福
--预计七月会发布wds整体版本。对之前出现的问题进行适配
5.Apache Linkis 社区运营 进展同步。 —— 李文
（1）数据增长情况：Issue / PR 35+，Star / Fork 20+，社群用户/沙箱体验 50+，公众号粉丝 40+；
（2）运营事项：
●内容发布：《微众银行和一代人的“开源武林”》、《活动直播 | Apache Linkis集成OceanBase的探索与实践》、《CCF
GLCC2023学生报名现已开放，和Linkis、DSS一起开启开源世界大门吧！》
●活动：6月13日星期二晚上与OceanBase联合活动已发起宣传预热；
●社区CDH版本镜像版本正在验收测试中；预计七月完成验收；
6.下一场例会的主持人，欢迎认领
--王和平
7.基于git action 实现linkis的集成测试 夏晨
当前进展
第一阶段 基于git action的服务部署和验证 整体80%
镜像自动构建 docker部署，和服务拉起 已经ok shell 和python 引擎基础验证 已ok
示例 https://github.com/apache/linkis/actions/runs/5189223163/jobs/9353917765
https://github.com/apache/linkis/actions/runs/5176401876/jobs/9325171636
待优化事项 欢迎感兴趣同学参与
●pod服务日志上传（git action工具 ），异常时 在git 工作流页面能查看到服务日志 方便定位排查问题
● 其 他主要引擎的支持和验证 如spark hive flink等 基于之前的ldh模式
● 优化构建缓存 ，将 apache-hive-3.1.3-bin.tar.gz 等ldh模式基础包进行缓存，避免每次构建时都下载导致耗时增加
●当前新增了模块依赖 github/actions/kind-action 因为对于kind-action
官方未默认开白名单，不能直接使用，考虑提官方工单开通
●考虑引入jmeter 类型的action工具
如/https://github.com/marketplace/actions/perfaction-for-jmeter 集成对常用接口的测试
第二阶段
●基于Testcontainers 组件 编写linkis核心模块的集成测试
●打通git 和开源共建环境机器的通路，使用开源共建环境的机器，进行cicd和集成测 以及一些其他的复杂的验证等
8.社区开发测试环境规划同步 郝金福
1.开源之夏活动
2.社区环境github网速问题
3.首页访问慢
4.测试支持,人力不足
5.社区沙箱环境
6.开源各组件版本
