Hi, Everyone,
Below are the weekly meeting minutes:
Date: 2022/9/27
Host:
Kevin Su
Participants:
Kevin Su, Fatal Lin, Xiang Chen, Tom, Zhao-Wei Liu
Discussion:
PRs completed:
[SUBMARINE-1329. Improve test coverage of submarine.artifacts
module](https://github.com/apache/submarine/pull/998)
Issues still to be processed:
[Need to add a XGBoost k8s
agent](https://issues.apache.org/jira/browse/SUBMARINE-1302)
A preliminary version has been completed that supports watching Kubeflow events
and updating the status of the experiment to the database. However, there are
still some details to be improved, so we can probably do a sharing and
discussion next week.
Issues planned to start:
[Reduce tasks in github's
workflow](https://issues.apache.org/jira/browse/SUBMARINE-1330)
There was a discussion on how to simplify the workflow of CICD, and the plan is
to keep only one language version for testing and validation on each part
(submarine-operator, submarine-sdk, submarine-server), and send the rest of the
tasks to other supported open source CICD platforms (e.g.
https://azure.microsoft.com/en-us/products/devops/pipelines/) using a gitbub
bot.
[Add load_datasets method in
submarine-sdk](https://issues.apache.org/jira/browse/SUBMARINE-1331)
After PR [SUBMARINE-1283. copy data for experiment before it running via distcp
to minio](https://github.com/apache/submarine/pull/989) merged, there is a
discussion on how to better load the dataset. During the meeting, there are
some details that need to be refined, and the people involved will find another
time to discuss them after the meeting.
Meeting every Tuesday at 12:40(GMT+8):
https://cloudera.zoom.us/j/97264903288
Sync Up:
https://docs.google.com/document/d/16pUO3TP4SxSeLduG817GhVAjtiph9HYpRHo_JgduDvw/edit
Slack Developer:
https://join.slack.com/t/asf-submarine/shared_invite/zt-18614cyqs-UhspdUOneiyg~ZPiVomDqw
YouTube: https://www.youtube.com/channel/UCmy7EV9WD9YM_iOpcGwIQPA
Cheers,
Xiang Chen
