[NOTICE] Xiang-chen for Apache Submarine PMC
Hi, Xiang-chen Thank you for your contribution to the community. Today the Submarine community officially invites you to become a PMC member. Please subscribe to the priv...@submarine.apache.org mailing list to get better involved in the submarine community. Thanks! Best, Xun Liu
Re: Submarine weekly meeting minutes (2022/10/04)
Hi, Xiang Chen Thank you for organizing the community meeting. Thanks! RB, Xun Liu On Thu, Oct 6, 2022 at 10:53 AM Xiang Chen wrote: > Hi, Everyone, > > Below are the weekly meeting minutes: > > Date: 2022/10/04 > > Discussion: > > Host: > >Xiang Chen > > Participants: > >Xiang Chen, yao-Ching Huang, Po Han Huang > > > > Discussion: > > PRs to be reviewed: > > [SUBMARINE-1293. Move seldon-core install to helm]( > https://github.com/apache/submarine/pull/999) > > [SUBMARINE-1333. Replace legacy tmpdir with tmp_path]( > https://github.com/apache/submarine/pull/1000) > > > > Issues planned to start: > > [Optimising notebook asynchronous refresh handling]( > https://issues.apache.org/jira/browse/SUBMARINE-1334) > > Currently the notebook's list takes 10 seconds to display the correct data > and the alert for the delete button disappears after the asynchronous api > is triggered. This can significantly affect the user experience. > > [Add codecov for python]( > https://issues.apache.org/jira/browse/SUBMARINE-1337) > > Plan to add python codecov to github workflow. > > Meeting every Tuesday at 12:40(GMT+8): > > https://cloudera.zoom.us/j/97264903288 > > Sync Up: > https://docs.google.com/document/d/16pUO3TP4SxSeLduG817GhVAjtiph9HYpRHo_JgduDvw/edit > > Slack Developer: > https://join.slack.com/t/asf-submarine/shared_invite/zt-18614cyqs-UhspdUOneiyg~ZPiVomDqw > > YouTube: https://www.youtube.com/channel/UCmy7EV9WD9YM_iOpcGwIQPA > > Cheers, > > Xiang Chen >
Re: Should submarine-cloud-v2 be deprecated?
Hi Xiang Chen, I've heard discussions about multi-tenancy before. The general idea is this. When segregating tenants by different namespaces inside a submarine, the It was found that some services were not accessible to each other and the submarine was not running properly. I'm not sure about the details of the situation. BR, Xun Liu On Fri, Sep 30, 2022 at 5:43 PM Xiang Chen wrote: > Hi all > > I am currently conducting a PR review ( > https://github.com/apache/submarine/pull/999) and I have found a > multi-tenancy issue about model serving. > > The current serving deployment is based on the `default` namespace, > however the actual serving service we are doing is on a different tenant > service under the operator. So we may need to move the relevant > [seldon-secret.yaml]( > https://github.com/apache/submarine/blob/master/submarine-serve/installation/seldon-secret.yaml) > file inside the operator for implementation (I have already created an > issue about this https://issues.apache.org/jira/browse/SUBMARINE-1332). > > We have `submarine-cloud-v2` and v3 under the current master branch. There > seems to be a lack of progress on the progress of the operator upgrade. > So I thought I'd ask if we should base all our new issue/PR changes on v3 > and migrate the operator deployment to v3 from recently after testing and > validation? >
Re: [VOTE] Submarine-0.7.0-RC1 is ready for a vote!
+1 BR, Xun Liu On Fri, Apr 15, 2022 at 8:27 PM 劉奇聖 wrote: > +1 > > On Fri, Apr 15, 2022 at 4:51 PM Kevin Su wrote: > > > Thanks to everyone's help on this release. Special thanks to Kuan-Hsun > Li, > > Shou Liu, Yu-Teng Chen, Lisa, Charles, Chi-Sheng Liu, Liang-Chun Chen, > > Yu-Tang Lin, Ken Chu, You Ting Wang, Brandon！ > > > > I've created a release candidate (RC1) for submarine 0.7.0. The > > highlighted features are as follows: > > > > 1. Submarine agent - it will directly update pods status in the DB, and > > reduce submarine server overhead. > > 2. Support deploying model through workbench > > 3. Upgrade default Kubernetes client API > > 4. Improve workbench UI/UX > > 5. Submarine CLI > > > > For more information about this release, check here > > < > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12350377&styleName=Html&projectId=12322824 > > > > > > > The RC tag in git is here: > > https://github.com/apache/submarine/releases/tag/release-0.7.0-RC1 > > The RC release artifacts are available at: > > http://home.apache.org/~pingsutw/submarine-0.7.0-RC1 > > > > > > The Maven staging repository is here: > > > https://repository.apache.org/content/repositories/orgapachesubmarine-1033 > > > > My public key is here: > > https://dist.apache.org/repos/dist/release/submarine/KEYS > > > > > > *This vote will run for 7 days, ending on Apr 15, 2022, at 00:50 am PST.* > > > > For the testing, I have verified the > > > > 1. Build from source, Install Submarine on minikube > > 2. Workbench UI (Experiment / Notebook / Template / Environment / Model > > serving) > > 3. Experiment / Notebook / Template / Environment REST API > > > > My +1 to start. Thanks! > > > > > > BR, > > Kevin Su > > >
Re: [VOTE] Submarine-0.7.0-RC0 is ready for a vote!
hi Kenvin, +1 for me, Thanks for your work, Submarine-0.7-rc0 looks fantastic! Best Regards, Xun Liu On Tue, Mar 22, 2022 at 2:46 PM Xun Liu wrote: > hi Kenvin, > > Thanks for your work, Submarine-0.7-rc0 looks fantastic! > > Best Regards, > Xun Liu > > On Tue, Mar 22, 2022 at 12:40 PM Kevin Su wrote: > >> Hi folks, >> >> Thanks to everyone's help on this release. Special thanks to Kuan-Hsun Li, >> Shou Liu, Yu-Teng Chen, Lisa, Charles, Chi-Sheng Liu, Liang-Chun Chen, >> Yu-Tang Lin, Ken Chu, You Ting Wang, Brandon！ >> >> I've created a release candidate (RC0) for submarine 0.7.0. The >> highlighted features are as follows: >> >> 1. Submarine agent - it will directly update pods status in the DB, and >> reduce submarine server overhead. >> 2. Support deploying model through workbench >> 3. Upgrade default Kubernetes client API >> 4. Improve workbench UI/UX >> 5. Submarine CLI >> >> For more information about this release, check here >> < >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12350377&styleName=Html&projectId=12322824 >> > >> >> The RC tag in git is here: >> https://github.com/apache/submarine/releases/tag/release-0.7.0-RC0 >> The RC release artifacts are available at: >> http://home.apache.org/~pingsutw/submarine-0.7.0-RC0 >> >> >> The Maven staging repository is here: >> https://repository.apache.org/content/repositories/orgapachesubmarine-1032 >> >> My public key is here: >> https://dist.apache.org/repos/dist/release/submarine/KEYS >> >> >> *This vote will run for 7 days, ending on Mar 22, 2022, at 11:59 pm PST.* >> >> For the testing, I have verified the >> >> 1. Build from source, Install Submarine on minikube >> 2. Workbench UI (Experiment / Notebook / Template / Environment / Model >> serving) >> 3. Experiment / Notebook / Template / Environment REST API >> >> My +1 to start. Thanks! >> >> >> BR, >> Kevin Su >> >
Re: [VOTE] Submarine-0.7.0-RC0 is ready for a vote!
hi Kenvin, Thanks for your work, Submarine-0.7-rc0 looks fantastic! Best Regards, Xun Liu On Tue, Mar 22, 2022 at 12:40 PM Kevin Su wrote: > Hi folks, > > Thanks to everyone's help on this release. Special thanks to Kuan-Hsun Li, > Shou Liu, Yu-Teng Chen, Lisa, Charles, Chi-Sheng Liu, Liang-Chun Chen, > Yu-Tang Lin, Ken Chu, You Ting Wang, Brandon！ > > I've created a release candidate (RC0) for submarine 0.7.0. The > highlighted features are as follows: > > 1. Submarine agent - it will directly update pods status in the DB, and > reduce submarine server overhead. > 2. Support deploying model through workbench > 3. Upgrade default Kubernetes client API > 4. Improve workbench UI/UX > 5. Submarine CLI > > For more information about this release, check here > < > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12350377&styleName=Html&projectId=12322824 > > > > The RC tag in git is here: > https://github.com/apache/submarine/releases/tag/release-0.7.0-RC0 > The RC release artifacts are available at: > http://home.apache.org/~pingsutw/submarine-0.7.0-RC0 > > > The Maven staging repository is here: > https://repository.apache.org/content/repositories/orgapachesubmarine-1032 > > My public key is here: > https://dist.apache.org/repos/dist/release/submarine/KEYS > > > *This vote will run for 7 days, ending on Mar 22, 2022, at 11:59 pm PST.* > > For the testing, I have verified the > > 1. Build from source, Install Submarine on minikube > 2. Workbench UI (Experiment / Notebook / Template / Environment / Model > serving) > 3. Experiment / Notebook / Template / Environment REST API > > My +1 to start. Thanks! > > > BR, > Kevin Su >
Re: Submarine weekly meeting minutes of the Operator Group (2021/10/7)
Hi, Cheers Good job! Xun Liu Best regards, On Sat, Oct 9, 2021 at 10:28 PM 陳亮君 wrote: > Hi, Everyone, > > Below are the weekly meeting minutes of the Operator Group. > > Date: 2021/10/7 > > Host: > > Chi-Sheng Liu > > > Participants: > > Chi-Sheng Liu, Brandon, 朱哲廣, 王友廷, 陳映樵, 傅譽, 莊哲榮 > > > Discussion and PR: > > >- > >SUBMARINE-103 <https://issues.apache.org/jira/browse/SUBMARINE-1038>8 >- > > Use while loop to get the status of submarine CR and wait for its > status to be running in CI. > - > >SUBMARINE-1039 <https://github.com/apache/submarine/pull/762> >- > > PR has been merged, and I created a new story SUBMARINE-1051 to > remove maven building profile and hadoop dependency. > - > >SUBMARINE-1021 <https://github.com/apache/submarine/pull/767> >- > > pass to 陳亮君, to implement websocket > - > >SUBMARINE-1033 <https://github.com/apache/submarine/pull/768> with 傅譽 >- > > Delete submarine-cloud directory > > > The Operater group Meeting is on every Thursday 22:00(GMT+8), feel free > to join the discussion. > Sync Up: > https://docs.google.com/document/d/16pUO3TP4SxSeLduG817GhVAjtiph9HYpRHo_JgduDvw/edit > Slack Developer: > https://join.slack.com/t/the-asf/shared_invite/zt-vlfbf7ch-HkbNHiU_uDlcH_RvaHv9gQ > YouTube: https://www.youtube.com/channel/UCmy7EV9WD9YM_iOpcGwIQPA > > Cheers, > Liang-Chun >
Re: [ANNOUNCE] Apache Submarine 0.6.0 release!
Hi, kevin We are very happy to see the release of submarine 0.6. Thank you and your community partners for your active contributions. Many new features have been added to the submarine project. Thank you very much! Xun Liu Best regards, On Mon, Oct 4, 2021 at 2:15 AM Kevin Su wrote: > Hi folks, > > It's a great honor for me to announce that the Apache Submarine Community > has released Apache Submarine 0.6.0! > > The highlighted features are: > 1. Support Tensorboard and mlflow in Experiment > 2. Submarine model management > 3. Submarine operator > 4. Improve workbench UI/UX > > Tons of thanks to our contributors and community! Let's keep fighting! > > *Apache Submarine 0.6.0 released*: > https://submarine.apache.org/docs/next/releases/submarine-release-0.6.0 > > BR, > Kevin Su >
Re: [VOTE] Submarine-0.6.0-RC0 is ready for a vote!
hi, kevin +1 (banding for me) Thank you Kevin and fellow community partners for their hard work. We have seen that in the submarine-0.6 version, Tensorboard and mlflow are supported, as well as model management capabilities. In addition, we are also building the community, such as communicating more with the community through email, and inviting more people to join our slack channel. Thanks! Xun Liu Best regards, On Mon, Sep 20, 2021 at 12:58 PM Kevin Su wrote: > Hi folks, > > > Thanks to everyone's help on this release. Special thanks to Kuan-Hsun Li, > Shou Liu, Yu-Teng Chen, Lisa, Charles, Chi-Sheng Liu, Liang-Chun Chen, > Yu-Tang Lin, Ken Chu, You Ting Wang！ > > > I've created a release candidate (RC0) for submarine 0.6.0. The > highlighted features > are as follows: > > 1. Support Tensorboard and mlflow in Experiment > > 2. Submarine model management > > 3. Submarine operator > > 4. Improve workbench UI/UX > > > The mini-submarine image is here: > > docker pull apache/submarine:mini-0.6.0-RC0 > > > The RC tag in git is here: > > https://github.com/apache/submarine/releases/tag/release-0.6.0-RC0 > > The RC release artifacts are available at: > > http://home.apache.org/~pingsutw/submarine-0.6.0-RC0 > > > The Maven staging repository is here: > > https://repository.apache.org/content/repositories/orgapachesubmarine-1030 > > My public key is here: > > https://dist.apache.org/repos/dist/release/submarine/KEYS > > > *This vote will run for 7 days, ending on Sep 27, 2021, at 11:59 pm PST.* > > > For the testing, I have verified the > > 1. Build from source, Install Submarine on minikube > > 2. Workbench UI (Experiment / Notebook / Template / Environment) > > 3. Experiment / Notebook / Template / Environment REST API > > > > My +1 to start. Thanks! > > > BR, > > Kevin Su >
Re: Submarine weekly meeting minutes (2021/9/7)
Hi, Cheers Thank you! Best regards Xun Liu On Wed, Sep 8, 2021 at 3:18 PM Ryan Lo wrote: > Liang-Chun, > > Thank you for taking the notes. > > > 陳亮君 於 2021年9月8日 下午2:38 寫道： > > > > Hi, Everyone, > > > > Below are yesterday's weekly meeting minutes: > > > > Participants: > > Ryan Lo、小风 叶、Charles、KUAN-HSUN-LI、朱哲廣、文謙、Brandonlin、Chi-Sheng-Liu、Kevin > Su、Liuxun、YuTengChen、王友廷、陳亮君 > > Discussion: > > Multi-tenant server path problem (should talk with 占坤). > > Remain java submarine server. > > Add new submarine server status (pulling image) > > Start to delete redundant code (no longer support yarn). > > Traefik v.s. Istio (should do more research) . > > Fix pysubmarine format problem. > > Short-term goal: model management and serving, and find more user to use > submarine > > > > > > Meeting on every Tuesday at 12:40(GMT+8): > https://cloudera.zoom.us/j/880548968 <https://cloudera.zoom.us/j/880548968 > > > > Sync Up: > https://docs.google.com/document/d/16pUO3TP4SxSeLduG817GhVAjtiph9HYpRHo_JgduDvw/edit > < > https://docs.google.com/document/d/16pUO3TP4SxSeLduG817GhVAjtiph9HYpRHo_JgduDvw/edit > > > > Slack Developer: > https://join.slack.com/t/the-asf/shared_invite/zt-vlfbf7ch-HkbNHiU_uDlcH_RvaHv9gQ > < > https://join.slack.com/t/the-asf/shared_invite/zt-vlfbf7ch-HkbNHiU_uDlcH_RvaHv9gQ > > > > YouTube: https://www.youtube.com/channel/UCmy7EV9WD9YM_iOpcGwIQPA < > https://www.youtube.com/channel/UCmy7EV9WD9YM_iOpcGwIQPA> > > > > Cheers, > > Liang-Chun > >
Re: [DISCUSS] Submarine 0.6 release and roadmap
Hi, Wei-Chiu > I'm confused here. > We have a dedicated repo for the website > https://github.com/apache/submarine-site/tree/master > btu we also have a website directory under the main repo: > https://github.com/apache/submarine/tree/master/website > Any idea how they are used? @Kevin Su Relatively familiar this. On Thu, Jun 3, 2021 at 12:21 PM Wei-Chiu Chuang wrote: > I'm confused here. > > We have a dedicated repo for the website > https://github.com/apache/submarine-site/tree/master > > btu we also have a website directory under the main repo: > https://github.com/apache/submarine/tree/master/website > > Any idea how they are used? > > > On Thu, Jun 3, 2021 at 12:13 PM Wanqiang Ji wrote: > > > Hi Wei-Chiu > > > > Thanks for pushing this work about the new release. > > > > But I have one question, should we move the website folder to the > > submarine-website repo before the new release? > > > > BR > > Wanqiang Ji > > > > On Wed, Jun 2, 2021 at 12:44 PM Xun Liu wrote: > > > > > Thank Wei-Chiu, > > > > > > In the community development work in recent months, > > > everyone has contributed a lot of new features. > > > I think version 0.6 can be released. > > > > > > +1 binding > > > > > > Xun Liu > > > > > > On Wed, Jun 2, 2021 at 11:42 AM Kai-Hsun Chen > > wrote: > > > > > > > Thank Wei-Chiu for launching this discussion! How can we help you in > > the > > > > release process? For example, write a thorough document, or record a > > demo > > > > video, and so on. > > > > > > > > Thanks! > > > > Kai-Hsun > > > > > > > > On 2021/06/02 02:08:26, Wei-Chiu Chuang wrote: > > > > > Hi, > > > > > > > > > > our last release 0.5.0 was made last December, and it's been six > > month > > > > > since then. It's time to prepare for the next minor release to keep > > the > > > > > momentum going. > > > > > > > > > > * 107 issues resolved > > > > > > > > > > > > > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20SUBMARINE%20AND%20fixVersion%20%3D%200.6.0%20and%20status%20%3D%20resolved%20 > > > > > * 10 new features > > > > > > > > > > > > > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20SUBMARINE%20AND%20fixVersion%20%3D%200.6.0%20and%20status%20%3D%20resolved%20%20%20and%20type%20%3D%20%22New%20Feature%22 > > > > > > > > > > I know there are still a few features to be finalized, including > > > > > submarine-operator in single user mode SUBMARINE-760 > > > > > <https://issues.apache.org/jira/browse/SUBMARINE-760>, but it's > time > > > to > > > > > wrap up for this release, and push out things that won't make it > near > > > > time. > > > > > > > > > > Any volunteers looking to make this release? I'm almost done with > my > > > > Hadoop > > > > > 3.3.1 release manager duty so I can start looking at it if no one > > beats > > > > me. > > > > > :) > > > > > > > > > > Additionally, thanks @kevin su for the new > > > > website, > > > > > but it looks like we don't have a roadmap doc on our website. While > > > > > preparing the 0.6 release, we should start to scope the release > > after. > > > > > > > > > > Thoughts? > > > > > Weichiu > > > > > > > > > > > > > - > > > > To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org > > > > For additional commands, e-mail: dev-h...@submarine.apache.org > > > > > > > > > > > > > >
Re: [DISCUSS] Submarine 0.6 release and roadmap
Thank Wei-Chiu, In the community development work in recent months, everyone has contributed a lot of new features. I think version 0.6 can be released. +1 binding Xun Liu On Wed, Jun 2, 2021 at 11:42 AM Kai-Hsun Chen wrote: > Thank Wei-Chiu for launching this discussion! How can we help you in the > release process? For example, write a thorough document, or record a demo > video, and so on. > > Thanks! > Kai-Hsun > > On 2021/06/02 02:08:26, Wei-Chiu Chuang wrote: > > Hi, > > > > our last release 0.5.0 was made last December, and it's been six month > > since then. It's time to prepare for the next minor release to keep the > > momentum going. > > > > * 107 issues resolved > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20SUBMARINE%20AND%20fixVersion%20%3D%200.6.0%20and%20status%20%3D%20resolved%20 > > * 10 new features > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20SUBMARINE%20AND%20fixVersion%20%3D%200.6.0%20and%20status%20%3D%20resolved%20%20%20and%20type%20%3D%20%22New%20Feature%22 > > > > I know there are still a few features to be finalized, including > > submarine-operator in single user mode SUBMARINE-760 > > <https://issues.apache.org/jira/browse/SUBMARINE-760>, but it's time to > > wrap up for this release, and push out things that won't make it near > time. > > > > Any volunteers looking to make this release? I'm almost done with my > Hadoop > > 3.3.1 release manager duty so I can start looking at it if no one beats > me. > > :) > > > > Additionally, thanks @kevin su for the new > website, > > but it looks like we don't have a roadmap doc on our website. While > > preparing the 0.6 release, we should start to scope the release after. > > > > Thoughts? > > Weichiu > > > > - > To unsubscribe, e-mail: dev-unsubscr...@submarine.apache.org > For additional commands, e-mail: dev-h...@submarine.apache.org > >
Re: Submarine Weekly Sync
Thank you, Wei-Chiu. I will attend on time. Thanks, Xun Liu On Tue, May 4, 2021 at 1:00 PM Wei-Chiu Chuang wrote: > Update: We're moving it a little earlier. 12:40pm every Tuesday. > > The wiki is updated accordingly. > > On Wed, Apr 21, 2021 at 3:15 PM Wei-Chiu Chuang > wrote: > > > For those who are not aware (those who are new to the project), > > > > We run a weekly sync (in Mandarin), currently 1pm every Tuesday Beijing > > time (GMT+8) > > > > https://cwiki.apache.org/confluence/display/SUBMARINE/Weekly+Sync > > > > Most of the time it's a rundown of everyone reporting their status. > > Sometimes a guest is invited for topics like how MLOps is done in their > > organization. You are welcomed to join via the Zoom link below: > > > > https://cloudera.zoom.us/j/880548968 > > > > > > Note that the above time changes from time to time (to adjust for > daylight > > savings, etc). I'll strive to update it in the wiki (probably also in the > > project's doc too) > > > > > > Cheers, > > > > Weichiu > > >
Re: [ANNOUNCE] Apache Submarine 0.5.0 release!
Submarine getting better! Thanks Kevin! BR, Xun Liu On Fri, Dec 25, 2020 at 2:39 PM Zhankun Tang wrote: > Thanks to all the contributors! > And thanks for leading this release effort! Kevin! > > BR, > Zhankun > > On Thu, 24 Dec 2020 at 17:03, Kevin Su wrote: > >> Hi folks, >> >> It's a great honor for me to announce that the Apache Submarine Community >> has released Apache Submarine 0.5.0! >> >> Apache Submarine 0.5.0 is the third release after the spin-off from >> Apache >> Hadoop. It includes 99 patches since the prior version. >> >> The highlighted features are: >> 1. Submarine Experiments: Redefined the experiment spec, sync up code >> from Git, it could be HTTP and ssh >> 2. Predefined experiment template: Register A experiment template and >> submit related parameter to run an experiment using Rest API >> 3. Environment profile: Users could easily manage their docker image and >> conda environment >> 4. Jupyter Notebook: Spawn a jupyter notebook using Rest API, and execute >> ML code on K8s, or submit an experiment to submarine server >> 5. Submarine Workbench UI: CRUD Experiment, Environment, Notebook through >> the UI >> 6. Disable interpreter module >> >> Tons of thanks to our contributors and community! Let's keep fighting! >> >> *Apache Submarine 0.5.0 released*: >> http://submarine.apache.org/releases/submarine-release-0.5.0.html >> *Changelog*: https://s.apache.org/mz6hr >> >> BR, >> Kevin Su >> >
Re: [VOTE] Submarine-0.5.0-RC3 is ready for a vote!
+1 Thanks, Kevin. BR, Xun Liu On Tue, Dec 8, 2020 at 10:33 AM Zhankun Tang wrote: > Thanks for Kevin's hard work! > > +1 from me. > > BR, > Zhankun > > On Fri, 4 Dec 2020 at 14:23, Kevin Su wrote: > >> Hi folks, >> >> >> Thanks to everyone's help on this release. Special thanks to Wangda, >> >> Zhankun, Xun, Wei-Chiu, Wanqiang, Ryan, Manikandan, and JohnTing! >> >> I've created a release candidate (RC3) for submarine 0.5.0. The >> highlighted >> >> features are as follows: >> >> 1. Submarine Experiments: Redefined the experiment spec, sync up code >> from Git, it could be HTTP and ssh >> >> 2. Predefined experiment template: Register A experiment template and >> submit related parameter to run an experiment using Rest API >> >> 3. Environment profile: Users could easily manage their docker image and >> conda environment >> >> 4. Jupyter Notebook: Spawn a jupyter notebook using Rest API, and execute >> ML code on K8s, or submit an experiment to submarine server >> >> 5. Submarine Workbench UI: CRUD Experiment, Environment, Notebook >> through the UI >> >> 6. Disable interpreter module >> >> The RC tag in git is here: >> https://github.com/apache/submarine/releases/tag/release-0.5.0-RC3 >> The RC release artifacts are available at: >> http://home.apache.org/~pingsutw/submarine-0.5.0-RC3 >> >> The mini-submarine image is here: >> >> https://hub.docker.com/layers/apache/submarine/mini-0.5.0-RC3/images/sha256-e3248c8c6336b245539028043783b91135eaffe9302dec05fe13571a0f2902a6?context=explore >> >> The server image is here: >> >> https://hub.docker.com/layers/apache/submarine/server-0.5.0/images/sha256-1805df8fd8e5274d16be8cdf39900d8576119c0caac7598db29990ebe138bf5c?context=explore >> >> The database image is here: >> >> https://hub.docker.com/layers/apache/submarine/database-0.5.0/images/sha256-073889e773c1b44cef9f518dc2fc468ebc420200f6087e2a943438677dadc9e5?context=explore >> >> The Jupyter Notebook image is here: >> >> https://hub.docker.com/layers/apache/submarine/jupyter-notebook-0.5.0/images/sha256-f3cc2510c208b752ef4be7b383ee8f2325e4fc538696078bdb604d62fa47e4be?context=explore >> >> The Maven staging repository is here: >> https://repository.apache.org/content/repositories/orgapachesubmarine-1028 >> >> My public key is here: >> https://dist.apache.org/repos/dist/release/submarine/KEYS >> >> *This vote will run for 7 days, ending on Dec 10, 2020, at 11:59 pm PST.* >> >> For the testing, I have verified the >> >> 1. Build from source, Run the mnist on Hadoop >> >> 2. Example with mini-submarine(both local and remote mode) >> >> 3. Verified the experiment operations to K8s by Submarine Server REST >> and PySubmarine. >> >> 4. Workbench UI (experiment, environment, notebook) >> >> 5. HTTP sync code in the experiment >> >> 6. Environment profile REST API >> >> 7. Notebook REST API >> >> >> Please follow the document to test these features. >> * https://github.com/apache/submarine/tree/master/dev-support/mini- >> submarine >> * https://github.com/apache/submarine/blob/master/docs/user-guide-home.md >> >> My +1 to start. Thanks! >> >> BR, >> Kevin Su >> >
Re: [VOTE] Submarine-0.5.0-RC2 is ready for a vote!
+1 Thank Kevin. BR, Xun Liu On Mon, Nov 9, 2020 at 12:20 PM Kevin Su wrote: > Hi folks, > > > Thanks to everyone's help on this release. Special thanks to Wangda, > > Zhankun, Xun, Wei-Chiu, Wanqiang, Ryan, Manikandan, and JohnTing! > > Restart a new vote because rc1 achieve size is too large. > > I've created a release candidate (RC2) for submarine 0.5.0. The > highlighted > > features are as follows: > > 1. Submarine Experiments: Redefined the experiment spec, sync up code > from Git, it could be https and ssh > > 2. Predefined experiment template: Register A experiment template and > submit related parameter to run an experiment using Rest API > > 3. Environment profile: Users could easily manage their docker image and > conda environment > > 4. Jupyter Notebook: Spawn a jupyter notebook using Rest API, and execute > ML code on K8s, or submit an experiment to submarine server > > 5. Submarine Workbench UI: CRUD Experiment, Environment, Notebook through > the UI > > 6. Disable interpreter module > > The RC tag in git is here: > https://github.com/apache/submarine/releases/tag/release-0.5.0-RC2 > The RC release artifacts are available at: > http://home.apache.org/~pingsutw/submarine-0.5.0-RC2 > > The mini-submarine image is here: > > https://hub.docker.com/layers/apache/submarine/mini-0.5.0-RC2/images/sha256-d92b084199c03abe70a44f657647dca23639c6be5f28180653e327c258c5bdfc?context=explore > > The server image is here: > > https://hub.docker.com/layers/apache/submarine/server-0.5.0/images/sha256-ad19a86d5c484113ce4d42ea05f412fc96f1c32eaccd68904b8df89b1f069adb?context=explore > > The database image is here: > > https://hub.docker.com/layers/apache/submarine/database-0.5.0/images/sha256-fcf72289e0aa46e83fc8e65c8aca79be4bba96ec9813d54568e5679925cdc94f?context=explore > > The Jupyter Notebook image is here: > > https://hub.docker.com/layers/apache/submarine/jupyter-notebook-0.5.0/images/sha256-1e05cdd3c814063b3cac9de12bdecd70475d38d708c06794c2d3b55ef97de82a?context=explore > > The Maven staging repository is here: > https://repository.apache.org/content/repositories/orgapachesubmarine-1016 > > My public key is here: > https://dist.apache.org/repos/dist/release/submarine/KEYS > > *This vote will run for 7 days, ending on Nov 16, 2020, at 11:59 pm PST.* > > For the testing, I have verified the > > 1. Build from source, Run the mnist on Hadoop > > 2. Example with mini-submarine(both local and remote mode) > > 3. Verified the experiment operations to K8s by Submarine Server REST and > PySubmarine. > > 4. Workbench UI (experiment, environment, notebook) > > 5. HTTP sync code in the experiment > > 6. Environment profile REST API > > 7. Notebook REST API > > > Please follow the document to test these features. > * https://github.com/apache/submarine/tree/master/dev-support/mini- > submarine > * https://github.com/apache/submarine/blob/master/docs/user-guide-home.md > > My +1 to start. Thanks! > > BR, > Kevin Su >
Re: [ANNOUNCE] New Submarine Committer: Ryan Lo
Congratulation, Ryan! On Tue, Oct 27, 2020 at 11:28 AM Kevin Su wrote: > Congratulation, Ryan! > > BR, > Kevin Su > > Zhankun Tang 於 2020年10月27日 週二 上午10:41寫道： > >> Congrats and welcome! Ryan Lo! >> >> BR, >> Zhankun >> >> On Tue, 27 Oct 2020 at 02:08, Wei-Chiu Chuang wrote: >> >>> Dear all, >>> >>> I am pleased to announce our latest Submarine committer: Ryan Lo, who >>> accepted the PMC's invitation to become a committer and to take on more >>> responsibilities. >>> >>> Ryan has contributed many features such as MXNET on Hadoop, install >>> trafik, and jupyter notebook controller by the helm chart so that users >>> could easily connect the notebook. Additionally, he also revised the >>> Submarine Submitter to create not only experiments but also notebook >>> instances. Last but not least, he actively helped other new contributors to >>> solve the problem, it helps us get more people to use and contribute to >>> Submarine. >>> >>> We appreciate his contributions thus far and look forward to his >>> continued involvement. >>> >>> Congratulations and welcome, >>> >>> Wei-Chiu CHuang >>> (On behalf of the Apache Submarine PMC) >>> >>
Re: [VOTE] Submarine-0.4.0-RC0 is ready for a vote!
+1, Thanks Wanqiang! Best Regards Xun Liu On Fri, Jun 26, 2020 at 10:15 PM kevin su wrote: > +1, Thanks Wanqiang > > Best Regards, > Kevin Su > > Wanqiang Ji 於 2020年6月26日 週五，下午9:53寫道： > > > Hi folks, > > > > Thanks to everyone's help on this release. Special thanks to Wangda, > > Zhankun, Xun, Kevin and JohnTing! > > > > I've created a release candidate (RC0) for submarine 0.4.0. The > highlighted > > features are as follows: > > 1. Submarine Experiments: Refactor the Job to experiment and redefined > the > > experiment spec. > > 2. Submarine Helm Charts: Provides one command to install the submarine > > into the Kubernetes cluster. > > 3. PySubmarine: Submarine Python SDK > > > > The RC tag in git is here: > > https://github.com/apache/submarine/releases/tag/release-0.4.0-RC0 > > > > The RC release artifacts are available at: > > http://home.apache.org/~jiwq/submarine-0.4.0-RC0/ > > > > The mini-submarine image is here: > > > > > https://hub.docker.com/layers/apache/submarine/mini-0.4.0-RC0/images/sha256-a8e7bd98f1f0325223d68e0ba64fd48bd56ee91736461d289945e70ad138e08f?context=explore > > > > The server image is here: > > > > > https://hub.docker.com/layers/apache/submarine/server-0.4.0/images/sha256-9e9775e0ed2ac9d4b108dd747dfb4f4fc27cee0fdd19501e1f53db30d966a3db?context=repo > > > > The database image is here: > > > > > https://hub.docker.com/layers/apache/submarine/database-0.4.0/images/sha256-5edf4aac2c14e14f78a9955bd84757879e1c05266c1edd5a7d5ef08b6359a400?context=repo > > > > The Maven staging repository is here: > > > https://repository.apache.org/content/repositories/orgapachesubmarine-1003 > > > > My public key is here: > > https://dist.apache.org/repos/dist/release/submarine/KEYS > > > > *This vote will run for 7 days, ending on Jul 2, 2020 at 11:59 pm PST.* > > > > For the testing, I have verified the build from source, run the mnist > > example with mini-submarine(both local and remote mode) and verified > > the experiment operations to K8s by Submarine Server REST and > PySubmarine. > > > > Please follow the document to test these features. > > * > > > https://github.com/apache/submarine/tree/master/dev-support/mini-submarine > > * > https://github.com/apache/submarine/blob/master/docs/user-guide-home.md > > > > My +1 to start. Thanks! > > > > BR, > > Wanqiang Ji > > >
Re: [DISCUSS] Move commit activities to commits@
+1 Thanks Xun Liu On Wed, Mar 11, 2020 at 1:36 PM Sunil Govindan wrote: > +1. This absolutely makes sense. > > Thanks > Sunil > > On Wed, Mar 11, 2020 at 11:01 AM Wei-Chiu Chuang > wrote: > >> Hi Submarine devs and users, >> >> The Apache Submarine projects has a commits@ mailing list ( >> https://submarine.apache.org/community/contributors.html) but it is not >> being used: >> https://lists.apache.org/list.html?comm...@submarine.apache.org:2020: >> >> Instead, all the commit messages as well as Jira activity notifications >> are sent to dev@submarine.apache.org >> >> Other projects such as Hadoop, HBase, Kafka reserves dev@ mailing list >> for human generated discussions. Shall we follow the same? >> >> Best, >> Wei-Chiu >> >
Re: [ANNOUNCE] Apache Submarine 0.3.0 release!
Thanks to all contributors! Let's continue to develop better features for submarine!! On Thu, Feb 6, 2020 at 7:25 PM Sunil Govindan wrote: > Awesome! Hearty Congratulations to all of you for the first release of > Submarine as Apache TLP! > Kudos to all who helped in this release! > > - Sunil > > On Thu, Feb 6, 2020 at 4:36 PM Zhankun Tang wrote: > > > Hi folks, > > > > It's a great honor for me to announce that the Apache Submarine community > > has released Apache Submarine 0.3.0! > > > > Apache Submarine 0.3.0 is the first release after the spin-off from > Apache > > Hadoop. It includes 196 patches since the prior version. > > The highlighted features are: > > - Mini-submarine (YARN) > > - Basic Tensorflow job submission to k8s through submarine-server RESTful > > API > > - Job submission on YARN through submarine-server RPC protocol > > > > Tons of thanks to our contributors and community! Let's keep fighting! > > > > *Apache Submarine 0.3.0 released*: > > http://submarine.apache.org/releases/submarine-release-0.3.0.html > > *Changelog*: https://s.apache.org/4ezw1 > > > > BR, > > Zhankun > > >
Re: [VOTE] Submarine-0.3.0-RC0 is ready for a vote! Re: [Submarine Release Plan] Submarine-0.3.0
+1. Thanks, Xun Liu. On Thu, Jan 23, 2020 at 12:08 AM Xun Liu wrote: > Thanks Zhankun & all the contributors for release 0.3.0 > > On Wed, Jan 22, 2020 at 6:44 PM Zhankun Tang wrote: > >> Hi folks, >> >> Thanks to everyone's help on this release. Special thanks to Wanqiang, >> Zac, Kevin, Xun, and Jeff! >> >> I've created a release candidate (RC0) for submarine 0.3.0. The >> highlighted features are as follows: >> - Mini-submarine >> - Basic Tensorflow job submission to k8s through submarine-server RESTful >> API >> - Job submission on YARN through submarine-server RPC protocol >> >> The RC tag in git is here: >> https://github.com/apache/submarine/tree/release-0.3.0-RC0 >> >> The RC release artifacts are available at: >> http://home.apache.org/~ztang/submarine-0.3.0-RC0/ >> >> The mini-submarine image is here: >> docker pull apache/submarine:mini-0.3.0-RC0 >> >> https://hub.docker.com/layers/apache/submarine/mini-0.3.0-RC0/images/sha256-3dd49054bf8a91521f5743c675278d626a5fa568e91651c67867b8ba6ceba340 >> >> The Maven staging repository is here: >> https://repository.apache.org/content/repositories/orgapachesubmarine-1001 >> >> My public key is here: >> https://dist.apache.org/repos/dist/release/submarine/KEYS >> >> *This vote will run for 10 days, ending on Feb. 1st, 2020 at 11:59 pm >> PST.* >> >> For the testing, I have verified the build from source, run the mnist >> example with mini-submarine(both local and remote mode) and verified >> posting a mnist TFJob to K8s through the submarine. >> >> Please follow the document to test these features. >> https://github.com/apache/submarine/tree/master/dev-support/mini-submarine >> >> https://github.com/apache/submarine/blob/master/docs/submarine-server/README.md >> >> My +1 (binding) to start. Thanks! >> >> BR, >> Zhankun >> >> On Thu, 16 Jan 2020 at 18:11, yuan.zac.zq wrote: >> >>> Thanks Zhankun & all the contributors for release 0.3.0 >>> >>> Zac Zhou >>> On 1/16/2020 18:08，Xun Liu >>> wrote： >>> >>> Submarine 0.3.0 is release, which is really good news! >>> >>> On Thu, Jan 16, 2020 at 6:04 PM Rohith Sharma K S < >>> rohithsharm...@apache.org> >>> wrote: >>> >>> Thanks Zhankun, for the initiating release process. >>> >>> >>> On Wed, 15 Jan 2020 at 19:21, Zhankun Tang wrote: >>> >>> Hi folks, >>> >>> I've cleaned up the JIRAs[1] for 0.3.0 and created a tag >>> "release-0.3.0-RC0"[2] instead of branching to simplify the release >>> >>> process >>> >>> before our v1.0. This tag means version 0.3.0 is code frozen. If we found >>> big issues in RC0 artifacts, we can tag an RC1. >>> >>> It means Submarine releases will happen from master branch always >>> >>> until v1.0. Branching will be done from v1.0 onward, right? If so, is it >>> inline with Apache release process compliance? Can you confirm? >>> >>> -Rohith Sharma K S >>> >>>
Re: [VOTE] Submarine-0.3.0-RC0 is ready for a vote! Re: [Submarine Release Plan] Submarine-0.3.0
Thanks Zhankun & all the contributors for release 0.3.0 On Wed, Jan 22, 2020 at 6:44 PM Zhankun Tang wrote: > Hi folks, > > Thanks to everyone's help on this release. Special thanks to Wanqiang, > Zac, Kevin, Xun, and Jeff! > > I've created a release candidate (RC0) for submarine 0.3.0. The > highlighted features are as follows: > - Mini-submarine > - Basic Tensorflow job submission to k8s through submarine-server RESTful > API > - Job submission on YARN through submarine-server RPC protocol > > The RC tag in git is here: > https://github.com/apache/submarine/tree/release-0.3.0-RC0 > > The RC release artifacts are available at: > http://home.apache.org/~ztang/submarine-0.3.0-RC0/ > > The mini-submarine image is here: > docker pull apache/submarine:mini-0.3.0-RC0 > > https://hub.docker.com/layers/apache/submarine/mini-0.3.0-RC0/images/sha256-3dd49054bf8a91521f5743c675278d626a5fa568e91651c67867b8ba6ceba340 > > The Maven staging repository is here: > https://repository.apache.org/content/repositories/orgapachesubmarine-1001 > > My public key is here: > https://dist.apache.org/repos/dist/release/submarine/KEYS > > *This vote will run for 10 days, ending on Feb. 1st, 2020 at 11:59 pm PST.* > > For the testing, I have verified the build from source, run the mnist > example with mini-submarine(both local and remote mode) and verified > posting a mnist TFJob to K8s through the submarine. > > Please follow the document to test these features. > https://github.com/apache/submarine/tree/master/dev-support/mini-submarine > > https://github.com/apache/submarine/blob/master/docs/submarine-server/README.md > > My +1 (binding) to start. Thanks! > > BR, > Zhankun > > On Thu, 16 Jan 2020 at 18:11, yuan.zac.zq wrote: > >> Thanks Zhankun & all the contributors for release 0.3.0 >> >> Zac Zhou >> On 1/16/2020 18:08，Xun Liu wrote： >> >> Submarine 0.3.0 is release, which is really good news! >> >> On Thu, Jan 16, 2020 at 6:04 PM Rohith Sharma K S < >> rohithsharm...@apache.org> >> wrote: >> >> Thanks Zhankun, for the initiating release process. >> >> >> On Wed, 15 Jan 2020 at 19:21, Zhankun Tang wrote: >> >> Hi folks, >> >> I've cleaned up the JIRAs[1] for 0.3.0 and created a tag >> "release-0.3.0-RC0"[2] instead of branching to simplify the release >> >> process >> >> before our v1.0. This tag means version 0.3.0 is code frozen. If we found >> big issues in RC0 artifacts, we can tag an RC1. >> >> It means Submarine releases will happen from master branch always >> >> until v1.0. Branching will be done from v1.0 onward, right? If so, is it >> inline with Apache release process compliance? Can you confirm? >> >> -Rohith Sharma K S >> >>
Re: [Submarine Release Plan] Submarine-0.3.0
Submarine 0.3.0 is release, which is really good news! On Thu, Jan 16, 2020 at 6:04 PM Rohith Sharma K S wrote: > Thanks Zhankun, for the initiating release process. > > > On Wed, 15 Jan 2020 at 19:21, Zhankun Tang wrote: > > > Hi folks, > > > > I've cleaned up the JIRAs[1] for 0.3.0 and created a tag > > "release-0.3.0-RC0"[2] instead of branching to simplify the release > process > > before our v1.0. This tag means version 0.3.0 is code frozen. If we found > > big issues in RC0 artifacts, we can tag an RC1. > > > It means Submarine releases will happen from master branch always > until v1.0. Branching will be done from v1.0 onward, right? If so, is it > inline with Apache release process compliance? Can you confirm? > > -Rohith Sharma K S >
[ANNOUNCE] Welcome Kevin Su as New Submarine Committer
The Project Management Committee (PMC) for Apache Submarine has invited Kevin Su to become a committer and we are very pleased to announce that he has accepted. We greatly appreciate all of Kevin's hard work and generous contributions to the project. We look forward to continued involvement in the project. Congratulations & Welcome aboard Kevin ! Best Regards Xun Liu
