Re: More mailing lists for the Submarine project?

2020-01-13 Thread Zhankun Tang
Hi Wei-Chiu, There's dev, user and commit mailing list published here: http://submarine.apache.org/community/contributors.html I think we could have the security mailing list. But I'm afraid it might be less active for a long time. :) And for the user issue, I guess they will ask the user mailing

[Submarine Release Plan] Submarine-0.3.0

2020-01-15 Thread Zhankun Tang
Hi folks, Thanks for everyone's hard work! We are ready for a new Submarine 0.3.0 release! Apache Submarine 0.3.0 is the first release after the spin-off from Apache Hadoop. It is a very good starting point for us. This release will consist of 187 fixes[1]. Among them, there're three features wor

Re: [Submarine Release Plan] Submarine-0.3.0

2020-01-15 Thread Zhankun Tang
s! Thanks all for helping in this release. > > - Sunil > > On Wed, Jan 15, 2020 at 3:56 PM Zhankun Tang wrote: > > > Hi folks, > > > > Thanks for everyone's hard work! We are ready for a new Submarine 0.3.0 > > release! > > Apache Submarine 0.3.0

Re: [ANNOUNCE] Welcome Kevin Su as New Submarine Committer

2020-01-16 Thread Zhankun Tang
Congratulations! Kevin, welcome onboard! BR, Zhankun On Thu, 16 Jan 2020 at 18:09, yuan.zac.zq wrote: > Congratulations! Well Deserved! > > Zac Zhou > On 1/16/2020 17:48,Rohith Sharma K S > wrote: > > Congratulations! Welcome onboard! > > -Rohith Sharma K S > > On Tue, 14 Jan 2020 at 19:57, Xu

[VOTE] Submarine-0.3.0-RC0 is ready for a vote! Re: [Submarine Release Plan] Submarine-0.3.0

2020-01-22 Thread Zhankun Tang
arma K S < > rohithsharm...@apache.org> > wrote: > > Thanks Zhankun, for the initiating release process. > > > On Wed, 15 Jan 2020 at 19:21, Zhankun Tang wrote: > > Hi folks, > > I've cleaned up the JIRAs[1] for 0.3.0 and created a tag > "release-

Re: [VOTE] Submarine-0.3.0-RC0 is ready for a vote! Re: [Submarine Release Plan] Submarine-0.3.0

2020-02-03 Thread Zhankun Tang
proposal. > > > > kevin su 于2020年1月25日周六 下午8:18写道: > > > > > +1, thanks Zhankun > > > > > > Xun Liu 於 2020年1月25日 週六 下午7:48寫道: > > > > > > > +1. Thanks, Xun Liu. > > > > > > > > On Thu,

Re: [VOTE] Submarine-0.3.0-RC0 is ready for a vote! Re: [Submarine Release Plan] Submarine-0.3.0

2020-02-06 Thread Zhankun Tang
Appreciate all of your efforts for this release > > - Sunil > > On Mon, Feb 3, 2020 at 1:44 PM Zhankun Tang wrote: > > > Hi Sunil, > > > > Thanks for the help in verifying it! > > > > For the 404-Not Found of the maven staging repo, it's because I

[ANNOUNCE] Apache Submarine 0.3.0 release!

2020-02-06 Thread Zhankun Tang
Hi folks, It's a great honor for me to announce that the Apache Submarine community has released Apache Submarine 0.3.0! Apache Submarine 0.3.0 is the first release after the spin-off from Apache Hadoop. It includes 196 patches since the prior version. The highlighted features are: - Mini-submari

Re: [DISCUSS] Move commit activities to commits@

2020-03-11 Thread Zhankun Tang
On Wed, 11 Mar 2020 at 13:46, Ayush Saxena wrote: > Thanx Wei-chiu for initiating this. > Makes sense to me. > +1 > > -Ayush > > > On 11-Mar-2020, at 11:14 AM, Wei-Chiu Chuang > wrote: > > > > Small correction -- > > Hadoop send JIRA notifications to *-issues@ mailing list. Still, it > gives >

Re: [DISCUSS] Move commit activities to commits@

2020-03-11 Thread Zhankun Tang
+1. BR, Zhankun On Wed, 11 Mar 2020 at 13:46, Ayush Saxena wrote: > Thanx Wei-chiu for initiating this. > Makes sense to me. > +1 > > -Ayush > > > On 11-Mar-2020, at 11:14 AM, Wei-Chiu Chuang > wrote: > > > > Small correction -- > > Hadoop send JIRA notifications to *-issues@ mailing list. St

Re: Lecture slides "Design and Implementation of a Machine Learning Platform"

2020-03-23 Thread Zhankun Tang
Thanks for sharing! Wei-Chiu. It's helpful and inspiring. And the guy in the picture is very handsome. :) BR, Zhankun On Tue, 24 Mar 2020 at 08:13, kevin su wrote: > Weichiu, thank you very much for sharing. > > BR, > Kevin Su. > > Wei-Chiu Chuang 於 2020年3月24日 週二 上午7:47寫道: > > > Hey Submarine

Re: [DISCUSS] Proposal of Task Breakdown and Timeline of Submarine 0.4.0/0.5.0/1.0.0 release

2020-04-30 Thread Zhankun Tang
Thanks Wangda for the proposal. It LGTM. One doubt for running experiment on YARN. Will it be included? BR, Zhankun Wei-Chiu Chuang 于2020年5月1日 周五上午2:18写道: > Looks good to me. Thanks! > > Yes we need security to call a 1.0 GA > > On Wed, Apr 29, 2020 at 9:58 PM Wangda Tan wrote: > > > Hi dev, >

Re: [Release Plan] Submarine-0.4.0

2020-06-26 Thread Zhankun Tang
Thanks Wanqiang for driving these efforts!! One minor problem I found is that there're 15 JIRAs marked as 0.5.0 as a fixed version due to unknown reasons. Below Jira's search criteria will show them. *project in ("Apache Submarine") AND fixVersion = 0.5.0 And statusCategory = Done* We should ma

Re: [VOTE] Submarine-0.4.0-RC0 is ready for a vote!

2020-06-29 Thread Zhankun Tang
Thanks for Wanqiang's hard work! I've done below testing: 1. Download the source code and verify the signature 2. Build it successfully 3. Install Helm charts 4. Run an experiment with the SDK example. +1 from me. One thing to mention is that we need to publish the python SDK to "pypi.org" when

Re: [ANNOUNCE] Apache Submarine 0.4.0 release!

2020-07-06 Thread Zhankun Tang
Really happy to see 0.4.0 released! Thanks for leading these efforts! Wanqiang! BR, Zhankun On Sun, 5 Jul 2020 at 18:45, Wanqiang Ji wrote: > Hi forks, > > It's a great honor for me to announce that the Apache Submarine Community > has released Apache Submarine 0.4.0! > > Apache Submarine 0.4.0

Re: [ANNOUNCE] Apache Submarine 0.4.0 release!

2020-07-06 Thread Zhankun Tang
> > > > Thanks > > Sunil > > > > On Mon, Jul 6, 2020 at 3:35 PM Zhankun Tang wrote: > > > >> Really happy to see 0.4.0 released! Thanks for leading these efforts! > >> Wanqiang! > >> > >> BR, > >> Zhankun > >&

Re: [VOTE] Submarine-0.5.0-RC0 is ready for a vote!

2020-10-20 Thread Zhankun Tang
Thanks for the hard work! Kevin. One minor problem found is that it seems the public key used when signing the artifacts is different from the one pasted in the KEYS file. Did anyone else meet this problem? $ gpg --list-keys pings...@apache.org pub rsa3072 2020-10-14 [SC] [expires: 2022-10-14]

Re: [ANNOUNCE] New Apache Submarine PMC: Kevin Su

2020-10-26 Thread Zhankun Tang
Congratulations! Kevin Su. Welcome! BR, Zhankun On Tue, 27 Oct 2020 at 03:13, Wei-Chiu Chuang wrote: > Dear all, > > I am pleased to announce our latest Submarine PMC member : Kevin Su, who > accepted the PMC's invitation to become a PMC member and to take on more > responsibilities. > > Kevin

Re: [ANNOUNCE] New Submarine Committer: Ryan Lo

2020-10-26 Thread Zhankun Tang
Congrats and welcome! Ryan Lo! BR, Zhankun On Tue, 27 Oct 2020 at 02:08, Wei-Chiu Chuang wrote: > Dear all, > > I am pleased to announce our latest Submarine committer: Ryan Lo, who > accepted the PMC's invitation to become a committer and to take on more > responsibilities. > > Ryan has contri

Re: [VOTE] Submarine-0.5.0-RC1 is ready for a vote!

2020-10-28 Thread Zhankun Tang
Thanks for the great efforts! Kevin! I've done the below testing 1. Verify the signatures (I signed Kevin's key and updated the KEYS file) 2. Build from source 3. Install the helm charts against Docker desktop k8s (v1.14.8) 4. Check basic UI's experiment and notebook features And I like the built-

Re: [VOTE] Submarine-0.5.0-RC3 is ready for a vote!

2020-12-07 Thread Zhankun Tang
Thanks for Kevin's hard work! +1 from me. BR, Zhankun On Fri, 4 Dec 2020 at 14:23, Kevin Su wrote: > Hi folks, > > > Thanks to everyone's help on this release. Special thanks to Wangda, > > Zhankun, Xun, Wei-Chiu, Wanqiang, Ryan, Manikandan, and JohnTing! > > I've created a release candidate (

Re: [ANNOUNCE] Apache Submarine 0.5.0 release!

2020-12-24 Thread Zhankun Tang
Thanks to all the contributors! And thanks for leading this release effort! Kevin! BR, Zhankun On Thu, 24 Dec 2020 at 17:03, Kevin Su wrote: > Hi folks, > > It's a great honor for me to announce that the Apache Submarine Community > has released Apache Submarine 0.5.0! > > Apache Submarine 0.5.

Re: [VOTE] Submarine-0.6.0-RC0 is ready for a vote!

2021-09-21 Thread Zhankun Tang
Folks, this v0.6 is great progress! Thanks for the efforts! +1 from me. BR, Zhankun On Tue, 21 Sept 2021 at 13:29, Xun Liu wrote: > hi, kevin > > +1 (banding for me) > > Thank you Kevin and fellow community partners for their hard work. > We have seen that in the submarine-0.6 version, Tensorb

Latest submarine architecture and feature list wrap-up

2022-01-24 Thread Zhankun Tang
Hi guys, Is there a place or guide where I can find out the newest architecture figure or document? I'd like to get a wrap-up on this. Seems the README in GitHub is outdated. BR, Zhankun

[jira] [Updated] (SUBMARINE-267) Initial job server which defines simple job spec and REST skelon.

2019-11-07 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-267: --- Summary: Initial job server which defines simple job spec and REST skelon. (was

[jira] [Commented] (SUBMARINE-304) add project encoding

2019-11-28 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16984501#comment-16984501 ] Zhankun Tang commented on SUBMARINE-304: [~ayushsaxena], this jira is to

[jira] [Commented] (SUBMARINE-304) add project encoding

2019-11-28 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16984502#comment-16984502 ] Zhankun Tang commented on SUBMARINE-304: And can you add more descriptio

[jira] [Updated] (SUBMARINE-308) Support PyTorch with TonY runtime

2019-12-05 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-308: --- Summary: Support PyTorch with TonY runtime (was: support PyTorch with TonY runtime

[jira] [Commented] (SUBMARINE-308) Support PyTorch with TonY runtime

2019-12-05 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988890#comment-16988890 ] Zhankun Tang commented on SUBMARINE-308: [~jason_jane], Thanks for helpin

[jira] [Commented] (SUBMARINE-308) Support PyTorch with TonY runtime

2019-12-10 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16992355#comment-16992355 ] Zhankun Tang commented on SUBMARINE-308: Thanks a lot! [~adam.a

[jira] [Commented] (SUBMARINE-244) Submarine Releases Milestones and Planning

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997803#comment-16997803 ] Zhankun Tang commented on SUBMARINE-244: [~wangda], Thanks for updating

[jira] [Resolved] (SUBMARINE-244) Submarine Releases Milestones and Planning

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved SUBMARINE-244. Resolution: Fixed Let's use the wiki page with Jira filter statistics. > S

[jira] [Updated] (SUBMARINE-225) [Umbrella] Submarine Client

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-225: --- Component/s: Backend Server Target Version: 0.3.0 > [Umbrella] Submarine Cli

[jira] [Updated] (SUBMARINE-225) [Umbrella] Submarine Client

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-225: --- Description: Maybe we can used the SC in the JIRA summary field to mark the task related

[jira] [Commented] (SUBMARINE-225) [Umbrella] Submarine Client

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997818#comment-16997818 ] Zhankun Tang commented on SUBMARINE-225: In my understanding, the subma

[jira] [Updated] (SUBMARINE-223) The Ecosystem page links to the old, non-Apache github repo

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-223: --- Component/s: Doc Target Version: 0.3.0 > The Ecosystem page links to the old,

[jira] [Updated] (SUBMARINE-188) [E2E] Submarine integration test workbench user

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-188: --- Component/s: E2E Test Target Version: 0.4.0 > [E2E] Submarine integration t

[jira] [Updated] (SUBMARINE-173) [SC] Create the submarine-client module

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-173: --- Component/s: Backend Server Target Version: 0.3.0 > [SC] Create the submar

[jira] [Updated] (SUBMARINE-186) [E2E] Create new module submarine-integration Initialize E2E Test Framework

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-186: --- Component/s: E2E Test Target Version: 0.4.0 > [E2E] Create new module submar

[jira] [Updated] (SUBMARINE-187) [E2E] Submarine integration test workbench department

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-187: --- Component/s: E2E Test Target Version: 0.4.0 > [E2E] Submarine integration t

[jira] [Commented] (SUBMARINE-162) [Umbrella] Submarine Job Spec

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997821#comment-16997821 ] Zhankun Tang commented on SUBMARINE-162: [~jiwq], is thhis duplicated

[jira] [Updated] (SUBMARINE-162) [Umbrella] Submarine Job Spec

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-162: --- Component/s: Backend Server Target Version: 0.3.0 > [Umbrella] Submarine Job S

[jira] [Commented] (SUBMARINE-160) Move Restful code to new workbench service class

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997823#comment-16997823 ] Zhankun Tang commented on SUBMARINE-160: [~liuxun323], is this alr

[jira] [Updated] (SUBMARINE-154) [Umbrella] Submarine on K8s

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-154: --- Component/s: Backend Server Target Version: 0.3.0 > [Umbrella] Submarine on

[jira] [Updated] (SUBMARINE-160) Move Restful code to new workbench service class

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-160: --- Component/s: Workbench Target Version: 0.3.0 > Move Restful code to new workbe

[jira] [Commented] (SUBMARINE-132) [DB] Submarine Database Design

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997824#comment-16997824 ] Zhankun Tang commented on SUBMARINE-132: [~liuxun323], it seems all the t

[jira] [Updated] (SUBMARINE-132) [DB] Submarine Database Design

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-132: --- Component/s: Workbench Target Version: 0.3.0 > [DB] Submarine Database Des

[jira] [Updated] (SUBMARINE-122) Fixed package name `org.apache.hadoop` error in the documentation

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-122: --- Component/s: Doc Target Version: 0.3.0 > Fixed package name `org.apache.had

[jira] [Resolved] (SUBMARINE-122) Fixed package name `org.apache.hadoop` error in the documentation

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved SUBMARINE-122. Fix Version/s: 0.3.0 Resolution: Fixed > Fixed package name `org.apache.had

[jira] [Updated] (SUBMARINE-98) [Umbrella] Submarine web page

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-98?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-98: -- Target Version: 0.4.0 > [Umbrella] Submarine web p

[jira] [Updated] (SUBMARINE-116) [WEB] Submarine web Model serving page

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-116: --- Component/s: Workbench Web Target Version: 0.4.0 > [WEB] Submarine web Mo

[jira] [Updated] (SUBMARINE-115) [WEB] Submarine web Model page

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-115: --- Component/s: Workbench Web Target Version: 0.4.0 > [WEB] Submarine web Model p

[jira] [Updated] (SUBMARINE-105) [WEB] Submarine web demo

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-105: --- Component/s: Workbench Web Target Version: 0.4.0 > [WEB] Submarine web d

[jira] [Updated] (SUBMARINE-113) [Document] Submarine all document in here

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-113: --- Component/s: Doc > [Document] Submarine all document in h

[jira] [Updated] (SUBMARINE-95) Add Docker image for developers and beginners to try submarine in one container

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-95?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-95: -- Component/s: Mini Submarine Target Version: 0.3.0 > Add Docker image for develop

[jira] [Updated] (SUBMARINE-95) Add Docker image for developers and beginners to try submarine in one container

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-95?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-95: -- Fix Version/s: 0.3.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Updated] (SUBMARINE-90) Submarine 0.3.0 website

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-90?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-90: -- Component/s: Doc Target Version: 0.3.0 > Submarine 0.3.0 webs

[jira] [Updated] (SUBMARINE-84) The environment variable TF_CONFIG hard coded port number "8000" will cause distributed training job's worker fail to start

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-84?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-84: -- Component/s: YARN-native-service Target Version: 0.4.0 > The environment varia

[jira] [Updated] (SUBMARINE-81) Add documentation about YAML config parser with example config

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-81?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-81: -- Component/s: Doc Target Version: 0.4.0 > Add documentation about YAML config par

[jira] [Updated] (SUBMARINE-78) Make RemoteDirectoryManager interface more consistent

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-78?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-78: -- Component/s: Commons Target Version: 0.4.0 > Make RemoteDirectoryManager interf

[jira] [Updated] (SUBMARINE-79) Cleanup MockRemoteDirectoryManager

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-79?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-79: -- Component/s: Commons Target Version: 0.4.0 > Cleanup MockRemoteDirectoryMana

[jira] [Updated] (SUBMARINE-77) Create a builder class for NS Component

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-77?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-77: -- Component/s: Commons Target Version: 0.4.0 > Create a builder class for NS Compon

[jira] [Updated] (SUBMARINE-76) Create factory class to produce either TensorFlow or PyTorch service spec for Native Service

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-76?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-76: -- Component/s: YARN-native-service Target Version: 0.4.0 > Create factory class

[jira] [Updated] (SUBMARINE-75) Add tests to HadoopEnvironmentSetup class

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-75?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-75: -- Component/s: Commons Target Version: 0.4.0 > Add tests to HadoopEnvironmentSe

[jira] [Updated] (SUBMARINE-74) Add tests to TensorFlowServiceSpec class

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-74?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-74: -- Component/s: Commons Target Version: 0.4.0 > Add tests to TensorFlowServiceSpec cl

[jira] [Resolved] (SUBMARINE-73) Submarine and Tony engine use the same interface

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-73?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved SUBMARINE-73. --- Resolution: Duplicate > Submarine and Tony engine use the same interf

[jira] [Updated] (SUBMARINE-71) [umbrella] Update submarine site

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-71?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-71: -- Component/s: Doc > [umbrella] Update submarine s

[jira] [Resolved] (SUBMARINE-70) Support PyTorch framework option with TonY runtime

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-70?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved SUBMARINE-70. --- Resolution: Duplicate Close this as duplicated with SUBMARINE-308. Let's discuss

[jira] [Updated] (SUBMARINE-308) Support PyTorch with TonY runtime

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-308: --- Parent: SUBMARINE-14 Issue Type: Sub-task (was: New Feature) > Support PyTo

[jira] [Updated] (SUBMARINE-65) Make PyTorch support HDFS

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-65?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-65: -- Component/s: TonY Target Version: 0.4.0 > Make PyTorch support H

[jira] [Updated] (SUBMARINE-53) Generate Service spec + launch script for distributed PyTorch learning job

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-53?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-53: -- Component/s: YARN-native-service Target Version: 0.4.0 > Generate Service s

[jira] [Updated] (SUBMARINE-51) Print short error messages in case of configuration issues

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-51?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-51: -- Component/s: Commons Target Version: 0.4.0 > Print short error messages in case

[jira] [Updated] (SUBMARINE-50) Ensure that null values from CLI / YAML configs handled appropriately

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-50?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-50: -- Component/s: Commons Target Version: 0.4.0 > Ensure that null values from CLI / Y

[jira] [Updated] (SUBMARINE-48) Format of env vars job run parameter is not documented

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-48?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-48: -- Component/s: Commons > Format of env vars job run parameter is not documen

[jira] [Resolved] (SUBMARINE-48) Format of env vars job run parameter is not documented

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-48?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved SUBMARINE-48. --- Fix Version/s: 0.3.0 Resolution: Fixed Let's resolve this for now. Submarine n

[jira] [Updated] (SUBMARINE-43) Add a Kubernetes Runtime to Submarine

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-43?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-43: -- Resolution: Duplicate Status: Resolved (was: Patch Available) Close this due to

[jira] [Updated] (SUBMARINE-42) Need to support the task to run failed container does not destroy

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-42?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-42: -- Component/s: YARN-native-service Target Version: 0.4.0 > Need to support the task

[jira] [Resolved] (SUBMARINE-39) [Submarine] Improve submarine site contents

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-39?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved SUBMARINE-39. --- Resolution: Fixed After 0.2 got released, I think this has been resolved. Closing this

[jira] [Resolved] (SUBMARINE-37) [Submarine] Support long-running service type services

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-37?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved SUBMARINE-37. --- Resolution: Won't Fix > [Submarine] Support long-running service type

[jira] [Resolved] (SUBMARINE-36) [Submarine] Support fault tolerance when Tensorflow worker container fails

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-36?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved SUBMARINE-36. --- Resolution: Won't Fix TonY should have already supported this. > [Submarine]

[jira] [Updated] (SUBMARINE-34) Can't re-run a submarine job, if the previous job with the same service name has finished

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-34?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-34: -- Component/s: Commons Target Version: 0.4.0 > Can't re-run a submarine job

[jira] [Updated] (SUBMARINE-29) [Submarine] Improve job state check

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-29?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-29: -- Component/s: YARN-native-service Target Version: 0.4.0 > [Submarine] Improve

[jira] [Resolved] (SUBMARINE-27) [Submarine] Support for executing tensorflow algorithm files on hdfs

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-27?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved SUBMARINE-27. --- Resolution: Duplicate > [Submarine] Support for executing tensorflow algorithm files

[jira] [Updated] (SUBMARINE-25) [Submarine] Manage submarine's docker image with docker hub

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-25?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-25: -- Component/s: Mini Submarine Target Version: 0.3.0 > [Submarine] Manage submarin

[jira] [Resolved] (SUBMARINE-21) [Submarine] Add submarine installation scripts

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-21?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved SUBMARINE-21. --- Fix Version/s: 0.3.0 Resolution: Fixed > [Submarine] Add submarine installat

[jira] [Resolved] (SUBMARINE-23) [Submarine] Job monitor long-running service of submarine

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-23?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved SUBMARINE-23. --- Resolution: Won't Fix > [Submarine] Job monitor long-running service of s

[jira] [Updated] (SUBMARINE-14) [Umbrella] Support using Submarine to submit Pytorch job

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-14?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-14: -- Component/s: Commons Target Version: 0.4.0 > [Umbrella] Support using Submarine

[jira] [Updated] (SUBMARINE-14) [Umbrella] Support using Submarine to submit Pytorch job

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-14?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-14: -- Component/s: Backend Server > [Umbrella] Support using Submarine to submit Pytorch

[jira] [Updated] (SUBMARINE-18) Enable local staging directory and clean it up when submarine job is submitted

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-18?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-18: -- Component/s: Commons Target Version: 0.4.0 > Enable local staging directory and cl

[jira] [Resolved] (SUBMARINE-10) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-10?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved SUBMARINE-10. --- Resolution: Duplicate duplicated with SUBMARINE-18 > Submarine job staging directory

[jira] [Resolved] (SUBMARINE-8) [Submarine] Support deploy model serving for existing models

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved SUBMARINE-8. -- Resolution: Later Since the design of the submarine changed a lot after the spin-off. Let&#

[jira] [Updated] (SUBMARINE-7) [Submarine] Support create models / versions for training result.

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-7: - Component/s: Commons Target Version: 0.4.0 > [Submarine] Support create mod

[jira] [Resolved] (SUBMARINE-5) [Submarine] Support users to specify Python/TF package/version/dependencies for training job.

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved SUBMARINE-5. -- Resolution: Later The current "localization" option (SUBMARINE-4) resolves part

[jira] [Resolved] (SUBMARINE-2) Hadoop {Submarine} Project: Simple and scalable deployment of deep learning training / serving jobs on Hadoop

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved SUBMARINE-2. -- Resolution: Fixed > Hadoop {Submarine} Project: Simple and scalable deployment of d

[jira] [Resolved] (SUBMARINE-9) [Submarine] Support passing Kerberos principle tokens when launch training jobs.

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved SUBMARINE-9. -- Fix Version/s: 0.2.0 Resolution: Fixed IIRC, this has been fixed in yarn native

[jira] [Updated] (SUBMARINE-173) [SC] Create the submarine-client REST module

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-173: --- Summary: [SC] Create the submarine-client REST module (was: [SC] Create the submarine

[jira] [Updated] (SUBMARINE-173) [SC] Create the submarine-client REST module

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-173: --- Target Version: 0.4.0 (was: 0.3.0) > [SC] Create the submarine-client REST mod

[jira] [Resolved] (SUBMARINE-90) Submarine 0.3.0 website

2019-12-16 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-90?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved SUBMARINE-90. --- Resolution: Fixed > Submarine 0.3.0 webs

[jira] [Updated] (SUBMARINE-296) [SDK] Submarine pipeline example

2019-12-23 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-296: --- Target Version: 0.4.0 > [SDK] Submarine pipeline exam

[jira] [Updated] (SUBMARINE-296) [SDK] Submarine pipeline example

2019-12-23 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/SUBMARINE-296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated SUBMARINE-296: --- Fix Version/s: (was: 0.4.0) > [SDK] Submarine pipeline exam

  1   2   3   >