Re: [ANNOUNCE] Welcome Kevin Su as New Submarine Committer

[Sunil Govindan]

Congratulations!

On Tue, Jan 14, 2020 at 7:59 PM Wei-Chiu Chuang  wrote:

> Congrats! Welcome onboard!
>
> On Tue, Jan 14, 2020 at 6:27 AM Xun Liu  wrote:
>
>> The Project Management Committee (PMC) for Apache Submarine
>> has invited Kevin Su to become a committer and we are very pleased
>> to announce that he has accepted.
>>
>> We greatly appreciate all of Kevin's hard work and generous contributions
>> to
>> the project. We look forward to continued involvement in the project.
>>
>> Congratulations & Welcome aboard Kevin !
>>
>> Best Regards
>> Xun Liu
>>
>

Re: [Submarine Release Plan] Submarine-0.3.0

[Sunil Govindan]

Kudos! Thanks all for helping in this release.

- Sunil

On Wed, Jan 15, 2020 at 3:56 PM Zhankun Tang  wrote:

> Hi folks,
>
> Thanks for everyone's hard work! We are ready for a new Submarine 0.3.0
> release!
> Apache Submarine 0.3.0 is the first release after the spin-off from Apache
> Hadoop. It is a very good starting point for us.
>
> This release will consist of 187 fixes[1]. Among them, there're three
> features worth mentioning:
> 1. Mini-submarine. The easiest way to play with the submarine. We'll
> provide the official apache repo docker images.
> 2. Submarine on k8s. The basic TF job submission to K8s through
> submarine-server
> 3. Cluster mode job submission to YARN. The CLI now supports a new "remote"
> option to let the submarine-server submit a job.
>
> The release plan:
> *Code Freezing Date: 15th Jan 2020*
> *Release Date: 21th Jan 2020*
>
> Please feel free to share your insights on this. Thanks!
>
> [1] https://s.apache.org/i2dys
>
> BR,
> Zhankun
>

Re: [VOTE] Submarine-0.3.0-RC0 is ready for a vote! Re: [Submarine Release Plan] Submarine-0.3.0

[Sunil Govindan]

Generally the tests looks good to me.
I tried to run locally and basic setup seems fine.

Some doubts in the below parts.
1.
https://repository.apache.org/content/repositories/orgapachesubmarine-1001 is
coming as 404-Not Found for me ?
2. Could we use apache docker repo? or is this maintained by Submarine, if
so, how many images we can maintain here?

Thanks
Sunil

On Mon, Feb 3, 2020 at 9:18 AM Zac Zhou  wrote:

> +1
>
> Zhankun, thanks for your proposal.
>
> kevin su  于2020年1月25日周六 下午8:18写道：
>
> > +1, thanks Zhankun
> >
> > Xun Liu  於 2020年1月25日 週六 下午7:48寫道：
> >
> > > +1. Thanks, Xun Liu.
> > >
> > > On Thu, Jan 23, 2020 at 12:08 AM Xun Liu  wrote:
> > >
> > > > Thanks Zhankun & all the contributors for release 0.3.0
> > > >
> > > > On Wed, Jan 22, 2020 at 6:44 PM Zhankun Tang 
> wrote:
> > > >
> > > >> Hi folks,
> > > >>
> > > >> Thanks to everyone's help on this release. Special thanks to
> Wanqiang,
> > > >> Zac, Kevin, Xun, and Jeff!
> > > >>
> > > >> I've created a release candidate (RC0) for submarine 0.3.0. The
> > > >> highlighted features are as follows:
> > > >> - Mini-submarine
> > > >> - Basic Tensorflow job submission to k8s through submarine-server
> > > RESTful
> > > >> API
> > > >> - Job submission on YARN through submarine-server RPC protocol
> > > >>
> > > >> The RC tag in git is here:
> > > >> https://github.com/apache/submarine/tree/release-0.3.0-RC0
> > > >>
> > > >> The RC release artifacts are available at:
> > > >> http://home.apache.org/~ztang/submarine-0.3.0-RC0/
> > > >>
> > > >> The mini-submarine image is here:
> > > >> docker pull apache/submarine:mini-0.3.0-RC0
> > > >>
> > > >>
> > >
> >
> https://hub.docker.com/layers/apache/submarine/mini-0.3.0-RC0/images/sha256-3dd49054bf8a91521f5743c675278d626a5fa568e91651c67867b8ba6ceba340
> > > >>
> > > >> The Maven staging repository is here:
> > > >>
> > >
> >
> https://repository.apache.org/content/repositories/orgapachesubmarine-1001
> > > >>
> > > >> My public key is here:
> > > >> https://dist.apache.org/repos/dist/release/submarine/KEYS
> > > >>
> > > >> *This vote will run for 10 days, ending on Feb. 1st, 2020 at 11:59
> pm
> > > >> PST.*
> > > >>
> > > >> For the testing, I have verified the build from source, run the
> mnist
> > > >> example with mini-submarine(both local and remote mode) and verified
> > > >> posting a mnist TFJob to K8s through the submarine.
> > > >>
> > > >> Please follow the document to test these features.
> > > >>
> > >
> >
> https://github.com/apache/submarine/tree/master/dev-support/mini-submarine
> > > >>
> > > >>
> > >
> >
> https://github.com/apache/submarine/blob/master/docs/submarine-server/README.md
> > > >>
> > > >> My +1 (binding) to start. Thanks!
> > > >>
> > > >> BR,
> > > >> Zhankun
> > > >>
> > > >> On Thu, 16 Jan 2020 at 18:11, yuan.zac.zq 
> > > wrote:
> > > >>
> > > >>> Thanks Zhankun & all the contributors for release 0.3.0
> > > >>>
> > > >>> Zac Zhou
> > > >>> On 1/16/2020 18:08，Xun Liu 
> > > >>> wrote：
> > > >>>
> > > >>> Submarine 0.3.0 is release, which is really good news!
> > > >>>
> > > >>> On Thu, Jan 16, 2020 at 6:04 PM Rohith Sharma K S <
> > > >>> rohithsharm...@apache.org>
> > > >>> wrote:
> > > >>>
> > > >>> Thanks Zhankun, for the initiating release process.
> > > >>>
> > > >>>
> > > >>> On Wed, 15 Jan 2020 at 19:21, Zhankun Tang 
> wrote:
> > > >>>
> > > >>> Hi folks,
> > > >>>
> > > >>> I've cleaned up the JIRAs[1] for 0.3.0 and created a tag
> > > >>> "release-0.3.0-RC0"[2] instead of branching to simplify the release
> > > >>>
> > > >>> process
> > > >>>
> > > >>> before our v1.0. This tag means version 0.3.0 is code frozen. If we
> > > found
> > > >>> big issues in RC0 artifacts, we can tag an RC1.
> > > >>>
> > > >>> It means Submarine releases will happen from master branch always
> > > >>>
> > > >>> until v1.0. Branching will be done from v1.0 onward, right? If so,
> is
> > > it
> > > >>> inline with Apache release process compliance? Can you confirm?
> > > >>>
> > > >>> -Rohith Sharma K S
> > > >>>
> > > >>>
> > >
> >
>

Re: [VOTE] Submarine-0.3.0-RC0 is ready for a vote! Re: [Submarine Release Plan] Submarine-0.3.0

[Sunil Govindan]

Thanks Zhankun for clarifying.

I am converting my vote to +1 (binding)
Appreciate all of your efforts for this release

- Sunil

On Mon, Feb 3, 2020 at 1:44 PM Zhankun Tang  wrote:

> Hi Sunil,
>
> Thanks for the help in verifying it!
>
> For the 404-Not Found of the maven staging repo, it's because I've clicked
> the release button for it. We've got 3 binding +1 and 1 non-binding +1. I'm
> already doing the publishing. :)
> For the submarine docker images, it's stored under the apache/submarine
> repo created by "apache" user(maintained by Apache INFRA) in Docker hub.
> And the submarine images are maintained by the docker hub users owned by
> submarine PMCs. See here for more details.
> https://issues.apache.org/jira/browse/INFRA-19650
>
> BR,
> Zhankun
>
>
> On Mon, 3 Feb 2020 at 15:08, Sunil Govindan  wrote:
>
> > Generally the tests looks good to me.
> > I tried to run locally and basic setup seems fine.
> >
> > Some doubts in the below parts.
> > 1.
> >
> https://repository.apache.org/content/repositories/orgapachesubmarine-1001
> > is
> > coming as 404-Not Found for me ?
> > 2. Could we use apache docker repo? or is this maintained by Submarine,
> if
> > so, how many images we can maintain here?
> >
> > Thanks
> > Sunil
> >
> > On Mon, Feb 3, 2020 at 9:18 AM Zac Zhou  wrote:
> >
> > > +1
> > >
> > > Zhankun, thanks for your proposal.
> > >
> > > kevin su  于2020年1月25日周六 下午8:18写道：
> > >
> > > > +1, thanks Zhankun
> > > >
> > > > Xun Liu  於 2020年1月25日 週六 下午7:48寫道：
> > > >
> > > > > +1. Thanks, Xun Liu.
> > > > >
> > > > > On Thu, Jan 23, 2020 at 12:08 AM Xun Liu 
> wrote:
> > > > >
> > > > > > Thanks Zhankun & all the contributors for release 0.3.0
> > > > > >
> > > > > > On Wed, Jan 22, 2020 at 6:44 PM Zhankun Tang 
> > > wrote:
> > > > > >
> > > > > >> Hi folks,
> > > > > >>
> > > > > >> Thanks to everyone's help on this release. Special thanks to
> > > Wanqiang,
> > > > > >> Zac, Kevin, Xun, and Jeff!
> > > > > >>
> > > > > >> I've created a release candidate (RC0) for submarine 0.3.0. The
> > > > > >> highlighted features are as follows:
> > > > > >> - Mini-submarine
> > > > > >> - Basic Tensorflow job submission to k8s through
> submarine-server
> > > > > RESTful
> > > > > >> API
> > > > > >> - Job submission on YARN through submarine-server RPC protocol
> > > > > >>
> > > > > >> The RC tag in git is here:
> > > > > >> https://github.com/apache/submarine/tree/release-0.3.0-RC0
> > > > > >>
> > > > > >> The RC release artifacts are available at:
> > > > > >> http://home.apache.org/~ztang/submarine-0.3.0-RC0/
> > > > > >>
> > > > > >> The mini-submarine image is here:
> > > > > >> docker pull apache/submarine:mini-0.3.0-RC0
> > > > > >>
> > > > > >>
> > > > >
> > > >
> > >
> >
> https://hub.docker.com/layers/apache/submarine/mini-0.3.0-RC0/images/sha256-3dd49054bf8a91521f5743c675278d626a5fa568e91651c67867b8ba6ceba340
> > > > > >>
> > > > > >> The Maven staging repository is here:
> > > > > >>
> > > > >
> > > >
> > >
> >
> https://repository.apache.org/content/repositories/orgapachesubmarine-1001
> > > > > >>
> > > > > >> My public key is here:
> > > > > >> https://dist.apache.org/repos/dist/release/submarine/KEYS
> > > > > >>
> > > > > >> *This vote will run for 10 days, ending on Feb. 1st, 2020 at
> 11:59
> > > pm
> > > > > >> PST.*
> > > > > >>
> > > > > >> For the testing, I have verified the build from source, run the
> > > mnist
> > > > > >> example with mini-submarine(both local and remote mode) and
> > verified
> > > > > >> posting a mnist TFJob to K8s through the submarine.
> > > > > >>
> > > > > >> Please foll

Re: [ANNOUNCE] Apache Submarine 0.3.0 release!

[Sunil Govindan]

Awesome! Hearty Congratulations to all of you for the first release of
Submarine as Apache TLP!
Kudos to all who helped in this release!

- Sunil

On Thu, Feb 6, 2020 at 4:36 PM Zhankun Tang  wrote:

> Hi folks,
>
> It's a great honor for me to announce that the Apache Submarine community
> has released Apache Submarine 0.3.0!
>
> Apache Submarine 0.3.0 is the first release after the spin-off from Apache
> Hadoop. It includes 196 patches since the prior version.
> The highlighted features are:
> - Mini-submarine (YARN)
> - Basic Tensorflow job submission to k8s through submarine-server RESTful
> API
> - Job submission on YARN through submarine-server RPC protocol
>
> Tons of thanks to our contributors and community! Let's keep fighting!
>
> *Apache Submarine 0.3.0 released*:
> http://submarine.apache.org/releases/submarine-release-0.3.0.html
> *Changelog*: https://s.apache.org/4ezw1
>
> BR,
> Zhankun
>

Re: [DISCUSS] Use hadoop 2.10 by default

[Sunil Govindan]

Thanks Folks.
I missed the thread. Apologies for this.
2.10.0 is not a stable release, do you see any problem @Wei-Chiu Chuang


- Sunil

On Wed, Mar 11, 2020 at 10:44 AM Wei-Chiu Chuang
 wrote:

> Thanks.
> Filed SUBMARINE-419 
> to
> get started.
>
> On Mon, Mar 9, 2020 at 7:30 PM Zac Zhou  wrote:
>
> > Wei-chiu Chuang
> > Thanks for this proposal, it looks good to me.
> >
> >
> > Wei-Chiu Chuang  于2020年3月10日周二 上午7:28写道：
> >
> > > Hello Submarine devs,
> > >
> > >
> > >1. SUBMARINE-399 <
> https://issues.apache.org/jira/browse/SUBMARINE-399
> > >
> > > added
> > >a profile to support Hadoop 2.10.
> > >2.
> > >3.
> > >
> > > One of the highlights in Hadoop 2.10 is the GPU scheduling support on
> > YARN.
> > > It makes the Submarine project much useful. What do you think of
> setting
> > > Hadoop 2.10 as the default profile?
> > >
> >
>

Re: [DISCUSS] Move commit activities to commits@

[Sunil Govindan]

+1. This absolutely makes sense.

Thanks
Sunil

On Wed, Mar 11, 2020 at 11:01 AM Wei-Chiu Chuang  wrote:

> Hi Submarine devs and users,
>
> The Apache Submarine projects has a commits@ mailing list (
> https://submarine.apache.org/community/contributors.html) but it is not
> being used:
> https://lists.apache.org/list.html?comm...@submarine.apache.org:2020:
>
> Instead, all the commit messages as well as Jira activity notifications
> are sent to dev@submarine.apache.org
>
> Other projects such as Hadoop, HBase, Kafka reserves dev@ mailing list
> for human generated discussions. Shall we follow the same?
>
> Best,
> Wei-Chiu
>

Re: [ANNOUNCE] Apache Submarine 0.4.0 release!

[Sunil Govindan]

Great to see 0.4.0 release out! Kudos to all who helped!

Thanks
Sunil

On Mon, Jul 6, 2020 at 3:35 PM Zhankun Tang  wrote:

> Really happy to see 0.4.0 released! Thanks for leading these efforts!
> Wanqiang!
>
> BR,
> Zhankun
>
> On Sun, 5 Jul 2020 at 18:45, Wanqiang Ji  wrote:
>
>> Hi forks,
>>
>> It's a great honor for me to announce that the Apache Submarine Community
>> has released Apache Submarine 0.4.0!
>>
>> Apache Submarine 0.4.0 is the second release after the spin-off from
>> Apache
>> Hadoop. It includes 175 patches since the prior version.
>> The highlighted features are:
>> - Submarine Experiments: Refactor the Job to experiment and redefined the
>> experiment spec
>> - Submarine Helm Charts: Provides one command to install the submarine
>> into the Kubernetes cluster
>> - PySubmarine: Submarine Python SDK
>>
>> Tons of thanks to our contributors and community! Let's keep fighting!
>>
>> *Apache Submarine 0.4.0 released*:
>> http://submarine.apache.org/releases/submarine-release-0.4.0.html
>> *Changelog*: https://s.apache.org/5barn
>>
>> BR,
>> Wanqiang Ji
>>
>>