Hi I am a teacher at Southeast University (https://www.seu.edu.cn/). We are a major in electrical engineering. Our teaching teams and students use bigoop submarine for big data analysis and automation control of electrical equipment.
Many thanks to the hadoop community for providing us with machine learning tools like submarine. I wish hadoop submarine is getting better and better. ============================== 赵欣 东南大学电气工程学院 ----------------------------------------------------- Zhao XIN School of Electrical Engineering ============================== 2019-07-22 From: Xun Liu Date: 2019-07-22 16:06 To: 赵欣; adam.antal CC: common-dev; yarn-dev; hdfs-dev; mapreduce-dev; submarine-dev; user Subject: Re: Any thoughts making Submarine a separate Apache project? @adam.antal The submarine development team has completed the following preparations: 1. Established a temporary test repository on Github. 2. Change the package name of hadoop submarine from org.hadoop.submarine to org.submarine 3. Combine the Linkedin/TonY code into the Hadoop submarine module; 4. On the Github docked travis-ci system, all test cases have been tested; 5. Several Hadoop submarine users completed the system test using the code in this repository. 赵欣 <xinz...@seu.edu.cn> 于2019年7月22日周一 上午9:38写道： Hi I am a teacher at Southeast University (https://www.seu.edu.cn/). We are a major in electrical engineering. Our teaching teams and students use bigoop submarine for big data analysis and automation control of electrical equipment. Many thanks to the hadoop community for providing us with machine learning tools like submarine. I wish hadoop submarine is getting better and better. ============================== 赵欣 东南大学电气工程学院 ----------------------------------------------------- Zhao XIN School of Electrical Engineering ============================== 2019-07-18 From: Xun Liu Date: 2019-07-18 09:46 To: xinzhao Subject: Fwd: Re: Any thoughts making Submarine a separate Apache project? ---------- Forwarded message --------- 发件人： dashuiguailu...@gmail.com <dashuiguailu...@gmail.com> Date: 2019年7月17日周三 下午3:17 Subject: Re: Re: Any thoughts making Submarine a separate Apache project? To: Szilard Nemeth <snem...@cloudera.com.invalid>, runlin zhang <runlin...@gmail.com> Cc: Xun Liu <liu...@apache.org>, common-dev <common-...@hadoop.apache.org>, yarn-dev <yarn-...@hadoop.apache.org>, hdfs-dev <hdfs-...@hadoop.apache.org>, mapreduce-dev <mapreduce-...@hadoop.apache.org>, submarine-dev <submarine-...@hadoop.apache.org> +1 ，Good idea, we are very much looking forward to it. dashuiguailu...@gmail.com From: Szilard Nemeth Date: 2019-07-17 14:55 To: runlin zhang CC: Xun Liu; Hadoop Common; yarn-dev; Hdfs-dev; mapreduce-dev; submarine-dev Subject: Re: Any thoughts making Submarine a separate Apache project? +1, this is a very great idea. As Hadoop repository has already grown huge and contains many projects, I think in general it's a good idea to separate projects in the early phase. On Wed, Jul 17, 2019, 08:50 runlin zhang <runlin...@gmail.com> wrote: > +1 ，That will be great ！ > > > 在 2019年7月10日，下午3:34，Xun Liu <liu...@apache.org> 写道： > > > > Hi all, > > > > This is Xun Liu contributing to the Submarine project for deep learning > > workloads running with big data workloads together on Hadoop clusters. > > > > There are a bunch of integrations of Submarine to other projects are > > finished or going on, such as Apache Zeppelin, TonY, Azkaban. The next > step > > of Submarine is going to integrate with more projects like Apache Arrow, > > Redis, MLflow, etc. & be able to handle end-to-end machine learning use > > cases like model serving, notebook management, advanced training > > optimizations (like auto parameter tuning, memory cache optimizations for > > large datasets for training, etc.), and make it run on other platforms > like > > Kubernetes or natively on Cloud. LinkedIn also wants to donate TonY > project > > to Apache so we can put Submarine and TonY together to the same codebase > > (Page #30. > > > https://www.slideshare.net/xkrogen/hadoop-meetup-jan-2019-tony-tensorflow-on-yarn-and-beyond#30 > > ). > > > > This expands the scope of the original Submarine project in exciting new > > ways. Toward that end, would it make sense to create a separate Submarine > > project at Apache? This can make faster adoption of Submarine, and allow > > Submarine to grow to a full-blown machine learning platform. > > > > There will be lots of technical details to work out, but any initial > > thoughts on this? > > > > Best Regards, > > Xun Liu > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > >
