I just moved all of the non-Storm-dev addresses on this thread to bcc. If anybody is not on the Storm dev list and would like to continue to follow this conversation, you should subscribe to the storm dev list. We should not be spamming everybody else.
There is a standard Apache process to deal with this. JStorm can become an incubator project. Once JStorm demonstrates the ability to function as an Apache project, it can graduate either to a top-level project or to become part of a project like Storm. A second mechanism is that if the Storm group is interested, they can directly adopt the code as it is, possibly asking one or more of the contributors to become committers to help support this new code. That is a much harder thing to do than incubation since it is unusual for a project to be enthusiastic about supporting a large new codebase. On Thu, Oct 23, 2014 at 8:19 PM, 刘键(夏蒅) <basti...@alibaba-inc.com> wrote: > Hi Andy, > > > > Thanks for your quick response. What you concern is reasonable and > understandable. > > > > But maybe there is some misunderstanding on our proposal. According to the > current development situation in China, java core is indeed to bring more > contributors here. > > That is reason why we begin to think if it is also a way for us to provide > our contribution to Storm project. It is true that it is a risk to switch > the core in a short period. > > Actually, if possible, maybe we can consider to take JStorm as a > subproject of Storm(A branch or some other ways…). We will be responsible > for the maintain of it and try to propagate the features from Storm to > JStorm, and continue to develop our features and improvements on this. You > guys can try the new core and take a long time to estimate if it is worth > doing the switch in the future or taking JStorm as official optional core > of Storm for user. > > > > Regards > > Basti > > > > *发件人:* Andrew Feng [mailto:af...@yahoo-inc.com <af...@yahoo-inc.com>] > *发送时间:* 2014年10月24日 0:24 > *收件人:* 封仲淹(纪君祥); nat...@nathanmarz.com; 徐明明(护城); ja...@cvk.ca; > f...@infochimps.com; david...@microsoft.com; ptgo...@gmail.com; > cutt...@apache.org; tdunn...@maprtech.com; arv...@apache.org; > d...@hortonworks.com; m.ben.frank...@gmail.com; benjamin.hind...@gmail.com > *抄送:* aloha-dev; scott.z...@vipshop.com; yannia...@tencent.com; > mlc...@iflytek.com; z...@tencent.com > *主题:* Re: 答复: Could JStorm project collaborate with Storm? > > > > Zhongyan: > > > > Yahoo almost took your path 2 years ago. After some discussion with > Nathan, we decided to work with community on Storm, and some of us learned > Clojure quickly. We are very glad that we did that. > > > > Under the assumption that Storm provides all features of JStorm, my > personal vote will be NO for your proposal. > > - Storm has enjoyed its current success before Nathan built a very > solid core in Clojure. We should not replace that core until we are 100% > sure that alternative implementation is at least as good as our Clojure > implementation. > - Clojure has not prevent Storm attract contributors (currently 108). > We have contributors who write code in Clojure and Java. It doesn’t take > much time for one to be able to understand Clojure code. > - The convergence of streaming processing and batch processing will > occur at higher level of abstractions. Trident API, for example, is very > much similar to batch API such as Pig or Cascading. > - Including Jstorm under Storm will only create confusion to our user > community at this stage. > > > > Why don’t you have discussion with 徐明明 to figure out an alternative path > for JStorm? > > > > Thanks, > > > > Andy > > > > *From: *"封仲淹 (纪君祥)" <zhongyan.f...@alibaba-inc.com> > *Reply-To: *"封仲淹(纪君祥)" <zhongyan.f...@alibaba-inc.com> > *Date: *Wednesday, October 22, 2014 at 11:37 PM > *To: *Andy Feng <af...@yahoo-inc.com>, "nat...@nathanmarz.com" < > nat...@nathanmarz.com>, "徐明明(护城)" <mingming.x...@alibaba-inc.com>, " > ja...@cvk.ca" <ja...@cvk.ca>, "f...@infochimps.com" <f...@infochimps.com>, > "david...@microsoft.com" <david...@microsoft.com>, "ptgo...@gmail.com" < > ptgo...@gmail.com>, Doug Cutting <cutt...@apache.org>, " > tdunn...@maprtech.com" <tdunn...@maprtech.com>, "arv...@apache.org" < > arv...@apache.org>, "d...@hortonworks.com" <d...@hortonworks.com>, " > m.ben.frank...@gmail.com" <m.ben.frank...@gmail.com>, " > benjamin.hind...@gmail.com" <benjamin.hind...@gmail.com> > *Cc: *aloha-dev <aloha-...@list.alibaba-inc.com>, "scott.z...@vipshop.com" > <scott.z...@vipshop.com>, "yannia...@tencent.com" <yannia...@tencent.com>, > "mlc...@iflytek.com" <mlc...@iflytek.com>, "z...@tencent.com" < > z...@tencent.com> > *Subject: *答复: Could JStorm project collaborate with Storm? > > > > Andrew, Thanks for suggest. > > > > The problem is that the core of Storm is implemented by Clojure, if it is > java, we are glad to merge all our commit into the Strom Trunk. > > If the core of Storm is implemented by Java, I think the contributor of > Storm would be double. > > > > > > May I put forward 2 proposal: > > 1. Could Jstorm be the son project of Storm? > > 2. Task a long time to change Storm-core as Jstorm-core. > > a) If the core of Storm is implemented by Java, I think the > contributor of Storm would be double. Once one user found one bug, maybe he > is able to fix it by himself, in this method, Storm resolve problem will be > double > > b) In the next one or two years, batch handling and stream handling > will merge into one solution, Spark/Flink are doing this job. If we still > use clojure, I am a little afraid that we can’t follow the steps of other > community and this direction. > > > > > > Thanks > > Longda > > > > *发件人:* Andrew Feng [mailto:af...@yahoo-inc.com <af...@yahoo-inc.com>] > *发送时间:* 2014年10月23日 13:31 > *收件人:* 封仲淹(纪君祥); nat...@nathanmarz.com; 徐明明(护城); ja...@cvk.ca; > f...@infochimps.com; david...@microsoft.com; ptgo...@gmail.com; > cutt...@apache.org; tdunn...@maprtech.com; arv...@apache.org; > d...@hortonworks.com; m.ben.frank...@gmail.com; benjamin.hind...@gmail.com > *抄送:* aloha-dev; scott.z...@vipshop.com; yannia...@tencent.com; > mlc...@iflytek.com; z...@tencent.com > *主题:* Re: Could JStorm project collaborate with Storm? > > > > Zhongyan: > > > > I would suggest you identify a collection of key features in Jstorm, and > then propose pull requests to Storm. > > Once these pull requests are accepted, you could then simply adopt Storm. > > > > Andy > > > > *From: *"封仲淹 (纪君祥)" <zhongyan.f...@alibaba-inc.com> > *Reply-To: *"封仲淹(纪君祥)" <zhongyan.f...@alibaba-inc.com> > *Date: *Wednesday, October 22, 2014 at 8:23 PM > *To: *"nat...@nathanmarz.com" <nat...@nathanmarz.com>, "徐明明(护城)" < > mingming.x...@alibaba-inc.com>, "ja...@cvk.ca" <ja...@cvk.ca>, Andy Feng < > af...@yahoo-inc.com>, "f...@infochimps.com" <f...@infochimps.com>, " > david...@microsoft.com" <david...@microsoft.com>, "ptgo...@gmail.com" < > ptgo...@gmail.com>, Doug Cutting <cutt...@apache.org>, " > tdunn...@maprtech.com" <tdunn...@maprtech.com>, "arv...@apache.org" < > arv...@apache.org>, "d...@hortonworks.com" <d...@hortonworks.com>, " > m.ben.frank...@gmail.com" <m.ben.frank...@gmail.com>, " > benjamin.hind...@gmail.com" <benjamin.hind...@gmail.com> > *Cc: *aloha-dev <aloha-...@list.alibaba-inc.com>, "scott.z...@vipshop.com" > <scott.z...@vipshop.com>, "yannia...@tencent.com" <yannia...@tencent.com>, > "mlc...@iflytek.com" <mlc...@iflytek.com>, "z...@tencent.com" < > z...@tencent.com> > *Subject: *Could JStorm project collaborate with Storm? > > > > Hi all, > > > > Firstly, congratulate Storm becoming the top project of Apache. Since the > first day of Storm opened source, it has become one of hottest technologies > in the BigData field and brought a new perspective to the world, which has > helped many companies resolve hundreds of requirements. > > > > Since 2012/4, we have forked a project named "JStorm". At the beginning > time, we just wanted to implement Storm with Java. As time goes on, more > and more features have been added to JStorm. In 2013/9, JStorm changed to > be an open source project; from then on, more and more people and companies > join this project. > > > > As JStorm is derived from Storm, and born in a great company named > Alibaba, which just successfully listed on the New York Stock Exchange on > Sept. 19, is a very open company. We also want to share our technology with > more people, and favor rapid evolution of streaming technology. > > > > *So, could JStorm project collaborate with Storm? * > > > > A little introduction for JStorm as follows: > > JStorm is a distributed and fault-tolerant real-time computation system. > Inspired by Apache Storm, JStorm has been completely rewritten in Java and > provides more enhanced features. JStorm has been widely used in many > enterprise environments and proved robust and stable. > > > > Begun from 2012/2, we have released 11 versions till 2014/09/28. More than > 10 companies are using it, including several leading companies such as > Alibaba, Tencent, Baidu, Huawei, ZTE in China. > > > > Please refer to https://github.com/alibaba/jstorm for more details > > > > > > Regards > > Longda >
