Re: Implementation of RNN/LSTM in Spark

2017-02-28 Thread Liang-Chi Hsieh
Yeah, I'd agree with Nick. To have an implementation of RNN/LSTM in Spark, you may need a comprehensive abstraction of neural networks which is general enough to represent the computation (think of Torch, Keras, Tensorflow, MXNet, Caffe, etc.), and modify current computation engine to work

Re: Implementation of RNN/LSTM in Spark

2017-02-28 Thread Michael Allman
also support a "sequential trainer" which allows you to train a model on > Spark dataframes. > > Kind regards, > > Joeri > . > From: Nick Pentreath [nick.pentre...@gmail.com > <mailto:nick.pentre...@gmail.com>] > Sent: 23 February 20

Re: Implementation of RNN/LSTM in Spark

2017-02-27 Thread Yuhao Yang
k Pentreath [nick.pentre...@gmail.com] > Sent: 23 February 2017 13:39 > To: dev@spark.apache.org > Subject: Re: Implementation of RNN/LSTM in Spark > > The short answer is there is none and highly unlikely to be inside of > Spark MLlib any time in the near future. > > The best

RE: Implementation of RNN/LSTM in Spark

2017-02-23 Thread Joeri Hermans
ick.pentre...@gmail.com] Sent: 23 February 2017 13:39 To: dev@spark.apache.org Subject: Re: Implementation of RNN/LSTM in Spark The short answer is there is none and highly unlikely to be inside of Spark MLlib any time in the near future. The best bets are to look at other DL libraries

Re: Implementation of RNN/LSTM in Spark

2017-02-23 Thread Nick Pentreath
us about RNNs in Spark is? > > > > -- > View this message in context: > http://apache-spark-developers-list.1001551.n3.nabble.com/Implementation-of-RNN-LSTM-in-Spark-tp14866p21060.html > Sent from the Apache Spark Developer

Re: Implementation of RNN/LSTM in Spark

2017-02-23 Thread n1kt0
Hi, can anyone tell me what the current status about RNNs in Spark is? -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Implementation-of-RNN-LSTM-in-Spark-tp14866p21060.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com

Re: Implementation of RNN/LSTM in Spark

2015-11-03 Thread Disha Shrivastava
Hi Julio, Can you please cite references based on the distributed implementation? On Tue, Nov 3, 2015 at 8:52 PM, Julio Antonio Soto de Vicente < ju...@esbet.es> wrote: > Hi, > Is my understanding that little research has been done yet on distributed > computation (without access to shared

Re: Implementation of RNN/LSTM in Spark

2015-11-01 Thread Sasaki Kai
Hi, Disha There seems to be no JIRA on RNN/LSTM directly. But there were several tickets about other type of networks regarding deep learning. Stacked Auto Encoder https://issues.apache.org/jira/browse/SPARK-2623 CNN

Implementation of RNN/LSTM in Spark

2015-11-01 Thread Disha Shrivastava
Hi, I wanted to know if someone is working on implementing RNN/LSTM in Spark or has already done. I am also willing to contribute to it and get some guidance on how to go about it. Thanks and Regards Disha Masters Student, IIT Delhi