Re: Deep learning libraries for scala

[Masood Krohy]

If you need ConvNets and RNNs and want to stay in Scala/Java, then Deep 
Learning for Java (DL4J) might be the most mature option.

If you want  ConvNets and RNNs, as implemented in TensorFlow, along with 
all the bells and whistles, then you might want to switch to PySpark + 
TensorFlow and write the entire pipeline in Python. You'd do the data 
preparation/ingestion in PySpark and pass the data to TensorFlow for the 
ML part. There are 2 supported modes here:
1) Simultaneous multi-model training (a.k.a. embarrassingly parallel: each 
node has the entire data and model):
https://databricks.com/blog/2016/01/25/deep-learning-with-apache-spark-and-tensorflow.html

2) Data parallelism (data is distributed, each node has the entire model): 

There are some prototypes out there and TensorSpark seems to be most 
mature: https://github.com/adatao/tensorspark
It implements Downpour/Asynchronous SGD for the distributed training; it 
remains to be stress-tested with large datasets, however.
More info: 
https://arimo.com/machine-learning/deep-learning/2016/arimo-distributed-tensorflow-on-spark/

TensorFrames does not allow distributed training and I did not see any 
performance benchmarks last time I checked.

Alexander Ulanov of HP made a presentation of the options few months ago:
https://www.oreilly.com/learning/distributed-deep-learning-on-spark

Masood


--
Masood Krohy, Ph.D.
Data Scientist, Intact Lab-R
Intact Financial Corporation




De :Benjamin Kim <bbuil...@gmail.com>
A : janardhan shetty <janardhan...@gmail.com>
Cc :Gourav Sengupta <gourav.sengu...@gmail.com>, user 
<user@spark.apache.org>
Date :  2016-11-01 13:14
Objet : Re: Deep learning libraries for scala



To add, I see that Databricks has been busy integrating deep learning more 
into their product and put out a new article about this.

https://databricks.com/blog/2016/10/27/gpu-acceleration-in-databricks.html

An interesting tidbit is at the bottom of the article mentioning 
TensorFrames.

https://github.com/databricks/tensorframes

Seems like an interesting direction…

Cheers,
Ben


On Oct 19, 2016, at 9:05 AM, janardhan shetty <janardhan...@gmail.com> 
wrote:

Agreed. But as it states deeper integration with (scala) is yet to be 
developed. 
Any thoughts on how to use tensorflow with scala ? Need to write wrappers 
I think. 

On Oct 19, 2016 7:56 AM, "Benjamin Kim" <bbuil...@gmail.com> wrote:
On that note, here is an article that Databricks made regarding using 
Tensorflow in conjunction with Spark.

https://databricks.com/blog/2016/01/25/deep-learning-with-apache-spark-and-tensorflow.html

Cheers,
Ben


On Oct 19, 2016, at 3:09 AM, Gourav Sengupta <gourav.sengu...@gmail.com> 
wrote:

while using Deep Learning you might want to stay as close to tensorflow as 
possible. There is very less translation loss, you get to access stable, 
scalable and tested libraries from the best brains in the industry and as 
far as Scala goes, it helps a lot to think about using the language as a 
tool to access algorithms in this instance unless you want to start 
developing algorithms from grounds up ( and in which case you might not 
require any libraries at all).

On Sat, Oct 1, 2016 at 3:30 AM, janardhan shetty <janardhan...@gmail.com> 
wrote:
Hi,

Are there any good libraries which can be used for scala deep learning 
models ?
How can we integrate tensorflow with scala ML ?

Re: Deep learning libraries for scala

[Benjamin Kim]

To add, I see that Databricks has been busy integrating deep learning more into 
their product and put out a new article about this.

https://databricks.com/blog/2016/10/27/gpu-acceleration-in-databricks.html 


An interesting tidbit is at the bottom of the article mentioning TensorFrames.

https://github.com/databricks/tensorframes 


Seems like an interesting direction…

Cheers,
Ben


> On Oct 19, 2016, at 9:05 AM, janardhan shetty  wrote:
> 
> Agreed. But as it states deeper integration with (scala) is yet to be 
> developed. 
> Any thoughts on how to use tensorflow with scala ? Need to write wrappers I 
> think.
> 
> 
> On Oct 19, 2016 7:56 AM, "Benjamin Kim"  > wrote:
> On that note, here is an article that Databricks made regarding using 
> Tensorflow in conjunction with Spark.
> 
> https://databricks.com/blog/2016/01/25/deep-learning-with-apache-spark-and-tensorflow.html
>  
> 
> 
> Cheers,
> Ben
> 
> 
>> On Oct 19, 2016, at 3:09 AM, Gourav Sengupta > > wrote:
>> 
>> while using Deep Learning you might want to stay as close to tensorflow as 
>> possible. There is very less translation loss, you get to access stable, 
>> scalable and tested libraries from the best brains in the industry and as 
>> far as Scala goes, it helps a lot to think about using the language as a 
>> tool to access algorithms in this instance unless you want to start 
>> developing algorithms from grounds up ( and in which case you might not 
>> require any libraries at all).
>> 
>> On Sat, Oct 1, 2016 at 3:30 AM, janardhan shetty > > wrote:
>> Hi,
>> 
>> Are there any good libraries which can be used for scala deep learning 
>> models ?
>> How can we integrate tensorflow with scala ML ?
>> 
> 

Re: Deep learning libraries for scala

[janardhan shetty]

Agreed. But as it states deeper integration with (scala) is yet to be
developed.
Any thoughts on how to use tensorflow with scala ? Need to write wrappers I
think.

On Oct 19, 2016 7:56 AM, "Benjamin Kim"  wrote:

> On that note, here is an article that Databricks made regarding using
> Tensorflow in conjunction with Spark.
>
> https://databricks.com/blog/2016/01/25/deep-learning-with-
> apache-spark-and-tensorflow.html
>
> Cheers,
> Ben
>
>
> On Oct 19, 2016, at 3:09 AM, Gourav Sengupta 
> wrote:
>
> while using Deep Learning you might want to stay as close to tensorflow as
> possible. There is very less translation loss, you get to access stable,
> scalable and tested libraries from the best brains in the industry and as
> far as Scala goes, it helps a lot to think about using the language as a
> tool to access algorithms in this instance unless you want to start
> developing algorithms from grounds up ( and in which case you might not
> require any libraries at all).
>
> On Sat, Oct 1, 2016 at 3:30 AM, janardhan shetty 
> wrote:
>
>> Hi,
>>
>> Are there any good libraries which can be used for scala deep learning
>> models ?
>> How can we integrate tensorflow with scala ML ?
>>
>
>
>

Re: Deep learning libraries for scala

[Benjamin Kim]

On that note, here is an article that Databricks made regarding using 
Tensorflow in conjunction with Spark.

https://databricks.com/blog/2016/01/25/deep-learning-with-apache-spark-and-tensorflow.html

Cheers,
Ben


> On Oct 19, 2016, at 3:09 AM, Gourav Sengupta  
> wrote:
> 
> while using Deep Learning you might want to stay as close to tensorflow as 
> possible. There is very less translation loss, you get to access stable, 
> scalable and tested libraries from the best brains in the industry and as far 
> as Scala goes, it helps a lot to think about using the language as a tool to 
> access algorithms in this instance unless you want to start developing 
> algorithms from grounds up ( and in which case you might not require any 
> libraries at all).
> 
> On Sat, Oct 1, 2016 at 3:30 AM, janardhan shetty  > wrote:
> Hi,
> 
> Are there any good libraries which can be used for scala deep learning models 
> ?
> How can we integrate tensorflow with scala ML ?
> 

Re: Deep learning libraries for scala

[Gourav Sengupta]

while using Deep Learning you might want to stay as close to tensorflow as
possible. There is very less translation loss, you get to access stable,
scalable and tested libraries from the best brains in the industry and as
far as Scala goes, it helps a lot to think about using the language as a
tool to access algorithms in this instance unless you want to start
developing algorithms from grounds up ( and in which case you might not
require any libraries at all).

On Sat, Oct 1, 2016 at 3:30 AM, janardhan shetty 
wrote:

> Hi,
>
> Are there any good libraries which can be used for scala deep learning
> models ?
> How can we integrate tensorflow with scala ML ?
>

Re: Deep learning libraries for scala

[Edward Fine]

How about https://deeplearning4j.org/ ?


On Wed, Oct 5, 2016 at 9:25 AM janardhan shetty 
wrote:

> Any help from the experts regarding this is appreciated
> On Oct 3, 2016 1:45 PM, "janardhan shetty"  wrote:
>
> Thanks Ben. The current spark ML package has feed forward multilayer
> perceptron algorithm as well and just wondering how different is your
> implementation ?
>
> https://spark.apache.org/docs/latest/ml-classification-regression.html#multilayer-perceptron-classifier
>
> On Mon, Oct 3, 2016 at 1:40 PM, Benjamin Kim  wrote:
>
> I got this email a while back in regards to this.
>
> Dear Spark users and developers,
>
> I have released version 1.0.0 of scalable-deeplearning package. This
> package is based on the implementation of artificial neural networks in
> Spark ML. It is intended for new Spark deep learning features that were not
> yet merged to Spark ML or that are too specific to be merged. The package
> provides ML pipeline API, distributed training, optimized numerical
> processing with tensor library, and extensible API for developers. Current
> features are the multilayer perceptron classifier and stacked autoencoder.
>
> As a Spark package:
> https://spark-packages.org/package/avulanov/scalable-deeplearning
>
> The source code: https://github.com/avulanov/scalable-deeplearning
>
> Contributions are very welcome! Please, let me know if you have any
> comment or questions.
>
>
> Hope this helps.
>
> Cheers,
> Ben
>
> On Oct 3, 2016, at 12:05 PM, janardhan shetty 
> wrote:
>
> Any leads in this regard ?
>
> On Sat, Oct 1, 2016 at 1:48 PM, janardhan shetty 
> wrote:
>
> Apparently there are no Neural network implementations in tensorframes
> which we can use right ? or Am I missing something here.
>
> I would like to apply neural networks for an NLP settting is there are any
> implementations which can be looked into ?
>
> On Fri, Sep 30, 2016 at 8:14 PM, Suresh Thalamati <
> suresh.thalam...@gmail.com> wrote:
>
> Tensor frames
>
> https://spark-packages.org/package/databricks/tensorframes
>
> Hope that helps
> -suresh
>
> On Sep 30, 2016, at 8:00 PM, janardhan shetty 
> wrote:
>
> Looking for scala dataframes in particular ?
>
> On Fri, Sep 30, 2016 at 7:46 PM, Gavin Yue  wrote:
>
> Skymind you could try. It is java
>
> I never test though.
>
> > On Sep 30, 2016, at 7:30 PM, janardhan shetty 
> wrote:
> >
> > Hi,
> >
> > Are there any good libraries which can be used for scala deep learning
> models ?
> > How can we integrate tensorflow with scala ML ?
>
>
>
>
>
>
>
>

Re: Deep learning libraries for scala

[janardhan shetty]

Apparently there are no Neural network implementations in tensorframes
which we can use right ? or Am I missing something here.

I would like to apply neural networks for an NLP settting is there are any
implementations which can be looked into ?

On Fri, Sep 30, 2016 at 8:14 PM, Suresh Thalamati <
suresh.thalam...@gmail.com> wrote:

> Tensor frames
>
> https://spark-packages.org/package/databricks/tensorframes
>
> Hope that helps
> -suresh
>
> On Sep 30, 2016, at 8:00 PM, janardhan shetty 
> wrote:
>
> Looking for scala dataframes in particular ?
>
> On Fri, Sep 30, 2016 at 7:46 PM, Gavin Yue  wrote:
>
>> Skymind you could try. It is java
>>
>> I never test though.
>>
>> > On Sep 30, 2016, at 7:30 PM, janardhan shetty 
>> wrote:
>> >
>> > Hi,
>> >
>> > Are there any good libraries which can be used for scala deep learning
>> models ?
>> > How can we integrate tensorflow with scala ML ?
>>
>
>
>

Re: Deep learning libraries for scala

[Suresh Thalamati]

Tensor frames

https://spark-packages.org/package/databricks/tensorframes 


Hope that helps
-suresh

> On Sep 30, 2016, at 8:00 PM, janardhan shetty  wrote:
> 
> Looking for scala dataframes in particular ?
> 
> On Fri, Sep 30, 2016 at 7:46 PM, Gavin Yue  > wrote:
> Skymind you could try. It is java
> 
> I never test though.
> 
> > On Sep 30, 2016, at 7:30 PM, janardhan shetty  > > wrote:
> >
> > Hi,
> >
> > Are there any good libraries which can be used for scala deep learning 
> > models ?
> > How can we integrate tensorflow with scala ML ?
> 

Re: Deep learning libraries for scala

[janardhan shetty]

Looking for scala dataframes in particular ?

On Fri, Sep 30, 2016 at 7:46 PM, Gavin Yue  wrote:

> Skymind you could try. It is java
>
> I never test though.
>
> > On Sep 30, 2016, at 7:30 PM, janardhan shetty 
> wrote:
> >
> > Hi,
> >
> > Are there any good libraries which can be used for scala deep learning
> models ?
> > How can we integrate tensorflow with scala ML ?
>

Re: Deep learning libraries for scala

[Gavin Yue]

Skymind you could try. It is java 

I never test though. 

> On Sep 30, 2016, at 7:30 PM, janardhan shetty  wrote:
> 
> Hi,
> 
> Are there any good libraries which can be used for scala deep learning models 
> ?
> How can we integrate tensorflow with scala ML ?

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Deep learning libraries for scala

[janardhan shetty]

Hi,

Are there any good libraries which can be used for scala deep learning
models ?
How can we integrate tensorflow with scala ML ?