Re: .NET on Apache Spark?

2015-07-05 Thread Ruslan Dautkhanov
Scala used to run on .NET http://www.scala-lang.org/old/node/10299 -- Ruslan Dautkhanov On Thu, Jul 2, 2015 at 1:26 PM, pedro ski.rodrig...@gmail.com wrote: You might try using .pipe() and installing your .NET program as a binary across the cluster (or using addFile). Its not ideal to pipe

RE: .NET on Apache Spark?

2015-07-05 Thread Ashic Mahtab
. Date: Sun, 5 Jul 2015 11:05:30 -0600 Subject: Re: .NET on Apache Spark? From: dautkha...@gmail.com To: ski.rodrig...@gmail.com CC: user@spark.apache.org Scala used to run on .NEThttp://www.scala-lang.org/old/node/10299 -- Ruslan Dautkhanov On Thu, Jul 2, 2015 at 1:26 PM, pedro ski.rodrig

Re: .NET on Apache Spark?

2015-07-05 Thread Jörn Franke
Ironpython shares with python only the syntax - at best. It is a scripting language within the .NET framework. Many applications have this for scripting the application itself. This won't work for you. You can use pipes or write your spark jobs in java/scala/r and submit them via your .NET

Re: .NET on Apache Spark?

2015-07-05 Thread Silvio Fiorito
between spark and .NET. However, given your requirements, mbrace might be something that you might find useful. -Ashic. Date: Sun, 5 Jul 2015 11:05:30 -0600 Subject: Re: .NET on Apache Spark? From: dautkha...@gmail.com To: ski.rodrig...@gmail.com CC: user

Re: .NET on Apache Spark?

2015-07-02 Thread Daniel Darabos
Indeed Spark does not have .NET bindings. On Thu, Jul 2, 2015 at 10:33 AM, Zwits daniel.van...@ortec-finance.com wrote: I'm currently looking into a way to run a program/code (DAG) written in .NET on a cluster using Spark. However I ran into problems concerning the coding language, Spark has

RE: .NET on Apache Spark?

2015-07-02 Thread Silvio Fiorito
Since Spark runs on the JVM, no there isn't support for .Net. You should take a look at Dryad and Naiad instead. https://github.com/MicrosoftResearch/ From: Zwitsmailto:daniel.van...@ortec-finance.com Sent: ‎7/‎2/‎2015 4:33 AM To: