Re: Use cases around image/video processing in spark

2016-08-10 Thread Benjamin Fradet
Hi, Check out the the thunder project On Wed, Aug 10, 2016 at 5:20 PM, Deepak Sharma wrote: > Hi > If anyone is using or knows about github repo that can help me get started > with image and video processing using spark. > The

Re: ml ALS.fit(..) issue

2016-07-22 Thread Benjamin Fradet
Seems like there is an incompatibility regarding scala versions between your program and the scala version Spark was compiled against. Either you're using scala 2.11 and your spark installation was built using 2.10 or the other way around. On Fri, Jul 22, 2016 at 11:06 PM, Pedro Rodriguez

Re: Spark Streaming KafkaUtils missing Save API?

2016-01-15 Thread Benjamin Fradet
There was a PR regarding this which was closed but the author of the PR created a spark-package: https://github.com/cloudera/spark-kafka-writer. I don't know exactly why it was decided not be incorporated into spark however. On 15 Jan 2016 8:04 p.m., "Renyi Xiong" wrote:

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

2015-12-22 Thread Benjamin Fradet
+1 On 22 Dec 2015 9:54 p.m., "Andrew Or" wrote: > +1 > > 2015-12-22 12:43 GMT-08:00 Reynold Xin : > >> +1 >> >> >> On Tue, Dec 22, 2015 at 12:29 PM, Michael Armbrust < >> mich...@databricks.com> wrote: >> >>> I'll kick the voting off with a +1. >>> >>>

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

2015-12-12 Thread Benjamin Fradet
-1 For me the docs are not displaying except for the first page, for example http://people.apache.org/~pwendell/spark-releases/spark-1.6.0-rc2-docs/mllib-guide.html is a blank page. This is because of SPARK-12199 : Element[W|w]iseProductExample.scala

[ML] Missing documentation for the IndexToString feature transformer

2015-12-05 Thread Benjamin Fradet
Hi, I was wondering why the IndexToString label transformer was not documented in ml-features.md . If it's not

Re: Grid search with Random Forest

2015-11-30 Thread Benjamin Fradet
Hi Ndjido, This is because GBTClassifier doesn't yet have a rawPredictionCol like the. RandomForestClassifier has. Cf: http://spark.apache.org/docs/latest/ml-ensembles.html#output-columns-predictions-1 On 1 Dec 2015 3:57 a.m., "Ndjido Ardo BAR" wrote: > Hi Joseph, > > Yes

Re: Unhandled case in VectorAssembler

2015-11-21 Thread Benjamin Fradet
Will do, thanks for your input. On 21 Nov 2015 2:42 a.m., "Joseph Bradley" wrote: > Yes, please, could you send a JIRA (and PR)? A custom error message would > be better. > Thank you! > Joseph > > On Fri, Nov 20, 2015 at 2:39 PM, BenFradet >