Unhandled case in VectorAssembler

2015-11-20 Thread BenFradet
Hey there, I noticed that there is an unhandled case in the transform method of VectorAssembler if one of the input columns doesn't have one of the supported type DoubleType, NumericType, BooleanType or VectorUDT. So, if you try to transform a column of StringType you get a cryptic "scala.MatchEr

Re: New Kafka producer API

2015-05-05 Thread BenFradet
Yes that might be true, I will have to test that. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/New-Kafka-producer-API-tp12050p12058.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

Re: New Kafka producer API

2015-05-05 Thread BenFradet
Even if it's only used for testing and the examples, why not move ahead of the deprecation and gain some performance along the way. Plus, regarding the examples, I think it's good practice to use the recommended API and not the legacy one. -- View this message in context: http://apache-spark-d

New Kafka producer API

2015-05-05 Thread BenFradet
Hi, Since we're now supporting Kafka 0.8.2.1 , and that there is a new Producer API with this version, I was wondering if we should convert to this new API in KafkaTestUtils