subject:"help coercing types"

Re: help coercing types

2016-03-19 Thread Jacek Laskowski

Hi, Just a side question: why do you convert DataFrame to RDD? It's like driving backwards (possible but ineffective and dangerous at times) P. S. I'd even go for Dataset. Jacek 18.03.2016 5:20 PM "Bauer, Robert" napisał(a): > I have data that I pull in using a sql

help coercing types

2016-03-19 Thread Bauer, Robert

I have data that I pull in using a sql context and then I convert to an rdd. The problem is that the type in the rdd is [Any, Iterable[Any]] And I need to have the type RDD[Array[String]] -- convert the Iterable to an Array. Here’s more detail: val zdata = sqlContext.read.parquet("s3://..