toDF() works very well -- thanks
On Sun, Mar 15, 2015 at 6:12 AM, David Mitchell
wrote:
>
> Thank you for your help. "toDF()" solved my first problem. And, the
> second issue was a non-issue, since the second example worked without any
> modification.
>
> David
>
>
> On Sun, Mar 15, 2015 at 1:
Thank you for your help. "toDF()" solved my first problem. And, the
second issue was a non-issue, since the second example worked without any
modification.
David
On Sun, Mar 15, 2015 at 1:37 AM, Rishi Yadav wrote:
> programmatically specifying Schema needs
>
> import org.apache.spark.sql.ty
programmatically specifying Schema needs
import org.apache.spark.sql.type._
for StructType and StructField to resolve.
On Sat, Mar 14, 2015 at 10:07 AM, Sean Owen wrote:
> Yes I think this was already just fixed by:
>
> https://github.com/apache/spark/pull/4977
>
> a ".toDF()" is missing
>
>
Yes I think this was already just fixed by:
https://github.com/apache/spark/pull/4977
a ".toDF()" is missing
On Sat, Mar 14, 2015 at 4:16 PM, Nick Pentreath
wrote:
> I've found people.toDF gives you a data frame (roughly equivalent to the
> previous Row RDD),
>
> And you can then call registerT
I've found people.toDF gives you a data frame (roughly equivalent to the
previous Row RDD),
And you can then call registerTempTable on that DataFrame.
So people.toDF.registerTempTable("people") should work
—
Sent from Mailbox
On Sat, Mar 14, 2015 at 5:33 PM, David Mitchell
wrote
I am pleased with the release of the DataFrame API. However, I started
playing with it, and neither of the two main examples in the documentation
work: http://spark.apache.org/docs/1.3.0/sql-programming-guide.html
Specfically:
- Inferring the Schema Using Reflection
- Programmatically Spec
