Re: Using Sqark SQL mapping over an RDD

2015-10-08 Thread Michael Armbrust
You can't do nested operations on RDDs or DataFrames (i.e. you can't create a DataFrame from within a map function). Perhaps if you explain what you are trying to accomplish someone can suggest another way. On Thu, Oct 8, 2015 at 10:10 AM, Afshartous, Nick wrote: > >

RE: Using Sqark SQL mapping over an RDD

2015-10-08 Thread Afshartous, Nick
08, 2015 1:16 PM To: Afshartous, Nick Cc: user@spark.apache.org Subject: Re: Using Sqark SQL mapping over an RDD You can't do nested operations on RDDs or DataFrames (i.e. you can't create a DataFrame from within a map function). Perhaps if you explain what you are trying to accomplish someone can

Re: Using Sqark SQL mapping over an RDD

2015-10-08 Thread Michael Armbrust
m: Michael Armbrust [mich...@databricks.com] > Sent: Thursday, October 08, 2015 1:16 PM > To: Afshartous, Nick > Cc: user@spark.apache.org > Subject: Re: Using Sqark SQL mapping over an RDD > > You can't do nested operations on RDDs or DataFrames (i.e. you can't > create a DataF