Spark_sql

Hi Everyone, I have a use case where I have to create a DataFrame inside the map() function. To create a DataFrame it need sqlContext or hiveContext. Now how do I pass the context to my map function ? And I am doing it in java. I tried creating a class "TestClass" which implements "Function

Re: Spark_sql

I don't think passing sqlContext to map() is supported. Can you describe your use case in more detail ? Why do you need to create a DataFrame inside the map() function ? Cheers On Wed, Oct 21, 2015 at 6:32 PM, Ajay Chander wrote: > Hi Everyone, > > I have a use case where