I think you need to consider using something like this:
http://sparklingpandas.com/
On Tue, Feb 16, 2016 at 10:59 AM, Devesh Raj Singh
wrote:
> Hi,
>
> I want to read a spark dataframe using python and then convert the spark
> dataframe to pandas dataframe then convert the pandas dataframe back
Hi,
I want to read a spark dataframe using python and then convert the spark
dataframe to pandas dataframe then convert the pandas dataframe back to
spark dataframe ( after doing some data analysis) . Please suggest.
--
Warm regards,
Devesh.
