Hi, I am writing a pyspark streaming job in which i am returning a pandas data frame as DStream. Now I wanted to save this DStream dataframe to parquet file. How to do that?
I am trying to convert it to spark data frame but I am getting multiple errors. Please suggest me how to do that. Regards, Yogesh