Hi, After joining two dataframes, saving dataframe using Spark CSV. But all the result data is being written to only one part file whereas there are 200 part files being created, rest 199 part files are empty.
What is the cause of uneven partitioning ? How can I evenly distribute the data ? Would really appreciate the help. Thanks, Divya