Most likely your JSON files are not formatted correctly. Please see the
Spark doc on specific formatting requirement for JSON data.
https://spark.apache.org/docs/latest/sql-data-sources-json.html.
On 4/26/22 10:43 AM, Sid wrote:
Hello,
Can somebody help me with the below problem?
https://stackoverflow.com/questions/72015557/dealing-with-large-number-of-small-json-files-using-pyspark
Thanks,
Sid
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
