Kontinuation commented on issue #860: URL: https://github.com/apache/sedona/issues/860#issuecomment-1590237483
I believe it is not caused by malformed CSV files. Apache Sedona does not have proper handling for escape sequences in CSV, which caused this problem. I've opened a ticket for switching to a fully functioning CSV parser for RDD API. For now, you can read the data files using Spark SQL and then convert the DataFrame to RDD using the adapter API as a workaround: ```python ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
