Martin Grund created SPARK-40854: ------------------------------------ Summary: Change default serialization from 'broken' CSV to Spark DF JSON Key: SPARK-40854 URL: https://issues.apache.org/jira/browse/SPARK-40854 Project: Spark Issue Type: Sub-task Components: Connect Affects Versions: 3.4.0 Reporter: Martin Grund
Currently, Spark Connect uses a mediocre version of CSV serialization for the results from the server side without proper batching. We should at least migrate to the existing Spark DF JSON serialization and batch the results. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org