王俊博 created SPARK-47707: --------------------------- Summary: Special handling of JSON type for MySQL connector Key: SPARK-47707 URL: https://issues.apache.org/jira/browse/SPARK-47707 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 3.4.0 Environment: mysql-connector-java-5.1.49.jar
spark-3.5.0 Reporter: 王俊博 MySQL JDBC drivers `mysql-connector-java-5.1.49.jar` converts JSON type into Types.CHAR with a precision of Int.Max. When receiving CHAR with Int.Max precision, Spark executor will throw an error of {{java.lang.OutOfMemoryError: Requested array size exceeds VM limit }}. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org