[ https://issues.apache.org/jira/browse/SPARK-4761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Wendell updated SPARK-4761: ----------------------------------- Fix Version/s: 1.2.0 > With JDBC server, set Kryo as default serializer and disable reference > tracking > ------------------------------------------------------------------------------- > > Key: SPARK-4761 > URL: https://issues.apache.org/jira/browse/SPARK-4761 > Project: Spark > Issue Type: Bug > Reporter: Patrick Wendell > Assignee: Cheng Lian > Priority: Blocker > Fix For: 1.2.0 > > > I saw some regression in 1.2 Spark SQL due to our broadcast change which > requires significantly more serialization. It would be good if when the JDBC > server is running it automatically sets the serializer to Kryo and disables > Kryo reference tracking. > Doing this while still honoring a user-provided serializer is tricky. I think > the best way is to expose an internal (private) constructor to SparkConf that > takes a set of lowest-precedence defaults. Those could get merged in with the > lowest precedence before the config file is read. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org