Davies Liu created SPARK-11737: ---------------------------------- Summary: String may not be serialized correctly with Kyro Key: SPARK-11737 URL: https://issues.apache.org/jira/browse/SPARK-11737 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 1.5.1, 1.6.0 Reporter: Davies Liu Assignee: Davies Liu Priority: Critical
When run in cluster mode, the driver may have different memory (and configs) than executor, also if Kyro is used, then string can not be collected back to driver: {code} >>> sqlContext.range(10).selectExpr("repeat(cast(id as string), 9)").show() +----------------------------+ |repeat(cast(id as string),9)| +----------------------------+ | 0| | 1| | 2| | 3| | 4| | 5| | 6| | 7| | 8| | 9| +----------------------------+ {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org