Kazuaki Ishizaki created SPARK-17490: ----------------------------------------
Summary: Optimize SerializeFromObject for primitive array Key: SPARK-17490 URL: https://issues.apache.org/jira/browse/SPARK-17490 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 2.0.0 Reporter: Kazuaki Ishizaki In logical plan, {{SerializeFromObject}} for an array always use {{GenericArrayData}} as a destination. {{UnsafeArrayData}} could be used for an primitive array. This is a simple approach to solve issues that are addressed by SPARK-16043. Here is a motivating example. {code} sparkContext.parallelize(Seq(Array(1)), 1).toDS.map(e => e).show {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org