[ https://issues.apache.org/jira/browse/SPARK-17490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15479418#comment-15479418 ]
Apache Spark commented on SPARK-17490: -------------------------------------- User 'kiszk' has created a pull request for this issue: https://github.com/apache/spark/pull/15044 > Optimize SerializeFromObject for primitive array > ------------------------------------------------ > > Key: SPARK-17490 > URL: https://issues.apache.org/jira/browse/SPARK-17490 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 2.0.0 > Reporter: Kazuaki Ishizaki > > In logical plan, {{SerializeFromObject}} for an array always use > {{GenericArrayData}} as a destination. {{UnsafeArrayData}} could be used for > an primitive array. This is a simple approach to solve issues that are > addressed by SPARK-16043. > Here is a motivating example. > {code} > sparkContext.parallelize(Seq(Array(1)), 1).toDS.map(e => e).show > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org