[ https://issues.apache.org/jira/browse/SPARK-16815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15736804#comment-15736804 ]
Michal Šenkýř commented on SPARK-16815: --------------------------------------- I made a PR that should fix this issue [#16240|https://github.com/apache/spark/pull/16240] > Dataset[List[T]] leads to ArrayStoreException > --------------------------------------------- > > Key: SPARK-16815 > URL: https://issues.apache.org/jira/browse/SPARK-16815 > Project: Spark > Issue Type: Bug > Components: SQL > Reporter: TobiasP > Priority: Minor > > {noformat} > scala> spark.sqlContext.createDataset(sc.parallelize(List(1) :: Nil)).collect > java.lang.ArrayStoreException: scala.collection.mutable.WrappedArray$ofRef > > at > scala.collection.mutable.ArrayBuilder$ofRef.$plus$eq(ArrayBuilder.scala:87) > at > scala.collection.mutable.ArrayBuilder$ofRef.$plus$eq(ArrayBuilder.scala:56) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) > at > scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) > at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186) > at scala.collection.TraversableLike$class.map(TraversableLike.scala:234) > at scala.collection.mutable.ArrayOps$ofRef.map(ArrayOps.scala:186) > at > org.apache.spark.sql.Dataset$$anonfun$org$apache$spark$sql$Dataset$$execute$1$1.apply(Dataset.scala:2218) > at > org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:57) > at org.apache.spark.sql.Dataset.withNewExecutionId(Dataset.scala:2568) > at > org.apache.spark.sql.Dataset.org$apache$spark$sql$Dataset$$execute$1(Dataset.scala:2217) > at > org.apache.spark.sql.Dataset$$anonfun$org$apache$spark$sql$Dataset$$collect$1.apply(Dataset.scala:2222) > at > org.apache.spark.sql.Dataset$$anonfun$org$apache$spark$sql$Dataset$$collect$1.apply(Dataset.scala:2222) > at org.apache.spark.sql.Dataset.withCallback(Dataset.scala:2581) > at > org.apache.spark.sql.Dataset.org$apache$spark$sql$Dataset$$collect(Dataset.scala:2222) > at org.apache.spark.sql.Dataset.collect(Dataset.scala:2198) > ... 48 elided > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org