[ https://issues.apache.org/jira/browse/SPARK-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15385984#comment-15385984 ]
Daniel Barclay commented on SPARK-16652: ---------------------------------------- More info.: Having the {{String}} member isn't necessary to trigger the bug. Maybe any kind of list fails: {{List\[Long]}}, {{List\[Int]}}, {{List\[Double]}}, {{List\[Any]}}, {{List\[AnyRef]}} and {{List\[String]}} all fail. > JVM crash from unsafe memory access for Dataset of class with List[Long] > ------------------------------------------------------------------------ > > Key: SPARK-16652 > URL: https://issues.apache.org/jira/browse/SPARK-16652 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 1.6.1, 1.6.2 > Environment: Scala 2.10.<various> > JDK: "Java HotSpot(TM) 64-Bit Server VM (build 25.74-b02, mixed mode)" > MacOs 10.11.2 > Reporter: Daniel Barclay > Attachments: UnsafeAccessCrashBugTest.scala > > > Generating and writing out a {{Dataset}} of a class that has a {{List}} (at > least if it's {{List\[Long]}}) member and a {{String}} member causes a JVM > crash. > The crash seems to be related to unsafe memory access especially because > earlier code (before I got it reduced to the current bug test case) reported > "{{java.lang.InternalError: a fault occurred in a recent unsafe memory access > operation in compiled Java code}}". -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org