Pete Robbins created SPARK-14848: ------------------------------------ Summary: DatasetSuite - Java encoder fails on Big Endian platforms Key: SPARK-14848 URL: https://issues.apache.org/jira/browse/SPARK-14848 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 2.0.0 Reporter: Pete Robbins
Since this PR https://github.com/apache/spark/pull/10703 for https://issues.apache.org/jira/browse/SPARK-12756 the "Java encoder" test in DatasetSuite has been failing on big endian platforms: - Java encoder *** FAILED *** Array((JavaData(2),1), (JavaData(1),1)) did not equal List((JavaData(1),1), (JavaData(2),1)) (DatasetSuite.scala:478) I note that the code for the "Kyro encoder" test was changed in the PR to use toSet and compare results against a Set to stop it failing in the same way whereas the Java encoder test still uses toSeq. Is it that the order is not guaranteed (but happens to be in the expected order on little endian) and this is a test issue? -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org