[
https://issues.apache.org/jira/browse/SPARK-31172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064533#comment-17064533
]
Hyukjin Kwon commented on SPARK-31172:
--------------------------------------
[~jineshpatel], there are multiple JIRAs open relating to Big Endian. Can you
please search and link them?
> RecordBinaryComparator Tests failing on Big Endian Platform (s390x)
> -------------------------------------------------------------------
>
> Key: SPARK-31172
> URL: https://issues.apache.org/jira/browse/SPARK-31172
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.4.5
> Environment: Architecture: Big Endian s390x
> Operating Systems:
> * RHEL 7.x
> * RHEL 8.x
> * Ubuntu 16.04
> * Ubuntu 18.04
> * Ubuntu 19.10
> * SLES 12 SP4 and SLES 12 SP5
> * SLES 15 SP1
> Reporter: Jinesh Patel
> Priority: Minor
> Fix For: 3.0.0, 3.1.0, 2.4.6
>
>
> Failing Test Cases in the RecordBinaryComparatorSuite:
> * testBinaryComparatorWhenSubtractionIsDivisibleByMaxIntValue
> * testBinaryComparatorWhenSubtractionCanOverflowLongValue
> Test cases failed after the change related to:
> [Github Pull Request
> #26548|https://github.com/apache/spark/pull/26548#issuecomment-554645859]
> Test Case: testBinaryComparatorWhenSubtractionIsDivisibleByMaxIntValue
> * Fails due to changing the compare from `<` to `>` as the test condition
> (In little endian this is valid when the bytes are reversed, but not for big
> endian)
> Test Case:Â testBinaryComparatorWhenSubtractionCanOverflowLongValue
> * Fails due to using Long.compareUnsigned
> * Possible Fix: Use signed compare for big endian platforms.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
