[jira] [Created] (ARROW-17369) [CI][Java] Automatically extract dependent library versions from pom.xml for s390x
Kazuaki Ishizaki created ARROW-17369:
Summary: [CI][Java] Automatically extract dependent library
versions from pom.xml for s390x
Key: ARROW-17369
URL: https://issues.apache.org/jira/browse/ARROW-17369
Project: Apache Arrow
Issue Type: Improvement
Components: Java
Affects Versions: 10.0.0
Reporter: Kazuaki Ishizaki
Current script {{java_build.sh }}requires a manual update for dependent library
versions.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (ARROW-17112) [Jafva] TestArrowReaderWriter.testFileFooterSizeOverflow causes a failure on s390x
Kazuaki Ishizaki created ARROW-17112:
Summary: [Jafva] TestArrowReaderWriter.testFileFooterSizeOverflow
causes a failure on s390x
Key: ARROW-17112
URL: https://issues.apache.org/jira/browse/ARROW-17112
Project: Apache Arrow
Issue Type: Bug
Components: Java
Affects Versions: 9.0.0
Reporter: Kazuaki Ishizaki
On big-endian plantform such as s390x,
{{TestArrowReaderWriter.testFileFooterSizeOverflow}} causes a failure.
{code}
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] TestArrowReaderWriter.testFileFooterSizeOverflow:913
expected:<...alid footer length: [2147483647]> but was:<...alid footer length:
[-129]>
[INFO]
[ERROR] Tests run: 610, Failures: 1, Errors: 0, Skipped: 4
[INFO]
[INFO]
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Arrow Java Root POM 9.0.0-SNAPSHOT .. SUCCESS [ 2.182 s]
[INFO] Arrow Format ... SUCCESS [ 0.995 s]
[INFO] Arrow Memory ... SUCCESS [ 0.761 s]
[INFO] Arrow Memory - Core SUCCESS [ 1.582 s]
[INFO] Arrow Memory - Unsafe .. SUCCESS [ 1.600 s]
[INFO] Arrow Memory - Netty ... SUCCESS [ 1.966 s]
[INFO] Arrow Vectors .. FAILURE [ 16.779 s]
[INFO] Arrow Compression .. SKIPPED
[INFO] Arrow Tools SKIPPED
[INFO] Arrow JDBC Adapter . SKIPPED
[INFO] Arrow Plasma Client SUCCESS [ 1.171 s]
[INFO] Arrow Flight ... SUCCESS [ 0.741 s]
[INFO] Arrow Flight Core .. SKIPPED
[INFO] Arrow Flight GRPC .. SKIPPED
[INFO] Arrow Flight SQL ... SKIPPED
[INFO] Arrow Flight Integration Tests . SKIPPED
[INFO] Arrow AVRO Adapter . SKIPPED
[INFO] Arrow Algorithms ... SKIPPED
[INFO] Arrow Performance Benchmarks 9.0.0-SNAPSHOT SKIPPED
[INFO]
[INFO] BUILD FAILURE
[INFO]
[INFO] Total time: 23.584 s (Wall Clock)
[INFO] Finished at: 2022-07-18T12:32:21Z
[INFO]
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M3:test (default-test) on
project arrow-vector: There are test failures.
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (ARROW-17101) [Java] Prepare new protoc-gen-grpc-java for s390x
Kazuaki Ishizaki created ARROW-17101: Summary: [Java] Prepare new protoc-gen-grpc-java for s390x Key: ARROW-17101 URL: https://issues.apache.org/jira/browse/ARROW-17101 Project: Apache Arrow Issue Type: Improvement Components: Java Affects Versions: 9.0.0 Reporter: Kazuaki Ishizaki Recent s390x build for Java causes [failures|https://app.travis-ci.com/github/apache/arrow/jobs/576822591#L2933] due to missing relevant version of protoc-gen-grpc-java. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (ARROW-14686) [Python] Current endian decision for numpy does not work for built-in data type.
Kazuaki Ishizaki created ARROW-14686: Summary: [Python] Current endian decision for numpy does not work for built-in data type. Key: ARROW-14686 URL: https://issues.apache.org/jira/browse/ARROW-14686 Project: Apache Arrow Issue Type: Improvement Components: Python Affects Versions: 7.0.0 Reporter: Kazuaki Ishizaki Assignee: Kazuaki Ishizaki Fix For: 7.0.0 Although the current NumPy converter code tries to detect endian against a given object, it does not work for a built-in object. This is because a build-in object may have `native |` byte order. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (ARROW-14685) [Python] Test case hard-codes endian information
Kazuaki Ishizaki created ARROW-14685:
Summary: [Python] Test case hard-codes endian information
Key: ARROW-14685
URL: https://issues.apache.org/jira/browse/ARROW-14685
Project: Apache Arrow
Issue Type: Test
Components: Python
Affects Versions: 7.0.0
Reporter: Kazuaki Ishizaki
Assignee: Kazuaki Ishizaki
Fix For: 7.0.0
The current test case causes a failure on big-endian platform since the endian
information `>` is hard-coded.
{{FAILED pyarrow/tests/test_pandas.py::test_timestamp_as_object_out_of_range -
AssertionError: assert (dtype('O'), dtype('>M8[ns]')) == (dtype('O'),
dtype('
[jira] [Created] (ARROW-14625) [Python][CI] Enable CI for Python on s390x
Kazuaki Ishizaki created ARROW-14625: Summary: [Python][CI] Enable CI for Python on s390x Key: ARROW-14625 URL: https://issues.apache.org/jira/browse/ARROW-14625 Project: Apache Arrow Issue Type: Test Components: Python Affects Versions: 7.0.0 Reporter: Kazuaki Ishizaki Assignee: Kazuaki Ishizaki We will support big-endian for Python. As the first step, we will enable Python CI on s390x using TravisCI. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (ARROW-13047) [Website] Add kiszk to committer list
Kazuaki Ishizaki created ARROW-13047: Summary: [Website] Add kiszk to committer list Key: ARROW-13047 URL: https://issues.apache.org/jira/browse/ARROW-13047 Project: Apache Arrow Issue Type: Improvement Reporter: Kazuaki Ishizaki Assignee: Kazuaki Ishizaki Fix For: 5.0.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-12419) [Java] flatc is not used in mvn
Kazuaki Ishizaki created ARROW-12419: Summary: [Java] flatc is not used in mvn Key: ARROW-12419 URL: https://issues.apache.org/jira/browse/ARROW-12419 Project: Apache Arrow Issue Type: Improvement Components: Java Affects Versions: 4.0.0 Reporter: Kazuaki Ishizaki Assignee: Kazuaki Ishizaki ARROW-12111 removed the usage of flatc during the build process in mvn. Thus, it is not necessary to explicitly download flatc for s390x. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-12330) [Developer] Restore values in counters column of Archery benchmark
Kazuaki Ishizaki created ARROW-12330:
Summary: [Developer] Restore values in counters column of Archery
benchmark
Key: ARROW-12330
URL: https://issues.apache.org/jira/browse/ARROW-12330
Project: Apache Arrow
Issue Type: Bug
Components: Developer Tools
Affects Versions: 3.0.0
Reporter: Kazuaki Ishizaki
Fix For: 4.0.0
The issue is that ARROW-11189 always suppressed values in {{counters}} column
of Archery benchmark
{code}
% archery benchmark run --benchmark-filter="SetBitsTo" --output=head2.json HEAD
HEAD~1
...
---
Benchmark Time CPU Iterations UserCounters...
---
SetBitsTo/28.15 ns 8.15 ns 81991087
bytes_per_second=234.044M/s
SetBitsTo/16 7.78 ns 7.78 ns 89928878
bytes_per_second=1.91429G/s
SetBitsTo/1024 13.9 ns 13.9 ns 50372172
bytes_per_second=68.6182G/s
SetBitsTo/131072 3508 ns 3508 ns 199335
bytes_per_second=34.7944G/s
--
Non-regressions: (4)
--
benchmark baselinecontender change % counters
SetBitsTo/161.877 GiB/sec1.914 GiB/sec 1.975 {}
SetBitsTo/2 230.566 MiB/sec 234.044 MiB/sec 1.509 {}
SetBitsTo/131072 34.722 GiB/sec 34.794 GiB/sec 0.207 {}
SetBitsTo/1024 68.593 GiB/sec 68.618 GiB/sec 0.037 {}
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-10860) [Java] Avoid integer overflow for Json file reader
Kazuaki Ishizaki created ARROW-10860:
Summary: [Java] Avoid integer overflow for Json file reader
Key: ARROW-10860
URL: https://issues.apache.org/jira/browse/ARROW-10860
Project: Apache Arrow
Issue Type: Bug
Components: Java
Affects Versions: 3.0.0
Reporter: Kazuaki Ishizaki
This issue is similar to https://issues.apache.org/jira/browse/ARROW-10662.
For the current implementation in the templates, {{int * int}} multiplication
is used to calculate buffer offset. The result may be larger than
Integer.MAX_VALUE, which will lead to integer overflow and unexpected behaviors.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-10621) [Java] flight-cpre test causes a failure on s390x
Kazuaki Ishizaki created ARROW-10621:
Summary: [Java] flight-cpre test causes a failure on s390x
Key: ARROW-10621
URL: https://issues.apache.org/jira/browse/ARROW-10621
Project: Apache Arrow
Issue Type: Bug
Components: Java
Affects Versions: 3.0.0
Reporter: Kazuaki Ishizaki
Java flight-core test on s390x causes a failure as follows:
{code:java}
[INFO] ---
[INFO] T E S T S
[INFO] ---
[INFO]
[INFO] --- protobuf-maven-plugin:0.5.0:compile (src) @ flight-core ---
[INFO] Compiling 1 proto file(s) to
/arrow/java/flight/flight-core/target/generated-sources/protobuf
[ERROR] PROTOC FAILED:
/arrow/java/flight/flight-core/target/protoc-plugins/protoc-3.7.1-linux-s390_64.exe:
error while loading shared libraries: libprotoc.so.18: cannot open shared
object file: No such file or directory
[ERROR] /arrow/java/flight/flight-core/../../../format/Flight.proto [0:0]:
/arrow/java/flight/flight-core/target/protoc-plugins/protoc-3.7.1-linux-s390_64.exe:
error while loading shared libraries: libprotoc.so.18: cannot open shared
object file: No such file or directory
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-10610) [C++] arrow-utility-test and arrow-csv-test causes failures on a big-endian platform
Kazuaki Ishizaki created ARROW-10610:
Summary: [C++] arrow-utility-test and arrow-csv-test causes
failures on a big-endian platform
Key: ARROW-10610
URL: https://issues.apache.org/jira/browse/ARROW-10610
Project: Apache Arrow
Issue Type: Bug
Components: C++
Affects Versions: 3.0.0
Reporter: Kazuaki Ishizaki
After [https://github.com/apache/arrow/pull/8494] has been merged, the
following tests, which use {{1eN}} format, cause failures.
{code}
[ RUN ] FloatingPointConversion.Basics
/arrow/cpp/src/arrow/testing/gtest_util.cc:128: Failure
Failed
@@ -1, +1 @@
--1e+30
+0
[ FAILED ] FloatingPointConversion.Basics (3 ms)
...
[ RUN ] StringConversion.ToFloat
/arrow/cpp/src/arrow/util/value_parsing_test.cc:35: Failure
Expected equality of these values:
out
Which is: 0
expected
Which is: -1e+20
Conversion failed for '-1e20'
[ FAILED ] StringConversion.ToFloat (0 ms)
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-10384) [c++] Fix typos and spelling
Kazuaki Ishizaki created ARROW-10384:
Summary: [c++] Fix typos and spelling
Key: ARROW-10384
URL: https://issues.apache.org/jira/browse/ARROW-10384
Project: Apache Arrow
Issue Type: Improvement
Components: C++
Affects Versions: 3.0.0
Reporter: Kazuaki Ishizaki
Fix typo under {{cpp}} directory
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-10383) [docs] Fix typos and spelling
Kazuaki Ishizaki created ARROW-10383:
Summary: [docs] Fix typos and spelling
Key: ARROW-10383
URL: https://issues.apache.org/jira/browse/ARROW-10383
Project: Apache Arrow
Issue Type: Improvement
Components: Documentation
Affects Versions: 3.0.0
Reporter: Kazuaki Ishizaki
Fix typo under {{docs}} directory
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-10382) [rust] Fix typos and spelling
Kazuaki Ishizaki created ARROW-10382:
Summary: [rust] Fix typos and spelling
Key: ARROW-10382
URL: https://issues.apache.org/jira/browse/ARROW-10382
Project: Apache Arrow
Issue Type: Improvement
Components: Rust
Affects Versions: 3.0.0
Reporter: Kazuaki Ishizaki
Fix typo under {{rust}} directory
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-10200) [Java][CI] Fix failure of Java CI on s390x
Kazuaki Ishizaki created ARROW-10200:
Summary: [Java][CI] Fix failure of Java CI on s390x
Key: ARROW-10200
URL: https://issues.apache.org/jira/browse/ARROW-10200
Project: Apache Arrow
Issue Type: Bug
Affects Versions: 2.0.0
Reporter: Kazuaki Ishizaki
ARROW-9701 causes the following failure due to missing a library
{{libprotobuf.so.18}}.
{code:java}
...
[ERROR] PROTOC FAILED:
/arrow/java/flight/flight-core/target/protoc-plugins/protoc-3.7.1-linux-s390_64.exe:
error while loading shared libraries: libprotobuf.so.18: cannot open shared
object file: No such file or directory
[ERROR] /arrow/java/flight/flight-core/../../../format/Flight.proto [0:0]:
/arrow/java/flight/flight-core/target/protoc-plugins/protoc-3.7.1-linux-s390_64.exe:
error while loading shared libraries: libprotobuf.so.18: cannot open shared
object file: No such file or directory
...
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-10031) Support Java benchmark in Ursabot
Kazuaki Ishizaki created ARROW-10031: Summary: Support Java benchmark in Ursabot Key: ARROW-10031 URL: https://issues.apache.org/jira/browse/ARROW-10031 Project: Apache Arrow Issue Type: New Feature Components: CI, Java Affects Versions: 2.0.0 Reporter: Kazuaki Ishizaki Assignee: Kazuaki Ishizaki Based on [the suggestion|https://mail-archives.apache.org/mod_mbox/arrow-dev/202008.mbox/%3ccabnn7+q35j7qwshjbx8omdewkt+f1p_m7r1_f6szs4dqc+l...@mail.gmail.com%3e], Ursabot will support Java benchmarks. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-9862) Throw an exception in UnsafeDirectLittleEndian on Big-Endian platform
Kazuaki Ishizaki created ARROW-9862:
---
Summary: Throw an exception in UnsafeDirectLittleEndian on
Big-Endian platform
Key: ARROW-9862
URL: https://issues.apache.org/jira/browse/ARROW-9862
Project: Apache Arrow
Issue Type: Improvement
Components: Java
Affects Versions: 2.0.0
Reporter: Kazuaki Ishizaki
The current code throws an intended exception on a big-endian platform while
this class supports native endianness for the primitive data types (up to
64-bit).
{code:java}
throw new IllegalStateException("Arrow only runs on LittleEndian systems.");
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-9861) [Java] Failed Arrow Vector on big-endian platform
Kazuaki Ishizaki created ARROW-9861:
---
Summary: [Java] Failed Arrow Vector on big-endian platform
Key: ARROW-9861
URL: https://issues.apache.org/jira/browse/ARROW-9861
Project: Apache Arrow
Issue Type: Improvement
Components: Java
Affects Versions: 2.0.0
Reporter: Kazuaki Ishizaki
The following test failure occurs on a big-endian platform
{code:java}
mvn -B -Drat.skip=true
-Dorg.slf4j.simpleLogger.log.org.apache.maven.cli.transfer.Slf4jMavenTransferListener=warn
-Dflatc.download.skip=true -rf :arrow-vector test
...
[INFO] Running org.apache.arrow.vector.TestDecimalVector
[ERROR] Tests run: 9, Failures: 3, Errors: 0, Skipped: 0, Time elapsed: 0.008 s
<<< FAILURE! - in org.apache.arrow.vector.TestDecimalVector
[ERROR] setUsingArrowBufOfLEInts Time elapsed: 0.001 s <<< FAILURE!
java.lang.AssertionError: expected:<705.32> but was:<-20791293.44>
at
org.apache.arrow.vector.TestDecimalVector.setUsingArrowBufOfLEInts(TestDecimalVector.java:295)
[ERROR] setUsingArrowLongLEBytes Time elapsed: 0.001 s <<< FAILURE!
java.lang.AssertionError: expected:<9223372036854775807> but was:<-129>
at
org.apache.arrow.vector.TestDecimalVector.setUsingArrowLongLEBytes(TestDecimalVector.java:322)
[ERROR] testLongReadWrite Time elapsed: 0.001 s <<< FAILURE!
java.lang.AssertionError: expected:<-2> but was:<-72057594037927937>
at
org.apache.arrow.vector.TestDecimalVector.testLongReadWrite(TestDecimalVector.java:176)
...
[ERROR] Failures:
[ERROR] TestDecimalVector.setUsingArrowBufOfLEInts:295 expected:<705.32> but
was:<-20791293.44>
[ERROR] TestDecimalVector.setUsingArrowLongLEBytes:322
expected:<9223372036854775807> but was:<-129>
[ERROR] TestDecimalVector.testLongReadWrite:176 expected:<-2> but
was:<-72057594037927937>
...
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-9709) [Java] Test cases in arrow-vector assume little-endian platform
Kazuaki Ishizaki created ARROW-9709:
---
Summary: [Java] Test cases in arrow-vector assume little-endian
platform
Key: ARROW-9709
URL: https://issues.apache.org/jira/browse/ARROW-9709
Project: Apache Arrow
Issue Type: Improvement
Affects Versions: 2.0.0
Reporter: Kazuaki Ishizaki
Assignee: Kazuaki Ishizaki
{{MessageSerializerTest.testWriteMessageBufferAligned}},
{{TestArrowReaderWriter.testChannelReadFully}} and
{{TestArrowReaderWriter.testChannelReadFullyEos}} assume only a little-endian
platform.
Two tests in {{TestArrowReaderWriter}} fails on a big-endian platform.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-9706) [Java] Tests in TestLargeListVector fails on big endian platform
Kazuaki Ishizaki created ARROW-9706:
---
Summary: [Java] Tests in TestLargeListVector fails on big endian
platform
Key: ARROW-9706
URL: https://issues.apache.org/jira/browse/ARROW-9706
Project: Apache Arrow
Issue Type: Improvement
Components: Java
Affects Versions: 2.0.0
Reporter: Kazuaki Ishizaki
Assignee: Kazuaki Ishizaki
Multiple test cases (e.g. {{testSetLastSetUsage}}) in {{TestLargeListVector}}
fail on a big-endian platform.
This is because these test cases read offset as integer while the width of the
offset is 8-byte. This means that only the first 4-byte are read. It works only
for a little-endian platform.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-9704) [Java] TestEndianness.testLittleEndian fails on big endian platform
Kazuaki Ishizaki created ARROW-9704:
---
Summary: [Java] TestEndianness.testLittleEndian fails on big
endian platform
Key: ARROW-9704
URL: https://issues.apache.org/jira/browse/ARROW-9704
Project: Apache Arrow
Issue Type: Improvement
Components: Java
Reporter: Kazuaki Ishizaki
Assignee: Kazuaki Ishizaki
Fix For: 2.0.0
{{TestEndianness.testLittleEndian}} assumes that the data layout of int is
little-endian. Thus, this test fails on a big-endian platform.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-9701) [Java][CI] Add a test job on s390x
Kazuaki Ishizaki created ARROW-9701: --- Summary: [Java][CI] Add a test job on s390x Key: ARROW-9701 URL: https://issues.apache.org/jira/browse/ARROW-9701 Project: Apache Arrow Issue Type: Improvement Affects Versions: 2.0.0 Reporter: Kazuaki Ishizaki Assignee: Kazuaki Ishizaki -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-9681) [Java] Failed Arrow Memory - Core on big-endian platform
Kazuaki Ishizaki created ARROW-9681:
---
Summary: [Java] Failed Arrow Memory - Core on big-endian platform
Key: ARROW-9681
URL: https://issues.apache.org/jira/browse/ARROW-9681
Project: Apache Arrow
Issue Type: Improvement
Components: Java
Affects Versions: 2.0.0
Reporter: Kazuaki Ishizaki
The following error occurs on a big-endian platform.
{code:java}
% mvn -B -Drat.skip=true
-Dorg.slf4j.simpleLogger.log.org.apache.maven.cli.transfer.Slf4jMavenTransferListener=warn
-Dflatc.download.skip=true -rf :arrow-memory-core test% mvn -B -Drat.skip=true
-Dorg.slf4j.simpleLogger.log.org.apache.maven.cli.transfer.Slf4jMavenTransferListener=warn
-Dflatc.download.skip=true -rf :arrow-memory-core test...[INFO]
---[INFO] T E S T S[INFO]
---[INFO] Running
org.apache.arrow.memory.TestBoundaryChecking[INFO] Tests run: 4, Failures: 0,
Errors: 0, Skipped: 0, Time elapsed: 0.003 s - in
org.apache.arrow.memory.TestBoundaryChecking[INFO] Running
org.apache.arrow.memory.TestAllocationManager[INFO] Tests run: 1, Failures: 0,
Errors: 0, Skipped: 0, Time elapsed: 0.02 s - in
org.apache.arrow.memory.TestAllocationManager[INFO] Running
org.apache.arrow.memory.TestArrowBuf13:50:53.066 [main] INFO
org.apache.arrow.memory.BaseAllocator - Debug mode enabled.13:50:53.068 [main]
INFO org.apache.arrow.memory.DefaultAllocationManagerOption - allocation
manager type not specified, using netty as the default type13:50:53.069 [main]
INFO org.apache.arrow.memory.CheckAllocator - Using DefaultAllocationManager at
memory/memory-core/target/test-classes/org/apache/arrow/memory/DefaultAllocationManagerFactory.class13:50:53.071
[main] DEBUG org.apache.arrow.memory.util.MemoryUtil - Constructor for direct
buffer found and made accessible13:50:53.071 [main] DEBUG
org.apache.arrow.memory.util.MemoryUtil - direct buffer constructor:
available13:50:53.073 [main] DEBUG
org.apache.arrow.memory.rounding.DefaultRoundingPolicy -
-Dorg.apache.memory.allocator.pageSize: 819213:50:53.073 [main] DEBUG
org.apache.arrow.memory.rounding.DefaultRoundingPolicy -
-Dorg.apache.memory.allocator.maxOrder: 1113:50:53.075 [main] DEBUG
org.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].13:50:53.076
[main] DEBUG org.apache.arrow.memory.BaseAllocator - closed
allocator[ROOT].13:50:53.077 [main] DEBUG org.apache.arrow.memory.BaseAllocator
- closed allocator[ROOT].13:50:53.082 [main] DEBUG
org.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].13:50:53.083
[main] DEBUG org.apache.arrow.memory.BaseAllocator - closed
allocator[ROOT].[ERROR] Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time
elapsed: 0.017 s <<< FAILURE! - in org.apache.arrow.memory.TestArrowBuf[ERROR]
testSetBytesBigEndian Time elapsed: 0.004 s <<<
FAILURE!org.junit.internal.ArrayComparisonFailure: arrays first differed at
element [0]; expected:<0> but was:<7> at
org.apache.arrow.memory.TestArrowBuf.testSetBytesBigEndian(TestArrowBuf.java:145)Caused
by: java.lang.AssertionError: expected:<0> but was:<7> at
org.apache.arrow.memory.TestArrowBuf.testSetBytesBigEndian(TestArrowBuf.java:145)
[INFO] Running org.apache.arrow.memory.TestLowCostIdentityHashMap[INFO] Tests
run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s - in
org.apache.arrow.memory.TestLowCostIdentityHashMap[INFO] Running
org.apache.arrow.memory.TestAccountant[INFO] Tests run: 3, Failures: 0, Errors:
0, Skipped: 0, Time elapsed: 0.045 s - in
org.apache.arrow.memory.TestAccountant[INFO] Running
org.apache.arrow.memory.util.TestArrowBufPointer13:50:53.133 [main] DEBUG
org.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].13:50:53.134
[main] DEBUG org.apache.arrow.memory.BaseAllocator - closed
allocator[ROOT].13:50:53.135 [main] DEBUG org.apache.arrow.memory.BaseAllocator
- closed allocator[ROOT].13:50:53.136 [main] DEBUG
org.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].13:50:53.136
[main] DEBUG org.apache.arrow.memory.BaseAllocator - closed
allocator[ROOT].13:50:53.138 [main] DEBUG org.apache.arrow.memory.BaseAllocator
- closed allocator[ROOT].[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped:
0, Time elapsed: 0.005 s - in
org.apache.arrow.memory.util.TestArrowBufPointer[INFO] Running
org.apache.arrow.memory.util.hash.TestArrowBufHasher13:50:53.139 [main] DEBUG
org.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].13:50:53.141
[main] DEBUG org.apache.arrow.memory.ArrowBuf - event log for: ArrowBuf[21]
5531898924530725 create() at
org.apache.arrow.memory.util.StackTrace.(StackTrace.java:34) at
org.apache.arrow.memory.util.HistoricalLog$Event.(HistoricalLog.java:175)
at
org.apache.arrow.memory.util.HistoricalLog.recordEvent(HistoricalLog.java:83)
at org.apache.arrow.memory.
[jira] [Created] (ARROW-9417) [C++][IPC] size in message written in native endian
Kazuaki Ishizaki created ARROW-9417:
---
Summary: [C++][IPC] size in message written in native endian
Key: ARROW-9417
URL: https://issues.apache.org/jira/browse/ARROW-9417
Project: Apache Arrow
Issue Type: Test
Components: C++
Reporter: Kazuaki Ishizaki
According to [this
specification|https://github.com/apache/arrow/blob/master/docs/source/format/Columnar.rst],
{{metadata length}} and {{footer size}} should be written in little endian
However, the current implementation writes them in native endian.
On little-endian
{code}
: 41 52 52 4f 57 31 00 00 ff ff ff ff 88 07 00 00 10 00 00 00 00 00 0a
00 0e 00 06 00 05 00 08 00 ARROW1..
...
5700: 62 6f 6f 6c 5f 6e 75 6c 6c 61 62 6c 65 00 00 00 d0 07 00 00 41 52 52
4f 57 31bool_nullable...ARROW1
{code}
On big-endian
{code}
: 41 52 52 4f 57 31 00 00 ff ff ff ff 00 00 07 90 10 00 00 00 00 00 0a
00 0e 00 06 00 05 00 08 00 ARROW1..
~~~
...
5700: 04 00 00 00 0d 00 00 00 62 6f 6f 6c 5f 6e 75 6c 6c 61 62 6c 65 00 00
00 00 00 07 d0 41 52 52 4f bool_nullable...ARRO
~~~
5720: 57 31
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-9238) [C++][CI] A few test coverages of round-robin in ipc and flight
Kazuaki Ishizaki created ARROW-9238: --- Summary: [C++][CI] A few test coverages of round-robin in ipc and flight Key: ARROW-9238 URL: https://issues.apache.org/jira/browse/ARROW-9238 Project: Apache Arrow Issue Type: Test Components: C++, CI, FlightRPC Reporter: Kazuaki Ishizaki The current round-robin tests under ipc and flight cover only a few types (e.g. int32 and dictionary). -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (ARROW-8981) [C++][Dataset] Add support for compressed FileSources
[ https://issues.apache.org/jira/browse/ARROW-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki reassigned ARROW-8981: --- Assignee: Kazuaki Ishizaki > [C++][Dataset] Add support for compressed FileSources > - > > Key: ARROW-8981 > URL: https://issues.apache.org/jira/browse/ARROW-8981 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Affects Versions: 0.17.1 >Reporter: Ben Kietzman >Assignee: Kazuaki Ishizaki >Priority: Major > Labels: dataset > Fix For: 1.0.0 > > > FileSource::compression_ is currently ignored. Ideally files/buffers which > are compressed could be decompressed on read. See ARROW-8942 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (ARROW-8981) [C++][Dataset] Add support for compressed FileSources
[ https://issues.apache.org/jira/browse/ARROW-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki reassigned ARROW-8981: --- Assignee: (was: Kazuaki Ishizaki) > [C++][Dataset] Add support for compressed FileSources > - > > Key: ARROW-8981 > URL: https://issues.apache.org/jira/browse/ARROW-8981 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Affects Versions: 0.17.1 >Reporter: Ben Kietzman >Priority: Major > Labels: dataset > Fix For: 1.0.0 > > > FileSource::compression_ is currently ignored. Ideally files/buffers which > are compressed could be decompressed on read. See ARROW-8942 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (ARROW-8982) [CI] Remove allow_failures for s390x in TravisCI
[
https://issues.apache.org/jira/browse/ARROW-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki reassigned ARROW-8982:
---
Assignee: Kazuaki Ishizaki
> [CI] Remove allow_failures for s390x in TravisCI
>
>
> Key: ARROW-8982
> URL: https://issues.apache.org/jira/browse/ARROW-8982
> Project: Apache Arrow
> Issue Type: Bug
> Components: CI
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Major
>
> Now, all of existing tests except Parquet pass on s390x. It is good time to
> remove {{allow_failures}} for s390x on TravisCI.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-8982) [CI] Remove allow_failures for s390x in TravisCI
Kazuaki Ishizaki created ARROW-8982:
---
Summary: [CI] Remove allow_failures for s390x in TravisCI
Key: ARROW-8982
URL: https://issues.apache.org/jira/browse/ARROW-8982
Project: Apache Arrow
Issue Type: Bug
Components: CI
Reporter: Kazuaki Ishizaki
Now, all of existing tests except Parquet pass on s390x. It is good time to
remove {{allow_failures}} for s390x on TravisCI.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-8968) [c++][gandiva] Show link warning message on s390x
Kazuaki Ishizaki created ARROW-8968:
---
Summary: [c++][gandiva] Show link warning message on s390x
Key: ARROW-8968
URL: https://issues.apache.org/jira/browse/ARROW-8968
Project: Apache Arrow
Issue Type: Bug
Reporter: Kazuaki Ishizaki
When execute gandiva test, the warning message is shown as follows
{code}
~/arrow/cpp/src/gandiva$ ../../build/debug/gandiva-binary-test -V
Running main() from
/home/ishizaki/arrow/cpp/googletest_ep-prefix/src/googletest_ep/googletest/src/gtest_main.cc
[==] Running 1 test from 1 test case.
[--] Global test environment set-up.
[--] 1 test from TestBinary
[ RUN ] TestBinary.TestSimple
warning: Linking two modules of different data layouts: 'precompiled' is
'E-m:e-i1:8:16-i8:8:16-i64:64-f128:64-a:8:16-n32:64' whereas 'codegen' is
'E-m:e-i1:8:16-i8:8:16-i64:64-f128:64-v128:64-a:8:16-n32:64'
[ OK ] TestBinary.TestSimple (41 ms)
[--] 1 test from TestBinary (41 ms total)
[--] Global test environment tear-down
[==] 1 test from 1 test case ran. (41 ms total)
[ PASSED ] 1 test.
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (ARROW-8930) [C++] libz.so linking error with liborc.a
[
https://issues.apache.org/jira/browse/ARROW-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17115934#comment-17115934
]
Kazuaki Ishizaki commented on ARROW-8930:
-
[https://github.com/apache/arrow/pull/7266] can also resolve this issue.
> [C++] libz.so linking error with liborc.a
> -
>
> Key: ARROW-8930
> URL: https://issues.apache.org/jira/browse/ARROW-8930
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, Continuous Integration
>Reporter: Wes McKinney
>Priority: Major
> Fix For: 1.0.0
>
>
> This is failing in the Travis CI ARM build
> https://travis-ci.org/github/apache/arrow/jobs/690722203
> {code}
> : && /usr/bin/ccache /usr/bin/c++ -Wno-noexcept-type
> -fdiagnostics-color=always -ggdb -O0 -Wall -Wno-conversion
> -Wno-sign-conversion -Wno-unused-variable -Werror -march=armv8-a -g
> -rdynamic
> src/arrow/adapters/orc/CMakeFiles/arrow-orc-adapter-test.dir/adapter_test.cc.o
> -o debug/arrow-orc-adapter-test -Wl,-rpath,/build/cpp/debug
> debug/libarrow_testing.a debug/libarrow.a debug//libgtest_maind.so
> debug//libgtestd.so /usr/lib/aarch64-linux-gnu/libsnappy.so.1.1.8
> /usr/lib/aarch64-linux-gnu/liblz4.so /usr/lib/aarch64-linux-gnu/libz.so
> -lpthread -ldl orc_ep-install/lib/liborc.a
> /usr/lib/aarch64-linux-gnu/libssl.so /usr/lib/aarch64-linux-gnu/libcrypto.so
> /usr/lib/aarch64-linux-gnu/libbrotlienc.so
> /usr/lib/aarch64-linux-gnu/libbrotlidec.so
> /usr/lib/aarch64-linux-gnu/libbrotlicommon.so
> /usr/lib/aarch64-linux-gnu/libbz2.so /usr/lib/aarch64-linux-gnu/libzstd.so
> /usr/lib/aarch64-linux-gnu/libprotobuf.so
> /usr/lib/aarch64-linux-gnu/libglog.so
> jemalloc_ep-prefix/src/jemalloc_ep/dist//lib/libjemalloc_pic.a -pthread
> -lrt && :
> /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): undefined
> reference to symbol 'inflateEnd'
> /usr/bin/ld: /usr/lib/aarch64-linux-gnu/libz.so: error adding symbols: DSO
> missing from command line
> collect2: error: ld returned 1 exit status
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (ARROW-8932) [C++] symbol resolution failures with liborc.a
[
https://issues.apache.org/jira/browse/ARROW-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki reassigned ARROW-8932:
---
Assignee: Kazuaki Ishizaki
> [C++] symbol resolution failures with liborc.a
> --
>
> Key: ARROW-8932
> URL: https://issues.apache.org/jira/browse/ARROW-8932
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, Continuous Integration
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Major
> Labels: pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> This is failing in the Travis CI s390x build. I am not sure this is related
> to ARROW-8930.
> [https://travis-ci.org/github/apache/arrow/jobs/690006107] was successful.
> [https://travis-ci.org/github/apache/arrow/jobs/690634108#L1023|https://travis-ci.org/github/apache/arrow/jobs/690634108]
> causes failures.
> {code:java}
> [435/548] Linking CXX executable debug/arrow-orc-adapter-test
> 1024 FAILED: debug/arrow-orc-adapter-test
> 1025 : && /usr/bin/ccache /usr/bin/c++ -Wno-noexcept-type
> -fdiagnostics-color=always -ggdb -O0 -Wall -Wno-conversion
> -Wno-sign-conversion -Wno-unused-variable -Werror -g -rdynamic
> src/arrow/adapters/orc/CMakeFiles/arrow-orc-adapter-test.dir/adapter_test.cc.o
> -o debug/arrow-orc-adapter-test -Wl,-rpath,/build/cpp/debug
> debug/libarrow_testing.a debug/libarrow.a debug//libgtest_maind.so
> debug//libgtestd.so /usr/lib/s390x-linux-gnu/libsnappy.so.1.1.8
> /usr/lib/s390x-linux-gnu/liblz4.so /usr/lib/s390x-linux-gnu/libz.so
> -lpthread -ldl orc_ep-install/lib/liborc.a
> /usr/lib/s390x-linux-gnu/libssl.so /usr/lib/s390x-linux-gnu/libcrypto.so
> /usr/lib/s390x-linux-gnu/libbrotlienc.so
> /usr/lib/s390x-linux-gnu/libbrotlidec.so
> /usr/lib/s390x-linux-gnu/libbrotlicommon.so
> /usr/lib/s390x-linux-gnu/libbz2.so /usr/lib/s390x-linux-gnu/libzstd.so
> protobuf_ep-install/lib/libprotobuf.a /usr/lib/s390x-linux-gnu/libglog.so
> jemalloc_ep-prefix/src/jemalloc_ep/dist//lib/libjemalloc_pic.a -pthread
> -lrt && :
> 1026 /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
> `orc::ZlibCompressionStream::doStreamingCompression()':
> 1027 /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:244:
> undefined reference to `deflateReset'
> 1028 /usr/bin/ld:
> /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:266: undefined
> reference to `deflate'
> 1029 /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
> `orc::ZlibCompressionStream::init()':
> 1030 /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:296:
> undefined reference to `deflateInit2_'
> 1031 /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
> `orc::ZlibCompressionStream::end()':
> 1032 /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:303:
> undefined reference to `deflateEnd'
> 1033 /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
> `orc::ZlibDecompressionStream::ZlibDecompressionStream(std::unique_ptr std::default_delete >, unsigned long,
> orc::MemoryPool&)':
> 1034 /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:417:
> undefined reference to `inflateInit2_'
> 1035 /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
> `orc::ZlibDecompressionStream::~ZlibDecompressionStream()':
> 1036 /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:442:
> undefined reference to `inflateEnd'
> 1037 /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
> `orc::ZlibDecompressionStream::Next(void const**, int*)':
> 1038 /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:483:
> undefined reference to `inflateReset'
> 1039 /usr/bin/ld:
> /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:489: undefined
> reference to `inflate'
> 1040 /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
> `orc::SnappyDecompressionStream::decompress(char const*, unsigned long,
> char*, unsigned long)':
> 1041 /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:848:
> undefined reference to `snappy::GetUncompressedLength(char const*, unsigned
> long, unsigned long*)'
> 1042 /usr/bin/ld:
> /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:856: undefined
> reference to `snappy::RawUncompress(char const*, unsigned long, char*)'
> 1043 /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
> `orc::Lz4DecompressionStream::decompress(char const*, unsigned long, char*,
> unsigned long)':
> 1044 /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:922:
> undefined reference to `LZ4_decompress_safe'
> 1045 collect2: error: ld returned 1 exit status{code}
>
--
This message was sent by Atlassian Jira
[jira] [Updated] (ARROW-8932) [C++] symbol resolution failures with liborc.a
[
https://issues.apache.org/jira/browse/ARROW-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated ARROW-8932:
Description:
This is failing in the Travis CI s390x build. I am not sure this is related to
ARROW-8930.
[https://travis-ci.org/github/apache/arrow/jobs/690006107] was successful.
[https://travis-ci.org/github/apache/arrow/jobs/690634108#L1023|https://travis-ci.org/github/apache/arrow/jobs/690634108]
causes failures.
{code:java}
[435/548] Linking CXX executable debug/arrow-orc-adapter-test
1024 FAILED: debug/arrow-orc-adapter-test
1025 : && /usr/bin/ccache /usr/bin/c++ -Wno-noexcept-type
-fdiagnostics-color=always -ggdb -O0 -Wall -Wno-conversion
-Wno-sign-conversion -Wno-unused-variable -Werror -g -rdynamic
src/arrow/adapters/orc/CMakeFiles/arrow-orc-adapter-test.dir/adapter_test.cc.o
-o debug/arrow-orc-adapter-test -Wl,-rpath,/build/cpp/debug
debug/libarrow_testing.a debug/libarrow.a debug//libgtest_maind.so
debug//libgtestd.so /usr/lib/s390x-linux-gnu/libsnappy.so.1.1.8
/usr/lib/s390x-linux-gnu/liblz4.so /usr/lib/s390x-linux-gnu/libz.so -lpthread
-ldl orc_ep-install/lib/liborc.a /usr/lib/s390x-linux-gnu/libssl.so
/usr/lib/s390x-linux-gnu/libcrypto.so /usr/lib/s390x-linux-gnu/libbrotlienc.so
/usr/lib/s390x-linux-gnu/libbrotlidec.so
/usr/lib/s390x-linux-gnu/libbrotlicommon.so /usr/lib/s390x-linux-gnu/libbz2.so
/usr/lib/s390x-linux-gnu/libzstd.so protobuf_ep-install/lib/libprotobuf.a
/usr/lib/s390x-linux-gnu/libglog.so
jemalloc_ep-prefix/src/jemalloc_ep/dist//lib/libjemalloc_pic.a -pthread -lrt
&& :
1026 /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibCompressionStream::doStreamingCompression()':
1027 /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:244: undefined
reference to `deflateReset'
1028 /usr/bin/ld:
/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:266: undefined
reference to `deflate'
1029 /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibCompressionStream::init()':
1030 /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:296: undefined
reference to `deflateInit2_'
1031 /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibCompressionStream::end()':
1032 /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:303: undefined
reference to `deflateEnd'
1033 /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibDecompressionStream::ZlibDecompressionStream(std::unique_ptr >, unsigned long,
orc::MemoryPool&)':
1034 /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:417: undefined
reference to `inflateInit2_'
1035 /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibDecompressionStream::~ZlibDecompressionStream()':
1036 /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:442: undefined
reference to `inflateEnd'
1037 /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibDecompressionStream::Next(void const**, int*)':
1038 /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:483: undefined
reference to `inflateReset'
1039 /usr/bin/ld:
/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:489: undefined
reference to `inflate'
1040 /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::SnappyDecompressionStream::decompress(char const*, unsigned long, char*,
unsigned long)':
1041 /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:848: undefined
reference to `snappy::GetUncompressedLength(char const*, unsigned long,
unsigned long*)'
1042 /usr/bin/ld:
/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:856: undefined
reference to `snappy::RawUncompress(char const*, unsigned long, char*)'
1043 /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::Lz4DecompressionStream::decompress(char const*, unsigned long, char*,
unsigned long)':
1044 /build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:922: undefined
reference to `LZ4_decompress_safe'
1045 collect2: error: ld returned 1 exit status{code}
was:
This is failing in the Travis CI s390x build. I am not sure this is related to
ARROW-8930.
[https://travis-ci.org/github/apache/arrow/jobs/690006107] was successful.
[https://travis-ci.org/github/apache/arrow/jobs/690634108#L1023|https://travis-ci.org/github/apache/arrow/jobs/690634108]
causes failures.
{code:java}
[435/548] Linking CXX executable debug/arrow-orc-adapter-test
1024FAILED: debug/arrow-orc-adapter-test
1025: && /usr/bin/ccache /usr/bin/c++ -Wno-noexcept-type
-fdiagnostics-color=always -ggdb -O0 -Wall -Wno-conversion
-Wno-sign-conversion -Wno-unused-variable -Werror -g -rdynamic
src/arrow/adapters/orc/CMakeFiles/arrow-orc-adapter-test.dir/adapter_test.cc.o
-o debug/arrow-orc-adapter-test -Wl,-rpath,/build/cpp/debug
[jira] [Commented] (ARROW-8930) [C++] libz.so linking error with liborc.a
[
https://issues.apache.org/jira/browse/ARROW-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17115672#comment-17115672
]
Kazuaki Ishizaki commented on ARROW-8930:
-
According to
[https://stackoverflow.com/questions/19901934/libpthread-so-0-error-adding-symbols-dso-missing-from-command-line],
IMHO, the proposed order makes sense.
The question is why this failure did not occur three days ago.
[https://travis-ci.org/github/apache/arrow/jobs/690006106]
> [C++] libz.so linking error with liborc.a
> -
>
> Key: ARROW-8930
> URL: https://issues.apache.org/jira/browse/ARROW-8930
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, Continuous Integration
>Reporter: Wes McKinney
>Priority: Major
> Fix For: 1.0.0
>
>
> This is failing in the Travis CI ARM build
> https://travis-ci.org/github/apache/arrow/jobs/690722203
> {code}
> : && /usr/bin/ccache /usr/bin/c++ -Wno-noexcept-type
> -fdiagnostics-color=always -ggdb -O0 -Wall -Wno-conversion
> -Wno-sign-conversion -Wno-unused-variable -Werror -march=armv8-a -g
> -rdynamic
> src/arrow/adapters/orc/CMakeFiles/arrow-orc-adapter-test.dir/adapter_test.cc.o
> -o debug/arrow-orc-adapter-test -Wl,-rpath,/build/cpp/debug
> debug/libarrow_testing.a debug/libarrow.a debug//libgtest_maind.so
> debug//libgtestd.so /usr/lib/aarch64-linux-gnu/libsnappy.so.1.1.8
> /usr/lib/aarch64-linux-gnu/liblz4.so /usr/lib/aarch64-linux-gnu/libz.so
> -lpthread -ldl orc_ep-install/lib/liborc.a
> /usr/lib/aarch64-linux-gnu/libssl.so /usr/lib/aarch64-linux-gnu/libcrypto.so
> /usr/lib/aarch64-linux-gnu/libbrotlienc.so
> /usr/lib/aarch64-linux-gnu/libbrotlidec.so
> /usr/lib/aarch64-linux-gnu/libbrotlicommon.so
> /usr/lib/aarch64-linux-gnu/libbz2.so /usr/lib/aarch64-linux-gnu/libzstd.so
> /usr/lib/aarch64-linux-gnu/libprotobuf.so
> /usr/lib/aarch64-linux-gnu/libglog.so
> jemalloc_ep-prefix/src/jemalloc_ep/dist//lib/libjemalloc_pic.a -pthread
> -lrt && :
> /usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): undefined
> reference to symbol 'inflateEnd'
> /usr/bin/ld: /usr/lib/aarch64-linux-gnu/libz.so: error adding symbols: DSO
> missing from command line
> collect2: error: ld returned 1 exit status
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (ARROW-8932) [C++] symbol resolution failures with liborc.a
[
https://issues.apache.org/jira/browse/ARROW-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated ARROW-8932:
Description:
This is failing in the Travis CI s390x build. I am not sure this is related to
ARROW-8930.
[https://travis-ci.org/github/apache/arrow/jobs/690006107] was successful.
[https://travis-ci.org/github/apache/arrow/jobs/690634108#L1023|https://travis-ci.org/github/apache/arrow/jobs/690634108]
causes failures.
{code:java}
[435/548] Linking CXX executable debug/arrow-orc-adapter-test
1024FAILED: debug/arrow-orc-adapter-test
1025: && /usr/bin/ccache /usr/bin/c++ -Wno-noexcept-type
-fdiagnostics-color=always -ggdb -O0 -Wall -Wno-conversion
-Wno-sign-conversion -Wno-unused-variable -Werror -g -rdynamic
src/arrow/adapters/orc/CMakeFiles/arrow-orc-adapter-test.dir/adapter_test.cc.o
-o debug/arrow-orc-adapter-test -Wl,-rpath,/build/cpp/debug
debug/libarrow_testing.a debug/libarrow.a debug//libgtest_maind.so
debug//libgtestd.so /usr/lib/s390x-linux-gnu/libsnappy.so.1.1.8
/usr/lib/s390x-linux-gnu/liblz4.so /usr/lib/s390x-linux-gnu/libz.so -lpthread
-ldl orc_ep-install/lib/liborc.a /usr/lib/s390x-linux-gnu/libssl.so
/usr/lib/s390x-linux-gnu/libcrypto.so /usr/lib/s390x-linux-gnu/libbrotlienc.so
/usr/lib/s390x-linux-gnu/libbrotlidec.so
/usr/lib/s390x-linux-gnu/libbrotlicommon.so /usr/lib/s390x-linux-gnu/libbz2.so
/usr/lib/s390x-linux-gnu/libzstd.so protobuf_ep-install/lib/libprotobuf.a
/usr/lib/s390x-linux-gnu/libglog.so
jemalloc_ep-prefix/src/jemalloc_ep/dist//lib/libjemalloc_pic.a -pthread -lrt
&& :
1026/usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibCompressionStream::doStreamingCompression()':
1027/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:244: undefined
reference to `deflateReset'
1028/usr/bin/ld:
/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:266: undefined
reference to `deflate'
1029/usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibCompressionStream::init()':
1030/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:296: undefined
reference to `deflateInit2_'
1031/usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibCompressionStream::end()':
1032/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:303: undefined
reference to `deflateEnd'
1033/usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibDecompressionStream::ZlibDecompressionStream(std::unique_ptr >, unsigned long,
orc::MemoryPool&)':
1034/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:417: undefined
reference to `inflateInit2_'
1035/usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibDecompressionStream::~ZlibDecompressionStream()':
1036/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:442: undefined
reference to `inflateEnd'
1037/usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibDecompressionStream::Next(void const**, int*)':
1038/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:483: undefined
reference to `inflateReset'
1039/usr/bin/ld:
/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:489: undefined
reference to `inflate'
1040/usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::SnappyDecompressionStream::decompress(char const*, unsigned long, char*,
unsigned long)':
1041/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:848: undefined
reference to `snappy::GetUncompressedLength(char const*, unsigned long,
unsigned long*)'
1042/usr/bin/ld:
/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:856: undefined
reference to `snappy::RawUncompress(char const*, unsigned long, char*)'
1043/usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::Lz4DecompressionStream::decompress(char const*, unsigned long, char*,
unsigned long)':
1044/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:922: undefined
reference to `LZ4_decompress_safe'
1045collect2: error: ld returned 1 exit status{code}
was:
This is failing in the Travis CI s390x build. I am not sure this is related to
ARROW-8930.
[https://travis-ci.org/github/apache/arrow/jobs/690006107] was successful.
[https://travis-ci.org/github/apache/arrow/jobs/690634108#L1023|https://travis-ci.org/github/apache/arrow/jobs/690634108]
causes failures.
{code:java}
[435/548] Linking CXX executable debug/arrow-orc-adapter-test1024FAILED:
debug/arrow-orc-adapter-test 1025: && /usr/bin/ccache /usr/bin/c++
-Wno-noexcept-type -fdiagnostics-color=always -ggdb -O0 -Wall -Wno-conversion
-Wno-sign-conversion -Wno-unused-variable -Werror -g -rdynamic
src/arrow/adapters/orc/CMakeFiles/arrow-orc-adapter-test.dir/adapter_test.cc.o
-o debug/arrow-orc-adapter-test -Wl,-rpath,/build/cpp/debug
debug/libarrow_test
[jira] [Created] (ARROW-8932) [C++] symbol resolution failures with liborc.a
Kazuaki Ishizaki created ARROW-8932:
---
Summary: [C++] symbol resolution failures with liborc.a
Key: ARROW-8932
URL: https://issues.apache.org/jira/browse/ARROW-8932
Project: Apache Arrow
Issue Type: Bug
Components: C++, Continuous Integration
Reporter: Kazuaki Ishizaki
This is failing in the Travis CI s390x build. I am not sure this is related to
ARROW-8930.
[https://travis-ci.org/github/apache/arrow/jobs/690006107] was successful.
[https://travis-ci.org/github/apache/arrow/jobs/690634108#L1023|https://travis-ci.org/github/apache/arrow/jobs/690634108]
causes failures.
{code:java}
[435/548] Linking CXX executable debug/arrow-orc-adapter-test1024FAILED:
debug/arrow-orc-adapter-test 1025: && /usr/bin/ccache /usr/bin/c++
-Wno-noexcept-type -fdiagnostics-color=always -ggdb -O0 -Wall -Wno-conversion
-Wno-sign-conversion -Wno-unused-variable -Werror -g -rdynamic
src/arrow/adapters/orc/CMakeFiles/arrow-orc-adapter-test.dir/adapter_test.cc.o
-o debug/arrow-orc-adapter-test -Wl,-rpath,/build/cpp/debug
debug/libarrow_testing.a debug/libarrow.a debug//libgtest_maind.so
debug//libgtestd.so /usr/lib/s390x-linux-gnu/libsnappy.so.1.1.8
/usr/lib/s390x-linux-gnu/liblz4.so /usr/lib/s390x-linux-gnu/libz.so -lpthread
-ldl orc_ep-install/lib/liborc.a /usr/lib/s390x-linux-gnu/libssl.so
/usr/lib/s390x-linux-gnu/libcrypto.so /usr/lib/s390x-linux-gnu/libbrotlienc.so
/usr/lib/s390x-linux-gnu/libbrotlidec.so
/usr/lib/s390x-linux-gnu/libbrotlicommon.so /usr/lib/s390x-linux-gnu/libbz2.so
/usr/lib/s390x-linux-gnu/libzstd.so protobuf_ep-install/lib/libprotobuf.a
/usr/lib/s390x-linux-gnu/libglog.so
jemalloc_ep-prefix/src/jemalloc_ep/dist//lib/libjemalloc_pic.a -pthread -lrt
&& :1026/usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibCompressionStream::doStreamingCompression()':1027/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:244:
undefined reference to `deflateReset'1028/usr/bin/ld:
/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:266: undefined
reference to `deflate'1029/usr/bin/ld:
orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibCompressionStream::init()':1030/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:296:
undefined reference to `deflateInit2_'1031/usr/bin/ld:
orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibCompressionStream::end()':1032/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:303:
undefined reference to `deflateEnd'1033/usr/bin/ld:
orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibDecompressionStream::ZlibDecompressionStream(std::unique_ptr >, unsigned long,
orc::MemoryPool&)':1034/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:417:
undefined reference to `inflateInit2_'1035/usr/bin/ld:
orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibDecompressionStream::~ZlibDecompressionStream()':1036/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:442:
undefined reference to `inflateEnd'1037/usr/bin/ld:
orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::ZlibDecompressionStream::Next(void const**,
int*)':1038/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:483:
undefined reference to `inflateReset'1039/usr/bin/ld:
/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:489: undefined
reference to `inflate'1040/usr/bin/ld:
orc_ep-install/lib/liborc.a(Compression.cc.o): in function
`orc::SnappyDecompressionStream::decompress(char const*, unsigned long, char*,
unsigned
long)':1041/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:848:
undefined reference to `snappy::GetUncompressedLength(char const*, unsigned
long, unsigned long*)'1042/usr/bin/ld:
/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:856: undefined
reference to `snappy::RawUncompress(char const*, unsigned long,
char*)'1043/usr/bin/ld: orc_ep-install/lib/liborc.a(Compression.cc.o): in
function `orc::Lz4DecompressionStream::decompress(char const*, unsigned long,
char*, unsigned
long)':1044/build/cpp/orc_ep-prefix/src/orc_ep/c++/src/Compression.cc:922:
undefined reference to `LZ4_decompress_safe'1045collect2: error: ld returned 1
exit status{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (ARROW-8924) [C++][Gandiva] castDATE_date32() may cause overflow
[
https://issues.apache.org/jira/browse/ARROW-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated ARROW-8924:
Description:
The following code in `cpp/src/gandiva/precompiled/time.cc` may cause overflow
since `int32` * `int32` is `int32`, then it is converted to `int64`. The result
of `int32` may loose the part of the result of the multiplication
{code:java}
gdv_date64 castDATE_date32(gdv_date32 days) { return days * MILLIS_IN_DAY; }
{code}
was:
The following code in `cpp/src/gandiva/precompiled/time.cc` may cause overflow
since `int32` * `int32` is `int32`, then it is converted to `int64`.
{code:java}
gdv_date64 castDATE_date32(gdv_date32 days) { return days * MILLIS_IN_DAY; }
{code}
> [C++][Gandiva] castDATE_date32() may cause overflow
> ---
>
> Key: ARROW-8924
> URL: https://issues.apache.org/jira/browse/ARROW-8924
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++ - Gandiva
>Reporter: Kazuaki Ishizaki
>Priority: Minor
>
> The following code in `cpp/src/gandiva/precompiled/time.cc` may cause
> overflow since `int32` * `int32` is `int32`, then it is converted to `int64`.
> The result of `int32` may loose the part of the result of the multiplication
>
> {code:java}
> gdv_date64 castDATE_date32(gdv_date32 days) { return days * MILLIS_IN_DAY; }
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-8924) [C++][Gandiva] castDATE_date32() may cause overflow
Kazuaki Ishizaki created ARROW-8924:
---
Summary: [C++][Gandiva] castDATE_date32() may cause overflow
Key: ARROW-8924
URL: https://issues.apache.org/jira/browse/ARROW-8924
Project: Apache Arrow
Issue Type: Bug
Components: C++ - Gandiva
Reporter: Kazuaki Ishizaki
The following code in `cpp/src/gandiva/precompiled/time.cc` may cause overflow
since `int32` * `int32` is `int32`, then it is converted to `int64`.
{code:java}
gdv_date64 castDATE_date32(gdv_date32 days) { return days * MILLIS_IN_DAY; }
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (ARROW-8914) [C++][Gandiva] Decimal128 related test failed on big-endian platforms
[
https://issues.apache.org/jira/browse/ARROW-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki reassigned ARROW-8914:
---
Assignee: Kazuaki Ishizaki
> [C++][Gandiva] Decimal128 related test failed on big-endian platforms
> -
>
> Key: ARROW-8914
> URL: https://issues.apache.org/jira/browse/ARROW-8914
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++ - Gandiva
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Minor
> Labels: pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> These test failures in gandiva tests occur on big-endian platforms. An
> example from https://travis-ci.org/github/apache/arrow/jobs/690006107#L2306
> {code}
> ...
> [==] 17 tests from 1 test case ran. (2334 ms total)
> [ PASSED ] 7 tests.
> [ FAILED ] 10 tests, listed below:
> [ FAILED ] TestDecimal.TestSimple
> [ FAILED ] TestDecimal.TestLiteral
> [ FAILED ] TestDecimal.TestCompare
> [ FAILED ] TestDecimal.TestRoundFunctions
> [ FAILED ] TestDecimal.TestCastFunctions
> [ FAILED ] TestDecimal.TestIsDistinct
> [ FAILED ] TestDecimal.TestCastVarCharDecimal
> [ FAILED ] TestDecimal.TestCastDecimalVarChar
> [ FAILED ] TestDecimal.TestVarCharDecimalNestedCast
> [ FAILED ] TestDecimal.TestCastDecimalOverflow
> ...
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-8914) [C++][Gandiva] Decimal128 related test failed on big-endian platforms
Kazuaki Ishizaki created ARROW-8914:
---
Summary: [C++][Gandiva] Decimal128 related test failed on
big-endian platforms
Key: ARROW-8914
URL: https://issues.apache.org/jira/browse/ARROW-8914
Project: Apache Arrow
Issue Type: Improvement
Components: C++ - Gandiva
Reporter: Kazuaki Ishizaki
These test failures in gandiva tests occur on big-endian platforms. An example
from https://travis-ci.org/github/apache/arrow/jobs/690006107#L2306
{code}
...
[==] 17 tests from 1 test case ran. (2334 ms total)
[ PASSED ] 7 tests.
[ FAILED ] 10 tests, listed below:
[ FAILED ] TestDecimal.TestSimple
[ FAILED ] TestDecimal.TestLiteral
[ FAILED ] TestDecimal.TestCompare
[ FAILED ] TestDecimal.TestRoundFunctions
[ FAILED ] TestDecimal.TestCastFunctions
[ FAILED ] TestDecimal.TestIsDistinct
[ FAILED ] TestDecimal.TestCastVarCharDecimal
[ FAILED ] TestDecimal.TestCastDecimalVarChar
[ FAILED ] TestDecimal.TestVarCharDecimalNestedCast
[ FAILED ] TestDecimal.TestCastDecimalOverflow
...
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (ARROW-8797) [C++] Support Flight RPC among diffent endian platforms
[ https://issues.apache.org/jira/browse/ARROW-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110453#comment-17110453 ] Kazuaki Ishizaki commented on ARROW-8797: - Sure, IPC should exchange data using the data endianness in the schema. Then, a reader has to take care of the field. First, we may have to create test cases. > [C++] Support Flight RPC among diffent endian platforms > --- > > Key: ARROW-8797 > URL: https://issues.apache.org/jira/browse/ARROW-8797 > Project: Apache Arrow > Issue Type: Improvement > Components: C++, FlightRPC >Reporter: Kazuaki Ishizaki >Priority: Major > > This PR is derived from discussion in ARROW-8790. The current implementation > of the Flight RPC exchanges messages using a native endlian format. It does > not allow us to exchange data though Flight RPC among different endian > machines (e.g. x86_64 <-> s390x). > There is a field to show an endianness at[ > https://github.com/apache/arrow/blob/master/format/Schema.fbs#L343-L346|https://github.com/apache/arrow/blob/master/format/Schema.fbs#L343-L346], > which is added by ARROW-245. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ARROW-8797) [C++] Support Flight RPC among diffent endian platforms
[ https://issues.apache.org/jira/browse/ARROW-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110438#comment-17110438 ] Kazuaki Ishizaki commented on ARROW-8797: - [~apitrou] According to your comment, current FlightRPC transfers data in native endlian. In my opinion, we may have two opinions to exchange data between different endian platforms. 1. Exchange data using native endian. If the receiver detects the message endian is different from the machine-native endian, the receiver converts endian. 2. The FlightRPC always use the specific endian regardless of endian of sender or receiver. Is there any comment? > [C++] Support Flight RPC among diffent endian platforms > --- > > Key: ARROW-8797 > URL: https://issues.apache.org/jira/browse/ARROW-8797 > Project: Apache Arrow > Issue Type: Improvement > Components: C++, FlightRPC >Reporter: Kazuaki Ishizaki >Priority: Major > > This PR is derived from discussion in ARROW-8790. The current implementation > of the Flight RPC exchanges messages using a native endlian format. It does > not allow us to exchange data though Flight RPC among different endian > machines (e.g. x86_64 <-> s390x). > There is a field to show an endianness at[ > https://github.com/apache/arrow/blob/master/format/Schema.fbs#L343-L346|https://github.com/apache/arrow/blob/master/format/Schema.fbs#L343-L346], > which is added by ARROW-245. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ARROW-8790) [C++][CI] enable arrow-flight-test on s390x
[
https://issues.apache.org/jira/browse/ARROW-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17107221#comment-17107221
]
Kazuaki Ishizaki commented on ARROW-8790:
-
Created ARROW-8797.
> [C++][CI] enable arrow-flight-test on s390x
> ---
>
> Key: ARROW-8790
> URL: https://issues.apache.org/jira/browse/ARROW-8790
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, CI
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Minor
> Labels: pull-request-available
> Time Spent: 50m
> Remaining Estimate: 0h
>
> arrow-flight-test on s390x looks good with the latest master.
> {code}
> Start 48: arrow-flight-test
> 45/55 Test #48: arrow-flight-test Passed0.33 sec
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-8797) [C++] Support Flight RPC among diffent endian platforms
Kazuaki Ishizaki created ARROW-8797: --- Summary: [C++] Support Flight RPC among diffent endian platforms Key: ARROW-8797 URL: https://issues.apache.org/jira/browse/ARROW-8797 Project: Apache Arrow Issue Type: Improvement Components: C++, FlightRPC Reporter: Kazuaki Ishizaki This PR is derived from discussion in ARROW-8790. The current implementation of the Flight RPC exchanges messages using a native endlian format. It does not allow us to exchange data though Flight RPC among different endian machines (e.g. x86_64 <-> s390x). There is a field to show an endianness at[ https://github.com/apache/arrow/blob/master/format/Schema.fbs#L343-L346|https://github.com/apache/arrow/blob/master/format/Schema.fbs#L343-L346], which is added by ARROW-245. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ARROW-8790) [C++][CI] enable arrow-flight-test on s390x
[
https://issues.apache.org/jira/browse/ARROW-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17107213#comment-17107213
]
Kazuaki Ishizaki commented on ARROW-8790:
-
Sure, I will open a new PR. Related to that field, I found that a old PR
(ARROW-245) that adds the field.
> [C++][CI] enable arrow-flight-test on s390x
> ---
>
> Key: ARROW-8790
> URL: https://issues.apache.org/jira/browse/ARROW-8790
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, CI
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Minor
> Labels: pull-request-available
> Time Spent: 50m
> Remaining Estimate: 0h
>
> arrow-flight-test on s390x looks good with the latest master.
> {code}
> Start 48: arrow-flight-test
> 45/55 Test #48: arrow-flight-test Passed0.33 sec
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (ARROW-8790) [C++][CI] enable arrow-flight-test on s390x
[
https://issues.apache.org/jira/browse/ARROW-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17106829#comment-17106829
]
Kazuaki Ishizaki commented on ARROW-8790:
-
I was not able to find JIRA about endianness IPC messages.
> [C++][CI] enable arrow-flight-test on s390x
> ---
>
> Key: ARROW-8790
> URL: https://issues.apache.org/jira/browse/ARROW-8790
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, CI
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Minor
> Labels: pull-request-available
> Time Spent: 50m
> Remaining Estimate: 0h
>
> arrow-flight-test on s390x looks good with the latest master.
> {code}
> Start 48: arrow-flight-test
> 45/55 Test #48: arrow-flight-test Passed0.33 sec
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (ARROW-8790) [C++][CI] enable arrow-flight-test on s390x
[
https://issues.apache.org/jira/browse/ARROW-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17106767#comment-17106767
]
Kazuaki Ishizaki commented on ARROW-8790:
-
Thank you for your comment. Let me look for JIRAs for endianness IPC message.
> [C++][CI] enable arrow-flight-test on s390x
> ---
>
> Key: ARROW-8790
> URL: https://issues.apache.org/jira/browse/ARROW-8790
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, CI
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Minor
> Labels: pull-request-available
> Time Spent: 40m
> Remaining Estimate: 0h
>
> arrow-flight-test on s390x looks good with the latest master.
> {code}
> Start 48: arrow-flight-test
> 45/55 Test #48: arrow-flight-test Passed0.33 sec
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (ARROW-8790) [C++][CI] enable arrow-flight-test on s390x
[
https://issues.apache.org/jira/browse/ARROW-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki reassigned ARROW-8790:
---
Assignee: Kazuaki Ishizaki
> [C++][CI] enable arrow-flight-test on s390x
> ---
>
> Key: ARROW-8790
> URL: https://issues.apache.org/jira/browse/ARROW-8790
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, CI
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Minor
>
> arrow-flight-test on s390x looks good with the latest master.
> {code}
> Start 48: arrow-flight-test
> 45/55 Test #48: arrow-flight-test Passed0.33 sec
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-8790) [C++][CI] enable arrow-flight-test on s390x
Kazuaki Ishizaki created ARROW-8790:
---
Summary: [C++][CI] enable arrow-flight-test on s390x
Key: ARROW-8790
URL: https://issues.apache.org/jira/browse/ARROW-8790
Project: Apache Arrow
Issue Type: Improvement
Components: C++, CI
Reporter: Kazuaki Ishizaki
arrow-flight-test on s390x looks good with the latest master.
{code}
Start 48: arrow-flight-test
45/55 Test #48: arrow-flight-test Passed0.33 sec
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (ARROW-8778) [C++][gandiva] SelectionVector related test failed on big-endian platforms
[
https://issues.apache.org/jira/browse/ARROW-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki reassigned ARROW-8778:
---
Assignee: Kazuaki Ishizaki
> [C++][gandiva] SelectionVector related test failed on big-endian platforms
> --
>
> Key: ARROW-8778
> URL: https://issues.apache.org/jira/browse/ARROW-8778
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++ - Gandiva
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Minor
>
> These test failures in gandiva tests occur on big-endian platforms
> {code}
> ...
> [--] 11 tests from TestSelectionVector
> [ RUN ] TestSelectionVector.TestInt16Make
> [ OK ] TestSelectionVector.TestInt16Make (0 ms)
> [ RUN ] TestSelectionVector.TestInt16MakeNegative
> [ OK ] TestSelectionVector.TestInt16MakeNegative (1 ms)
> [ RUN ] TestSelectionVector.TestInt16Set
> [ OK ] TestSelectionVector.TestInt16Set (0 ms)
> [ RUN ] TestSelectionVector.TestInt16PopulateFromBitMap
> /arrow/cpp/src/gandiva/selection_vector_test.cc:116: Failure
> Expected equality of these values:
> selection->GetIndex(0)
> Which is: 56
> 0
> /arrow/cpp/src/gandiva/selection_vector_test.cc:117: Failure
> Expected equality of these values:
> selection->GetIndex(1)
> Which is: 61
> 5
> /arrow/cpp/src/gandiva/selection_vector_test.cc:118: Failure
> Expected equality of these values:
> selection->GetIndex(2)
> Which is: 65
> 121
> [ FAILED ] TestSelectionVector.TestInt16PopulateFromBitMap (0 ms)
> [ RUN ] TestSelectionVector.TestInt16PopulateFromBitMapNegative
> /arrow/cpp/src/gandiva/selection_vector_test.cc:137: Failure
> Expected equality of these values:
> status.IsInvalid()
> Which is: false
> true
> [ FAILED ] TestSelectionVector.TestInt16PopulateFromBitMapNegative (0 ms)
> [ RUN ] TestSelectionVector.TestInt32Set
> [ OK ] TestSelectionVector.TestInt32Set (0 ms)
> [ RUN ] TestSelectionVector.TestInt32PopulateFromBitMap
> /arrow/cpp/src/gandiva/selection_vector_test.cc:187: Failure
> Expected equality of these values:
> selection->GetIndex(0)
> Which is: 56
> 0
> /arrow/cpp/src/gandiva/selection_vector_test.cc:188: Failure
> Expected equality of these values:
> selection->GetIndex(1)
> Which is: 61
> 5
> /arrow/cpp/src/gandiva/selection_vector_test.cc:189: Failure
> Expected equality of these values:
> selection->GetIndex(2)
> Which is: 65
> 121
> [ FAILED ] TestSelectionVector.TestInt32PopulateFromBitMap (0 ms)
> [ RUN ] TestSelectionVector.TestInt32MakeNegative
> [ OK ] TestSelectionVector.TestInt32MakeNegative (0 ms)
> [ RUN ] TestSelectionVector.TestInt64Set
> [ OK ] TestSelectionVector.TestInt64Set (0 ms)
> [ RUN ] TestSelectionVector.TestInt64PopulateFromBitMap
> /arrow/cpp/src/gandiva/selection_vector_test.cc:252: Failure
> Expected equality of these values:
> selection->GetIndex(0)
> Which is: 56
> 0
> /arrow/cpp/src/gandiva/selection_vector_test.cc:253: Failure
> Expected equality of these values:
> selection->GetIndex(1)
> Which is: 61
> 5
> /arrow/cpp/src/gandiva/selection_vector_test.cc:254: Failure
> Expected equality of these values:
> selection->GetIndex(2)
> Which is: 65
> 121
> [ FAILED ] TestSelectionVector.TestInt64PopulateFromBitMap (0 ms)
> [ RUN ] TestSelectionVector.TestInt64MakeNegative
> [ OK ] TestSelectionVector.TestInt64MakeNegative (0 ms)
> [--] 11 tests from TestSelectionVector (1 ms total)
> [--] 2 tests from TestLruCache
> [ RUN ] TestLruCache.TestEvict
> [ OK ] TestLruCache.TestEvict (0 ms)
> [ RUN ] TestLruCache.TestLruBehavior
> [ OK ] TestLruCache.TestLruBehavior (0 ms)
> [--] 2 tests from TestLruCache (0 ms total)
> [--] 4 tests from TestToDateHolder
> [ RUN ] TestToDateHolder.TestSimpleDateTime
> [ OK ] TestToDateHolder.TestSimpleDateTime (0 ms)
> [ RUN ] TestToDateHolder.TestSimpleDate
> [ OK ] TestToDateHolder.TestSimpleDate (0 ms)
> [ RUN ] TestToDateHolder.TestSimpleDateTimeError
> [ OK ] TestToDateHolder.TestSimpleDateTimeError (0 ms)
> [ RUN ] TestToDateHolder.TestSimpleDateTimeMakeError
> [ OK ] TestToDateHolder.TestSimpleDateTimeMakeError (0 ms)
> [--] 4 tests from TestToDateHolder (1 ms total)
> [--] 3 tests from TestSimpleArena
> [ RUN ] TestSimpleArena.TestAlloc
> [ OK ] TestSimpleArena.TestAlloc (0 ms)
> [ RUN ] TestSimpleArena.TestReset1
> [ OK ] TestSimpleArena.TestReset1 (0 ms)
> [ RUN ] TestSimpleArena.TestReset2
> [ OK ] TestSimpleArena.TestReset2 (0 ms)
> [--] 3 tests from TestSimpleArena (0 ms total)
> [--] 6 tests f
[jira] [Created] (ARROW-8778) [C++][gandiva] SelectionVector related test failed on big-endian platforms
Kazuaki Ishizaki created ARROW-8778:
---
Summary: [C++][gandiva] SelectionVector related test failed on
big-endian platforms
Key: ARROW-8778
URL: https://issues.apache.org/jira/browse/ARROW-8778
Project: Apache Arrow
Issue Type: Improvement
Components: C++ - Gandiva
Reporter: Kazuaki Ishizaki
These test failures in gandiva tests occur on big-endian platforms
{code}
...
[--] 11 tests from TestSelectionVector
[ RUN ] TestSelectionVector.TestInt16Make
[ OK ] TestSelectionVector.TestInt16Make (0 ms)
[ RUN ] TestSelectionVector.TestInt16MakeNegative
[ OK ] TestSelectionVector.TestInt16MakeNegative (1 ms)
[ RUN ] TestSelectionVector.TestInt16Set
[ OK ] TestSelectionVector.TestInt16Set (0 ms)
[ RUN ] TestSelectionVector.TestInt16PopulateFromBitMap
/arrow/cpp/src/gandiva/selection_vector_test.cc:116: Failure
Expected equality of these values:
selection->GetIndex(0)
Which is: 56
0
/arrow/cpp/src/gandiva/selection_vector_test.cc:117: Failure
Expected equality of these values:
selection->GetIndex(1)
Which is: 61
5
/arrow/cpp/src/gandiva/selection_vector_test.cc:118: Failure
Expected equality of these values:
selection->GetIndex(2)
Which is: 65
121
[ FAILED ] TestSelectionVector.TestInt16PopulateFromBitMap (0 ms)
[ RUN ] TestSelectionVector.TestInt16PopulateFromBitMapNegative
/arrow/cpp/src/gandiva/selection_vector_test.cc:137: Failure
Expected equality of these values:
status.IsInvalid()
Which is: false
true
[ FAILED ] TestSelectionVector.TestInt16PopulateFromBitMapNegative (0 ms)
[ RUN ] TestSelectionVector.TestInt32Set
[ OK ] TestSelectionVector.TestInt32Set (0 ms)
[ RUN ] TestSelectionVector.TestInt32PopulateFromBitMap
/arrow/cpp/src/gandiva/selection_vector_test.cc:187: Failure
Expected equality of these values:
selection->GetIndex(0)
Which is: 56
0
/arrow/cpp/src/gandiva/selection_vector_test.cc:188: Failure
Expected equality of these values:
selection->GetIndex(1)
Which is: 61
5
/arrow/cpp/src/gandiva/selection_vector_test.cc:189: Failure
Expected equality of these values:
selection->GetIndex(2)
Which is: 65
121
[ FAILED ] TestSelectionVector.TestInt32PopulateFromBitMap (0 ms)
[ RUN ] TestSelectionVector.TestInt32MakeNegative
[ OK ] TestSelectionVector.TestInt32MakeNegative (0 ms)
[ RUN ] TestSelectionVector.TestInt64Set
[ OK ] TestSelectionVector.TestInt64Set (0 ms)
[ RUN ] TestSelectionVector.TestInt64PopulateFromBitMap
/arrow/cpp/src/gandiva/selection_vector_test.cc:252: Failure
Expected equality of these values:
selection->GetIndex(0)
Which is: 56
0
/arrow/cpp/src/gandiva/selection_vector_test.cc:253: Failure
Expected equality of these values:
selection->GetIndex(1)
Which is: 61
5
/arrow/cpp/src/gandiva/selection_vector_test.cc:254: Failure
Expected equality of these values:
selection->GetIndex(2)
Which is: 65
121
[ FAILED ] TestSelectionVector.TestInt64PopulateFromBitMap (0 ms)
[ RUN ] TestSelectionVector.TestInt64MakeNegative
[ OK ] TestSelectionVector.TestInt64MakeNegative (0 ms)
[--] 11 tests from TestSelectionVector (1 ms total)
[--] 2 tests from TestLruCache
[ RUN ] TestLruCache.TestEvict
[ OK ] TestLruCache.TestEvict (0 ms)
[ RUN ] TestLruCache.TestLruBehavior
[ OK ] TestLruCache.TestLruBehavior (0 ms)
[--] 2 tests from TestLruCache (0 ms total)
[--] 4 tests from TestToDateHolder
[ RUN ] TestToDateHolder.TestSimpleDateTime
[ OK ] TestToDateHolder.TestSimpleDateTime (0 ms)
[ RUN ] TestToDateHolder.TestSimpleDate
[ OK ] TestToDateHolder.TestSimpleDate (0 ms)
[ RUN ] TestToDateHolder.TestSimpleDateTimeError
[ OK ] TestToDateHolder.TestSimpleDateTimeError (0 ms)
[ RUN ] TestToDateHolder.TestSimpleDateTimeMakeError
[ OK ] TestToDateHolder.TestSimpleDateTimeMakeError (0 ms)
[--] 4 tests from TestToDateHolder (1 ms total)
[--] 3 tests from TestSimpleArena
[ RUN ] TestSimpleArena.TestAlloc
[ OK ] TestSimpleArena.TestAlloc (0 ms)
[ RUN ] TestSimpleArena.TestReset1
[ OK ] TestSimpleArena.TestReset1 (0 ms)
[ RUN ] TestSimpleArena.TestReset2
[ OK ] TestSimpleArena.TestReset2 (0 ms)
[--] 3 tests from TestSimpleArena (0 ms total)
[--] 6 tests from TestLikeHolder
[ RUN ] TestLikeHolder.TestMatchAny
[ OK ] TestLikeHolder.TestMatchAny (0 ms)
[ RUN ] TestLikeHolder.TestMatchOne
[ OK ] TestLikeHolder.TestMatchOne (0 ms)
[ RUN ] TestLikeHolder.TestPcreSpecial
[ OK ] TestLikeHolder.TestPcreSpecial (0 ms)
[ RUN ] TestLikeHolder.TestRegexEscape
[ OK ] TestLikeHolder.TestRegexEscape (0 ms)
[ RUN ] TestLikeHolder.TestDot
[ OK ] TestLikeHolder.TestDot (0 ms)
[ RUN ] TestLikeHolder.TestOp
[jira] [Created] (ARROW-8770) [C++][CI] enable arrow-csv-test on s390x
Kazuaki Ishizaki created ARROW-8770:
---
Summary: [C++][CI] enable arrow-csv-test on s390x
Key: ARROW-8770
URL: https://issues.apache.org/jira/browse/ARROW-8770
Project: Apache Arrow
Issue Type: Improvement
Components: C++
Reporter: Kazuaki Ishizaki
arrow-csv-test on s390x looks good with the latest master.
{code}
Start 25: arrow-csv-test
24/75 Test #25: arrow-csv-test Passed0.31 sec
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-8759) [C++] TestPlasmaSerialization.DeleteReply tests failure on big-endian platforms
Kazuaki Ishizaki created ARROW-8759:
---
Summary: [C++] TestPlasmaSerialization.DeleteReply tests failure
on big-endian platforms
Key: ARROW-8759
URL: https://issues.apache.org/jira/browse/ARROW-8759
Project: Apache Arrow
Issue Type: Improvement
Components: C++ - Plasma
Reporter: Kazuaki Ishizaki
TestPlasmaSerialization.DeleteReply test in plasma-serialization-tests causes a
failure as follows:
{code}
1: [==] Running 14 tests from 1 test case.
1: [--] Global test environment set-up.
1: [--] 14 tests from TestPlasmaSerialization
1: [ RUN ] TestPlasmaSerialization.CreateRequest
1: /home/ishizaki/Arrow/arrow/cpp/src/plasma/test/serialization_tests.cc:87:
file path: '/tmp/ser-test-kk8t88p9/fileXX'
1: [ OK ] TestPlasmaSerialization.CreateRequest (2 ms)
1: [ RUN ] TestPlasmaSerialization.CreateReply
1: /home/ishizaki/Arrow/arrow/cpp/src/plasma/test/serialization_tests.cc:87:
file path: '/tmp/ser-test-97gspx5v/fileXX'
1: [ OK ] TestPlasmaSerialization.CreateReply (0 ms)
1: [ RUN ] TestPlasmaSerialization.SealRequest
1: /home/ishizaki/Arrow/arrow/cpp/src/plasma/test/serialization_tests.cc:87:
file path: '/tmp/ser-test-dkksx76p/fileXX'
1: [ OK ] TestPlasmaSerialization.SealRequest (1 ms)
1: [ RUN ] TestPlasmaSerialization.SealReply
1: /home/ishizaki/Arrow/arrow/cpp/src/plasma/test/serialization_tests.cc:87:
file path: '/tmp/ser-test-oqbs9vm0/fileXX'
1: [ OK ] TestPlasmaSerialization.SealReply (0 ms)
1: [ RUN ] TestPlasmaSerialization.GetRequest
1: /home/ishizaki/Arrow/arrow/cpp/src/plasma/test/serialization_tests.cc:87:
file path: '/tmp/ser-test-d7q6h5q4/fileXX'
1: [ OK ] TestPlasmaSerialization.GetRequest (1 ms)
1: [ RUN ] TestPlasmaSerialization.GetReply
1: /home/ishizaki/Arrow/arrow/cpp/src/plasma/test/serialization_tests.cc:87:
file path: '/tmp/ser-test-sxsncs72/fileXX'
1: [ OK ] TestPlasmaSerialization.GetReply (1 ms)
1: [ RUN ] TestPlasmaSerialization.ReleaseRequest
1: /home/ishizaki/Arrow/arrow/cpp/src/plasma/test/serialization_tests.cc:87:
file path: '/tmp/ser-test-njc3g3b5/fileXX'
1: [ OK ] TestPlasmaSerialization.ReleaseRequest (0 ms)
1: [ RUN ] TestPlasmaSerialization.ReleaseReply
1: /home/ishizaki/Arrow/arrow/cpp/src/plasma/test/serialization_tests.cc:87:
file path: '/tmp/ser-test-917ybxmo/fileXX'
1: [ OK ] TestPlasmaSerialization.ReleaseReply (1 ms)
1: [ RUN ] TestPlasmaSerialization.DeleteRequest
1: /home/ishizaki/Arrow/arrow/cpp/src/plasma/test/serialization_tests.cc:87:
file path: '/tmp/ser-test-1kwauefv/fileXX'
1: [ OK ] TestPlasmaSerialization.DeleteRequest (0 ms)
1: [ RUN ] TestPlasmaSerialization.DeleteReply
1: /home/ishizaki/Arrow/arrow/cpp/src/plasma/test/serialization_tests.cc:87:
file path: '/tmp/ser-test-4ftq28pq/fileXX'
1: /home/ishizaki/Arrow/arrow/cpp/src/plasma/test/serialization_tests.cc:271:
Failure
1: Value of: error_vec[0] == PlasmaError::ObjectExists
1: Actual: false
1: Expected: true
1: [ FAILED ] TestPlasmaSerialization.DeleteReply (1 ms)
1: [ RUN ] TestPlasmaSerialization.EvictRequest
1: /home/ishizaki/Arrow/arrow/cpp/src/plasma/test/serialization_tests.cc:87:
file path: '/tmp/ser-test-vl97870w/fileXX'
1: [ OK ] TestPlasmaSerialization.EvictRequest (0 ms)
1: [ RUN ] TestPlasmaSerialization.EvictReply
1: /home/ishizaki/Arrow/arrow/cpp/src/plasma/test/serialization_tests.cc:87:
file path: '/tmp/ser-test-3am9a6rv/fileXX'
1: [ OK ] TestPlasmaSerialization.EvictReply (1 ms)
1: [ RUN ] TestPlasmaSerialization.DataRequest
1: /home/ishizaki/Arrow/arrow/cpp/src/plasma/test/serialization_tests.cc:87:
file path: '/tmp/ser-test-plye5tmm/fileXX'
1: [ OK ] TestPlasmaSerialization.DataRequest (0 ms)
1: [ RUN ] TestPlasmaSerialization.DataReply
1: /home/ishizaki/Arrow/arrow/cpp/src/plasma/test/serialization_tests.cc:87:
file path: '/tmp/ser-test-mbu6lqsq/fileXX'
1: [ OK ] TestPlasmaSerialization.DataReply (1 ms)
1: [--] 14 tests from TestPlasmaSerialization (9 ms total)
1:
1: [--] Global test environment tear-down
1: [==] 14 tests from 1 test case ran. (9 ms total)
1: [ PASSED ] 13 tests.
1: [ FAILED ] 1 test, listed below:
1: [ FAILED ] TestPlasmaSerialization.DeleteReply
1:
1: 1 FAILED TEST
1: /home/ishizaki/Arrow/arrow/cpp/src/plasma
1/3 Test #1: plasma-serialization-tests ...***Failed0.27 sec
...
3/3 Test #3: plasma-external-store-tests .. Passed0.46 sec
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-8757) [c++] Plasma header is written in native endian
Kazuaki Ishizaki created ARROW-8757: --- Summary: [c++] Plasma header is written in native endian Key: ARROW-8757 URL: https://issues.apache.org/jira/browse/ARROW-8757 Project: Apache Arrow Issue Type: Improvement Components: C++ - Plasma Reporter: Kazuaki Ishizaki The current Plasma header (version, type, and length) is written in native endian at [here|https://github.com/apache/arrow/blob/master/cpp/src/plasma/io.cc#L65-L71]. It will be hard to interpret the Plasma data among different endian platforms in the future. At least, the header should be written in the pre-defined endian. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (ARROW-4018) [C++] RLE decoder may not big-endian compatible
[
https://issues.apache.org/jira/browse/ARROW-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki reassigned ARROW-4018:
---
Assignee: Kazuaki Ishizaki
> [C++] RLE decoder may not big-endian compatible
> ---
>
> Key: ARROW-4018
> URL: https://issues.apache.org/jira/browse/ARROW-4018
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.11.1
>Reporter: Antoine Pitrou
>Assignee: Kazuaki Ishizaki
>Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> This issue was found by Coverity. The {{RleDecoder::NextCounts}} method has
> the following code to fetch the repeated literal in repeated runs:
> {code:c++}
> bool result =
>
> bit_reader_.GetAligned(static_cast(BitUtil::CeilDiv(bit_width_, 8)),
> reinterpret_cast(¤t_value_));
> {code}
> Coverity says this:
> bq. Pointer "&this->current_value_" points to an object whose effective type
> is "unsigned long long" (64 bits, unsigned) but is dereferenced as a narrower
> "unsigned int" (32 bits, unsigned). This may lead to unexpected results
> depending on machine endianness.
> bq.
> In addition, it's not obvious whether {{current_value_}} also needs
> byte-swapping (presumably, at least in the Parquet file format, it's supposed
> to be stored in little-endian format in the RLE bitstream).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-8756) [C++] Bitmap word tests cause failures on a big-endian platform
Kazuaki Ishizaki created ARROW-8756:
---
Summary: [C++] Bitmap word tests cause failures on a big-endian
platform
Key: ARROW-8756
URL: https://issues.apache.org/jira/browse/ARROW-8756
Project: Apache Arrow
Issue Type: Improvement
Components: C++
Reporter: Kazuaki Ishizaki
The following two tests in arrow-utility-tests cause failures on big-endian
platforms
{code}
[--] 5 tests from Bitmap
[ RUN ] Bitmap.ShiftingWordsOptimization
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/bit_util_test.cc:1133: Failure
Expected equality of these values:
BitUtil::GetBit(bytes, i)
Which is: false
bool((word >> i) & 1)
Which is: true
[ FAILED ] Bitmap.ShiftingWordsOptimization (0 ms)
...
[ RUN ] Bitmap.VisitWordsAnd
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/bit_util_test.cc:1289: Failure
Value of: BitmapEquals(actual_buffer->data(), min_offset,
expected_buffer->data(), 0, num_bits)
Actual: false
Expected: true
left_offset:1 bits:8191 right_offset:0
@@ -71, +71 @@
-false
@@ -75, +74 @@
+true
@@ -79, +79 @@
-true
@@ -85, +84 @@
+false
@@ -183, +183 @@
-true
@@ -185, +184 @@
+false
@@ -199, +199 @@
-true
@@ -201, +200 @@
-true
@@ -203, +201 @@
+true
@@ -210, +209 @@
+true
@@ -223, +223 @@
-true
...
@@ -7967, +7967 @@
-false
+true
@@ -7975, +7975 @@
-true
@@ -7977, +7976 @@
+false
@@ -8007, +8007 @@
-true
@@ -8011, +8010 @@
+false
@@ -8015, +8015 @@
-true
@@ -8024, +8023 @@
+false
@@ -8039, +8039 @@
-true
@@ -8044, +8043 @@
+false
@@ -8063, +8063 @@
-true
@@ -8067, +8066 @@
+false
[ FAILED ] Bitmap.VisitWordsAnd (138 ms)
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Closed] (ARROW-8755) {C++} BitArray tests failures on big-endian platforms
[
https://issues.apache.org/jira/browse/ARROW-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki closed ARROW-8755.
---
Resolution: Duplicate
> {C++} BitArray tests failures on big-endian platforms
> -
>
> Key: ARROW-8755
> URL: https://issues.apache.org/jira/browse/ARROW-8755
> Project: Apache Arrow
> Issue Type: Sub-task
> Components: C++
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Minor
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> These two test causes failures as attached
> {code:java}
> [ FAILED ] BitArray.TestBool
> [ FAILED ] BitArray.TestValues{code}
> {code:java}
> [--] 3 tests from BitArray
> [ RUN ] BitArray.TestBool
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:52:
> Failure
> Expected equality of these values:
> buffer[0]
> Which is: '\0'
> 0xAA
> Which is: 170
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:73:
> Failure
> Expected equality of these values:
> buffer[0]
> Which is: '\0'
> 0xAA
> Which is: 170
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:74:
> Failure
> Expected equality of these values:
> buffer[1]
> Which is: '\0'
> 0xCC
> Which is: 204
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
> Failure
> Expected equality of these values:
> val
> Which is: false
> (i % 2) != 0
> Which is: true
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
> Failure
> Expected equality of these values:
> val
> Which is: false
> (i % 2) != 0
> Which is: true
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
> Failure
> Expected equality of these values:
> val
> Which is: true
> (i % 2) != 0
> Which is: false
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
> Failure
> Expected equality of these values:
> val
> Which is: true
> false
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
> Failure
> Expected equality of these values:
> val
> Which is: true
> false
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
> Failure
> Expected equality of these values:
> val
> Which is: false
> true
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
> Failure
> Expected equality of these values:
> val
> Which is: false
> true
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
> Failure
> Expected equality of these values:
> val
> Which is: true
> false
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
> Failure
> Expected equality of these values:
> val
> Which is: true
> false
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
> Failure
> Expected equality of these values:
> val
> Which is: false
> true
> [ FAILED ] BitArray.TestBool (3 ms)
> [ RUN ] BitArray.TestValues
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 0
> i % mod
> Which is: 1
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 0
> i % mod
> Which is: 1
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 2
> i % mod
> Which is: 0
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 2
> i % mod
> Which is: 0
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 2
> i % mod
> Which is: 1
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 2
> i % mod
> Which is: 0
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 2
> i % mod
> Which is: 1
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 2
> i % mod
> Which is: 3
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 4
> i % mod
> Which is: 0
> /home/ishizaki/Arro
[jira] [Commented] (ARROW-8486) [C++] arrow-utility-test causes failures on a big-endian platform
[
https://issues.apache.org/jira/browse/ARROW-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103682#comment-17103682
]
Kazuaki Ishizaki commented on ARROW-8486:
-
These two test causes failures as attached
{code:java}
[ FAILED ] BitArray.TestBool
[ FAILED ] BitArray.TestValues{code}
{code:java}
[--] 3 tests from BitArray
[ RUN ] BitArray.TestBool
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:52:
Failure
Expected equality of these values:
buffer[0]
Which is: '\0'
0xAA
Which is: 170
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:73:
Failure
Expected equality of these values:
buffer[0]
Which is: '\0'
0xAA
Which is: 170
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:74:
Failure
Expected equality of these values:
buffer[1]
Which is: '\0'
0xCC
Which is: 204
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
Failure
Expected equality of these values:
val
Which is: false
(i % 2) != 0
Which is: true
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
Failure
Expected equality of these values:
val
Which is: false
(i % 2) != 0
Which is: true
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
Failure
Expected equality of these values:
val
Which is: true
(i % 2) != 0
Which is: false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
Failure
Expected equality of these values:
val
Which is: true
false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
Failure
Expected equality of these values:
val
Which is: true
false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
Failure
Expected equality of these values:
val
Which is: false
true
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
Failure
Expected equality of these values:
val
Which is: false
true
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
Failure
Expected equality of these values:
val
Which is: true
false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
Failure
Expected equality of these values:
val
Which is: true
false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
Failure
Expected equality of these values:
val
Which is: false
true
[ FAILED ] BitArray.TestBool (3 ms)
[ RUN ] BitArray.TestValues
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 0
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 0
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 3
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 3
i % mod
[jira] [Assigned] (ARROW-8755) {C++} BitArray tests failures on big-endian platforms
[
https://issues.apache.org/jira/browse/ARROW-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki reassigned ARROW-8755:
---
Assignee: Kazuaki Ishizaki
> {C++} BitArray tests failures on big-endian platforms
> -
>
> Key: ARROW-8755
> URL: https://issues.apache.org/jira/browse/ARROW-8755
> Project: Apache Arrow
> Issue Type: Sub-task
> Components: C++
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Minor
>
> These two test causes failures as attached
> {code:java}
> [ FAILED ] BitArray.TestBool
> [ FAILED ] BitArray.TestValues{code}
> {code:java}
> [--] 3 tests from BitArray
> [ RUN ] BitArray.TestBool
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:52:
> Failure
> Expected equality of these values:
> buffer[0]
> Which is: '\0'
> 0xAA
> Which is: 170
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:73:
> Failure
> Expected equality of these values:
> buffer[0]
> Which is: '\0'
> 0xAA
> Which is: 170
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:74:
> Failure
> Expected equality of these values:
> buffer[1]
> Which is: '\0'
> 0xCC
> Which is: 204
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
> Failure
> Expected equality of these values:
> val
> Which is: false
> (i % 2) != 0
> Which is: true
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
> Failure
> Expected equality of these values:
> val
> Which is: false
> (i % 2) != 0
> Which is: true
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
> Failure
> Expected equality of these values:
> val
> Which is: true
> (i % 2) != 0
> Which is: false
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
> Failure
> Expected equality of these values:
> val
> Which is: true
> false
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
> Failure
> Expected equality of these values:
> val
> Which is: true
> false
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
> Failure
> Expected equality of these values:
> val
> Which is: false
> true
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
> Failure
> Expected equality of these values:
> val
> Which is: false
> true
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
> Failure
> Expected equality of these values:
> val
> Which is: true
> false
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
> Failure
> Expected equality of these values:
> val
> Which is: true
> false
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
> Failure
> Expected equality of these values:
> val
> Which is: false
> true
> [ FAILED ] BitArray.TestBool (3 ms)
> [ RUN ] BitArray.TestValues
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 0
> i % mod
> Which is: 1
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 0
> i % mod
> Which is: 1
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 2
> i % mod
> Which is: 0
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 2
> i % mod
> Which is: 0
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 2
> i % mod
> Which is: 1
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 2
> i % mod
> Which is: 0
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 2
> i % mod
> Which is: 1
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 2
> i % mod
> Which is: 3
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equality of these values:
> val
> Which is: 4
> i % mod
> Which is: 0
> /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
> Failure
> Expected equali
[jira] [Updated] (ARROW-8755) {C++} BitArray tests failures on big-endian platforms
[
https://issues.apache.org/jira/browse/ARROW-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated ARROW-8755:
Description:
These two test causes failures as attached
{code:java}
[ FAILED ] BitArray.TestBool
[ FAILED ] BitArray.TestValues{code}
{code:java}
[--] 3 tests from BitArray
[ RUN ] BitArray.TestBool
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:52:
Failure
Expected equality of these values:
buffer[0]
Which is: '\0'
0xAA
Which is: 170
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:73:
Failure
Expected equality of these values:
buffer[0]
Which is: '\0'
0xAA
Which is: 170
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:74:
Failure
Expected equality of these values:
buffer[1]
Which is: '\0'
0xCC
Which is: 204
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
Failure
Expected equality of these values:
val
Which is: false
(i % 2) != 0
Which is: true
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
Failure
Expected equality of these values:
val
Which is: false
(i % 2) != 0
Which is: true
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
Failure
Expected equality of these values:
val
Which is: true
(i % 2) != 0
Which is: false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
Failure
Expected equality of these values:
val
Which is: true
false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
Failure
Expected equality of these values:
val
Which is: true
false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
Failure
Expected equality of these values:
val
Which is: false
true
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
Failure
Expected equality of these values:
val
Which is: false
true
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
Failure
Expected equality of these values:
val
Which is: true
false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
Failure
Expected equality of these values:
val
Which is: true
false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
Failure
Expected equality of these values:
val
Which is: false
true
[ FAILED ] BitArray.TestBool (3 ms)
[ RUN ] BitArray.TestValues
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 0
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 0
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 3
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 3
i % mod
Which is: 2
/home/ishizaki/Arrow/arro
[jira] [Issue Comment Deleted] (ARROW-8486) [C++] arrow-utility-test causes failures on a big-endian platform
[
https://issues.apache.org/jira/browse/ARROW-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated ARROW-8486:
Comment: was deleted
(was: These two test causes failures as attached
{code:java}
[ FAILED ] BitArray.TestBool
[ FAILED ] BitArray.TestValues{code}
{code:java}
[--] 3 tests from BitArray
[ RUN ] BitArray.TestBool
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:52:
Failure
Expected equality of these values:
buffer[0]
Which is: '\0'
0xAA
Which is: 170
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:73:
Failure
Expected equality of these values:
buffer[0]
Which is: '\0'
0xAA
Which is: 170
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:74:
Failure
Expected equality of these values:
buffer[1]
Which is: '\0'
0xCC
Which is: 204
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
Failure
Expected equality of these values:
val
Which is: false
(i % 2) != 0
Which is: true
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
Failure
Expected equality of these values:
val
Which is: false
(i % 2) != 0
Which is: true
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
Failure
Expected equality of these values:
val
Which is: true
(i % 2) != 0
Which is: false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
Failure
Expected equality of these values:
val
Which is: true
false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
Failure
Expected equality of these values:
val
Which is: true
false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
Failure
Expected equality of these values:
val
Which is: false
true
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
Failure
Expected equality of these values:
val
Which is: false
true
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
Failure
Expected equality of these values:
val
Which is: true
false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
Failure
Expected equality of these values:
val
Which is: true
false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
Failure
Expected equality of these values:
val
Which is: false
true
[ FAILED ] BitArray.TestBool (3 ms)
[ RUN ] BitArray.TestValues
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 0
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 0
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 3
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 3
i % mod
Which is: 2
/home/ishiz
[jira] [Created] (ARROW-8755) {C++} BitArray tests failures on big-endian platforms
Kazuaki Ishizaki created ARROW-8755:
---
Summary: {C++} BitArray tests failures on big-endian platforms
Key: ARROW-8755
URL: https://issues.apache.org/jira/browse/ARROW-8755
Project: Apache Arrow
Issue Type: Sub-task
Components: C++
Reporter: Kazuaki Ishizaki
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (ARROW-8486) [C++] arrow-utility-test causes failures on a big-endian platform
[
https://issues.apache.org/jira/browse/ARROW-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103679#comment-17103679
]
Kazuaki Ishizaki commented on ARROW-8486:
-
These two test causes failures as attached
{code:java}
[ FAILED ] BitArray.TestBool
[ FAILED ] BitArray.TestValues{code}
{code:java}
[--] 3 tests from BitArray
[ RUN ] BitArray.TestBool
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:52:
Failure
Expected equality of these values:
buffer[0]
Which is: '\0'
0xAA
Which is: 170
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:73:
Failure
Expected equality of these values:
buffer[0]
Which is: '\0'
0xAA
Which is: 170
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:74:
Failure
Expected equality of these values:
buffer[1]
Which is: '\0'
0xCC
Which is: 204
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
Failure
Expected equality of these values:
val
Which is: false
(i % 2) != 0
Which is: true
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
Failure
Expected equality of these values:
val
Which is: false
(i % 2) != 0
Which is: true
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:82:
Failure
Expected equality of these values:
val
Which is: true
(i % 2) != 0
Which is: false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
Failure
Expected equality of these values:
val
Which is: true
false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
Failure
Expected equality of these values:
val
Which is: true
false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
Failure
Expected equality of these values:
val
Which is: false
true
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
Failure
Expected equality of these values:
val
Which is: false
true
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
Failure
Expected equality of these values:
val
Which is: true
false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:94:
Failure
Expected equality of these values:
val
Which is: true
false
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:97:
Failure
Expected equality of these values:
val
Which is: false
true
[ FAILED ] BitArray.TestBool (3 ms)
[ RUN ] BitArray.TestValues
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 0
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 0
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 2
i % mod
Which is: 3
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 0
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 4
i % mod
Which is: 1
/home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/rle_encoding_test.cc:123:
Failure
Expected equality of these values:
val
Which is: 3
i % mod
[jira] [Updated] (ARROW-8754) [C++][CI] enable tests for additional components on big-endian platforms
[
https://issues.apache.org/jira/browse/ARROW-8754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated ARROW-8754:
Summary: [C++][CI] enable tests for additional components on big-endian
platforms (was: [C++] enable tests for additional components on big-endian
platforms)
> [C++][CI] enable tests for additional components on big-endian platforms
>
>
> Key: ARROW-8754
> URL: https://issues.apache.org/jira/browse/ARROW-8754
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, CI
>Reporter: Kazuaki Ishizaki
>Priority: Minor
>
> At the current master, I confirmed that tests for additional components
> (ARROW_COMPUTE, ARROW_DATASET, ARROW_FILESYSTEM, ARROW_HDFS, ARROW_ORC, and
> ARROW_IPC (default on)) pass.
> {code}
> Start 1: arrow-array-test
> 1/51 Test #1: arrow-array-test . Passed4.62 sec
> Start 2: arrow-buffer-test
> 2/51 Test #2: arrow-buffer-test Passed0.14 sec
> Start 3: arrow-extension-type-test
> 3/51 Test #3: arrow-extension-type-test Passed0.12 sec
> Start 4: arrow-misc-test
> 4/51 Test #4: arrow-misc-test .. Passed0.14 sec
> Start 5: arrow-public-api-test
> 5/51 Test #5: arrow-public-api-test Passed0.12 sec
> Start 6: arrow-scalar-test
> 6/51 Test #6: arrow-scalar-test Passed0.13 sec
> Start 7: arrow-type-test
> 7/51 Test #7: arrow-type-test .. Passed0.14 sec
> Start 8: arrow-table-test
> 8/51 Test #8: arrow-table-test . Passed0.13 sec
> Start 9: arrow-tensor-test
> 9/51 Test #9: arrow-tensor-test Passed0.13 sec
> Start 10: arrow-sparse-tensor-test
> 10/51 Test #10: arrow-sparse-tensor-test . Passed0.16 sec
> Start 11: arrow-stl-test
> 11/51 Test #11: arrow-stl-test ... Passed0.12 sec
> Start 12: arrow-concatenate-test
> 12/51 Test #12: arrow-concatenate-test ... Passed0.53 sec
> Start 13: arrow-diff-test
> 13/51 Test #13: arrow-diff-test .. Passed1.45 sec
> Start 14: arrow-c-bridge-test
> 14/51 Test #14: arrow-c-bridge-test .. Passed0.18 sec
> Start 15: arrow-io-buffered-test
> 15/51 Test #15: arrow-io-buffered-test ... Passed0.20 sec
> Start 16: arrow-io-compressed-test
> 16/51 Test #16: arrow-io-compressed-test . Passed3.48 sec
> Start 17: arrow-io-file-test
> 17/51 Test #17: arrow-io-file-test ... Passed0.74 sec
> Start 18: arrow-io-hdfs-test
> 18/51 Test #18: arrow-io-hdfs-test ... Passed0.12 sec
> Start 19: arrow-io-memory-test
> 19/51 Test #19: arrow-io-memory-test . Passed2.77 sec
> Start 20: arrow-utility-test
> 20/51 Test #20: arrow-utility-test ...***Failed5.65 sec
> Start 21: arrow-threading-utility-test
> 21/51 Test #21: arrow-threading-utility-test . Passed1.34 sec
> Start 22: arrow-compute-compute-test
> 22/51 Test #22: arrow-compute-compute-test ... Passed0.13 sec
> Start 23: arrow-compute-boolean-test
> 23/51 Test #23: arrow-compute-boolean-test ... Passed0.15 sec
> Start 24: arrow-compute-cast-test
> 24/51 Test #24: arrow-compute-cast-test .. Passed0.22 sec
> Start 25: arrow-compute-hash-test
> 25/51 Test #25: arrow-compute-hash-test .. Passed2.61 sec
> Start 26: arrow-compute-isin-test
> 26/51 Test #26: arrow-compute-isin-test .. Passed0.81 sec
> Start 27: arrow-compute-match-test
> 27/51 Test #27: arrow-compute-match-test . Passed0.40 sec
> Start 28: arrow-compute-sort-to-indices-test
> 28/51 Test #28: arrow-compute-sort-to-indices-test ... Passed3.33 sec
> Start 29: arrow-compute-nth-to-indices-test
> 29/51 Test #29: arrow-compute-nth-to-indices-test Passed1.51 sec
> Start 30: arrow-compute-util-internal-test
> 30/51 Test #30: arrow-compute-util-internal-test . Passed0.13 sec
> Start 31: arrow-compute-add-test
> 31/51 Test #31: arrow-compute-add-test ... Passed0.12 sec
> Start 32: arrow-compute-aggregate-test
> 32/51 Test #32: arrow-compute-aggregate-test . Passed 14.70 sec
> Start 33: arrow-compute-compare-test
> 33/51 Test #33: arrow-compute-compare-test ... Passed7.96 sec
> Start 34: arrow-compute-take-test
> 34/51 Test #34: arrow-compute-take-test
[jira] [Updated] (ARROW-8754) [C++] enable tests for additional components on big-endian platforms
[
https://issues.apache.org/jira/browse/ARROW-8754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated ARROW-8754:
Component/s: CI
> [C++] enable tests for additional components on big-endian platforms
>
>
> Key: ARROW-8754
> URL: https://issues.apache.org/jira/browse/ARROW-8754
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, CI
>Reporter: Kazuaki Ishizaki
>Priority: Minor
>
> At the current master, I confirmed that tests for additional components
> (ARROW_COMPUTE, ARROW_DATASET, ARROW_FILESYSTEM, ARROW_HDFS, ARROW_ORC, and
> ARROW_IPC (default on)) pass.
> {code}
> Start 1: arrow-array-test
> 1/51 Test #1: arrow-array-test . Passed4.62 sec
> Start 2: arrow-buffer-test
> 2/51 Test #2: arrow-buffer-test Passed0.14 sec
> Start 3: arrow-extension-type-test
> 3/51 Test #3: arrow-extension-type-test Passed0.12 sec
> Start 4: arrow-misc-test
> 4/51 Test #4: arrow-misc-test .. Passed0.14 sec
> Start 5: arrow-public-api-test
> 5/51 Test #5: arrow-public-api-test Passed0.12 sec
> Start 6: arrow-scalar-test
> 6/51 Test #6: arrow-scalar-test Passed0.13 sec
> Start 7: arrow-type-test
> 7/51 Test #7: arrow-type-test .. Passed0.14 sec
> Start 8: arrow-table-test
> 8/51 Test #8: arrow-table-test . Passed0.13 sec
> Start 9: arrow-tensor-test
> 9/51 Test #9: arrow-tensor-test Passed0.13 sec
> Start 10: arrow-sparse-tensor-test
> 10/51 Test #10: arrow-sparse-tensor-test . Passed0.16 sec
> Start 11: arrow-stl-test
> 11/51 Test #11: arrow-stl-test ... Passed0.12 sec
> Start 12: arrow-concatenate-test
> 12/51 Test #12: arrow-concatenate-test ... Passed0.53 sec
> Start 13: arrow-diff-test
> 13/51 Test #13: arrow-diff-test .. Passed1.45 sec
> Start 14: arrow-c-bridge-test
> 14/51 Test #14: arrow-c-bridge-test .. Passed0.18 sec
> Start 15: arrow-io-buffered-test
> 15/51 Test #15: arrow-io-buffered-test ... Passed0.20 sec
> Start 16: arrow-io-compressed-test
> 16/51 Test #16: arrow-io-compressed-test . Passed3.48 sec
> Start 17: arrow-io-file-test
> 17/51 Test #17: arrow-io-file-test ... Passed0.74 sec
> Start 18: arrow-io-hdfs-test
> 18/51 Test #18: arrow-io-hdfs-test ... Passed0.12 sec
> Start 19: arrow-io-memory-test
> 19/51 Test #19: arrow-io-memory-test . Passed2.77 sec
> Start 20: arrow-utility-test
> 20/51 Test #20: arrow-utility-test ...***Failed5.65 sec
> Start 21: arrow-threading-utility-test
> 21/51 Test #21: arrow-threading-utility-test . Passed1.34 sec
> Start 22: arrow-compute-compute-test
> 22/51 Test #22: arrow-compute-compute-test ... Passed0.13 sec
> Start 23: arrow-compute-boolean-test
> 23/51 Test #23: arrow-compute-boolean-test ... Passed0.15 sec
> Start 24: arrow-compute-cast-test
> 24/51 Test #24: arrow-compute-cast-test .. Passed0.22 sec
> Start 25: arrow-compute-hash-test
> 25/51 Test #25: arrow-compute-hash-test .. Passed2.61 sec
> Start 26: arrow-compute-isin-test
> 26/51 Test #26: arrow-compute-isin-test .. Passed0.81 sec
> Start 27: arrow-compute-match-test
> 27/51 Test #27: arrow-compute-match-test . Passed0.40 sec
> Start 28: arrow-compute-sort-to-indices-test
> 28/51 Test #28: arrow-compute-sort-to-indices-test ... Passed3.33 sec
> Start 29: arrow-compute-nth-to-indices-test
> 29/51 Test #29: arrow-compute-nth-to-indices-test Passed1.51 sec
> Start 30: arrow-compute-util-internal-test
> 30/51 Test #30: arrow-compute-util-internal-test . Passed0.13 sec
> Start 31: arrow-compute-add-test
> 31/51 Test #31: arrow-compute-add-test ... Passed0.12 sec
> Start 32: arrow-compute-aggregate-test
> 32/51 Test #32: arrow-compute-aggregate-test . Passed 14.70 sec
> Start 33: arrow-compute-compare-test
> 33/51 Test #33: arrow-compute-compare-test ... Passed7.96 sec
> Start 34: arrow-compute-take-test
> 34/51 Test #34: arrow-compute-take-test .. Passed4.80 sec
> Start 35: arrow-compute-filter-test
> 35/51 Test #35: arrow-compute-filter-test Passed8.2
[jira] [Created] (ARROW-8754) [C++] enable tests for additional components on big-endian platforms
Kazuaki Ishizaki created ARROW-8754:
---
Summary: [C++] enable tests for additional components on
big-endian platforms
Key: ARROW-8754
URL: https://issues.apache.org/jira/browse/ARROW-8754
Project: Apache Arrow
Issue Type: Improvement
Components: C++
Reporter: Kazuaki Ishizaki
At the current master, I confirmed that tests for additional components
(ARROW_COMPUTE, ARROW_DATASET, ARROW_FILESYSTEM, ARROW_HDFS, ARROW_ORC, and
ARROW_IPC (default on)) pass.
{code}
Start 1: arrow-array-test
1/51 Test #1: arrow-array-test . Passed4.62 sec
Start 2: arrow-buffer-test
2/51 Test #2: arrow-buffer-test Passed0.14 sec
Start 3: arrow-extension-type-test
3/51 Test #3: arrow-extension-type-test Passed0.12 sec
Start 4: arrow-misc-test
4/51 Test #4: arrow-misc-test .. Passed0.14 sec
Start 5: arrow-public-api-test
5/51 Test #5: arrow-public-api-test Passed0.12 sec
Start 6: arrow-scalar-test
6/51 Test #6: arrow-scalar-test Passed0.13 sec
Start 7: arrow-type-test
7/51 Test #7: arrow-type-test .. Passed0.14 sec
Start 8: arrow-table-test
8/51 Test #8: arrow-table-test . Passed0.13 sec
Start 9: arrow-tensor-test
9/51 Test #9: arrow-tensor-test Passed0.13 sec
Start 10: arrow-sparse-tensor-test
10/51 Test #10: arrow-sparse-tensor-test . Passed0.16 sec
Start 11: arrow-stl-test
11/51 Test #11: arrow-stl-test ... Passed0.12 sec
Start 12: arrow-concatenate-test
12/51 Test #12: arrow-concatenate-test ... Passed0.53 sec
Start 13: arrow-diff-test
13/51 Test #13: arrow-diff-test .. Passed1.45 sec
Start 14: arrow-c-bridge-test
14/51 Test #14: arrow-c-bridge-test .. Passed0.18 sec
Start 15: arrow-io-buffered-test
15/51 Test #15: arrow-io-buffered-test ... Passed0.20 sec
Start 16: arrow-io-compressed-test
16/51 Test #16: arrow-io-compressed-test . Passed3.48 sec
Start 17: arrow-io-file-test
17/51 Test #17: arrow-io-file-test ... Passed0.74 sec
Start 18: arrow-io-hdfs-test
18/51 Test #18: arrow-io-hdfs-test ... Passed0.12 sec
Start 19: arrow-io-memory-test
19/51 Test #19: arrow-io-memory-test . Passed2.77 sec
Start 20: arrow-utility-test
20/51 Test #20: arrow-utility-test ...***Failed5.65 sec
Start 21: arrow-threading-utility-test
21/51 Test #21: arrow-threading-utility-test . Passed1.34 sec
Start 22: arrow-compute-compute-test
22/51 Test #22: arrow-compute-compute-test ... Passed0.13 sec
Start 23: arrow-compute-boolean-test
23/51 Test #23: arrow-compute-boolean-test ... Passed0.15 sec
Start 24: arrow-compute-cast-test
24/51 Test #24: arrow-compute-cast-test .. Passed0.22 sec
Start 25: arrow-compute-hash-test
25/51 Test #25: arrow-compute-hash-test .. Passed2.61 sec
Start 26: arrow-compute-isin-test
26/51 Test #26: arrow-compute-isin-test .. Passed0.81 sec
Start 27: arrow-compute-match-test
27/51 Test #27: arrow-compute-match-test . Passed0.40 sec
Start 28: arrow-compute-sort-to-indices-test
28/51 Test #28: arrow-compute-sort-to-indices-test ... Passed3.33 sec
Start 29: arrow-compute-nth-to-indices-test
29/51 Test #29: arrow-compute-nth-to-indices-test Passed1.51 sec
Start 30: arrow-compute-util-internal-test
30/51 Test #30: arrow-compute-util-internal-test . Passed0.13 sec
Start 31: arrow-compute-add-test
31/51 Test #31: arrow-compute-add-test ... Passed0.12 sec
Start 32: arrow-compute-aggregate-test
32/51 Test #32: arrow-compute-aggregate-test . Passed 14.70 sec
Start 33: arrow-compute-compare-test
33/51 Test #33: arrow-compute-compare-test ... Passed7.96 sec
Start 34: arrow-compute-take-test
34/51 Test #34: arrow-compute-take-test .. Passed4.80 sec
Start 35: arrow-compute-filter-test
35/51 Test #35: arrow-compute-filter-test Passed8.23 sec
Start 36: arrow-dataset-dataset-test
36/51 Test #36: arrow-dataset-dataset-test ... Passed0.25 sec
Start 37: arrow-dataset-discovery-test
37/51 Test #37: arrow-dataset-discovery-test . Passed0.13 sec
Start 38: arrow-dataset-file-ipc-test
38/51 Test #38: arrow-dataset-file-ipc-test .. Passed0.21 sec
Start 39: ar
[jira] [Assigned] (ARROW-8747) [C++] Feather tests with compression cause failure on big-endian platforms
[
https://issues.apache.org/jira/browse/ARROW-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki reassigned ARROW-8747:
---
Assignee: Kazuaki Ishizaki
> [C++] Feather tests with compression cause failure on big-endian platforms
> --
>
> Key: ARROW-8747
> URL: https://issues.apache.org/jira/browse/ARROW-8747
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Minor
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> These tests are failed on Travis-CI s390x like
> https://travis-ci.org/github/apache/arrow/builds/685085866#L3038
> {code}
> ...
> [ RUN ] FeatherTests/TestFeather.ReadIndicesOrNames/0
> [ OK ] FeatherTests/TestFeather.ReadIndicesOrNames/0 (7 ms)
> [ RUN ] FeatherTests/TestFeather.ReadIndicesOrNames/1
> [ OK ] FeatherTests/TestFeather.ReadIndicesOrNames/1 (1 ms)
> [ RUN ] FeatherTests/TestFeather.ReadIndicesOrNames/2
> /arrow/cpp/build-support/run-test.sh: line 92: 6340 Killed
> $TEST_EXECUTABLE "$@" 2>&1
> 6341 Done| ${PYTHON:-python}
> $ROOT/build-support/asan_symbolize.py
> 6342 Done| ${CXXFILT:-c++filt}
> 6343 Done|
> $ROOT/build-support/stacktrace_addr2line.pl $TEST_EXECUTABLE
> 6344 Done| $pipe_cmd 2>&1
> 6345 Done| tee $LOGFILE
> /build/cpp/src/arrow/ipc
> ...
> [--] 5 tests from TestWriteRecordBatch
> [ RUN ] TestWriteRecordBatch.WriteWithCompression
> /arrow/cpp/build-support/run-test.sh: line 92: 6719 Killed
> $TEST_EXECUTABLE "$@" 2>&1
> 6720 Done| ${PYTHON:-python}
> $ROOT/build-support/asan_symbolize.py
> 6721 Done| ${CXXFILT:-c++filt}
> 6722 Done|
> $ROOT/build-support/stacktrace_addr2line.pl $TEST_EXECUTABLE
> 6723 Done| $pipe_cmd 2>&1
> 6724 Done| tee $LOGFILE
> /build/cpp/src/arrow/ipc
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (ARROW-8747) [C++] Feather tests with compression cause failure on big-endian platforms
[
https://issues.apache.org/jira/browse/ARROW-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated ARROW-8747:
Description:
These tests are failed on Travis-CI s390x like
https://travis-ci.org/github/apache/arrow/builds/685085866#L3038
{code}
...
[ RUN ] FeatherTests/TestFeather.ReadIndicesOrNames/0
[ OK ] FeatherTests/TestFeather.ReadIndicesOrNames/0 (7 ms)
[ RUN ] FeatherTests/TestFeather.ReadIndicesOrNames/1
[ OK ] FeatherTests/TestFeather.ReadIndicesOrNames/1 (1 ms)
[ RUN ] FeatherTests/TestFeather.ReadIndicesOrNames/2
/arrow/cpp/build-support/run-test.sh: line 92: 6340 Killed
$TEST_EXECUTABLE "$@" 2>&1
6341 Done| ${PYTHON:-python}
$ROOT/build-support/asan_symbolize.py
6342 Done| ${CXXFILT:-c++filt}
6343 Done|
$ROOT/build-support/stacktrace_addr2line.pl $TEST_EXECUTABLE
6344 Done| $pipe_cmd 2>&1
6345 Done| tee $LOGFILE
/build/cpp/src/arrow/ipc
...
[--] 5 tests from TestWriteRecordBatch
[ RUN ] TestWriteRecordBatch.WriteWithCompression
/arrow/cpp/build-support/run-test.sh: line 92: 6719 Killed
$TEST_EXECUTABLE "$@" 2>&1
6720 Done| ${PYTHON:-python}
$ROOT/build-support/asan_symbolize.py
6721 Done| ${CXXFILT:-c++filt}
6722 Done|
$ROOT/build-support/stacktrace_addr2line.pl $TEST_EXECUTABLE
6723 Done| $pipe_cmd 2>&1
6724 Done| tee $LOGFILE
/build/cpp/src/arrow/ipc
{code}
was:
These tests are failed on Travis-CI s390x
{code}
...
[ RUN ] FeatherTests/TestFeather.ReadIndicesOrNames/0
[ OK ] FeatherTests/TestFeather.ReadIndicesOrNames/0 (7 ms)
[ RUN ] FeatherTests/TestFeather.ReadIndicesOrNames/1
[ OK ] FeatherTests/TestFeather.ReadIndicesOrNames/1 (1 ms)
[ RUN ] FeatherTests/TestFeather.ReadIndicesOrNames/2
/arrow/cpp/build-support/run-test.sh: line 92: 6340 Killed
$TEST_EXECUTABLE "$@" 2>&1
6341 Done| ${PYTHON:-python}
$ROOT/build-support/asan_symbolize.py
6342 Done| ${CXXFILT:-c++filt}
6343 Done|
$ROOT/build-support/stacktrace_addr2line.pl $TEST_EXECUTABLE
6344 Done| $pipe_cmd 2>&1
6345 Done| tee $LOGFILE
/build/cpp/src/arrow/ipc
...
[--] 5 tests from TestWriteRecordBatch
[ RUN ] TestWriteRecordBatch.WriteWithCompression
/arrow/cpp/build-support/run-test.sh: line 92: 6719 Killed
$TEST_EXECUTABLE "$@" 2>&1
6720 Done| ${PYTHON:-python}
$ROOT/build-support/asan_symbolize.py
6721 Done| ${CXXFILT:-c++filt}
6722 Done|
$ROOT/build-support/stacktrace_addr2line.pl $TEST_EXECUTABLE
6723 Done| $pipe_cmd 2>&1
6724 Done| tee $LOGFILE
/build/cpp/src/arrow/ipc
{code}
> [C++] Feather tests with compression cause failure on big-endian platforms
> --
>
> Key: ARROW-8747
> URL: https://issues.apache.org/jira/browse/ARROW-8747
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
>Reporter: Kazuaki Ishizaki
>Priority: Minor
>
> These tests are failed on Travis-CI s390x like
> https://travis-ci.org/github/apache/arrow/builds/685085866#L3038
> {code}
> ...
> [ RUN ] FeatherTests/TestFeather.ReadIndicesOrNames/0
> [ OK ] FeatherTests/TestFeather.ReadIndicesOrNames/0 (7 ms)
> [ RUN ] FeatherTests/TestFeather.ReadIndicesOrNames/1
> [ OK ] FeatherTests/TestFeather.ReadIndicesOrNames/1 (1 ms)
> [ RUN ] FeatherTests/TestFeather.ReadIndicesOrNames/2
> /arrow/cpp/build-support/run-test.sh: line 92: 6340 Killed
> $TEST_EXECUTABLE "$@" 2>&1
> 6341 Done| ${PYTHON:-python}
> $ROOT/build-support/asan_symbolize.py
> 6342 Done| ${CXXFILT:-c++filt}
> 6343 Done|
> $ROOT/build-support/stacktrace_addr2line.pl $TEST_EXECUTABLE
> 6344 Done| $pipe_cmd 2>&1
> 6345 Done| tee $LOGFILE
> /build/cpp/src/arrow/ipc
> ...
> [--] 5 tests from TestWriteRecordBatch
> [ RUN ] TestWriteRecordBatch.WriteWithCompression
> /arrow/cpp/build-support/run-test.sh: line 92: 6719 Killed
> $TEST_EXECUTABLE "$@" 2>&1
> 6720 Done| ${PYTHON:-python}
> $ROOT/build-support/asan_symbolize.py
> 6721 Done| ${CXXFILT:-c++filt}
> 6722 Done|
> $ROOT/build-s
[jira] [Created] (ARROW-8747) [C++] Feather tests with compression cause failure on big-endian platforms
Kazuaki Ishizaki created ARROW-8747:
---
Summary: [C++] Feather tests with compression cause failure on
big-endian platforms
Key: ARROW-8747
URL: https://issues.apache.org/jira/browse/ARROW-8747
Project: Apache Arrow
Issue Type: Improvement
Components: C++
Reporter: Kazuaki Ishizaki
These tests are failed on Travis-CI s390x
{code}
...
[ RUN ] FeatherTests/TestFeather.ReadIndicesOrNames/0
[ OK ] FeatherTests/TestFeather.ReadIndicesOrNames/0 (7 ms)
[ RUN ] FeatherTests/TestFeather.ReadIndicesOrNames/1
[ OK ] FeatherTests/TestFeather.ReadIndicesOrNames/1 (1 ms)
[ RUN ] FeatherTests/TestFeather.ReadIndicesOrNames/2
/arrow/cpp/build-support/run-test.sh: line 92: 6340 Killed
$TEST_EXECUTABLE "$@" 2>&1
6341 Done| ${PYTHON:-python}
$ROOT/build-support/asan_symbolize.py
6342 Done| ${CXXFILT:-c++filt}
6343 Done|
$ROOT/build-support/stacktrace_addr2line.pl $TEST_EXECUTABLE
6344 Done| $pipe_cmd 2>&1
6345 Done| tee $LOGFILE
/build/cpp/src/arrow/ipc
...
[--] 5 tests from TestWriteRecordBatch
[ RUN ] TestWriteRecordBatch.WriteWithCompression
/arrow/cpp/build-support/run-test.sh: line 92: 6719 Killed
$TEST_EXECUTABLE "$@" 2>&1
6720 Done| ${PYTHON:-python}
$ROOT/build-support/asan_symbolize.py
6721 Done| ${CXXFILT:-c++filt}
6722 Done|
$ROOT/build-support/stacktrace_addr2line.pl $TEST_EXECUTABLE
6723 Done| $pipe_cmd 2>&1
6724 Done| tee $LOGFILE
/build/cpp/src/arrow/ipc
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (ARROW-8486) [C++] arrow-utility-test causes failures on a big-endian platform
[
https://issues.apache.org/jira/browse/ARROW-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki reassigned ARROW-8486:
---
Assignee: Kazuaki Ishizaki
> [C++] arrow-utility-test causes failures on a big-endian platform
> -
>
> Key: ARROW-8486
> URL: https://issues.apache.org/jira/browse/ARROW-8486
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Minor
>
> The current master causes the following failures in arrow-util-test.
> {code}
> Start 17: arrow-utility-test
> ...
> 17: [ PASSED ] 253 tests.
> 17: [ FAILED ] 11 tests, listed below:
> 17: [ FAILED ] Bitmap.ShiftingWordsOptimization
> 17: [ FAILED ] Bitmap.VisitWordsAnd
> 17: [ FAILED ] BitArray.TestBool
> 17: [ FAILED ] BitArray.TestValues
> 17: [ FAILED ] Rle.SpecificSequences
> 17: [ FAILED ] Rle.TestValues
> 17: [ FAILED ] BitRle.Flush
> 17: [ FAILED ] BitRle.Random
> 17: [ FAILED ] BitRle.RepeatedPattern
> 17: [ FAILED ] BitRle.Overflow
> 17: [ FAILED ] RleDecoder.GetBatchSpaced
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (ARROW-8745) [C++] Bitmap.ToString causes failures on a big-endian platform
[
https://issues.apache.org/jira/browse/ARROW-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki reassigned ARROW-8745:
---
Assignee: Kazuaki Ishizaki
> [C++] Bitmap.ToString causes failures on a big-endian platform
> --
>
> Key: ARROW-8745
> URL: https://issues.apache.org/jira/browse/ARROW-8745
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> The new test causes the failure on a big-endian platform.
> {code}
> 1: [--] 5 tests from Bitmap
> 1: [ RUN ] Bitmap.ShiftingWordsOptimization
> 1: [ OK ] Bitmap.ShiftingWordsOptimization (7 ms)
> 1: [ RUN ] Bitmap.VisitWords
> 1: [ OK ] Bitmap.VisitWords (3 ms)
> 1: [ RUN ] Bitmap.VisitPartialWords
> 1: [ OK ] Bitmap.VisitPartialWords (0 ms)
> 1: [ RUN ] Bitmap.ToString
> 1: /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/bit_util_test.cc:1265:
> Failure
> 1: Expected equality of these values:
> 1: Bitmap(bitmap, 0, 34).ToString()
> 1: Which is: " 00"
> 1: "00110101 01010011 00"
> 1: /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/bit_util_test.cc:1267:
> Failure
> 1: Expected equality of these values:
> 1: Bitmap(bitmap, 0, 16).ToString()
> 1: Which is: " "
> 1: "00110101 01010011"
> 1: /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/bit_util_test.cc:1268:
> Failure
> 1: Expected equality of these values:
> 1: Bitmap(bitmap, 0, 11).ToString()
> 1: Which is: " 000"
> 1: "00110101 010"
> 1: /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/bit_util_test.cc:1269:
> Failure
> 1: Expected equality of these values:
> 1: Bitmap(bitmap, 3, 8).ToString()
> 1: Which is: ""
> 1: "10101010"
> 1: [ FAILED ] Bitmap.ToString (1 ms)
> 1: [ RUN ] Bitmap.VisitWordsAnd
> 1: [ OK ] Bitmap.VisitWordsAnd (708 ms)
> 1: [--] 5 tests from Bitmap (719 ms total)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-8745) [C++] Bitmap.ToString causes failures on a big-endian platform
Kazuaki Ishizaki created ARROW-8745:
---
Summary: [C++] Bitmap.ToString causes failures on a big-endian
platform
Key: ARROW-8745
URL: https://issues.apache.org/jira/browse/ARROW-8745
Project: Apache Arrow
Issue Type: Improvement
Components: C++
Reporter: Kazuaki Ishizaki
The new test causes the failure on a big-endian platform.
{code}
1: [--] 5 tests from Bitmap
1: [ RUN ] Bitmap.ShiftingWordsOptimization
1: [ OK ] Bitmap.ShiftingWordsOptimization (7 ms)
1: [ RUN ] Bitmap.VisitWords
1: [ OK ] Bitmap.VisitWords (3 ms)
1: [ RUN ] Bitmap.VisitPartialWords
1: [ OK ] Bitmap.VisitPartialWords (0 ms)
1: [ RUN ] Bitmap.ToString
1: /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/bit_util_test.cc:1265:
Failure
1: Expected equality of these values:
1: Bitmap(bitmap, 0, 34).ToString()
1: Which is: " 00"
1: "00110101 01010011 00"
1: /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/bit_util_test.cc:1267:
Failure
1: Expected equality of these values:
1: Bitmap(bitmap, 0, 16).ToString()
1: Which is: " "
1: "00110101 01010011"
1: /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/bit_util_test.cc:1268:
Failure
1: Expected equality of these values:
1: Bitmap(bitmap, 0, 11).ToString()
1: Which is: " 000"
1: "00110101 010"
1: /home/ishizaki/Arrow/arrow-rle/cpp/src/arrow/util/bit_util_test.cc:1269:
Failure
1: Expected equality of these values:
1: Bitmap(bitmap, 3, 8).ToString()
1: Which is: ""
1: "10101010"
1: [ FAILED ] Bitmap.ToString (1 ms)
1: [ RUN ] Bitmap.VisitWordsAnd
1: [ OK ] Bitmap.VisitWordsAnd (708 ms)
1: [--] 5 tests from Bitmap (719 ms total)
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (ARROW-8486) [C++] arrow-utility-test causes failures on a big-endian platform
[
https://issues.apache.org/jira/browse/ARROW-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17087868#comment-17087868
]
Kazuaki Ishizaki commented on ARROW-8486:
-
Thank you very much for submitting https://github.com/apache/arrow/pull/6991.
> [C++] arrow-utility-test causes failures on a big-endian platform
> -
>
> Key: ARROW-8486
> URL: https://issues.apache.org/jira/browse/ARROW-8486
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
>Reporter: Kazuaki Ishizaki
>Priority: Minor
>
> The current master causes the following failures in arrow-util-test.
> {code}
> Start 17: arrow-utility-test
> ...
> 17: [ PASSED ] 253 tests.
> 17: [ FAILED ] 11 tests, listed below:
> 17: [ FAILED ] Bitmap.ShiftingWordsOptimization
> 17: [ FAILED ] Bitmap.VisitWordsAnd
> 17: [ FAILED ] BitArray.TestBool
> 17: [ FAILED ] BitArray.TestValues
> 17: [ FAILED ] Rle.SpecificSequences
> 17: [ FAILED ] Rle.TestValues
> 17: [ FAILED ] BitRle.Flush
> 17: [ FAILED ] BitRle.Random
> 17: [ FAILED ] BitRle.RepeatedPattern
> 17: [ FAILED ] BitRle.Overflow
> 17: [ FAILED ] RleDecoder.GetBatchSpaced
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (ARROW-8486) [C++] arrow-utility-test causes failures on a big-endian platform
[
https://issues.apache.org/jira/browse/ARROW-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17087671#comment-17087671
]
Kazuaki Ishizaki commented on ARROW-8486:
-
I confirmed that this change works well. Thanks again. I struggled with this
for many weeks.
I would appreciate it if you could create a PR for this patch.
> [C++] arrow-utility-test causes failures on a big-endian platform
> -
>
> Key: ARROW-8486
> URL: https://issues.apache.org/jira/browse/ARROW-8486
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
>Reporter: Kazuaki Ishizaki
>Priority: Minor
>
> The current master causes the following failures in arrow-util-test.
> {code}
> Start 17: arrow-utility-test
> ...
> 17: [ PASSED ] 253 tests.
> 17: [ FAILED ] 11 tests, listed below:
> 17: [ FAILED ] Bitmap.ShiftingWordsOptimization
> 17: [ FAILED ] Bitmap.VisitWordsAnd
> 17: [ FAILED ] BitArray.TestBool
> 17: [ FAILED ] BitArray.TestValues
> 17: [ FAILED ] Rle.SpecificSequences
> 17: [ FAILED ] Rle.TestValues
> 17: [ FAILED ] BitRle.Flush
> 17: [ FAILED ] BitRle.Random
> 17: [ FAILED ] BitRle.RepeatedPattern
> 17: [ FAILED ] BitRle.Overflow
> 17: [ FAILED ] RleDecoder.GetBatchSpaced
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (ARROW-8486) [C++] arrow-utility-test causes failures on a big-endian platform
[
https://issues.apache.org/jira/browse/ARROW-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17087638#comment-17087638
]
Kazuaki Ishizaki commented on ARROW-8486:
-
Great, thank you very much. I will apply it.
> [C++] arrow-utility-test causes failures on a big-endian platform
> -
>
> Key: ARROW-8486
> URL: https://issues.apache.org/jira/browse/ARROW-8486
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
>Reporter: Kazuaki Ishizaki
>Priority: Minor
>
> The current master causes the following failures in arrow-util-test.
> {code}
> Start 17: arrow-utility-test
> ...
> 17: [ PASSED ] 253 tests.
> 17: [ FAILED ] 11 tests, listed below:
> 17: [ FAILED ] Bitmap.ShiftingWordsOptimization
> 17: [ FAILED ] Bitmap.VisitWordsAnd
> 17: [ FAILED ] BitArray.TestBool
> 17: [ FAILED ] BitArray.TestValues
> 17: [ FAILED ] Rle.SpecificSequences
> 17: [ FAILED ] Rle.TestValues
> 17: [ FAILED ] BitRle.Flush
> 17: [ FAILED ] BitRle.Random
> 17: [ FAILED ] BitRle.RepeatedPattern
> 17: [ FAILED ] BitRle.Overflow
> 17: [ FAILED ] RleDecoder.GetBatchSpaced
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (ARROW-8486) [C++] arrow-utility-test causes failures on a big-endian platform
[
https://issues.apache.org/jira/browse/ARROW-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17087587#comment-17087587
]
Kazuaki Ishizaki commented on ARROW-8486:
-
> I don't think parquet::FixedLenByteArray and parquet::ByteArray ever get
> passed to RleDecoder. I'm not sure about Int96.
In my understanding, unfortunately, it occurs at
https://github.com/apache/arrow/blob/master/cpp/src/parquet/encoding.cc#L2530-L2559.
They read to call the constructor of `RleDecoder` at
https://github.com/apache/arrow/blob/master/cpp/src/parquet/encoding.cc#L1484.
Then, `T` is passed to `NextCounts()` thru `GetBatchWithDictSpaced()` at
https://github.com/apache/arrow/blob/master/cpp/src/parquet/encoding.cc#L1502
While Int96 is depreciated, test cases are there. Of course, I can make it
low-priority.
> [C++] arrow-utility-test causes failures on a big-endian platform
> -
>
> Key: ARROW-8486
> URL: https://issues.apache.org/jira/browse/ARROW-8486
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
>Reporter: Kazuaki Ishizaki
>Priority: Minor
>
> The current master causes the following failures in arrow-util-test.
> {code}
> Start 17: arrow-utility-test
> ...
> 17: [ PASSED ] 253 tests.
> 17: [ FAILED ] 11 tests, listed below:
> 17: [ FAILED ] Bitmap.ShiftingWordsOptimization
> 17: [ FAILED ] Bitmap.VisitWordsAnd
> 17: [ FAILED ] BitArray.TestBool
> 17: [ FAILED ] BitArray.TestValues
> 17: [ FAILED ] Rle.SpecificSequences
> 17: [ FAILED ] Rle.TestValues
> 17: [ FAILED ] BitRle.Flush
> 17: [ FAILED ] BitRle.Random
> 17: [ FAILED ] BitRle.RepeatedPattern
> 17: [ FAILED ] BitRle.Overflow
> 17: [ FAILED ] RleDecoder.GetBatchSpaced
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (ARROW-8486) [C++] arrow-utility-test causes failures on a big-endian platform
[
https://issues.apache.org/jira/browse/ARROW-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17086720#comment-17086720
]
Kazuaki Ishizaki commented on ARROW-8486:
-
[~apitrou] Could you give me your advice?
I am working for addressing an issue described in ARROW-4018. The below your
suggested code works well for primitive types.
On the other hand, I enable `-DARROW_PARQUET=ON` in cmake, non-primitive types
(parquet::FixedLenByteArray, parquet::ByteArray, and parquet::Int96) are passed
as T. In this case, this line `current_value_ = static_cast(value)`
causes the cast error.
IMHO, these cases use 32 as bit_width_ (just my guess, I did not confirm it).
Am I correct?
While I tried to create a patch by using std::enable_if or constexpr, I was not
successful to create it. Are there any advices to handle these three cases?
{code}
T value = T();
bool result =
bit_reader_.GetAligned(static_cast(BitUtil::CeilDiv(bit_width_,
8)), &value);
current_value_ = static_cast(value);
{code}
> [C++] arrow-utility-test causes failures on a big-endian platform
> -
>
> Key: ARROW-8486
> URL: https://issues.apache.org/jira/browse/ARROW-8486
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
>Reporter: Kazuaki Ishizaki
>Priority: Minor
>
> The current master causes the following failures in arrow-util-test.
> {code}
> Start 17: arrow-utility-test
> ...
> 17: [ PASSED ] 253 tests.
> 17: [ FAILED ] 11 tests, listed below:
> 17: [ FAILED ] Bitmap.ShiftingWordsOptimization
> 17: [ FAILED ] Bitmap.VisitWordsAnd
> 17: [ FAILED ] BitArray.TestBool
> 17: [ FAILED ] BitArray.TestValues
> 17: [ FAILED ] Rle.SpecificSequences
> 17: [ FAILED ] Rle.TestValues
> 17: [ FAILED ] BitRle.Flush
> 17: [ FAILED ] BitRle.Random
> 17: [ FAILED ] BitRle.RepeatedPattern
> 17: [ FAILED ] BitRle.Overflow
> 17: [ FAILED ] RleDecoder.GetBatchSpaced
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-8506) [c++] Miss tests to verify expected_buffer with bit_width > 8 in RLE
Kazuaki Ishizaki created ARROW-8506: --- Summary: [c++] Miss tests to verify expected_buffer with bit_width > 8 in RLE Key: ARROW-8506 URL: https://issues.apache.org/jira/browse/ARROW-8506 Project: Apache Arrow Issue Type: Improvement Components: C++ Reporter: Kazuaki Ishizaki The current test cases only verify the encoded stream by RLE when bit_width <= 8. It is hard to verify whether the encoded stream by RLE keeps the data in a little-endian format -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ARROW-8457) [C++] bridge test does not take care of endianness
[ https://issues.apache.org/jira/browse/ARROW-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17085189#comment-17085189 ] Kazuaki Ishizaki commented on ARROW-8457: - Thank you very much. When I run `cmake -DCMAKE_BUILD_TYPE=Debug -DARROW_BUILD_TESTS=ON . && make test`, ARROW-8486 is the last issue. Although I have a patch, it cannot be compiled with -DARROW_PARQUET=ON. It is related to ARROW-4018. I may ask your guidance at ARROW-8486 in the future. > [C++] bridge test does not take care of endianness > -- > > Key: ARROW-8457 > URL: https://issues.apache.org/jira/browse/ARROW-8457 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Reporter: Kazuaki Ishizaki >Assignee: Kazuaki Ishizaki >Priority: Minor > Labels: pull-request-available > Fix For: 0.17.0 > > Time Spent: 40m > Remaining Estimate: 0h > > According to the > [specification|https://github.com/apache/arrow/blob/master/docs/source/format/CDataInterface.rst] > of ArrowSchema, memory format uses the native endian of the CPU. However, > the test cases assume only little endian. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ARROW-8486) [C++] arrow-utility-test causes failures on a big-endian platform
[
https://issues.apache.org/jira/browse/ARROW-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated ARROW-8486:
Description:
The current master causes the following failures in arrow-util-test.
{code}
Start 17: arrow-utility-test
...
17: [ PASSED ] 253 tests.
17: [ FAILED ] 11 tests, listed below:
17: [ FAILED ] Bitmap.ShiftingWordsOptimization
17: [ FAILED ] Bitmap.VisitWordsAnd
17: [ FAILED ] BitArray.TestBool
17: [ FAILED ] BitArray.TestValues
17: [ FAILED ] Rle.SpecificSequences
17: [ FAILED ] Rle.TestValues
17: [ FAILED ] BitRle.Flush
17: [ FAILED ] BitRle.Random
17: [ FAILED ] BitRle.RepeatedPattern
17: [ FAILED ] BitRle.Overflow
17: [ FAILED ] RleDecoder.GetBatchSpaced
{code}
was:
The current master causes the following failures in arrow-util-test.
{{code}}
Start 17: arrow-utility-test
...
17: [ PASSED ] 253 tests.
17: [ FAILED ] 11 tests, listed below:
17: [ FAILED ] Bitmap.ShiftingWordsOptimization
17: [ FAILED ] Bitmap.VisitWordsAnd
17: [ FAILED ] BitArray.TestBool
17: [ FAILED ] BitArray.TestValues
17: [ FAILED ] Rle.SpecificSequences
17: [ FAILED ] Rle.TestValues
17: [ FAILED ] BitRle.Flush
17: [ FAILED ] BitRle.Random
17: [ FAILED ] BitRle.RepeatedPattern
17: [ FAILED ] BitRle.Overflow
17: [ FAILED ] RleDecoder.GetBatchSpaced
{{code}}
> [C++] arrow-utility-test causes failures on a big-endian platform
> -
>
> Key: ARROW-8486
> URL: https://issues.apache.org/jira/browse/ARROW-8486
> Project: Apache Arrow
> Issue Type: Improvement
>Reporter: Kazuaki Ishizaki
>Priority: Minor
>
> The current master causes the following failures in arrow-util-test.
> {code}
> Start 17: arrow-utility-test
> ...
> 17: [ PASSED ] 253 tests.
> 17: [ FAILED ] 11 tests, listed below:
> 17: [ FAILED ] Bitmap.ShiftingWordsOptimization
> 17: [ FAILED ] Bitmap.VisitWordsAnd
> 17: [ FAILED ] BitArray.TestBool
> 17: [ FAILED ] BitArray.TestValues
> 17: [ FAILED ] Rle.SpecificSequences
> 17: [ FAILED ] Rle.TestValues
> 17: [ FAILED ] BitRle.Flush
> 17: [ FAILED ] BitRle.Random
> 17: [ FAILED ] BitRle.RepeatedPattern
> 17: [ FAILED ] BitRle.Overflow
> 17: [ FAILED ] RleDecoder.GetBatchSpaced
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (ARROW-8486) [C++] arrow-utility-test causes failures on a big-endian platform
[
https://issues.apache.org/jira/browse/ARROW-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated ARROW-8486:
Description:
The current master causes the following failures in arrow-util-test.
{{code}}
Start 17: arrow-utility-test
...
17: [ PASSED ] 253 tests.
17: [ FAILED ] 11 tests, listed below:
17: [ FAILED ] Bitmap.ShiftingWordsOptimization
17: [ FAILED ] Bitmap.VisitWordsAnd
17: [ FAILED ] BitArray.TestBool
17: [ FAILED ] BitArray.TestValues
17: [ FAILED ] Rle.SpecificSequences
17: [ FAILED ] Rle.TestValues
17: [ FAILED ] BitRle.Flush
17: [ FAILED ] BitRle.Random
17: [ FAILED ] BitRle.RepeatedPattern
17: [ FAILED ] BitRle.Overflow
17: [ FAILED ] RleDecoder.GetBatchSpaced
{{code}}
was:
The current master causes the following failures in arrow-util-test.
```
Start 17: arrow-utility-test
...
17: [ PASSED ] 253 tests.
17: [ FAILED ] 11 tests, listed below:
17: [ FAILED ] Bitmap.ShiftingWordsOptimization
17: [ FAILED ] Bitmap.VisitWordsAnd
17: [ FAILED ] BitArray.TestBool
17: [ FAILED ] BitArray.TestValues
17: [ FAILED ] Rle.SpecificSequences
17: [ FAILED ] Rle.TestValues
17: [ FAILED ] BitRle.Flush
17: [ FAILED ] BitRle.Random
17: [ FAILED ] BitRle.RepeatedPattern
17: [ FAILED ] BitRle.Overflow
17: [ FAILED ] RleDecoder.GetBatchSpaced
```
> [C++] arrow-utility-test causes failures on a big-endian platform
> -
>
> Key: ARROW-8486
> URL: https://issues.apache.org/jira/browse/ARROW-8486
> Project: Apache Arrow
> Issue Type: Improvement
>Reporter: Kazuaki Ishizaki
>Priority: Minor
>
> The current master causes the following failures in arrow-util-test.
> {{code}}
> Start 17: arrow-utility-test
> ...
> 17: [ PASSED ] 253 tests.
> 17: [ FAILED ] 11 tests, listed below:
> 17: [ FAILED ] Bitmap.ShiftingWordsOptimization
> 17: [ FAILED ] Bitmap.VisitWordsAnd
> 17: [ FAILED ] BitArray.TestBool
> 17: [ FAILED ] BitArray.TestValues
> 17: [ FAILED ] Rle.SpecificSequences
> 17: [ FAILED ] Rle.TestValues
> 17: [ FAILED ] BitRle.Flush
> 17: [ FAILED ] BitRle.Random
> 17: [ FAILED ] BitRle.RepeatedPattern
> 17: [ FAILED ] BitRle.Overflow
> 17: [ FAILED ] RleDecoder.GetBatchSpaced
> {{code}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-8486) [C++] arrow-utility-test causes failures on a big-endian platform
Kazuaki Ishizaki created ARROW-8486: --- Summary: [C++] arrow-utility-test causes failures on a big-endian platform Key: ARROW-8486 URL: https://issues.apache.org/jira/browse/ARROW-8486 Project: Apache Arrow Issue Type: Improvement Reporter: Kazuaki Ishizaki The current master causes the following failures in arrow-util-test. ``` Start 17: arrow-utility-test ... 17: [ PASSED ] 253 tests. 17: [ FAILED ] 11 tests, listed below: 17: [ FAILED ] Bitmap.ShiftingWordsOptimization 17: [ FAILED ] Bitmap.VisitWordsAnd 17: [ FAILED ] BitArray.TestBool 17: [ FAILED ] BitArray.TestValues 17: [ FAILED ] Rle.SpecificSequences 17: [ FAILED ] Rle.TestValues 17: [ FAILED ] BitRle.Flush 17: [ FAILED ] BitRle.Random 17: [ FAILED ] BitRle.RepeatedPattern 17: [ FAILED ] BitRle.Overflow 17: [ FAILED ] RleDecoder.GetBatchSpaced ``` -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (ARROW-8484) [C++] TestArrayImport tests cause failures on a big-endian platform
[
https://issues.apache.org/jira/browse/ARROW-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki reassigned ARROW-8484:
---
Assignee: Kazuaki Ishizaki
> [C++] TestArrayImport tests cause failures on a big-endian platform
> ---
>
> Key: ARROW-8484
> URL: https://issues.apache.org/jira/browse/ARROW-8484
> Project: Apache Arrow
> Issue Type: Improvement
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Minor
>
> The current code causes two types of failures of TestArrayImport on a a
> big-endian platform as follows:
> {code}
> 12: [ RUN ] TestSchemaImport.Struct
> 12: /home/ishizaki/Arrow/arrow/cpp/build-support/run-test.sh: line 92: 19528
> Segmentation fault (core dumped) $TEST_EXECUTABLE "$@" 2>&1
> 12: 19529 Done| $ROOT/build-support/asan_symbolize.py
> 12: 19530 Done| ${CXXFILT:-c++filt}
> 12: 19531 Done|
> $ROOT/build-support/stacktrace_addr2line.pl $TEST_EXECUTABLE
> 12: 19532 Done| $pipe_cmd 2>&1
> 12: 19533 Done| tee $LOGFILE
> {code}
> {code}
> 12: [ RUN ] TestArrayImport.PrimitiveWithOffset
> 12: /home/ishizaki/Arrow/arrow/cpp/src/arrow/testing/gtest_util.cc:77: Failure
> 12: Failed
> 12:
> 12: @@ -0, +0 @@
> 12: -1027
> 12: -1541
> 12: -2055
> 12: +772
> 12: +1286
> 12: +1800
> 12: Expected:
> 12: [
> 12: 1027,
> 12: 1541,
> 12: 2055
> 12: ]
> 12: Actual:
> 12: [
> 12: 772,
> 12: 1286,
> 12: 1800
> 12: ]
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (ARROW-8457) [C++] bridge test does not take care of endianness
[ https://issues.apache.org/jira/browse/ARROW-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17085114#comment-17085114 ] Kazuaki Ishizaki commented on ARROW-8457: - Oh, I forgot mentioning the architecture. Yes, you are right. > [C++] bridge test does not take care of endianness > -- > > Key: ARROW-8457 > URL: https://issues.apache.org/jira/browse/ARROW-8457 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Reporter: Kazuaki Ishizaki >Assignee: Kazuaki Ishizaki >Priority: Minor > Labels: pull-request-available > Fix For: 0.17.0 > > Time Spent: 40m > Remaining Estimate: 0h > > According to the > [specification|https://github.com/apache/arrow/blob/master/docs/source/format/CDataInterface.rst] > of ArrowSchema, memory format uses the native endian of the CPU. However, > the test cases assume only little endian. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ARROW-8484) [C++] TestArrayImport tests cause failures on a big-endian platform
[
https://issues.apache.org/jira/browse/ARROW-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated ARROW-8484:
Description:
The current code causes two types of failures of TestArrayImport on a a
big-endian platform as follows:
{code}
12: [ RUN ] TestSchemaImport.Struct
12: /home/ishizaki/Arrow/arrow/cpp/build-support/run-test.sh: line 92: 19528
Segmentation fault (core dumped) $TEST_EXECUTABLE "$@" 2>&1
12: 19529 Done| $ROOT/build-support/asan_symbolize.py
12: 19530 Done| ${CXXFILT:-c++filt}
12: 19531 Done|
$ROOT/build-support/stacktrace_addr2line.pl $TEST_EXECUTABLE
12: 19532 Done| $pipe_cmd 2>&1
12: 19533 Done| tee $LOGFILE
{code}
{code}
12: [ RUN ] TestArrayImport.PrimitiveWithOffset
12: /home/ishizaki/Arrow/arrow/cpp/src/arrow/testing/gtest_util.cc:77: Failure
12: Failed
12:
12: @@ -0, +0 @@
12: -1027
12: -1541
12: -2055
12: +772
12: +1286
12: +1800
12: Expected:
12: [
12: 1027,
12: 1541,
12: 2055
12: ]
12: Actual:
12: [
12: 772,
12: 1286,
12: 1800
12: ]
{code}
was:
The current code causes two types of failures of TestArrayImport on a a
big-endian platform as follows:
```
12: [ RUN ] TestSchemaImport.Struct
12: /home/ishizaki/Arrow/arrow/cpp/build-support/run-test.sh: line 92: 19528
Segmentation fault (core dumped) $TEST_EXECUTABLE "$@" 2>&1
12: 19529 Done| $ROOT/build-support/asan_symbolize.py
12: 19530 Done| ${CXXFILT:-c++filt}
12: 19531 Done|
$ROOT/build-support/stacktrace_addr2line.pl $TEST_EXECUTABLE
12: 19532 Done| $pipe_cmd 2>&1
12: 19533 Done| tee $LOGFILE
```
```
12: [ RUN ] TestArrayImport.PrimitiveWithOffset
12: /home/ishizaki/Arrow/arrow/cpp/src/arrow/testing/gtest_util.cc:77: Failure
12: Failed
12:
12: @@ -0, +0 @@
12: -1027
12: -1541
12: -2055
12: +772
12: +1286
12: +1800
12: Expected:
12: [
12: 1027,
12: 1541,
12: 2055
12: ]
12: Actual:
12: [
12: 772,
12: 1286,
12: 1800
12: ]
```
> [C++] TestArrayImport tests cause failures on a big-endian platform
> ---
>
> Key: ARROW-8484
> URL: https://issues.apache.org/jira/browse/ARROW-8484
> Project: Apache Arrow
> Issue Type: Improvement
>Reporter: Kazuaki Ishizaki
>Priority: Minor
>
> The current code causes two types of failures of TestArrayImport on a a
> big-endian platform as follows:
> {code}
> 12: [ RUN ] TestSchemaImport.Struct
> 12: /home/ishizaki/Arrow/arrow/cpp/build-support/run-test.sh: line 92: 19528
> Segmentation fault (core dumped) $TEST_EXECUTABLE "$@" 2>&1
> 12: 19529 Done| $ROOT/build-support/asan_symbolize.py
> 12: 19530 Done| ${CXXFILT:-c++filt}
> 12: 19531 Done|
> $ROOT/build-support/stacktrace_addr2line.pl $TEST_EXECUTABLE
> 12: 19532 Done| $pipe_cmd 2>&1
> 12: 19533 Done| tee $LOGFILE
> {code}
> {code}
> 12: [ RUN ] TestArrayImport.PrimitiveWithOffset
> 12: /home/ishizaki/Arrow/arrow/cpp/src/arrow/testing/gtest_util.cc:77: Failure
> 12: Failed
> 12:
> 12: @@ -0, +0 @@
> 12: -1027
> 12: -1541
> 12: -2055
> 12: +772
> 12: +1286
> 12: +1800
> 12: Expected:
> 12: [
> 12: 1027,
> 12: 1541,
> 12: 2055
> 12: ]
> 12: Actual:
> 12: [
> 12: 772,
> 12: 1286,
> 12: 1800
> 12: ]
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-8484) [C++] TestArrayImport tests cause failures on a big-endian platform
Kazuaki Ishizaki created ARROW-8484:
---
Summary: [C++] TestArrayImport tests cause failures on a
big-endian platform
Key: ARROW-8484
URL: https://issues.apache.org/jira/browse/ARROW-8484
Project: Apache Arrow
Issue Type: Improvement
Reporter: Kazuaki Ishizaki
The current code causes two types of failures of TestArrayImport on a a
big-endian platform as follows:
```
12: [ RUN ] TestSchemaImport.Struct
12: /home/ishizaki/Arrow/arrow/cpp/build-support/run-test.sh: line 92: 19528
Segmentation fault (core dumped) $TEST_EXECUTABLE "$@" 2>&1
12: 19529 Done| $ROOT/build-support/asan_symbolize.py
12: 19530 Done| ${CXXFILT:-c++filt}
12: 19531 Done|
$ROOT/build-support/stacktrace_addr2line.pl $TEST_EXECUTABLE
12: 19532 Done| $pipe_cmd 2>&1
12: 19533 Done| tee $LOGFILE
```
```
12: [ RUN ] TestArrayImport.PrimitiveWithOffset
12: /home/ishizaki/Arrow/arrow/cpp/src/arrow/testing/gtest_util.cc:77: Failure
12: Failed
12:
12: @@ -0, +0 @@
12: -1027
12: -1541
12: -2055
12: +772
12: +1286
12: +1800
12: Expected:
12: [
12: 1027,
12: 1541,
12: 2055
12: ]
12: Actual:
12: [
12: 772,
12: 1286,
12: 1800
12: ]
```
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (ARROW-8457) [C++] bridge test does not take care of endianness
[ https://issues.apache.org/jira/browse/ARROW-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17085082#comment-17085082 ] Kazuaki Ishizaki commented on ARROW-8457: - [~apitrou] I have a big-endian machine to test Arrow in my local environment. In addition, there are two options to publically test Arrow on a big-endian machine. 1. Use TravisCI at https://blog.travis-ci.com/2019-11-12-multi-cpu-architecture-ibm-power-ibm-z 2. Use Jenkins at https://osuosl.org/services/ibm-z/. I created an account for Arrow one year ago, but have not set up yet. > [C++] bridge test does not take care of endianness > -- > > Key: ARROW-8457 > URL: https://issues.apache.org/jira/browse/ARROW-8457 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Reporter: Kazuaki Ishizaki >Assignee: Kazuaki Ishizaki >Priority: Minor > Labels: pull-request-available > Fix For: 0.17.0 > > Time Spent: 40m > Remaining Estimate: 0h > > According to the > [specification|https://github.com/apache/arrow/blob/master/docs/source/format/CDataInterface.rst] > of ArrowSchema, memory format uses the native endian of the CPU. However, > the test cases assume only little endian. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (ARROW-8467) [C++] Test cases using ArrayFromJSON assume only a little-endian platform
[
https://issues.apache.org/jira/browse/ARROW-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki reassigned ARROW-8467:
---
Assignee: Kazuaki Ishizaki
> [C++] Test cases using ArrayFromJSON assume only a little-endian platform
> -
>
> Key: ARROW-8467
> URL: https://issues.apache.org/jira/browse/ARROW-8467
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Minor
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Test cases using ArrayFromJSON assumes little endian platform
> The following test cases seem to assume little-endian platform.
> TEST_F(TestChunkedArray, View) at
> https://github.com/apache/arrow/blob/master/cpp/src/arrow/table_test.cc#L175
> TEST(TestArrayView, PrimitiveAsFixedSizeBinary) at
> https://github.com/apache/arrow/blob/master/cpp/src/arrow/array_view_test.cc#L105
> TEST(TestArrayView, StructAsStructSimple) at
> https://github.com/apache/arrow/blob/master/cpp/src/arrow/array_view_test.cc#L126
> TEST(TestArrayView, ExtensionType) at
> https://github.com/apache/arrow/blob/master/cpp/src/arrow/array_view_test.cc
> One of examples is {{PrimitiveAsFixedSizeBinary}}.
> {code}
> TEST(TestArrayView, PrimitiveAsFixedSizeBinary) {
> auto arr = ArrayFromJSON(int32(), "[2020568934, 2054316386, null]");
> auto expected = ArrayFromJSON(fixed_size_binary(4), R"(["foox", "barz",
> null])");
> CheckView(arr, expected);
> CheckView(expected, arr);
> }
> {code}
> The expected strings are represented in binary as follows:
> {code}
> "foox" = [0x66 0x6f 0x6f 0x78]
> "barz" = [0x62 0x61 0x72 0x7a]
> {code}
> This test gives a value as raw int32. The current values assume only a
> little-endian platform as follows to generate the expected binary sequence.
> {code}
> 2020568934 = 0x786f6f66
> 2054316386 = 0x7a726162
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (ARROW-8467) [C++] Test cases using ArrayFromJSON assume only a little-endian platform
[
https://issues.apache.org/jira/browse/ARROW-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated ARROW-8467:
Description:
Test cases using ArrayFromJSON assumes little endian platform
The following test cases seem to assume little-endian platform.
TEST_F(TestChunkedArray, View) at
https://github.com/apache/arrow/blob/master/cpp/src/arrow/table_test.cc#L175
TEST(TestArrayView, PrimitiveAsFixedSizeBinary) at
https://github.com/apache/arrow/blob/master/cpp/src/arrow/array_view_test.cc#L105
TEST(TestArrayView, StructAsStructSimple) at
https://github.com/apache/arrow/blob/master/cpp/src/arrow/array_view_test.cc#L126
TEST(TestArrayView, ExtensionType) at
https://github.com/apache/arrow/blob/master/cpp/src/arrow/array_view_test.cc
One of examples is {{PrimitiveAsFixedSizeBinary}}.
{code}
TEST(TestArrayView, PrimitiveAsFixedSizeBinary) {
auto arr = ArrayFromJSON(int32(), "[2020568934, 2054316386, null]");
auto expected = ArrayFromJSON(fixed_size_binary(4), R"(["foox", "barz",
null])");
CheckView(arr, expected);
CheckView(expected, arr);
}
{code}
The expected strings are represented in binary as follows:
{code}
"foox" = [0x66 0x6f 0x6f 0x78]
"barz" = [0x62 0x61 0x72 0x7a]
{code}
This test gives a value as raw int32. The current values assume only a
little-endian platform as follows to generate the expected binary sequence.
{code}
2020568934 = 0x786f6f66
2054316386 = 0x7a726162
{code}
was:
Test cases using ArrayFromJSON assumes little endian platform
The following test cases seem to assume little-endian platform.
TEST_F(TestChunkedArray, View) at
https://github.com/apache/arrow/blob/master/cpp/src/arrow/table_test.cc#L175
TEST(TestArrayView, PrimitiveAsFixedSizeBinary) at
https://github.com/apache/arrow/blob/master/cpp/src/arrow/array_view_test.cc#L105
TEST(TestArrayView, StructAsStructSimple) at
https://github.com/apache/arrow/blob/master/cpp/src/arrow/array_view_test.cc#L126
One of examples is {{PrimitiveAsFixedSizeBinary}}.
{code}
TEST(TestArrayView, PrimitiveAsFixedSizeBinary) {
auto arr = ArrayFromJSON(int32(), "[2020568934, 2054316386, null]");
auto expected = ArrayFromJSON(fixed_size_binary(4), R"(["foox", "barz",
null])");
CheckView(arr, expected);
CheckView(expected, arr);
}
{code}
The expected strings are represented in binary as follows:
{code}
"foox" = [0x66 0x6f 0x6f 0x78]
"barz" = [0x62 0x61 0x72 0x7a]
{code}
This test gives a value as raw int32. The current values assume only a
little-endian platform as follows to generate the expected binary sequence.
{code}
2020568934 = 0x786f6f66
2054316386 = 0x7a726162
{code}
> [C++] Test cases using ArrayFromJSON assume only a little-endian platform
> -
>
> Key: ARROW-8467
> URL: https://issues.apache.org/jira/browse/ARROW-8467
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
>Reporter: Kazuaki Ishizaki
>Priority: Minor
>
> Test cases using ArrayFromJSON assumes little endian platform
> The following test cases seem to assume little-endian platform.
> TEST_F(TestChunkedArray, View) at
> https://github.com/apache/arrow/blob/master/cpp/src/arrow/table_test.cc#L175
> TEST(TestArrayView, PrimitiveAsFixedSizeBinary) at
> https://github.com/apache/arrow/blob/master/cpp/src/arrow/array_view_test.cc#L105
> TEST(TestArrayView, StructAsStructSimple) at
> https://github.com/apache/arrow/blob/master/cpp/src/arrow/array_view_test.cc#L126
> TEST(TestArrayView, ExtensionType) at
> https://github.com/apache/arrow/blob/master/cpp/src/arrow/array_view_test.cc
> One of examples is {{PrimitiveAsFixedSizeBinary}}.
> {code}
> TEST(TestArrayView, PrimitiveAsFixedSizeBinary) {
> auto arr = ArrayFromJSON(int32(), "[2020568934, 2054316386, null]");
> auto expected = ArrayFromJSON(fixed_size_binary(4), R"(["foox", "barz",
> null])");
> CheckView(arr, expected);
> CheckView(expected, arr);
> }
> {code}
> The expected strings are represented in binary as follows:
> {code}
> "foox" = [0x66 0x6f 0x6f 0x78]
> "barz" = [0x62 0x61 0x72 0x7a]
> {code}
> This test gives a value as raw int32. The current values assume only a
> little-endian platform as follows to generate the expected binary sequence.
> {code}
> 2020568934 = 0x786f6f66
> 2054316386 = 0x7a726162
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-8467) [C++] Test cases using ArrayFromJSON assume only a little-endian platform
Kazuaki Ishizaki created ARROW-8467:
---
Summary: [C++] Test cases using ArrayFromJSON assume only a
little-endian platform
Key: ARROW-8467
URL: https://issues.apache.org/jira/browse/ARROW-8467
Project: Apache Arrow
Issue Type: Improvement
Components: C++
Reporter: Kazuaki Ishizaki
Test cases using ArrayFromJSON assumes little endian platform
The following test cases seem to assume little-endian platform.
TEST_F(TestChunkedArray, View) at
https://github.com/apache/arrow/blob/master/cpp/src/arrow/table_test.cc#L175
TEST(TestArrayView, PrimitiveAsFixedSizeBinary) at
https://github.com/apache/arrow/blob/master/cpp/src/arrow/array_view_test.cc#L105
TEST(TestArrayView, StructAsStructSimple) at
https://github.com/apache/arrow/blob/master/cpp/src/arrow/array_view_test.cc#L126
One of examples is {{PrimitiveAsFixedSizeBinary}}.
{code}
TEST(TestArrayView, PrimitiveAsFixedSizeBinary) {
auto arr = ArrayFromJSON(int32(), "[2020568934, 2054316386, null]");
auto expected = ArrayFromJSON(fixed_size_binary(4), R"(["foox", "barz",
null])");
CheckView(arr, expected);
CheckView(expected, arr);
}
{code}
The expected strings are represented in binary as follows:
{code}
"foox" = [0x66 0x6f 0x6f 0x78]
"barz" = [0x62 0x61 0x72 0x7a]
{code}
This test gives a value as raw int32. The current values assume only a
little-endian platform as follows to generate the expected binary sequence.
{code}
2020568934 = 0x786f6f66
2054316386 = 0x7a726162
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (ARROW-8457) [C++] bridge test does not take care of endianness
[ https://issues.apache.org/jira/browse/ARROW-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki reassigned ARROW-8457: --- Assignee: Kazuaki Ishizaki > [C++] bridge test does not take care of endianness > -- > > Key: ARROW-8457 > URL: https://issues.apache.org/jira/browse/ARROW-8457 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Reporter: Kazuaki Ishizaki >Assignee: Kazuaki Ishizaki >Priority: Minor > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > According to the > [specification|https://github.com/apache/arrow/blob/master/docs/source/format/CDataInterface.rst] > of ArrowSchema, memory format uses the native endian of the CPU. However, > the test cases assume only little endian. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-8457) [C++] bridge test does not take care of endianness
Kazuaki Ishizaki created ARROW-8457: --- Summary: [C++] bridge test does not take care of endianness Key: ARROW-8457 URL: https://issues.apache.org/jira/browse/ARROW-8457 Project: Apache Arrow Issue Type: Improvement Components: C++ Reporter: Kazuaki Ishizaki According to the [specification|https://github.com/apache/arrow/blob/master/docs/source/format/CDataInterface.rst] of ArrowSchema, memory format uses the native endian of the CPU. However, the test cases assume only little endian. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ARROW-4018) [C++] RLE decoder may not big-endian compatible
[
https://issues.apache.org/jira/browse/ARROW-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17034775#comment-17034775
]
Kazuaki Ishizaki commented on ARROW-4018:
-
Minor comment. This code should be
{code:c++}
T value = 0;
bool result =
bit_reader_.GetAligned(static_cast(BitUtil::CeilDiv(bit_width_,
8)), &value);
current_value_ = static_cast(value);
{code}
> [C++] RLE decoder may not big-endian compatible
> ---
>
> Key: ARROW-4018
> URL: https://issues.apache.org/jira/browse/ARROW-4018
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.11.1
>Reporter: Antoine Pitrou
>Priority: Major
>
> This issue was found by Coverity. The {{RleDecoder::NextCounts}} method has
> the following code to fetch the repeated literal in repeated runs:
> {code:c++}
> bool result =
>
> bit_reader_.GetAligned(static_cast(BitUtil::CeilDiv(bit_width_, 8)),
> reinterpret_cast(¤t_value_));
> {code}
> Coverity says this:
> bq. Pointer "&this->current_value_" points to an object whose effective type
> is "unsigned long long" (64 bits, unsigned) but is dereferenced as a narrower
> "unsigned int" (32 bits, unsigned). This may lead to unexpected results
> depending on machine endianness.
> bq.
> In addition, it's not obvious whether {{current_value_}} also needs
> byte-swapping (presumably, at least in the Parquet file format, it's supposed
> to be stored in little-endian format in the RLE bitstream).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-7489) [CI] Fix typos
Kazuaki Ishizaki created ARROW-7489:
---
Summary: [CI] Fix typos
Key: ARROW-7489
URL: https://issues.apache.org/jira/browse/ARROW-7489
Project: Apache Arrow
Issue Type: Improvement
Reporter: Kazuaki Ishizaki
Assignee: Kazuaki Ishizaki
Fix typos in files under {{ci}} and other directories
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (ARROW-7488) [GLib] Fix typo and broken link
[
https://issues.apache.org/jira/browse/ARROW-7488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated ARROW-7488:
Summary: [GLib] Fix typo and broken link (was: [GLib] Fix typo)
> [GLib] Fix typo and broken link
> ---
>
> Key: ARROW-7488
> URL: https://issues.apache.org/jira/browse/ARROW-7488
> Project: Apache Arrow
> Issue Type: Improvement
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Trivial
>
> Fix typo in files under {{c_glib}} directory
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (ARROW-7488) [GLib] Fix typo and broken link
[
https://issues.apache.org/jira/browse/ARROW-7488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated ARROW-7488:
Description: Fix typo and broken link in files under {{c_glib}} directory
(was: Fix typo in files under {{c_glib}} directory)
> [GLib] Fix typo and broken link
> ---
>
> Key: ARROW-7488
> URL: https://issues.apache.org/jira/browse/ARROW-7488
> Project: Apache Arrow
> Issue Type: Improvement
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Trivial
>
> Fix typo and broken link in files under {{c_glib}} directory
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-7488) [GLib] Fix typo
Kazuaki Ishizaki created ARROW-7488:
---
Summary: [GLib] Fix typo
Key: ARROW-7488
URL: https://issues.apache.org/jira/browse/ARROW-7488
Project: Apache Arrow
Issue Type: Improvement
Reporter: Kazuaki Ishizaki
Assignee: Kazuaki Ishizaki
Fix typo in files under {{c_glib}} directory
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-7487) [Dev] fix typo
Kazuaki Ishizaki created ARROW-7487:
---
Summary: [Dev] fix typo
Key: ARROW-7487
URL: https://issues.apache.org/jira/browse/ARROW-7487
Project: Apache Arrow
Issue Type: Improvement
Reporter: Kazuaki Ishizaki
Assignee: Kazuaki Ishizaki
Fix typo in files under {{dev}} directory
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Closed] (ARROW-7483) [C++][Parquet] Fix typos
[
https://issues.apache.org/jira/browse/ARROW-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki closed ARROW-7483.
---
Resolution: Fixed
> [C++][Parquet] Fix typos
>
>
> Key: ARROW-7483
> URL: https://issues.apache.org/jira/browse/ARROW-7483
> Project: Apache Arrow
> Issue Type: Improvement
>Reporter: Kazuaki Ishizaki
>Assignee: Kazuaki Ishizaki
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Fix typo in files under {{cpp/src/parquet}} directory
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
