[jira] [Commented] (ARROW-15778) [Java] Endianness field not emitted in IPC stream
[ https://issues.apache.org/jira/browse/ARROW-15778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502054#comment-17502054 ] Kazuaki Ishizaki commented on ARROW-15778: -- This fix is already created [here|https://github.com/kiszk/arrow/commit/db06d043b07c63069169b5a88a4393aa229c095c]. We confirmed this issue was solved by this fix. The challenge is to create a test case. I realized that the latest arrow requires more native libraries for the build. It takes some time. So, I will create a test case with an older version arrow. > [Java] Endianness field not emitted in IPC stream > - > > Key: ARROW-15778 > URL: https://issues.apache.org/jira/browse/ARROW-15778 > Project: Apache Arrow > Issue Type: Bug > Components: Java >Reporter: Antoine Pitrou >Priority: Major > Fix For: 8.0.0 > > > It seems the Java IPC writer implementation does not emit the Endianness > information at all (making it Little by default). This complicates > interoperability with the C++ IPC reader, which does read this information > and acts on it to decide whether it needs to byteswap the incoming data. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (ARROW-15854) [C++] Refine csv writer - populate columns in normal order
[ https://issues.apache.org/jira/browse/ARROW-15854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-15854: --- Labels: pull-request-available (was: ) > [C++] Refine csv writer - populate columns in normal order > -- > > Key: ARROW-15854 > URL: https://issues.apache.org/jira/browse/ARROW-15854 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ >Reporter: Yibo Cai >Assignee: Yibo Cai >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > CSV writer populates columns in reverse order, each row is constructed from > last cell to first cell. > Populating columns in normal order makes the code easier to follow, and > offers better optimization chances. E.g., EscapeReverse [1] is the hotspot > for quoted string benchmark, it's hard to improve if chars are scanned in > reverse order, but may benefit from simd if scanned in normal order. > [1] > https://github.com/apache/arrow/blob/master/cpp/src/arrow/csv/writer.cc#L141-L150 -- This message was sent by Atlassian Jira (v8.20.1#820001)
