Re: [Format] C Data Interface integration testing

2023-10-19 Thread Aldrin
t;> Hello again,>> Quick update: the C++, C#, Go and Java implementations now all> participate in C Data Interface integration testing.>> (this helped us fix a few interoperability bugs, and add deterministic> releasing of imported data in Go)>> Arrow Rust does not parti

Re: [Format] C Data Interface integration testing

2023-10-19 Thread Richard Haven
UNSUBSCRIBE BAJARSE ANFOSGRIFIAD ОТПИШИ HLOKOMELA On Thu, Oct 19, 2023 at 9:56 AM Antoine Pitrou wrote: > > Hello again, > > Quick update: the C++, C#, Go and Java implementations now all > participate in C Data Interface integration testing. > > (this helped us fix a

Re: [Format] C Data Interface integration testing

2023-10-19 Thread Richard Haven
> > > UNSUBSCRIBE >

Re: [Format] C Data Interface integration testing

2023-10-19 Thread Neal Richardson
Nice work! Neal On Thu, Oct 19, 2023 at 4:01 PM Antoine Pitrou wrote: > > Hello again, > > Quick update: the C++, C#, Go and Java implementations now all > participate in C Data Interface integration testing. > > (this helped us fix a few interoperability bugs,

Re: [Format] C Data Interface integration testing

2023-10-19 Thread Antoine Pitrou
Hello again, Quick update: the C++, C#, Go and Java implementations now all participate in C Data Interface integration testing. (this helped us fix a few interoperability bugs, and add deterministic releasing of imported data in Go) Arrow Rust does not participate yet, but given how

Re: [Format] C Data Interface integration testing

2023-09-26 Thread Dewey Dunnington
Thank you for setting this up! I look forward to adding nanoarrow as soon as time allows. Cheers, -dewey On Tue, Sep 26, 2023 at 9:48 AM Antoine Pitrou wrote: > > > Hello, > > We have added some infrastructure for integration testing of the C Data > Interface between Arrow i

[Format] C Data Interface integration testing

2023-09-26 Thread Antoine Pitrou
Hello, We have added some infrastructure for integration testing of the C Data Interface between Arrow implementations. We are now testing the C++ and Go implementations, but the goal in the future is for all major implementations to be tested there (perhaps including nanoarrow). - PR to

Re: Proposal for C Data Interface Integration testing

2022-11-04 Thread Matt Topol
esting and the C Data > Interface, I've put together a small proposal for developing the > integration testing for the C Data interface. For the most part it's an > extension of Archery and the way Archery's integration testing works. I've > put it into a Google d

Proposal for C Data Interface Integration testing

2022-10-28 Thread Matt Topol
Hey all! Given various discussions about our testing and the C Data Interface, I've put together a small proposal for developing the integration testing for the C Data interface. For the most part it's an extension of Archery and the way Archery's integration testing works. I&#

Re: Status of Rust Integration Testing

2020-07-11 Thread Neville Dipale
03 PM Neville Dipale > wrote: > > > Good day Arrow devs, > > > > I've spent a few evenings looking into the issues that we're experiencing > > with Rust integration testing. > > In summary, none of our tests pass (zero batch doesn't count :) ). &

Re: Status of Rust Integration Testing

2020-07-10 Thread Micah Kornfield
at 1:03 PM Neville Dipale wrote: > Good day Arrow devs, > > I've spent a few evenings looking into the issues that we're experiencing > with Rust integration testing. > In summary, none of our tests pass (zero batch doesn't count :) ). > This is mainly because of ch

Status of Rust Integration Testing

2020-07-10 Thread Neville Dipale
Good day Arrow devs, I've spent a few evenings looking into the issues that we're experiencing with Rust integration testing. In summary, none of our tests pass (zero batch doesn't count :) ). This is mainly because of changes from the legacy padding in the 0.15.0 release, which w

[jira] [Created] (ARROW-8883) [Rust] [Integration Testing] Disable unsupported tests

2020-05-21 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-8883: - Summary: [Rust] [Integration Testing] Disable unsupported tests Key: ARROW-8883 URL: https://issues.apache.org/jira/browse/ARROW-8883 Project: Apache Arrow

[jira] [Created] (ARROW-8859) [Rust] [Integration Testing] Implement --quiet / verbose correctly

2020-05-19 Thread Andy Grove (Jira)
Andy Grove created ARROW-8859: - Summary: [Rust] [Integration Testing] Implement --quiet / verbose correctly Key: ARROW-8859 URL: https://issues.apache.org/jira/browse/ARROW-8859 Project: Apache Arrow

[jira] [Created] (ARROW-8856) [Rust] [Integration Testing] Reading types other than record batches not yet supported

2020-05-18 Thread Andy Grove (Jira)
Andy Grove created ARROW-8856: - Summary: [Rust] [Integration Testing] Reading types other than record batches not yet supported Key: ARROW-8856 URL: https://issues.apache.org/jira/browse/ARROW-8856

[jira] [Created] (ARROW-8855) [Rust] [Integration Testing] data type Date32(Day) not supported

2020-05-18 Thread Andy Grove (Jira)
Andy Grove created ARROW-8855: - Summary: [Rust] [Integration Testing] data type Date32(Day) not supported Key: ARROW-8855 URL: https://issues.apache.org/jira/browse/ARROW-8855 Project: Apache Arrow

[jira] [Created] (ARROW-8854) [Rust] [Integration Testing] Show output from arrow-json-integration-test

2020-05-18 Thread Andy Grove (Jira)
Andy Grove created ARROW-8854: - Summary: [Rust] [Integration Testing] Show output from arrow-json-integration-test Key: ARROW-8854 URL: https://issues.apache.org/jira/browse/ARROW-8854 Project: Apache

[jira] [Created] (ARROW-8853) [Rust] [Integration Testing] Enable Flight tests

2020-05-18 Thread Andy Grove (Jira)
Andy Grove created ARROW-8853: - Summary: [Rust] [Integration Testing] Enable Flight tests Key: ARROW-8853 URL: https://issues.apache.org/jira/browse/ARROW-8853 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-8835) [Rust] Implement arrow-stream-to-file for integration testing

2020-05-17 Thread Andy Grove (Jira)
Andy Grove created ARROW-8835: - Summary: [Rust] Implement arrow-stream-to-file for integration testing Key: ARROW-8835 URL: https://issues.apache.org/jira/browse/ARROW-8835 Project: Apache Arrow

[jira] [Created] (ARROW-8834) [Rust] Implement arrow-file-to-stream for integration testing

2020-05-17 Thread Andy Grove (Jira)
Andy Grove created ARROW-8834: - Summary: [Rust] Implement arrow-file-to-stream for integration testing Key: ARROW-8834 URL: https://issues.apache.org/jira/browse/ARROW-8834 Project: Apache Arrow

[jira] [Created] (ARROW-8827) [Integration Testing] Initial skeleton for Rust integration tests

2020-05-16 Thread Andy Grove (Jira)
Andy Grove created ARROW-8827: - Summary: [Integration Testing] Initial skeleton for Rust integration tests Key: ARROW-8827 URL: https://issues.apache.org/jira/browse/ARROW-8827 Project: Apache Arrow

[jira] [Created] (ARROW-8807) [Docs] Integration testing instructions for base docker image are incorrect

2020-05-14 Thread Andy Grove (Jira)
Andy Grove created ARROW-8807: - Summary: [Docs] Integration testing instructions for base docker image are incorrect Key: ARROW-8807 URL: https://issues.apache.org/jira/browse/ARROW-8807 Project: Apache

Re: Integration testing

2020-03-05 Thread Neal Richardson
On Thu, Mar 5, 2020 at 8:44 PM Micah Kornfield wrote: > Hi Neal, > Sorry for the late reply. > > Unsigned integers in Java was resolved via > https://github.com/apache/arrow/pull/4432 > > Thanks, I've updated the spreadsheet to reflect that. > We might want to separate out Dense/Sparse union te

Re: Integration testing

2020-03-05 Thread Micah Kornfield
Hi Neal, Sorry for the late reply. Unsigned integers in Java was resolved via https://github.com/apache/arrow/pull/4432 We might want to separate out Dense/Sparse union testing into their own issues. Thanks, Micah On Fri, Feb 21, 2020 at 2:12 PM Neal Richardson wrote: > Thanks, I've marked th

Re: Integration testing

2020-02-21 Thread Neal Richardson
Thanks, I've marked that as not required for 1.0 (and added a legend to the bottom of the table). Anything else that needs to be added or reclassified? Neal On Fri, Feb 21, 2020 at 12:19 AM Antoine Pitrou wrote: > > Hi, > > I don't think float16 support is required for 1.0. > On the C++ side at

Re: Integration testing

2020-02-21 Thread Antoine Pitrou
Hi, I don't think float16 support is required for 1.0. On the C++ side at least, it will require integrating a dedicated library (probably in other languages as well). Regards Antoine. Le 21/02/2020 à 00:33, Neal Richardson a écrit : > Hi all, > To help us reach 1.0 with as complete and thor

Integration testing

2020-02-20 Thread Neal Richardson
Hi all, To help us reach 1.0 with as complete and thoroughly tested implementations of the Arrow format, I've surveyed our integration test suite and open issues and collected information here: https://docs.google.com/spreadsheets/d/1Yu68rn2XMBpAArUfCOP9LC7uHb06CQrtqKE5vQ4bQx4/edit#gid=782909347 I

[jira] [Created] (ARROW-6109) [Integration] Docker image for integration testing can't be built on windows

2019-08-01 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-6109: -- Summary: [Integration] Docker image for integration testing can't be built on windows Key: ARROW-6109 URL: https://issues.apache.org/jira/browse/ARROW-6109 Pr

[jira] [Created] (ARROW-5405) [Documentation] Move integration testing documentation to Sphinx docs, add instructions for JavaScript

2019-05-23 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-5405: --- Summary: [Documentation] Move integration testing documentation to Sphinx docs, add instructions for JavaScript Key: ARROW-5405 URL: https://issues.apache.org/jira/browse/ARROW

[jira] [Created] (ARROW-5312) [C++] Move JSON integration testing utilities to arrow/testing and libarrow_testing.so

2019-05-13 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-5312: --- Summary: [C++] Move JSON integration testing utilities to arrow/testing and libarrow_testing.so Key: ARROW-5312 URL: https://issues.apache.org/jira/browse/ARROW-5312

[jira] [Created] (ARROW-5143) [Flight] Enable integration testing of batches with dictionaries

2019-04-08 Thread David Li (JIRA)
David Li created ARROW-5143: --- Summary: [Flight] Enable integration testing of batches with dictionaries Key: ARROW-5143 URL: https://issues.apache.org/jira/browse/ARROW-5143 Project: Apache Arrow

[jira] [Created] (ARROW-4575) Add Python Flight implementation to integration testing

2019-02-14 Thread David Li (JIRA)
David Li created ARROW-4575: --- Summary: Add Python Flight implementation to integration testing Key: ARROW-4575 URL: https://issues.apache.org/jira/browse/ARROW-4575 Project: Apache Arrow Issue

Re: Rust IPC and Integration Testing

2018-11-20 Thread Chao Sun
n > > > Rust > > > > >> (I'm > > > > >> > >> sure this is going to take quite a while though so don't want > > to > > > get > > > > >> > >> anyones

Re: Rust IPC and Integration Testing

2018-11-20 Thread Krisztián Szűcs
; > >> > >> Andy. > > > >> > >> > > > >> > >> > > > >> > >> On Sat, May 19, 2018 at 4:05 PM Wes McKinney < > > wesmck...@gmail.com> > > > >> wrote: > > > >> >

Re: Rust IPC and Integration Testing

2018-11-20 Thread Chao Sun
PM Wes McKinney < > wesmck...@gmail.com> > > >> wrote: > > >> > >> > > >> > >>> Sorry to hear, it's a bit of a rough situation with Flatbuffers > and > > >> > >>> Rust. One possibility is to build an

Re: Rust IPC and Integration Testing

2018-11-19 Thread Wes McKinney
; > >>> bindings are header-only like C++ and if that makes things any > >> easier > >> > >>> for you. > >> > >>> > >> > >>> If you defined an API in Rust for reading and writing the Arrow > >> > >>>

Re: Rust IPC and Integration Testing

2018-11-19 Thread Andy Grove
kes things any >> easier >> > >>> for you. >> > >>> >> > >>> If you defined an API in Rust for reading and writing the Arrow >> > >>> metadata that does not expose any Flatbuffers-specific details, then >> > >&

Re: Rust IPC and Integration Testing

2018-11-17 Thread Andy Grove
t; > >>> the implementation details could be swapped out without disruption. > > >>> > > >>> > my recent attempts at contacting the author have been unsuccessful > > >>> > > >>> Have you e-mailed the author directly or only

Re: Rust IPC and Integration Testing

2018-11-04 Thread Wes McKinney
ul > >>> > >>> Have you e-mailed the author directly or only pings on GitHub? Pings > >>> may not be making it to their inbox. > >>> > >>> Appreciate your efforts on this; I think we'll see a lot more work in > >>> data proces

Re: Rust IPC and Integration Testing

2018-11-03 Thread Andy Grove
your efforts on this; I think we'll see a lot more work in >>> data processing in Rust in the coming years. >>> >>> - Wes >>> >>> On Fri, May 18, 2018 at 9:21 AM, Andy Grove >>> wrote: >>> > Hi, >>> > >>> &

[jira] [Created] (ARROW-3690) [Rust] add Rust to integration testing

2018-11-01 Thread Chao Sun (JIRA)
Chao Sun created ARROW-3690: --- Summary: [Rust] add Rust to integration testing Key: ARROW-3690 URL: https://issues.apache.org/jira/browse/ARROW-3690 Project: Apache Arrow Issue Type: Test

Re: Rust IPC and Integration Testing

2018-09-03 Thread Andy Grove
on this; I think we'll see a lot more work in >> data processing in Rust in the coming years. >> >> - Wes >> >> On Fri, May 18, 2018 at 9:21 AM, Andy Grove >> wrote: >> > Hi, >> > >> > Now that the refactor I've been working

Re: Rust IPC and Integration Testing

2018-06-19 Thread Andy Grove
y 18, 2018 at 9:21 AM, Andy Grove wrote: > > Hi, > > > > Now that the refactor I've been working on has been merged, the next > > priority for me personally with the Rust implementation is getting IPC > and > > integration testing working. > > >

Re: Rust IPC and Integration Testing

2018-05-19 Thread Wes McKinney
9:21 AM, Andy Grove wrote: > Hi, > > Now that the refactor I've been working on has been merged, the next > priority for me personally with the Rust implementation is getting IPC and > integration testing working. > > Unfortunately the official Flatbuffers Rust versi

Rust IPC and Integration Testing

2018-05-18 Thread Andy Grove
Hi, Now that the refactor I've been working on has been merged, the next priority for me personally with the Rust implementation is getting IPC and integration testing working. Unfortunately the official Flatbuffers Rust version is not available yet and my recent attempts at contactin

[jira] [Created] (ARROW-1502) [JS] Define code entry point for integration testing

2017-09-08 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1502: --- Summary: [JS] Define code entry point for integration testing Key: ARROW-1502 URL: https://issues.apache.org/jira/browse/ARROW-1502 Project: Apache Arrow

[jira] [Created] (ARROW-942) Support integration testing on Python 2.7

2017-05-02 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-942: -- Summary: Support integration testing on Python 2.7 Key: ARROW-942 URL: https://issues.apache.org/jira/browse/ARROW-942 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-941) [Docs] Improve "cold start" integration testing instructions

2017-05-02 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-941: -- Summary: [Docs] Improve "cold start" integration testing instructions Key: ARROW-941 URL: https://issues.apache.org/jira/browse/ARROW-941 Project: Ap

[jira] [Created] (ARROW-921) Add scripts to facilitate integration testing between revisions of the codebase

2017-04-30 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-921: -- Summary: Add scripts to facilitate integration testing between revisions of the codebase Key: ARROW-921 URL: https://issues.apache.org/jira/browse/ARROW-921 Project

[jira] [Created] (ARROW-620) [C++] Add date/time support to JSON reader/writer for integration testing

2017-03-12 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-620: -- Summary: [C++] Add date/time support to JSON reader/writer for integration testing Key: ARROW-620 URL: https://issues.apache.org/jira/browse/ARROW-620 Project: Apache

[jira] [Closed] (ARROW-310) [Java] Create CLI tool to read an Arrow file and write it out (for integration testing)

2017-01-26 Thread Wes McKinney (JIRA)
eate CLI tool to read an Arrow file and write it out (for > integration testing) > --- > > Key: ARROW-310 > URL: https://issues.apache.org/jira/browse/ARROW-310 >

[jira] [Resolved] (ARROW-506) Implement Arrow Echo server for integration testing

2017-01-23 Thread Wes McKinney (JIRA)
] > Implement Arrow Echo server for integration testing > --- > > Key: ARROW-506 > URL: https://issues.apache.org/jira/browse/ARROW-506 > Project: Apache Arrow > Issue Type: Task

[jira] [Created] (ARROW-506) Implement Arrow Echo server for integration testing

2017-01-21 Thread Nong Li (JIRA)
Nong Li created ARROW-506: - Summary: Implement Arrow Echo server for integration testing Key: ARROW-506 URL: https://issues.apache.org/jira/browse/ARROW-506 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-310) [Java] Create CLI tool to read an Arrow file and write it out (for integration testing)

2016-09-29 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-310: -- Summary: [Java] Create CLI tool to read an Arrow file and write it out (for integration testing) Key: ARROW-310 URL: https://issues.apache.org/jira/browse/ARROW-310