Re: [C++][Python] Do I have to make arrow::adapters::orc::WriterOptions and arrow::adapters::orc::ReaderOptions immutable?

Note you can create a Cython alias for any C++ type https://github.com/apache/arrow/blob/master/python/pyarrow/includes/libarrow.pxd#L138 so you can create an OrcCompressionKind alias for the fully scoped C++ type, no need for any C++ changes On Mon, Mar 15, 2021 at 4:00 AM Antoine Pitrou wrote

Re: [Release] Request for patch release of arrow 3.x

Probably a misunderstanding by the authors of that document. As https://arrow.apache.org/release/ shows, we've been doing quarterly major releases since roughly 2018, and they've been on the January/April/July/October ballpark, with the occasional delay. Perhaps we should formalize that somewhere o

Re: [Release] Request for patch release of arrow 3.x

Hi Arrow Devs, >From the following road-map document I found, it appears to be that arrow 4.0 next major release is in June 2021 as opposed to April 2021. https://docs.google.com/document/d/1qspsOM_dknOxJKdGvKbC1aoVoO0M3i6x1CIo58mmN2Y/edit# Quoting the document here: "...about plans for the 4.0

Re: [ALL] Integration tests for dense and sparse tensor

On Mon, 15 Mar 2021 19:48:22 + Fernando Herrera wrote: > Hi Neal, > > Thanks for the update and the link. > > I found that the project has these files for tensor checking > https://github.com/apache/arrow-testing/tree/e8ce32338f2dfeca3a5126f7677bdee159604000/data/arrow-ipc-tensor-stream > >

Re: [ALL] Integration tests for dense and sparse tensor

> > I found that the project has these files for tensor checking > > https://github.com/apache/arrow-testing/tree/e8ce32338f2dfeca3a5126f7677bdee159604000/data/arrow-ipc-tensor-stream These are fuzzing files from the readme in that directory: > These files contain Arrow IPC tensor streams, usual

Re: [ALL] Integration tests for dense and sparse tensor

Hi Neal, Thanks for the update and the link. I found that the project has these files for tensor checking https://github.com/apache/arrow-testing/tree/e8ce32338f2dfeca3a5126f7677bdee159604000/data/arrow-ipc-tensor-stream So, if I understand correctly, for any application to be compatible with C+

Re: [ALL] Integration tests for dense and sparse tensor

Hi Fernando, https://arrow.apache.org/docs/status.html lists the implementation status across languages, and that mostly reflects integration testing I think (though there may be some features listed as "implemented" that aren't tested). Neal On Mon, Mar 15, 2021 at 5:00 AM Fernando Herrera < fer

Re: Question about joining two tables

For future design docs/proposals, I've created: https://cwiki.apache.org/confluence/display/ARROW/from+the+mailing+list I'll append to that list as I see new docs come up. On Thu, Mar 11, 2021 at 10:33 PM Aldrin wrote: > Great, thanks for the responses! That all makes sense :) > > On Thu, Mar 1

Re: [Release] Request for patch release of arrow 3.x

Hi Prem, I didn't spot that this came from an NVIDIA email address when looking at this email on my phone. I will ping you directly and report conclusions back here. Thanks, Andy. On Fri, Mar 12, 2021 at 11:01 PM Andy Grove wrote: > Hi Prem, > > I'd like to learn more about your needs here. >

Re: How to compose nullable return types without Option

Hi John, is this a question about Apache Arrow or Arrow the Kotlin library (a different project)? On Mon, Mar 15, 2021 at 3:12 AM John Coleman wrote: > Hi, > > Presently one can compose a set of functions that return nullables by > using toOption to return None for a failed return. However with

[ALL] Integration tests for dense and sparse tensor

Hi all, Does anyone know what is the status for the dense and sparse tensor tests? I was looking for a data file with a tensor created with the C++ implementation but I couldnt find anything. Is anybody testing IPC for a tensor? Thanks in advance, Fernando

[NIGHTLY] Arrow Build Report for Job nightly-2021-03-15-0

Arrow Build Report for Job nightly-2021-03-15-0 All tasks: https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-03-15-0 Failed Tasks: - test-conda-cpp-valgrind: URL: https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-03-15-0-github-test-conda-cpp-

Re: [C++][Python] Do I have to make arrow::adapters::orc::WriterOptions and arrow::adapters::orc::ReaderOptions immutable?

Hi, Le 15/03/2021 à 00:31, Ying Zhou a écrit : I have a question about https://github.com/apache/arrow/pull/9702 (and another future PR) over WriterOptions and ReaderOptions that are basically code copied from the ORC project which then got Arrow

How to compose nullable return types without Option

Hi, Presently one can compose a set of functions that return nullables by using toOption to return None for a failed return. However with the loss of Option there will be no applicative to use. Can there be a Null.applicative? Without Option what can the a null be lifted into to compose it? R