Re: [Rust] Column names in FFI_ArrowSchema

2021-02-22 Thread Marc Prud'hommeaux
It looks like this would be trickier than I first expected: ffi::ArrowArray is created from an ArrayData, which itself doesn't appear to contain any name. I don't suppose we'd want to add a name property to it just for this. Any guidance on a mechanism to get the name through to the FFI_ArrowS

DataFusion Postgres License Requirements

2021-02-22 Thread Mike Seddon
Hi, The DataFusion project (an in-memory SQL engine built upon Arrow in Rust) has decided to adopt the Postgres dialect of SQL. The Postgres 'dialect' largely refers to the functions/API that Postgres has added in addition to meeting the ANSI SQL standard functions as all dialects have slightly di

Re: Constraints on fixed size list of variables sized types

2021-02-22 Thread Micah Kornfield
By the way, this behavior is what make supporting fixed size lists while reading parquet tricky. On Mon, Feb 22, 2021 at 11:35 AM Jorge Cardoso Leitão < jorgecarlei...@gmail.com> wrote: > Thank you both for your time and for your answers. I've made a mistake; > you are right :-) > > Best, > Jorge

Re: [C++] CMake Config to get MSVC cast warning on Linux?

2021-02-22 Thread Wes McKinney
You could also create an -m32 build on Linux which would show additional 64->32 bit integer narrowing warnings -- little bit of a pain to install the i386 toolchain but potentially useful. On Mon, Feb 22, 2021 at 4:55 AM Antoine Pitrou wrote: > > > You can try -Wconversion on gcc or clang, but II

Re: Constraints on fixed size list of variables sized types

2021-02-22 Thread Jorge Cardoso Leitão
Thank you both for your time and for your answers. I've made a mistake; you are right :-) Best, Jorge On Sun, Feb 21, 2021 at 1:39 PM Micah Kornfield wrote: > Hi Jorge, > I'm not sure I understand your example, but I would expect any child array > of a fixed size list to always have N*size of

Re: Constraints on fixed size list of variables sized types

2021-02-22 Thread Jacob Quinn
Yeah, I didn't quite follow the example either; it seems like your example actually corresponds to a FixedSizeList[2]>[2]? Or perhaps FixedSizeList>[2]? Assuming the former, it seems you'd need additional fixed size slots to account for the Null element. In Julia, you can inspect the internal struc

Re: [C++] libarrow isolation

2021-02-22 Thread Antoine Pitrou
Le 22/02/2021 à 15:29, Tahsin Hassan a écrit : > Hi all, > > MATLAB uses the Arrow C++ libraries (i.e. libarrow.so) to read and write > Parquet files (https://www.mathworks.com/help/matlab/ref/parquetread.html) > While exploring ways to integrate more tightly with Arrow, we've run into a > sy

[C++] libarrow isolation

2021-02-22 Thread Tahsin Hassan
Hi all, MATLAB uses the Arrow C++ libraries (i.e. libarrow.so) to read and write Parquet files (https://www.mathworks.com/help/matlab/ref/parquetread.html) While exploring ways to integrate more tightly with Arrow, we've run into a symbol/library naming clash issue. When running pyarrow within

Re: [C++] CMake Config to get MSVC cast warning on Linux?

2021-02-22 Thread Antoine Pitrou
You can try -Wconversion on gcc or clang, but IIRC it's much less smart than MSVC and will also warn about silly things. Regards Antoine. Le 22/02/2021 à 05:10, Micah Kornfield a écrit : > Are there CMake config flags or Compiler flags to get comparable errors > that our appveyor windows buil

[NIGHTLY] Arrow Build Report for Job nightly-2021-02-22-0

2021-02-22 Thread Crossbow
Arrow Build Report for Job nightly-2021-02-22-0 All tasks: https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-02-22-0 Failed Tasks: - conda-linux-gcc-py37-aarch64: URL: https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-02-22-0-drone-conda-linux