Re: Building an executable with arrow flight (C++)

2020-08-13 Thread Radu Teodorescu
Hi Wes, I will certainly give that a shot and provide feedback - my typical setup with arrow has so far used ExternalProject and I tend to prefer this for development vs the install path since it makes it easier track problems, step into the code, run arrow examples and tests when I need a

Re: Building an executable with arrow flight (C++)

2020-08-13 Thread Wes McKinney
hi Radu, If you use the approach in https://github.com/apache/arrow/blob/master/cpp/examples/minimal_build It should be sufficient to use find_package(ArrowFlight REQUIRED) and then use the imported arrow_flight_static target (or arrow_flight_shared, depending on your needs) when linking. If

Re: Building an executable with arrow flight (C++)

2020-08-13 Thread Radu Teodorescu
I can produce something isolated shortly - but really the questions is how can one build a hello world type flight server that does something like { FlightServerBase server; server.Serve(); //Yes I know this would fail at runtime but I just need to get there first } with a fully self

Re: Building an executable with arrow flight (C++)

2020-08-13 Thread Sutou Kouhei
Hi, Could you share a minimal CMake and C++ file set to reproduce your case? Thanks, -- kou In "Building an executable with arrow flight (C++)" on Thu, 13 Aug 2020 12:06:49 -0400, Radu Teodorescu wrote: > Hello, > I am trying to build a server that uses arrow flight and getting into a

Re: get element of ListArray as Array

2020-08-13 Thread Sutou Kouhei
Hi, The following code will work: auto list = std::static_pointer_cast(data->chunk(0)); auto currentSeries = list->value_slice(rowIndex); Thanks, -- kou In "Re: get element of ListArray as Array" on Thu, 13 Aug 2020 18:03:30 +0200, Kirill Lykov wrote: > I think I found a way: >

Building an executable with arrow flight (C++)

2020-08-13 Thread Radu Teodorescu
Hello, I am trying to build a server that uses arrow flight and getting into a bit of a rabbit hole with dependency inclusion. I have arrow included as an external project and so far everything has worked really smoothly (I have executables building with arrow, parquet arrow and I also have

Re: get element of ListArray as Array

2020-08-13 Thread Kirill Lykov
I think I found a way: ``` // data is arrow:ChunkedArray auto list = std::static_pointer_cast(data->chunk(0)); auto values = list->values(); auto startOffset = list->value_offset(rowIndex); auto length = list->value_offset(idx + 1) - startOffset;

My focus for Rust implementation for 2.0.0

2020-08-13 Thread Andy Grove
Some of you may have noticed a sudden flurry of activity from me after a bit of a break from the project, so I thought it might be useful to explain what I am up to. As of 1.0.0, DataFusion isn't really useful against any real-world data sets for a number of reasons, but most of all due to the

get element of ListArray as Array

2020-08-13 Thread Kirill Lykov
I have a ChunkedArray of type `arrow::list` and I want to take a value for a particular row in this column and return it as Array. >From example, I see one way of doing it -- get raw pointer using `values` method and also take `value_offset` to get offset. This way I will get pointers to the whole

Re: [C++]parse parquet with error: Invalid: Mix of struct and list types not yet supported.

2020-08-13 Thread Wes McKinney
Support for reading nested Parquet data is incomplete, see ARROW-1644. I hope this will be completed by the end of this year On Thu, Aug 13, 2020 at 4:54 AM annsshadow w wrote: > > Hi~all~ > I use the Arrow-1.0.0 to parse parquet and meet that error. > Is there any way or plan to deal with it? >

[NIGHTLY] Arrow Build Report for Job nightly-2020-08-13-0

2020-08-13 Thread Crossbow
Arrow Build Report for Job nightly-2020-08-13-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-08-13-0 Failed Tasks: - test-conda-python-3.7-hdfs-2.9.2: URL:

[C++]parse parquet with error: Invalid: Mix of struct and list types not yet supported.

2020-08-13 Thread annsshadow w
Hi~all~ I use the Arrow-1.0.0 to parse parquet and meet that error. Is there any way or plan to deal with it? The schema outputed by 'parquet-dump-schema' is below. message schema { optional int64 age; optional group logs { optional group players (List) { repeated group list {