Re: [C-GLib] reading values quickly from a list array

2020-09-09 Thread Ishan Anand
I'll make sure to do that. Thank you again. Best, Ishan From: Sutou Kouhei Sent: Tuesday, September 8, 2020 2:56 AM To: user@arrow.apache.org Subject: Re: [C-GLib] reading values quickly from a list array Hi, I've merged it. Note that you need

Re: [C-GLib] reading values quickly from a list array

2020-09-07 Thread Sutou Kouhei
Hi, I've merged it. Note that you need to install Apache Arrow C++ (master) before you install Apache Arrow GLib (master). Apache Arrow GLib depends on Apache Arrow C++. Thanks, -- kou In "Re: [C-GLib] reading values quickly from a list array " on Mon, 7 Sep 2020

Re: [C-GLib] reading values quickly from a list array

2020-09-06 Thread Ishan Anand
g Subject: Re: [C-GLib] reading values quickly from a list array Hi, garrow_list_array_get_value() is a bit high cost function because it creates a sub list array. It doesn't copy array data (it shares array data) but it creates a new sub array (container for data) in C++ level and C level

Re: [C-GLib] reading values quickly from a list array

2020-09-06 Thread Sutou Kouhei
for (k = 0; k < value_length; ++k) { raw_list_values[value_offset + k]; } } g_object_unref(list_values); g_object_unref(column); g_object_unref(record_batch); } } g_object_unref(reader); } g_object_unref(input); return EXIT_SUCCESS; } ---- It takes 0.5sec on my m

[C-GLib] reading values quickly from a list array

2020-09-06 Thread Ishan Anand
Hi I am trying to use the Arrow Glib API to read/write from C. Specifically, while Arrow is a columnar format, I'm really excited to be able to write a lot of rows from a C like runtime and access it from python for analytics as an array per column. And vice versa. To get a quick example runn