Re: [DISCUSS][JAVA]Support Fast/Unsafe Vector APIs for Arrow

2019-05-01 Thread Siddharth Teotia
Looks like there are 2 PRs for this work -- https://github.com/apache/arrow/pull/4186 this PR adds new getUnsafe type APIs to ArrowBuf that don't do checkIndex() before calling PlatformDependent.get(memory address). So the access will go through vector.get() -> buffer.get() ->

Re: ARROW-3191: Status update: Making ArrowBuf work with arbitrary memory

2019-05-01 Thread Siddharth Teotia
Quick status update: I have 2 outstanding integration test failures that need to be addressed -- was out for a couple of days and then got dragged into another issue. Looking into the failures now. I

Re: How about inet4/inet6/macaddr data types?

2019-05-01 Thread Micah Kornfield
> > I'm awaiting community feedback about the approach to implementing > extension types, whether the approach that I've used (using the > following keys in custom_metadata [1]) is the one that we want to use > longer-term. This certainly seems like a good time to have that > discussion. If there

[jira] [Created] (ARROW-5247) [Python][C++] libprotobuf-generated exception when importing pyarrow.cuda

2019-05-01 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-5247: --- Summary: [Python][C++] libprotobuf-generated exception when importing pyarrow.cuda Key: ARROW-5247 URL: https://issues.apache.org/jira/browse/ARROW-5247 Project:

Re: [DISCUSS][C++] Static versus variable Arrow dictionary encoding

2019-05-01 Thread Hatem Helal
Thanks Wes, your proposed additional data type makes more sense to me. > As a first use case for this I would be personally looking to address > reads of encoded data from > Parquet format without an intermediate pass through dense format > (which can be slow and wasteful for heavily

Arrow sync call

2019-05-01 Thread Ravindra Pindikura
Hi, We had only a few attendees today : Neal Richardson (Ursa labs) Wes (Ursa labs) Ravindra (dremio) Hatem Halel (MathWorks) Areg Melik (Intel) There were no specific issues, and wes seemed to have network issues. So, we had a very short meeting. - Neal described a mac build issue due to

[RESULT] [VOTE] Add 64-bit offset list, binary, string (utf8) types to the Arrow columnar format

2019-05-01 Thread Wes McKinney
The vote carries with 3 binding +1 and 2 non-binding +1 On Fri, Apr 26, 2019 at 10:05 AM Brian Bowman wrote: > > Can non-Arrow PMC members/committers vote? > > If so, +1 > > -Brian > > On 4/25/19, 4:34 PM, "Wes McKinney" wrote: > > EXTERNAL > > In a recent mailing list discussion [1]