Re: [DISCUSS] Support of higher bit-width Decimal type

2020-08-03 Thread Micah Kornfield
Given no objections, we'll go ahead and start implementing support for 256-bit decimals. I'm considering setting up another branch to develop all the components so they can be merged to master atomically. Thanks, Micah On Tue, Jul 28, 2020 at 6:39 AM Wes McKinney wrote: > Generally this sounds

Re: Compute kernels and alignment of buffer slices

2020-08-03 Thread Micah Kornfield
Also for alignment requirements in C++ we sometimes process unaligned leading/trailing data to reach the required alignment. On Monday, August 3, 2020, Wes McKinney wrote: > We handle arbitrary slices in C++ and it hasn't seemed especially > burdensome. We have some utilities (e.g. see > arrow/

Re: [DISCUSS][C++] MakeBuilder with a DictionaryType ignores the bit-width of the index type

2020-08-03 Thread Wes McKinney
It seems useful to use the index type to set the starting bit width of the builder. I guess we can preserve the behavior of expanding to the next bit width when overflowing the smaller integer types. On Sun, Aug 2, 2020 at 9:32 PM Kenta Murata wrote: > > Hi folks, > > arrow::MakeBuilder function

Re: Compute kernels and alignment of buffer slices

2020-08-03 Thread Wes McKinney
We handle arbitrary slices in C++ and it hasn't seemed especially burdensome. We have some utilities (e.g. see arrow/util/bit_block_counter.h) to facilitate efficiently iterating through bitmaps 64 bits at a time (even when slices on an unaligned offset) and associated bit-by-bit iterators (e.g. Bi

Compute kernels and alignment of buffer slices

2020-08-03 Thread Jörn Horstmann
While investigating an issue regarding offset handling in the rust arithmetic kernels (https://issues.apache.org/jira/browse/ARROW-9583), I started to wonder how the other implementations are handling compute on buffer slices. The rust implementation currently allows creating slices of arrays star

[NIGHTLY] Arrow Build Report for Job nightly-2020-08-03-0

2020-08-03 Thread Crossbow
Arrow Build Report for Job nightly-2020-08-03-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-08-03-0 Failed Tasks: - conda-linux-gcc-py36-cpu: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-08-03-0-azure-conda-linux-gcc-py36-cp