Re: possible bug in MakeArrayFromScalar

2021-07-12 Thread David Li
I noticed the same thing here: https://github.com/apache/arrow/pull/10642/files#diff-c3b0484ad8586ff46fa035d446a7d1c3a30cd35d13cd05678c99814938e07d5b If it helps I can pull that out into a separate JIRA (or feel free to do so as well). -David On Mon, Jul 12, 2021, at 21:27, Niranda Perera

possible bug in MakeArrayFromScalar

2021-07-12 Thread Niranda Perera
Hi all, It seems like there's a bug in MakeArrayFromScalar for FixedSizedBinaryType. https://github.com/apache/arrow/blob/e990d177b1f1dec962315487682f613d46be573c/cpp/src/arrow/array/util.cc#L516 ```c++ template enable_if_t::value || is_fixed_size_binary_type::value ||

Re: Building apache/arrow-site locally on Apple Silicon?

2021-07-12 Thread Wes McKinney
I never was able to get this to work on Apple Silicon, I vaguely found bug reports with the "sassc" Ruby gem that the errors appear to be originating from. I finished the website work I needed to do on an x86 machine but this may come up again when someone goes to work on the website on an M1 On

Re: [DISCUSS] Should we start marking "feather" as deprecated?

2021-07-12 Thread Wes McKinney
I don't have a strong view on this. As is, Feather serves as a convenient / simple encapsulation of an IPC file. Plenty of people use pandas.read_feather, so if we mark the name as deprecated in Arrow, then we would be asking pandas and other downstream consumers to deprecate it also in favor of

[DISCUSS] Should we start marking "feather" as deprecated?

2021-07-12 Thread Weston Pace
Feather V2 is currently synonymous with the IPC format. My impression is that the feather terminology is now being deprecated in favor of IPC. Do we want to start marking feather modules as deprecated (both in code and the documentation) and more explicitly point users to the newer

Re: [Rust] Preparing for the 5.0.0 release and the 5.x release line

2021-07-12 Thread Andrew Lamb
I currently plan to create the 5.0.0 Rust release candidate on Wednesday -- if anyone is interested here are the release notes [1] and readme cleanup [2] that I plan to merge prior to creating the release candidate. Now would also be an excellent time to respond to this thread if there is

Re: [DISCUSS] Binary Values in Key value pairs WAS: Re: [INFO_REQUEST][FLIGHT] - Dynamic schema changes in ArrowFlight streams

2021-07-12 Thread Wes McKinney
pyarrow at least treats the KeyValue values as binary and not UTF-8. On Sun, Jul 11, 2021 at 9:40 PM Micah Kornfield wrote: > > I think other languages (e.g. java, python) might make more of distinction > between utf-8 compatible strings and raw bytes. For python it might be less > of a

Re: Drafting July 2021 Arrow board report

2021-07-12 Thread Wes McKinney
hi all — anymore comments / suggestions for the report? We can try to follow up on issues that were raised in the last couple of quarterly reports On Tue, Jul 6, 2021 at 10:32 AM Wes McKinney wrote: > > It's time again for our quarterly ASF board report, I created a Google > doc here where you

Re: [GitHub] Pull Request 10621

2021-07-12 Thread Wes McKinney
The s390x build on Travis CI has been known to be flaky, so I don't think it's caused by your changes. On Mon, Jul 12, 2021 at 10:19 AM Tahsin Hassan wrote: > > Hi all, > > Trying to understand, whether the following failure > https://travis-ci.com/github/apache/arrow/jobs/520528070 is related

[GitHub] Pull Request 10621

2021-07-12 Thread Tahsin Hassan
Hi all, Trying to understand, whether the following failure https://travis-ci.com/github/apache/arrow/jobs/520528070 is related to my pull request changes https://github.com/apache/arrow/pull/10621 Any pointers would be helpful. Thanks, Tahsin

Re: [C++] [DISCUSS] Moving towards a consistent enum naming scheme

2021-07-12 Thread Benjamin Kietzman
Relevant to this thread: https://github.com/apache/arrow/pull/10691 adds an enum replacement which includes compile-time to/from strings. This should reduce repetitive boilerplate in the bindings and elsewhere mapping to/from user provided string values. On Mon, Jun 14, 2021 at 11:17 PM Micah

Re: [C++] Adopting a library for (distributed) tracing

2021-07-12 Thread David Li
A quick update on this, I don't think this will happen for 5.0; the upstream library still hasn't reached 1.0, and I don't want to cram this in at the end of a cycle, especially as each of their release candidates has needed an upstream fix in order to keep all our CI platforms working.

Re: [ANNOUNCE] New Arrow committer: Weston Pace

2021-07-12 Thread Krisztián Szűcs
Congrats! On Mon, Jul 12, 2021 at 8:51 AM Weston Pace wrote: > > Thank you everyone. I'm really enjoying working on such a great project. > > > On Fri, Jul 9, 2021 at 4:01 PM Neal Richardson > wrote: > > > > Congrats Weston! > > > > On Fri, Jul 9, 2021 at 11:53 AM Micah Kornfield > > wrote: >

Re: [ANNOUNCE] New Arrow committer: Weston Pace

2021-07-12 Thread Weston Pace
Thank you everyone. I'm really enjoying working on such a great project. On Fri, Jul 9, 2021 at 4:01 PM Neal Richardson wrote: > > Congrats Weston! > > On Fri, Jul 9, 2021 at 11:53 AM Micah Kornfield > wrote: > > > Congrats! > > > > On Fri, Jul 9, 2021 at 7:56 AM Benjamin Kietzman > > wrote: