Job posting

Hey All, Apologies ahead of time for the potential spam. I have been working with Jacques and co for about 6 months to bring Dremio to our front office trading organisation at UBS. We are now expanding the team and I am looking to hire some killer devs in London to work on Arrow, Gandiva and other

[jira] [Created] (ARROW-2758) [Plasma] Use Scope enum in Plasma

Philipp Moritz created ARROW-2758: - Summary: [Plasma] Use Scope enum in Plasma Key: ARROW-2758 URL: https://issues.apache.org/jira/browse/ARROW-2758 Project: Apache Arrow Issue Type: Improvem

[jira] [Created] (ARROW-2757) [Plasma] Huge pages test failing

Philipp Moritz created ARROW-2757: - Summary: [Plasma] Huge pages test failing Key: ARROW-2757 URL: https://issues.apache.org/jira/browse/ARROW-2757 Project: Apache Arrow Issue Type: Improveme

[DISCUSS] Joda Time -> Java8 Time

Hi, There has been a recent pr 2171 for ARROW-2015 to replace Joda time with Java8 time. I think this change is good as we move toward newer Java version and wonder if we should include this in the 0.10 release. The biggest concern is that this is a breaking change and could impact downstream pr

Re: Arrow sync at 12pm Eastern today

I won't be able to make it today. On Wed, Jun 27, 2018 at 10:48 AM Wes McKinney wrote: > https://meet.google.com/vtm-teks-phx >

Re: Some initial GPU questions

Hello Wes, Antoine, Thanks for your very detailed responses! It is really good to know that what is in arrow/gpu now is already setup to integrate into various GPU producer / consumers. The other responses made sense (assume in-memory and rely on orchestration, explicit over implicit, roadmap di

Arrow sync at 12pm Eastern today

https://meet.google.com/vtm-teks-phx

[jira] [Created] (ARROW-2756) [Python] Reduce redundant imports and minor fixes in parquet tests

Krisztian Szucs created ARROW-2756: -- Summary: [Python] Reduce redundant imports and minor fixes in parquet tests Key: ARROW-2756 URL: https://issues.apache.org/jira/browse/ARROW-2756 Project: Apache

[jira] [Created] (ARROW-2755) [Python] Allow using Ninja to build extension

Krisztian Szucs created ARROW-2755: -- Summary: [Python] Allow using Ninja to build extension Key: ARROW-2755 URL: https://issues.apache.org/jira/browse/ARROW-2755 Project: Apache Arrow Issue

Re: [DISCUSS] Developing a standard memory layout for in-memory records / "row-oriented" data

> I'm not sure this makes sense as an external stable api. I definitely think > it is useful as an internal representation for use within a particular > algorithm. I also think that can be informed by the particular algorithm that > you're working on. I agree that this is definitely needed in c

[jira] [Created] (ARROW-2754) [Python] When installing pyarrow via pip, a debug build is created

Wes McKinney created ARROW-2754: --- Summary: [Python] When installing pyarrow via pip, a debug build is created Key: ARROW-2754 URL: https://issues.apache.org/jira/browse/ARROW-2754 Project: Apache Arrow

[jira] [Created] (ARROW-2753) [GLib] Add garrow_schema_*_field()

Kouhei Sutou created ARROW-2753: --- Summary: [GLib] Add garrow_schema_*_field() Key: ARROW-2753 URL: https://issues.apache.org/jira/browse/ARROW-2753 Project: Apache Arrow Issue Type: New Feature

Re: [DISCUSS] Developing a standard memory layout for in-memory records / "row-oriented" data

I am wondering if this can be considered as an opportunity to implement support in Arrow for building high performance in-memory row stores for low latency and high throughput key based queries. In other words, we can design the in-memory record format keeping efficient RDMA reads as one of the goa

[jira] [Created] (ARROW-2752) [GLib] Document garrow_decimal_data_type_new()

Kouhei Sutou created ARROW-2752: --- Summary: [GLib] Document garrow_decimal_data_type_new() Key: ARROW-2752 URL: https://issues.apache.org/jira/browse/ARROW-2752 Project: Apache Arrow Issue Type: