Re: Rust nightly + formatting changes

2018-12-04 Thread Marco Neumann
rustfmt will hit 1.0 tomorrow (Rust 1.31 release) and ensures stable formatting over multiple releases. As far as I understood, this "formatting style stability" will affect all channels, so we could run rustfmt on the same channel(s) as our CI. Might be that we need a jira ticket to change from

[jira] [Created] (ARROW-3939) [Rust] Remove macro definition for ListArrayBuilder

2018-12-04 Thread Chao Sun (JIRA)
Chao Sun created ARROW-3939: --- Summary: [Rust] Remove macro definition for ListArrayBuilder Key: ARROW-3939 URL: https://issues.apache.org/jira/browse/ARROW-3939 Project: Apache Arrow Issue Type: Su

[jira] [Created] (ARROW-3938) [Packaging] Stop to refer java/pom.xml to get version information

2018-12-04 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-3938: --- Summary: [Packaging] Stop to refer java/pom.xml to get version information Key: ARROW-3938 URL: https://issues.apache.org/jira/browse/ARROW-3938 Project: Apache Arrow

Re: Rust nightly + formatting changes

2018-12-04 Thread Chao Sun
One question is whether we should only restrict this on rustfmt but still use nightly for testing. Also, how often should we update the nightly version? does it require a JIRA every time? Another option is to run stable rustfmt but use nightly for CI. Since we're already running CI with stable, th

Rust nightly + formatting changes

2018-12-04 Thread Andy Grove
One of the challenges of using Rust nightly is that things can change often. Master builds have been failing because CI is picking up the latest nightly all the time, and the formatting rules change over time. One option to avoid this is to have CI use a specific nightly version rather than always

[jira] [Created] (ARROW-3937) [Rust] Rust nightly build is failing

2018-12-04 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3937: --- Summary: [Rust] Rust nightly build is failing Key: ARROW-3937 URL: https://issues.apache.org/jira/browse/ARROW-3937 Project: Apache Arrow Issue Type: Bug

Arrow JS 0.4.0 Release

2018-12-04 Thread Brian Hulette
Hi all, It's been quite a while since our last major Arrow JS release (0.3.0 on February 22!), and since then we've added several new features that will make Arrow JS much easier to adopt. We've added convenience functions for creating Arrow vectors and tables natively in JavaScript, an IPC writer,

Re: Timeline for Arrow 0.12.0 release

2018-12-04 Thread Andy Grove
I'd love to tackle the three related issues for supporting simple math/comparison operations on primitive arrays and casting primitive arrays but since the change to use Rust specialization feature I'm a bit stuck and need some assistance applying the math operations to the numeric types and not th

Re: Timeline for Arrow 0.12.0 release

2018-12-04 Thread Wes McKinney
Andy, Paddy, or other Rust developers -- could you review the 6 issues in TODO in the 0.12 backlog and either assign them or move them to the next release if they aren't going to be completed this week or next? On Fri, Nov 30, 2018 at 4:34 PM Wes McKinney wrote: > > hi folks, > > Tomorrow is Dec

Re: [Go] High memory usage on CSV read into table

2018-12-04 Thread Sebastien Binet
On Tue, Dec 4, 2018 at 10:23 PM Daniel Harper wrote: > Sorry I've been away at reinvent. > > Just tried out what's currently on master (with the chunked change that > looks like it has merged). I'll do the break down of the different parts > later but as a high level look at just running the same

Re: [Go] High memory usage on CSV read into table

2018-12-04 Thread Daniel Harper
Sorry I've been away at reinvent. Just tried out what's currently on master (with the chunked change that looks like it has merged). I'll do the break down of the different parts later but as a high level look at just running the same script as described above these are the numbers https://docs.g

[jira] [Created] (ARROW-3936) Add _O_NOINHERIT to the file open flags on Windows

2018-12-04 Thread Philip Felton (JIRA)
Philip Felton created ARROW-3936: Summary: Add _O_NOINHERIT to the file open flags on Windows Key: ARROW-3936 URL: https://issues.apache.org/jira/browse/ARROW-3936 Project: Apache Arrow Issue

[jira] [Created] (ARROW-3935) [Packaging/Docker] Mount ccache directroy in docker-compose setup

2018-12-04 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-3935: -- Summary: [Packaging/Docker] Mount ccache directroy in docker-compose setup Key: ARROW-3935 URL: https://issues.apache.org/jira/browse/ARROW-3935 Project: Apache A