[jira] [Created] (ARROW-7747) [Python] coerce_timestamps + allow_truncated_timestamps does not work as expected with nanoseconds

2020-02-03 Thread Jira
Théophile Chevalier created ARROW-7747: -- Summary: [Python] coerce_timestamps + allow_truncated_timestamps does not work as expected with nanoseconds Key: ARROW-7747 URL: https://issues.apache.org/jira/browse

Re: [NIGHTLY] Arrow Build Report for Job nightly-2020-02-02-0

2020-02-03 Thread Francois Saint-Jacques
Opened https://github.com/apache/arrow/pull/6342 to silence the OSX jar issue. On Sun, Feb 2, 2020 at 8:31 AM Crossbow wrote: > > > Arrow Build Report for Job nightly-2020-02-02-0 > > All tasks: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-02-02-0 > > Failed Tasks: > -

Re: [NIGHTLY] Arrow Build Report for Job nightly-2020-02-02-0

2020-02-03 Thread Francois Saint-Jacques
Whelp, gmail didn't help with the thread folding. I'll just approve Krisz' patch :). On Mon, Feb 3, 2020 at 8:22 AM Francois Saint-Jacques wrote: > > Opened https://github.com/apache/arrow/pull/6342 to silence the OSX jar issue. > > On Sun, Feb 2, 2020 at 8:31 AM Crossbow wrote: > > > > > > Arro

[NIGHTLY] Arrow Build Report for Job nightly-2020-02-03-0

2020-02-03 Thread Crossbow
Arrow Build Report for Job nightly-2020-02-03-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-02-03-0 Failed Tasks: - debian-buster: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-02-03-0-azure-debian-buster - gandiva-jar-osx:

Re: [NIGHTLY] Arrow Build Report for Job nightly-2020-02-03-0

2020-02-03 Thread Francois Saint-Jacques
The debian buster failure seems to be a network issue with github upload, we'll see tomorrow. The gandiva-jar will be gone in the next nightly (https://github.com/apache/arrow/pull/6342). On Mon, Feb 3, 2020 at 8:48 AM Crossbow wrote: > > > Arrow Build Report for Job nightly-2020-02-03-0 > > All

[jira] [Created] (ARROW-7748) [C++] [Cuda] Cache CUDA contexts

2020-02-03 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-7748: - Summary: [C++] [Cuda] Cache CUDA contexts Key: ARROW-7748 URL: https://issues.apache.org/jira/browse/ARROW-7748 Project: Apache Arrow Issue Type: Improveme

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Antoine Pitrou
On Fri, 31 Jan 2020 04:13:12 +0100 Krisztián Szűcs wrote: > Hi, > > I would like to propose the following release candidate (RC2) of Apache > Arrow version 0.16.0. This is a release consisting of 728 > resolved JIRA issues[1]. > > This release candidate is based on commit: > 729a7689fd87572e6a14

[Java] Issues with IntelliJ + errorprone + OpenJDK

2020-02-03 Thread Andy Grove
I'm working on the Java codebase and cannot run code inside IntelliJ and it looks like some kind of compatibility issue between errorprone and the JDK that IntelliJ is using. I'm hoping other Java committers have found a solution already to this? Error:java: java.lang.RuntimeException: java.lang.N

[DISCUSS] Improving GitHub Actions configurations + tooling

2020-02-03 Thread Wes McKinney
hi folks, I have noticed that many of our GitHub Actions configurations are very similar to each other https://www.diffchecker.com/eF4tHdzo Aside from the "copy-paste" issue, some work would have to be done to generate a Crossbow configuration using GHA. It seems like a solution to these issues

[jira] [Created] (ARROW-7749) [C++] Link some tests together

2020-02-03 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-7749: - Summary: [C++] Link some tests together Key: ARROW-7749 URL: https://issues.apache.org/jira/browse/ARROW-7749 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-7750) [Release] Make the source release verification script restartable

2020-02-03 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7750: -- Summary: [Release] Make the source release verification script restartable Key: ARROW-7750 URL: https://issues.apache.org/jira/browse/ARROW-7750 Project: Apache A

[jira] [Created] (ARROW-7751) [Release] macOS wheel verification also needs arrow-testing

2020-02-03 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-7751: -- Summary: [Release] macOS wheel verification also needs arrow-testing Key: ARROW-7751 URL: https://issues.apache.org/jira/browse/ARROW-7751 Project: Apache Arrow

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Neal Richardson
+1 (non-binding) I did binary verification and macOS (10.14) wheels. Wheels for 3.5 failed as previously described, and 2.7 also failed similarly, so I'm gathering that that's not a blocker. 3.6 - 3.8 passed once I added this patch for Flight test fixtures: https://github.com/apache/arrow/pull/634

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Krisztián Szűcs
Please use the latest master [1] to verify the wheels. [1]: https://github.com/apache/arrow/commit/cb81f7d84c26cd75f4568ae1b29744cb4218b578 On Mon, Feb 3, 2020 at 8:26 PM Neal Richardson wrote: > > +1 (non-binding) > > I did binary verification and macOS (10.14) wheels. Wheels for 3.5 failed >

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Neal Richardson
I used that with https://patch-diff.githubusercontent.com/raw/apache/arrow/pull/6344.diff applied. On Mon, Feb 3, 2020 at 11:34 AM Krisztián Szűcs wrote: > Please use the latest master [1] to verify the wheels. > > [1]: > https://github.com/apache/arrow/commit/cb81f7d84c26cd75f4568ae1b29744cb421

[jira] [Created] (ARROW-7752) [Release] Enable and test dataset in the verification script

2020-02-03 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7752: -- Summary: [Release] Enable and test dataset in the verification script Key: ARROW-7752 URL: https://issues.apache.org/jira/browse/ARROW-7752 Project: Apache Arrow

Re: [Java] Issues with IntelliJ + errorprone + OpenJDK

2020-02-03 Thread Bryan Cutler
Hi Andy, What is your JDK version? I haven't seen that exact error, did you open Arrow as a Maven project in Intellij? On Mon, Feb 3, 2020 at 7:47 AM Andy Grove wrote: > I'm working on the Java codebase and cannot run code inside IntelliJ and it > looks like some kind of compatibility issue betw

Re: [Java] Issues with IntelliJ + errorprone + OpenJDK

2020-02-03 Thread Andy Grove
Hi Bryan, Yes, I tried opening as a Maven project and got the same error. I'm using OpenJDK 1.8.0_232 on both Ubuntu 19.04 and macOS 10.14.6 and get the same error on both. I'm using IntelliJ Ultimate 2019.3.2. Building from the command line with Maven works fine. Very odd. I'll guess I'll do a l

[jira] [Created] (ARROW-7753) [R] Implement halffloat -> R conversion

2020-02-03 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-7753: -- Summary: [R] Implement halffloat -> R conversion Key: ARROW-7753 URL: https://issues.apache.org/jira/browse/ARROW-7753 Project: Apache Arrow Issue Type:

Re: [Java] Issues with IntelliJ + errorprone + OpenJDK

2020-02-03 Thread Andy Grove
So it turns out there are specific instructions [1] for using errorprone with IntelliJ. Unfortunately, this doesn't work due to a bug in IntelliJ that was fixed a few days ago but not released yet [2]. [1] https://errorprone.info/docs/installation [2] https://intellij-support.jetbrains.com/hc/en-u

Re: [Gandiva] LLVM version

2020-02-03 Thread Sutou Kouhei
Hi Projjal, > Let me test the change by running it with Dremio. Thanks! > Will update if there are any issues. It means that we can move forward if we don't get any responses from you in a week (long? short?), right? Thanks, -- kou In <29da1c69-6f14-45aa-8ea6-4293dc615...@www.fastmail.com>

[jira] [Created] (ARROW-7754) [C++] Result is slow

2020-02-03 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-7754: - Summary: [C++] Result is slow Key: ARROW-7754 URL: https://issues.apache.org/jira/browse/ARROW-7754 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-7755) [Python] Windows wheel cannot be installed on Python 3.8

2020-02-03 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-7755: --- Summary: [Python] Windows wheel cannot be installed on Python 3.8 Key: ARROW-7755 URL: https://issues.apache.org/jira/browse/ARROW-7755 Project: Apache Arrow I

[jira] [Created] (ARROW-7756) [Java] Explore using Avatica as basis for Flight JDBC Driver

2020-02-03 Thread Andy Grove (Jira)
Andy Grove created ARROW-7756: - Summary: [Java] Explore using Avatica as basis for Flight JDBC Driver Key: ARROW-7756 URL: https://issues.apache.org/jira/browse/ARROW-7756 Project: Apache Arrow

[jira] [Created] (ARROW-7757) [C#] Change the class access modifier of `PrimitiveArrayBuilder` to public

2020-02-03 Thread Zachary Gramana (Jira)
Zachary Gramana created ARROW-7757: -- Summary: [C#] Change the class access modifier of `PrimitiveArrayBuilder` to public Key: ARROW-7757 URL: https://issues.apache.org/jira/browse/ARROW-7757 Project:

Re: [Java] Issues with IntelliJ + errorprone + OpenJDK

2020-02-03 Thread Bryan Cutler
Ahh, now that you sent that link it jogged my memory. A while ago I think I did see that error and installed the error prone compiler plugin mentioned. It worked after that I believe, but I am on IntillJ 2019.2.4 on Ubuntu, and it was a while ago so maybe something changed. If there is anything I c

Re: Coordinating / scheduling C++ Parquet-Arrow nested data work (ARROW-1644 and others)

2020-02-03 Thread Igor Calabria
Hi, I would love to help with this issue. I'm aware that this is a huge task for a first contribution to arrow, but I feel that I could help with the read path. Reading parquet seems like a extremely complex task since both hive[0] and spark[1] tried to implement a "vectorized" version and they all

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Neal Richardson
I've been experimenting with running the release verification on GitHub Actions: https://github.com/apache/arrow/pull/6349. It would be great to automate at least the core checks, even if releasing still requires some manual checking too. So far, I've verified Python wheels on Windows except for p

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Neal Richardson
Some further color, as builds have started to fail: 1. Windows source fails oddly; it seems that installing boost makes wget not work correctly. Before installing boost, I can wget the rc tarball and build as far as the boost version check in C++, but after installing boost, I can't download the t

Re: [Java] Issues with IntelliJ + errorprone + OpenJDK

2020-02-03 Thread Fan Liya
I was having the same problem, and it was solved by 1. Install the "Error Prone Compiler" plugin to intellij 2. setting "Settings/Build, Execution, Deployment/Compiler/Java Compiler/Use compiler" to "Javac with error-prone" I am using Intellij 2019.3 (Community Edition) Best, Liya Fan On Tue, F

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread David Li
Hi Neal, The flaky Flight auth test has been an issue recently: https://issues.apache.org/jira/browse/ARROW-7721 I'm hoping to take a look at this when I get a chance. Best, David On 2/3/20, Neal Richardson wrote: > Some further color, as builds have started to fail: > > 1. Windows source fail

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Andy Grove
+1 (binding) based on running the Rust tests Thanks. On Thu, Jan 30, 2020 at 8:13 PM Krisztián Szűcs wrote: > Hi, > > I would like to propose the following release candidate (RC2) of Apache > Arrow version 0.16.0. This is a release consisting of 728 > resolved JIRA issues[1]. > > This release c

[jira] [Created] (ARROW-7758) Specific dates such as 0000-01-01 raise ValueError and parquet file is not loaded into pandas dataframe

2020-02-03 Thread Evangelos Pertsinis (Jira)
Evangelos Pertsinis created ARROW-7758: -- Summary: Specific dates such as -01-01 raise ValueError and parquet file is not loaded into pandas dataframe Key: ARROW-7758 URL: https://issues.apache.org/jira/br

[jira] [Created] (ARROW-7759) [C++][Dataset] Add CsvFileFormat for CSV support

2020-02-03 Thread Francois Saint-Jacques (Jira)
Francois Saint-Jacques created ARROW-7759: - Summary: [C++][Dataset] Add CsvFileFormat for CSV support Key: ARROW-7759 URL: https://issues.apache.org/jira/browse/ARROW-7759 Project: Apache Arrow

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Francois Saint-Jacques
+1 Binaries verification didn't have any issues. Sources verification worked with some local environment hiccups François On Mon, Feb 3, 2020 at 8:46 PM Andy Grove wrote: > > +1 (binding) based on running the Rust tests > > Thanks. > > On Thu, Jan 30, 2020 at 8:13 PM Krisztián Szűcs > wrote: >

Re: [VOTE] Release Apache Arrow 0.16.0 - RC2

2020-02-03 Thread Francois Saint-Jacques
Tested on ubuntu 18.04 for the source release. On Mon, Feb 3, 2020 at 10:07 PM Francois Saint-Jacques wrote: > > +1 > > Binaries verification didn't have any issues. > Sources verification worked with some local environment hiccups > > François > > On Mon, Feb 3, 2020 at 8:46 PM Andy Grove wrote

Re: Coordinating / scheduling C++ Parquet-Arrow nested data work (ARROW-1644 and others)

2020-02-03 Thread Micah Kornfield
Hi Igor, Thanks for the offer. There is an old PR [1] that contains the generic logic for reading and writing, which last time I looked seemed like a reasonable start for the read portion (I think the write portion can potentially be made more memory efficient memory (at the expense of some recomp