[jira] [Created] (ARROW-2502) [Rust] Restore Windows Compatibility

2018-04-23 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-2502: -- Summary: [Rust] Restore Windows Compatibility Key: ARROW-2502 URL: https://issues.apache.org/jira/browse/ARROW-2502 Project: Apache Arrow Issue Type: Bug

Re: PyCon Sprint Document

2018-04-23 Thread Alex Hagerman
That makes sense :) https://docs.google.com/document/d/1ENUapCkKccgqSQUooSlQIymeYPFL3H1nkRPy6rs5E5A/edit?usp=sharing Thanks, Alex On 04/22/2018 10:32 PM, Wes McKinney wrote: Hi Alex, Can you create a Google Document so we can comment and collaborate more easily? Thanks Wes On Sun, Apr

[jira] [Created] (ARROW-2501) Upgrade Jackson to 2.9.5

2018-04-23 Thread Andy Grove (JIRA)
Andy Grove created ARROW-2501: - Summary: Upgrade Jackson to 2.9.5 Key: ARROW-2501 URL: https://issues.apache.org/jira/browse/ARROW-2501 Project: Apache Arrow Issue Type: Improvement Com

[jira] [Created] (ARROW-2500) [Java] IPC Writers/readers are not always setting validity bits correctly

2018-04-23 Thread Emilio Lahr-Vivaz (JIRA)
Emilio Lahr-Vivaz created ARROW-2500: Summary: [Java] IPC Writers/readers are not always setting validity bits correctly Key: ARROW-2500 URL: https://issues.apache.org/jira/browse/ARROW-2500 Proje

Re: Changing Github activity in JIRA

2018-04-23 Thread Uwe L. Korn
Nice, this seems to work now. Although it confused be at first that my github comment trigged a 10 minute work log :D Uwe On Mon, Apr 23, 2018, at 8:58 PM, Bryan Cutler wrote: > They can do it for us, I filed > https://issues.apache.org/jira/browse/INFRA-16426 > > On Mon, Apr 23, 2018 at 11:43

Re: Changing Github activity in JIRA

2018-04-23 Thread Bryan Cutler
They can do it for us, I filed https://issues.apache.org/jira/browse/INFRA-16426 On Mon, Apr 23, 2018 at 11:43 AM, Wes McKinney wrote: > That sounds like an INFRA-level thing, I'm sure they'll tell us if not > > On Mon, Apr 23, 2018 at 2:40 PM, Bryan Cutler wrote: > > Yeah, I understand that we

Re: Changing Github activity in JIRA

2018-04-23 Thread Wes McKinney
That sounds like an INFRA-level thing, I'm sure they'll tell us if not On Mon, Apr 23, 2018 at 2:40 PM, Bryan Cutler wrote: > Yeah, I understand that we don't want to rely on a third party to store all > of our code discussions. I took a look at a Beam issue and it had the > Github discussion un

Re: Changing Github activity in JIRA

2018-04-23 Thread Bryan Cutler
Yeah, I understand that we don't want to rely on a third party to store all of our code discussions. I took a look at a Beam issue and it had the Github discussion under "Work Log", so it does seem possible to do that. I'll send a question to INFRA about it, but is the configuration for this contr

Re: [Java] Upgrading Arrow to JDK 1.8

2018-04-23 Thread Bryan Cutler
+1 for Java 8 On Mon, Apr 23, 2018 at 11:18 AM, Dwight Gunning wrote: > A JIRA exists for this > > https://issues.apache.org/jira/plugins/servlet/mobile#issue/ARROW-2015 > > We were in agreement in principle on the migration - but when it was > created there were a lot of focus on the 0.9 releas

Re: [Java] Upgrading Arrow to JDK 1.8

2018-04-23 Thread Dwight Gunning
A JIRA exists for this https://issues.apache.org/jira/plugins/servlet/mobile#issue/ARROW-2015 We were in agreement in principle on the migration - but when it was created there were a lot of focus on the 0.9 release. No reason not to begin now Dwight Sent from my iPhone > On Apr 23, 2018, at

[jira] [Created] (ARROW-2499) [C++] Add iterator facility for Python sequences

2018-04-23 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-2499: - Summary: [C++] Add iterator facility for Python sequences Key: ARROW-2499 URL: https://issues.apache.org/jira/browse/ARROW-2499 Project: Apache Arrow Issue

Re: [Java] Upgrading Arrow to JDK 1.8

2018-04-23 Thread Li Jin
I don't see particular reason to maintaining JDK 7 compatibility, and am +1 to move to Java 8. On Mon, Apr 23, 2018 at 1:48 PM, Andy Grove wrote: > I’m trying to use the parquet-arrow library, which has just been updated > to use Arrow 0.8.0 but unfortunately I am still running into this issue:

[Java] Upgrading Arrow to JDK 1.8

2018-04-23 Thread Andy Grove
I’m trying to use the parquet-arrow library, which has just been updated to use Arrow 0.8.0 but unfortunately I am still running into this issue: java.lang.ClassNotFoundException: org.apache.arrow.vector.types.pojo.ArrowType$Struct_ The class in the arrow jar is actually `Struct` not `Struct_`.

[jira] [Created] (ARROW-2498) [Java] Upgrade to JDK 1.8

2018-04-23 Thread Andy Grove (JIRA)
Andy Grove created ARROW-2498: - Summary: [Java] Upgrade to JDK 1.8 Key: ARROW-2498 URL: https://issues.apache.org/jira/browse/ARROW-2498 Project: Apache Arrow Issue Type: Improvement Co

Re: Problem when saving large files via pyarrow hdfs

2018-04-23 Thread Wes McKinney
hi Jan, The issue is that the hdfsWrite API uses int32_t (aka "tSize") for write sizes: https://github.com/apache/arrow/blob/master/cpp/src/arrow/io/hdfs-internal.h#L69 So when writing files over INT32_MAX, we must write in chunks. Can you please open a JIRA with your bug report and this informa

Re: Continuous benchmarking setup

2018-04-23 Thread Tom Augspurger
Currently, there are 3 snowflakes :) - Benchmark setup: https://github.com/TomAugspurger/asv-runner + Some setup to bootstrap a clean install with airflow, conda, asv, supervisor, etc. All the infrastructure around running the benchmarks. + Each project adds itself to the list of benchmarks, a

Re: Continuous benchmarking setup

2018-04-23 Thread Wes McKinney
hi Tom -- is the publishing workflow for this documented someplace, or available in a GitHub repo? We want to make sure we don't accumulate any "snowflakes" in the development process. thanks! Wes On Fri, Apr 13, 2018 at 8:36 AM, Tom Augspurger wrote: > They are run daily and published to http:/

[jira] [Created] (ARROW-2497) Use ASSERT_NO_FATAIL_FAILURE in C++ unit tests

2018-04-23 Thread Joshua Storck (JIRA)
Joshua Storck created ARROW-2497: Summary: Use ASSERT_NO_FATAIL_FAILURE in C++ unit tests Key: ARROW-2497 URL: https://issues.apache.org/jira/browse/ARROW-2497 Project: Apache Arrow Issue Typ

Re: C++ RecordBatchWriter/ReadRecordBatch clarification

2018-04-23 Thread Wes McKinney
> So, I guess the ReadRecordBatch function is intended to only work if the > records were written by RecordBatchFileWriter, right? The *StreamWriter and *FileWriter classes use identical code paths for writing the IPC messages, the only difference is the preamble (the magic number and padding) an

[jira] [Created] (ARROW-2496) [C++] Add support for Libhdfs++

2018-04-23 Thread Deepak Majeti (JIRA)
Deepak Majeti created ARROW-2496: Summary: [C++] Add support for Libhdfs++ Key: ARROW-2496 URL: https://issues.apache.org/jira/browse/ARROW-2496 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-2495) [Plasma] Pretty print plasma objects

2018-04-23 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-2495: -- Summary: [Plasma] Pretty print plasma objects Key: ARROW-2495 URL: https://issues.apache.org/jira/browse/ARROW-2495 Project: Apache Arrow Issue Type: Imp

[jira] [Created] (ARROW-2494) Return status codes from PlasmaClient::Seal

2018-04-23 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-2494: -- Summary: Return status codes from PlasmaClient::Seal Key: ARROW-2494 URL: https://issues.apache.org/jira/browse/ARROW-2494 Project: Apache Arrow Issue Ty