[jira] [Created] (ARROW-7436) [Archery] Fix benchmark default configuration

2019-12-18 Thread Francois Saint-Jacques (Jira)
Francois Saint-Jacques created ARROW-7436: - Summary: [Archery] Fix benchmark default configuration Key: ARROW-7436 URL: https://issues.apache.org/jira/browse/ARROW-7436 Project: Apache Arrow

Re: [NIGHTLY] Arrow Build Report for Job nightly-2019-12-18-0

2019-12-18 Thread Wes McKinney
This looks like a new issue https://dev.azure.com/ursa-labs/crossbow/_build/results?buildId=3775=logs=cf796865-97b7-5cd1-be8e-6e00ce4fd8cf=88ee2fb8-46fd-5c68-fde3-1c8d31ba2a5f=299 CMake Error at cmake_modules/FindNumPy.cmake:62 (message): NumPy import failure: Traceback (most recent call last):

Re: Where can I report a security-related issue?

2019-12-18 Thread Adam Hooper
Thank you for the responses, Wes and Antoine. I've sent to private@ and then filed https://issues.apache.org/jira/browse/ARROW-7435 @Antoine I'm glad to hear the IPC layer is a security boundary. Could you please clarify what that means exactly? Do you mean (please check all that apply): 1.

[jira] [Created] (ARROW-7435) Security issue: ValidateOffsets() does not prevent buffer over-read

2019-12-18 Thread Adam Hooper (Jira)
Adam Hooper created ARROW-7435: -- Summary: Security issue: ValidateOffsets() does not prevent buffer over-read Key: ARROW-7435 URL: https://issues.apache.org/jira/browse/ARROW-7435 Project: Apache Arrow

Re: [NIGHTLY] Arrow Build Report for Job nightly-2019-12-18-0

2019-12-18 Thread Neal Richardson
conda-osx wheel builds have been failing for a long time. I found https://issues.apache.org/jira/browse/ARROW-7189 from over a month ago, but these builds here failed earlier than the error described on that ticket. Could someone take a look? Neal On Wed, Dec 18, 2019 at 5:47 AM Crossbow

Re: Where can I report a security-related issue?

2019-12-18 Thread Antoine Pitrou
Hi Adam, The validation was significantly enhanced in git master. In particular, Array::ValidateFull() will validate data more or less extensively. I wouldn't be surprised if not everything is validated, though. Feel free to open JIRA tickets about missing validation checks. However, if you

Re: Where can I report a security-related issue?

2019-12-18 Thread Wes McKinney
hi Adam, Can you please send the security issue to priv...@arrow.apache.org (this is a moderated non-public list) and we can discuss there. Thanks, Wes On Wed, Dec 18, 2019 at 10:43 AM Adam Hooper wrote: > > My project parses Arrow files produced by untrusted code. > > It looks to me like the

Where can I report a security-related issue?

2019-12-18 Thread Adam Hooper
My project parses Arrow files produced by untrusted code. It looks to me like the "validate" function should help me avoid undefined behavior given an invalid Arrow file. I found a bug in the function: even after validation, an invalid Arrow file can trigger undefined behavior. Is security a

Re: [Python] Exposing compute kernels

2019-12-18 Thread Wes McKinney
Personally I'd prefer pure functions to methods on the types. I believe this will result in less code to maintain and make argument polymorphism (function arguments that can be different data types) more obvious/discoverable. I don't mind having a few conveniences like `arr.cast(...)` but there's

Re: Unable to install pyarrow 0.14.1 from pip

2019-12-18 Thread Wes McKinney
hi Romano -- I'm guessing you're working on Windows. The 0.14.1 packages on Windows had some problems and were removed. Please ask the Superset developers to upgrade to 0.15.1 if possible. Thanks On Wed, Dec 18, 2019 at 10:12 AM Romano Plescia wrote: > Dear developers, > > > > I have recently

Unable to install pyarrow 0.14.1 from pip

2019-12-18 Thread Romano Plescia
Dear developers, I have recently encountered an issue whilst trying to deploy Apache Superset which has a dependency on pyarrow 0.14.1. When trying to manually install pyarrow 0.14.1 by running 'pip install pyarrow==0.14.1' I encountered the error below. Pypi.org maintainers have suggested

Re: [jira] [Created] (ARROW-7434) [GLib] Homebrew packages seem not working

2019-12-18 Thread Chengxin Ma
It works. Thanks! Sent with ProtonMail Secure Email. ‐‐‐ Original Message ‐‐‐ On Wednesday, December 18, 2019 2:52 PM, Jeroen Ooms wrote: > Try this: > > gcc -o hello_world hello_world.c $(pkg-config --libs --cflags arrow-glib) > > On Wed, Dec 18, 2019 at 1:07 PM Chengxin Ma (Jira)

Re: [jira] [Created] (ARROW-7434) [GLib] Homebrew packages seem not working

2019-12-18 Thread Jeroen Ooms
Try this: gcc -o hello_world hello_world.c $(pkg-config --libs --cflags arrow-glib) On Wed, Dec 18, 2019 at 1:07 PM Chengxin Ma (Jira) wrote: > > Chengxin Ma created ARROW-7434: > -- > > Summary: [GLib] Homebrew packages seem not working >

[NIGHTLY] Arrow Build Report for Job nightly-2019-12-18-0

2019-12-18 Thread Crossbow
Arrow Build Report for Job nightly-2019-12-18-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-18-0 Failed Tasks: - conda-osx-clang-py27: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-18-0-azure-conda-osx-clang-py27 -

[jira] [Created] (ARROW-7434) [GLib] Homebrew packages seem not working

2019-12-18 Thread Chengxin Ma (Jira)
Chengxin Ma created ARROW-7434: -- Summary: [GLib] Homebrew packages seem not working Key: ARROW-7434 URL: https://issues.apache.org/jira/browse/ARROW-7434 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-7433) [CI] [C++] Set up OSS-Fuzz

2019-12-18 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-7433: - Summary: [CI] [C++] Set up OSS-Fuzz Key: ARROW-7433 URL: https://issues.apache.org/jira/browse/ARROW-7433 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-7432) [Python] Add higher-level datasets functions

2019-12-18 Thread Joris Van den Bossche (Jira)
Joris Van den Bossche created ARROW-7432: Summary: [Python] Add higher-level datasets functions Key: ARROW-7432 URL: https://issues.apache.org/jira/browse/ARROW-7432 Project: Apache Arrow

[jira] [Created] (ARROW-7431) [Python] Add dataset API to reference docs

2019-12-18 Thread Joris Van den Bossche (Jira)
Joris Van den Bossche created ARROW-7431: Summary: [Python] Add dataset API to reference docs Key: ARROW-7431 URL: https://issues.apache.org/jira/browse/ARROW-7431 Project: Apache Arrow

[DISCUSS][Java] Enhance code style checking for Java code

2019-12-18 Thread Fan Liya
Dear all, We want to enhance the Java code style checking. This is due to a discussion in [1]. In the discussion, we found the current style checking for Java code is not sufficient. So we want to enhace it in a series of "small" steps, in order to avoid having to change too many files at once.

[jira] [Created] (ARROW-7430) [Python] Add more docstrings to dataset bindings

2019-12-18 Thread Joris Van den Bossche (Jira)
Joris Van den Bossche created ARROW-7430: Summary: [Python] Add more docstrings to dataset bindings Key: ARROW-7430 URL: https://issues.apache.org/jira/browse/ARROW-7430 Project: Apache Arrow

[jira] [Created] (ARROW-7429) [Java] Enhance code style checking for Java code (remove consecutive spaces)

2019-12-18 Thread Liya Fan (Jira)
Liya Fan created ARROW-7429: --- Summary: [Java] Enhance code style checking for Java code (remove consecutive spaces) Key: ARROW-7429 URL: https://issues.apache.org/jira/browse/ARROW-7429 Project: Apache

[jira] [Created] (ARROW-7428) [C++] Add serialization for CSF and CSC sparse tensors

2019-12-18 Thread Rok Mihevc (Jira)
Rok Mihevc created ARROW-7428: - Summary: [C++] Add serialization for CSF and CSC sparse tensors Key: ARROW-7428 URL: https://issues.apache.org/jira/browse/ARROW-7428 Project: Apache Arrow Issue

[jira] [Created] (ARROW-7427) [Python] Support SparseCSFMatrix

2019-12-18 Thread Rok Mihevc (Jira)
Rok Mihevc created ARROW-7427: - Summary: [Python] Support SparseCSFMatrix Key: ARROW-7427 URL: https://issues.apache.org/jira/browse/ARROW-7427 Project: Apache Arrow Issue Type: New Feature

[jira] [Created] (ARROW-7426) read_parquet and write_parquet not working on Ubuntu 19.10

2019-12-18 Thread claesmael...@gmail.com (Jira)
claesmael...@gmail.com created ARROW-7426: - Summary: read_parquet and write_parquet not working on Ubuntu 19.10 Key: ARROW-7426 URL: https://issues.apache.org/jira/browse/ARROW-7426 Project:

[jira] [Created] (ARROW-7425) [Java] PromotableWriter support writing FixedSizeList type data

2019-12-18 Thread Ji Liu (Jira)
Ji Liu created ARROW-7425: - Summary: [Java] PromotableWriter support writing FixedSizeList type data Key: ARROW-7425 URL: https://issues.apache.org/jira/browse/ARROW-7425 Project: Apache Arrow