Re: Python 2.7 support removed

2020-02-20 Thread Antoine Pitrou
Hi Micah, Unlike 2.7, it's not onerous at all, so we can definitely maintain it for a couple more months if desired. Regards Antoine. Le 20/02/2020 à 04:47, Micah Kornfield a écrit : > Hi Antoine, > Do you have a timeline for the 3.5 support? If possible could it maybe > wait until after th

Re: Using GitHub Actions to automate style and other fixes

2020-02-20 Thread Jacek Pliszka
As a beginner contributor I believe I can vote for linting as part of the build. For me the best would be BEGINNER/ALL_CHECKS option in the Makefile that does all the linting and all checks done in the build. And in the instruction it would be clearly suggested to use it. BR, Jacek śr., 19 lu

Re: Using GitHub Actions to automate style and other fixes

2020-02-20 Thread Wes McKinney
I'm also against _automatic_ (user-not-in-the-loop) changes. I think the model used conda-forge works pretty well, where a bot lints each patch and lets you know if any changes are needed https://github.com/conda-forge/pyarrow-feedstock/pull/99#issuecomment-585264694 However, note that bot-genera

Re: CI setup on dedicated arm hardware

2020-02-20 Thread Wes McKinney
hi Ganesh, Thanks for writing. I've been working on setting up Buildkite (BK) as a way for third parties for attach machines to run builds on, with a free organization at https://buildkite.com/apache-arrow Configuring a new machine to accept builds is very easy [1] and takes less than 60 second

Re: Using GitHub Actions to automate style and other fixes

2020-02-20 Thread Joris Van den Bossche
I am personally also not in favor of automatic fixes, but a bot you can call would be a nice feature. It might be possible to let a workflow be triggered by an issue comment? ( https://help.github.com/en/actions/reference/events-that-trigger-workflows#issue-comment-event-issue_comment ) In additio

Re: Using GitHub Actions to automate style and other fixes

2020-02-20 Thread Wes McKinney
I run the following bash function at pre-commit https://github.com/wesm/dev-toolchain/blob/1bd3daee1a0b21f8484a7d957de03c640ea8c113/toolchain/arrow-toolchain.sh#L441 Such a thing could be standardized but it may need to be tailored somewhat based on a contributor's focus areas (e.g. mine ignores

[jira] [Created] (ARROW-7892) [Python] Expose FilesystemSource.format attribute

2020-02-20 Thread Joris Van den Bossche (Jira)
Joris Van den Bossche created ARROW-7892: Summary: [Python] Expose FilesystemSource.format attribute Key: ARROW-7892 URL: https://issues.apache.org/jira/browse/ARROW-7892 Project: Apache Arrow

[NIGHTLY] Arrow Build Report for Job nightly-2020-02-20-0

2020-02-20 Thread Crossbow
Arrow Build Report for Job nightly-2020-02-20-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-02-20-0 Failed Tasks: - centos-6: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-02-20-0-azure-centos-6 - conda-osx-clang-py37: URL:

Re: CI setup on dedicated arm hardware

2020-02-20 Thread Krisztián Szűcs
On Thu, Feb 20, 2020 at 12:14 PM Wes McKinney wrote: > > hi Ganesh, > > Thanks for writing. > > I've been working on setting up Buildkite (BK) as a way for third > parties for attach machines to run builds on, with a free organization > at > > https://buildkite.com/apache-arrow > > Configuring a n

[jira] [Created] (ARROW-7893) [Developer][GLib] Document GLib development workflow when using conda environment on GTK-based Linux systems

2020-02-20 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-7893: --- Summary: [Developer][GLib] Document GLib development workflow when using conda environment on GTK-based Linux systems Key: ARROW-7893 URL: https://issues.apache.org/jira/browse/ARRO

Re: CI setup on dedicated arm hardware

2020-02-20 Thread Wes McKinney
On Thu, Feb 20, 2020 at 8:40 AM Krisztián Szűcs wrote: > > On Thu, Feb 20, 2020 at 12:14 PM Wes McKinney wrote: > > > > hi Ganesh, > > > > Thanks for writing. > > > > I've been working on setting up Buildkite (BK) as a way for third > > parties for attach machines to run builds on, with a free or

Re: CI setup on dedicated arm hardware

2020-02-20 Thread Krisztián Szűcs
On Thu, Feb 20, 2020 at 3:53 PM Wes McKinney wrote: > > On Thu, Feb 20, 2020 at 8:40 AM Krisztián Szűcs > wrote: > > > > On Thu, Feb 20, 2020 at 12:14 PM Wes McKinney wrote: > > > > > > hi Ganesh, > > > > > > Thanks for writing. > > > > > > I've been working on setting up Buildkite (BK) as a way

[jira] [Created] (ARROW-7894) [C++] DefineOptions should invoke add_definitions

2020-02-20 Thread Ben Kietzman (Jira)
Ben Kietzman created ARROW-7894: --- Summary: [C++] DefineOptions should invoke add_definitions Key: ARROW-7894 URL: https://issues.apache.org/jira/browse/ARROW-7894 Project: Apache Arrow Issue Ty

[jira] [Created] (ARROW-7895) [Python] Remove more python 2.7 cruft

2020-02-20 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-7895: -- Summary: [Python] Remove more python 2.7 cruft Key: ARROW-7895 URL: https://issues.apache.org/jira/browse/ARROW-7895 Project: Apache Arrow Issue Type: Im

[jira] [Created] (ARROW-7896) [C++] Refactor from #include guards to #pragma once

2020-02-20 Thread Ben Kietzman (Jira)
Ben Kietzman created ARROW-7896: --- Summary: [C++] Refactor from #include guards to #pragma once Key: ARROW-7896 URL: https://issues.apache.org/jira/browse/ARROW-7896 Project: Apache Arrow Issue

[jira] [Created] (ARROW-7897) [Packaging] Temporarily disable artifact uploading until we fix the deployment issues

2020-02-20 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7897: -- Summary: [Packaging] Temporarily disable artifact uploading until we fix the deployment issues Key: ARROW-7897 URL: https://issues.apache.org/jira/browse/ARROW-7897

[jira] [Created] (ARROW-7898) [Python] Fix docstring formatting issues using numpydoc

2020-02-20 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7898: -- Summary: [Python] Fix docstring formatting issues using numpydoc Key: ARROW-7898 URL: https://issues.apache.org/jira/browse/ARROW-7898 Project: Apache Arrow

[jira] [Created] (ARROW-7899) [Integration][Java] null type integration test

2020-02-20 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-7899: -- Summary: [Integration][Java] null type integration test Key: ARROW-7899 URL: https://issues.apache.org/jira/browse/ARROW-7899 Project: Apache Arrow Issue

[jira] [Created] (ARROW-7900) [Integration][JavaScript] Add null type integration test

2020-02-20 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-7900: -- Summary: [Integration][JavaScript] Add null type integration test Key: ARROW-7900 URL: https://issues.apache.org/jira/browse/ARROW-7900 Project: Apache Arrow

[jira] [Created] (ARROW-7901) [Integration][Go] Add null type (and integration test)

2020-02-20 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-7901: -- Summary: [Integration][Go] Add null type (and integration test) Key: ARROW-7901 URL: https://issues.apache.org/jira/browse/ARROW-7901 Project: Apache Arrow

[jira] [Created] (ARROW-7902) [Integration] Unskip nested dictionary integration tests

2020-02-20 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-7902: -- Summary: [Integration] Unskip nested dictionary integration tests Key: ARROW-7902 URL: https://issues.apache.org/jira/browse/ARROW-7902 Project: Apache Arrow

Integration testing

2020-02-20 Thread Neal Richardson
Hi all, To help us reach 1.0 with as complete and thoroughly tested implementations of the Arrow format, I've surveyed our integration test suite and open issues and collected information here: https://docs.google.com/spreadsheets/d/1Yu68rn2XMBpAArUfCOP9LC7uHb06CQrtqKE5vQ4bQx4/edit#gid=782909347 I

[jira] [Created] (ARROW-7903) [Rust] Upgrade SQLParser dependency for DataFusion?

2020-02-20 Thread Max Burke (Jira)
Max Burke created ARROW-7903: Summary: [Rust] Upgrade SQLParser dependency for DataFusion? Key: ARROW-7903 URL: https://issues.apache.org/jira/browse/ARROW-7903 Project: Apache Arrow Issue Type: