Re: Preparing for 0.17.0 Arrow release

2020-04-05 Thread Joris Van den Bossche
We also have a recent regression related to the KeyValueMetadata wrapping
python that is causing failures in downstream libraries, that seems a
blocker for the release: https://issues.apache.org/jira/browse/ARROW-8342

On Mon, 6 Apr 2020 at 00:25, Wes McKinney  wrote:

> We are getting close to the 0.17.0 endgame.
>
> Here are the 18 JIRAs still in the 0.17.0 milestone. There are a few
> issues without patches yet so we should decide quickly whether they
> need to be included. Are they any blocking issues not accounted for in
> the milestone?
>
> * ARROW-6947 [Rust] [DataFusion] Add support for scalar UDFs
>
> Patch available
>
> * ARROW-7794 [Rust] cargo publish fails for arrow-flight due to
> relative path to Flight.proto
>
> No patch yet
>
> * ARROW-7222 [Python][Release] Wipe any existing generated Python API
> documentation when updating website
>
> This issue needs to be addressed by the release manager and the
> Confluence instructions must be updated.
>
> * ARROW-7891 [C++] RecordBatch->Equals should also have a
> check_metadata argument
>
> Patch available that needs to be reviewed and approved
>
> * ARROW-8164: [C++][Dataset] Let datasets be viewable with non-identical
> schema
>
> Patch available, but failures to be resolved
>
> * ARROW-7965: [Python] Hold a reference to the dataset factory for later
> reuse
>
> Depends on ARROW-8164, will require rebase
>
> * ARROW-8039: [Python][Dataset] Support using dataset API in
> pyarrow.parquet with a minimal ParquetDataset shim
>
> Patch pending
>
> * ARROW-8047: [Python][Documentation] Document migration from
> ParquetDataset to pyarrow.datasets
>
> May be tackled beyond 0.17.0
>
> * ARROW-8063: [Python] Add user guide documentation for Datasets API
>
> May be tackled beyond 0.17.0
>
> * ARROW-8149 [C++/Python] Enable CUDA Support in conda recipes
>
> Does not seem strictly necessary for release, since a packaging issue
>
> * ARROW-8162: [Format][Python] Add serialization for CSF sparse tensors
>
> Patch available, but needs review. May
>
> * ARROW-8213: [Python][Dataset] Opening a dataset with a local
> incorrect path gives confusing error message
>
> Nice to have, but not essential
>
> * ARROW-8266: [C++] Add backup mirrors for external project source
> downloads
>
> Patch available, nice to have
>
> * ARROW-8275 [Python][Docs] Review Feather + IPC file documentation
> per "Feather V2" changes
>
> Patch available
>
> * ARROW-8300 [R] Documentation and changelog updates for 0.17
>
> Patch available
>
> * ARROW-8320 [Documentation][Format] Clarify (lack of) alignment
> requirements in C data interface
>
> Patch available
>
> * ARROW-8330: [Documentation] The post release script generates the
> documentation with a development version
>
> Patch available
>
> * ARROW-8335: [Release] Add crossbow jobs to run release verification
>
> Patch in progress
>
> On Tue, Mar 31, 2020 at 11:23 PM Fan Liya  wrote:
> >
> > I see ARROW-6871 in the list.
> > It seems it has some bugs, which are being fixed by ARROW-8239.
> > So I have added ARROW-8239 to the list.
> >
> > The PR for ARROW-8239 is already approved, so it is expected to be
> resolved
> > soon.
> >
> > Best,
> > Liya Fan
> >
> > On Wed, Apr 1, 2020 at 12:01 PM Micah Kornfield 
> > wrote:
> >
> > > I moved the Java issues out of 0.17.0, they seem complex enough or not
> of
> > > enough significance to make them blockers for 0.17.0 release.  If
> owners of
> > > the issues disagree please move them back int.
> > >
> > > On Tue, Mar 31, 2020 at 6:05 PM Wes McKinney 
> wrote:
> > >
> > > > We've made good progress, but there are still 35 issues in the
> > > > backlog. Some of them are documentation related, but there are some
> > > > functionality-related patches that could be at risk. If all could
> > > > review again to trim out anything that isn't going to make the cut
> for
> > > > 0.17.0, please do
> > > >
> > > > On Wed, Mar 25, 2020 at 2:39 PM Andy Grove 
> > > wrote:
> > > > >
> > > > > I just took a first pass at reviewing the Java and Rust issues and
> > > > removed
> > > > > some from the 0.17.0 release. There are a few small Rust issues
> that I
> > > am
> > > > > actively working on for this release.
> > > > >
> > > > > Thanks.
> > > > >
> > > > >
> > > > > On Wed, Mar 25, 2020 at 1:13 PM Wes McKinney 
> > > > wrote:
> > > > >
> > > > > > hi Neal,
> > > > > >
> > > > > > Thanks for helping coordinate. I agree we should be in a
> position to
> > > > > > release sometime next week.
> > > > > >
> > > > > > Can folks from the Rust and Java side review issues in the
> backlog?
> > > > > > According to the dashboard there are 19 Rust issues open and 7
> Java
> > > > > > issues.
> > > > > >
> > > > > > Thanks
> > > > > >
> > > > > > On Tue, Mar 24, 2020 at 10:01 AM Neal Richardson
> > > > > >  wrote:
> > > > > > >
> > > > > > > Hi all,
> > > > > > > A few weeks ago, there seemed to be consensus (lazy, at least)
> for
> > > a
> > > > 0.17
> > > > > > > release at the end of the month. Judging from
> > > 

[jira] [Created] (ARROW-8342) [Python] dask and kartothek integration tests are failing

2020-04-05 Thread Joris Van den Bossche (Jira)
Joris Van den Bossche created ARROW-8342:


 Summary: [Python] dask and kartothek integration tests are failing
 Key: ARROW-8342
 URL: https://issues.apache.org/jira/browse/ARROW-8342
 Project: Apache Arrow
  Issue Type: Bug
  Components: Python
Reporter: Joris Van den Bossche
 Fix For: 0.17.0


The integration tests for both dask and kartothek, and for both master and 
latest released version of them, started failing the last days.

Dask latest: 
https://circleci.com/gh/ursa-labs/crossbow/10629?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link
 
Kartothek latest: 
https://circleci.com/gh/ursa-labs/crossbow/10604?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link

I think both are related to the KeyValueMetadata changes (ARROW-8079).

The kartothek one is clearly related, as it gives: TypeError: 
'pyarrow.lib.KeyValueMetadata' object does not support item assignment

And I think the dask one is related to the "pandas" key now being present 
twice, and therefore it is using the "wrong" one.




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: [NIGHTLY] Arrow Build Report for Job nightly-2020-04-05-0

2020-04-05 Thread Joris Van den Bossche
I opened https://issues.apache.org/jira/browse/ARROW-8342 for the
dask/kartothek integration failures.

On Mon, 6 Apr 2020 at 02:54, Crossbow  wrote:

>
> Arrow Build Report for Job nightly-2020-04-05-0
>
> All tasks:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0
>
> Failed Tasks:
> - gandiva-jar-osx:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-travis-gandiva-jar-osx
> - gandiva-jar-trusty:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-travis-gandiva-jar-trusty
> - test-conda-python-3.6:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.6
> - test-conda-python-3.7-dask-latest:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.7-dask-latest
> - test-conda-python-3.7-kartothek-latest:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.7-kartothek-latest
> - test-conda-python-3.7-kartothek-master:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.7-kartothek-master
> - test-conda-python-3.7-turbodbc-latest:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.7-turbodbc-latest
> - test-conda-python-3.7-turbodbc-master:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.7-turbodbc-master
> - test-conda-python-3.8-dask-master:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.8-dask-master
> - test-ubuntu-18.04-docs:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-ubuntu-18.04-docs
> - ubuntu-eoan:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-github-ubuntu-eoan
> - ubuntu-focal:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-github-ubuntu-focal
>
> Succeeded Tasks:
> - centos-6:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-github-centos-6
> - centos-7:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-github-centos-7
> - centos-8:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-github-centos-8
> - conda-linux-gcc-py36:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-linux-gcc-py36
> - conda-linux-gcc-py37:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-linux-gcc-py37
> - conda-linux-gcc-py38:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-linux-gcc-py38
> - conda-osx-clang-py36:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-osx-clang-py36
> - conda-osx-clang-py37:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-osx-clang-py37
> - conda-osx-clang-py38:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-osx-clang-py38
> - conda-win-vs2015-py36:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-win-vs2015-py36
> - conda-win-vs2015-py37:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-win-vs2015-py37
> - conda-win-vs2015-py38:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-win-vs2015-py38
> - debian-buster:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-github-debian-buster
> - debian-stretch:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-github-debian-stretch
> - homebrew-cpp:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-travis-homebrew-cpp
> - macos-r-autobrew:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-travis-macos-r-autobrew
> - test-conda-cpp-valgrind:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-cpp-valgrind
> - test-conda-cpp:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-cpp
> - test-conda-python-3.7-hdfs-2.9.2:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.7-hdfs-2.9.2
> - test-conda-python-3.7-pandas-latest:
>   URL:
> https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.7-pandas-latest
> - test-cond

Re: building arrow with CMake 2.8 on CentOS

2020-04-05 Thread Sutou Kouhei
Hi,

We don't support CMake 2.8. Please use CMake 3.2 or later.

Are you using CentOS 6? You can install CMake 3.6 with EPEL
on CentOS 6:

  % sudo yum install -y epel-release
  % sudo yum install -y cmake3
  % cmake3 --version
  cmake3 version 3.6.1

  CMake suite maintained and supported by Kitware (kitware.com/cmake).


Thanks,
---
kou

In 
 

  "building arrow with CMake 2.8 on CentOS" on Mon, 6 Apr 2020 05:39:56 +,
  "Lekshmi Narayanan, Arun Balajiee"  wrote:

> Hi
> 
> I am looking to build Arrow on CentOS with cmake version 2.8. It is a shared 
> server, so the server admin at my school doesn't want to update the version 
> of cmake. I checked these two issues,
> https://issues.apache.org/jira/browse/ARROW-73
> https://issues.apache.org/jira/browse/ARROW-66
> 
> but I couldn't arrive at a resolution on how to build on my machine.
> 
> I don't find a documentation for building on CentOS with these cmake settings 
> as well. Could you help me with this?
> 
> 
> Regards,
> Arun  Balajiee


building arrow with CMake 2.8 on CentOS

2020-04-05 Thread Lekshmi Narayanan, Arun Balajiee
Hi

I am looking to build Arrow on CentOS with cmake version 2.8. It is a shared 
server, so the server admin at my school doesn't want to update the version of 
cmake. I checked these two issues,
https://issues.apache.org/jira/browse/ARROW-73
https://issues.apache.org/jira/browse/ARROW-66

but I couldn't arrive at a resolution on how to build on my machine.

I don't find a documentation for building on CentOS with these cmake settings 
as well. Could you help me with this?


Regards,
Arun  Balajiee


[jira] [Created] (ARROW-8341) [Packaging][deb] Fail to build by no disk space

2020-04-05 Thread Kouhei Sutou (Jira)
Kouhei Sutou created ARROW-8341:
---

 Summary: [Packaging][deb] Fail to build by no disk space
 Key: ARROW-8341
 URL: https://issues.apache.org/jira/browse/ARROW-8341
 Project: Apache Arrow
  Issue Type: Improvement
  Components: Packaging
Reporter: Kouhei Sutou
Assignee: Kouhei Sutou






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[NIGHTLY] Arrow Build Report for Job nightly-2020-04-05-0

2020-04-05 Thread Crossbow


Arrow Build Report for Job nightly-2020-04-05-0

All tasks: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0

Failed Tasks:
- gandiva-jar-osx:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-travis-gandiva-jar-osx
- gandiva-jar-trusty:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-travis-gandiva-jar-trusty
- test-conda-python-3.6:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.6
- test-conda-python-3.7-dask-latest:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.7-dask-latest
- test-conda-python-3.7-kartothek-latest:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.7-kartothek-latest
- test-conda-python-3.7-kartothek-master:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.7-kartothek-master
- test-conda-python-3.7-turbodbc-latest:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.7-turbodbc-latest
- test-conda-python-3.7-turbodbc-master:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.7-turbodbc-master
- test-conda-python-3.8-dask-master:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.8-dask-master
- test-ubuntu-18.04-docs:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-ubuntu-18.04-docs
- ubuntu-eoan:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-github-ubuntu-eoan
- ubuntu-focal:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-github-ubuntu-focal

Succeeded Tasks:
- centos-6:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-github-centos-6
- centos-7:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-github-centos-7
- centos-8:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-github-centos-8
- conda-linux-gcc-py36:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-linux-gcc-py36
- conda-linux-gcc-py37:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-linux-gcc-py37
- conda-linux-gcc-py38:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-linux-gcc-py38
- conda-osx-clang-py36:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-osx-clang-py36
- conda-osx-clang-py37:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-osx-clang-py37
- conda-osx-clang-py38:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-osx-clang-py38
- conda-win-vs2015-py36:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-win-vs2015-py36
- conda-win-vs2015-py37:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-win-vs2015-py37
- conda-win-vs2015-py38:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-azure-conda-win-vs2015-py38
- debian-buster:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-github-debian-buster
- debian-stretch:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-github-debian-stretch
- homebrew-cpp:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-travis-homebrew-cpp
- macos-r-autobrew:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-travis-macos-r-autobrew
- test-conda-cpp-valgrind:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-cpp-valgrind
- test-conda-cpp:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-cpp
- test-conda-python-3.7-hdfs-2.9.2:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.7-hdfs-2.9.2
- test-conda-python-3.7-pandas-latest:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.7-pandas-latest
- test-conda-python-3.7-pandas-master:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.7-pandas-master
- test-conda-python-3.7-spark-master:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-05-0-circle-test-conda-python-3.7-spark-master
- 

Re: Preparing for 0.17.0 Arrow release

2020-04-05 Thread Wes McKinney
We are getting close to the 0.17.0 endgame.

Here are the 18 JIRAs still in the 0.17.0 milestone. There are a few
issues without patches yet so we should decide quickly whether they
need to be included. Are they any blocking issues not accounted for in
the milestone?

* ARROW-6947 [Rust] [DataFusion] Add support for scalar UDFs

Patch available

* ARROW-7794 [Rust] cargo publish fails for arrow-flight due to
relative path to Flight.proto

No patch yet

* ARROW-7222 [Python][Release] Wipe any existing generated Python API
documentation when updating website

This issue needs to be addressed by the release manager and the
Confluence instructions must be updated.

* ARROW-7891 [C++] RecordBatch->Equals should also have a
check_metadata argument

Patch available that needs to be reviewed and approved

* ARROW-8164: [C++][Dataset] Let datasets be viewable with non-identical schema

Patch available, but failures to be resolved

* ARROW-7965: [Python] Hold a reference to the dataset factory for later reuse

Depends on ARROW-8164, will require rebase

* ARROW-8039: [Python][Dataset] Support using dataset API in
pyarrow.parquet with a minimal ParquetDataset shim

Patch pending

* ARROW-8047: [Python][Documentation] Document migration from
ParquetDataset to pyarrow.datasets

May be tackled beyond 0.17.0

* ARROW-8063: [Python] Add user guide documentation for Datasets API

May be tackled beyond 0.17.0

* ARROW-8149 [C++/Python] Enable CUDA Support in conda recipes

Does not seem strictly necessary for release, since a packaging issue

* ARROW-8162: [Format][Python] Add serialization for CSF sparse tensors

Patch available, but needs review. May

* ARROW-8213: [Python][Dataset] Opening a dataset with a local
incorrect path gives confusing error message

Nice to have, but not essential

* ARROW-8266: [C++] Add backup mirrors for external project source downloads

Patch available, nice to have

* ARROW-8275 [Python][Docs] Review Feather + IPC file documentation
per "Feather V2" changes

Patch available

* ARROW-8300 [R] Documentation and changelog updates for 0.17

Patch available

* ARROW-8320 [Documentation][Format] Clarify (lack of) alignment
requirements in C data interface

Patch available

* ARROW-8330: [Documentation] The post release script generates the
documentation with a development version

Patch available

* ARROW-8335: [Release] Add crossbow jobs to run release verification

Patch in progress

On Tue, Mar 31, 2020 at 11:23 PM Fan Liya  wrote:
>
> I see ARROW-6871 in the list.
> It seems it has some bugs, which are being fixed by ARROW-8239.
> So I have added ARROW-8239 to the list.
>
> The PR for ARROW-8239 is already approved, so it is expected to be resolved
> soon.
>
> Best,
> Liya Fan
>
> On Wed, Apr 1, 2020 at 12:01 PM Micah Kornfield 
> wrote:
>
> > I moved the Java issues out of 0.17.0, they seem complex enough or not of
> > enough significance to make them blockers for 0.17.0 release.  If owners of
> > the issues disagree please move them back int.
> >
> > On Tue, Mar 31, 2020 at 6:05 PM Wes McKinney  wrote:
> >
> > > We've made good progress, but there are still 35 issues in the
> > > backlog. Some of them are documentation related, but there are some
> > > functionality-related patches that could be at risk. If all could
> > > review again to trim out anything that isn't going to make the cut for
> > > 0.17.0, please do
> > >
> > > On Wed, Mar 25, 2020 at 2:39 PM Andy Grove 
> > wrote:
> > > >
> > > > I just took a first pass at reviewing the Java and Rust issues and
> > > removed
> > > > some from the 0.17.0 release. There are a few small Rust issues that I
> > am
> > > > actively working on for this release.
> > > >
> > > > Thanks.
> > > >
> > > >
> > > > On Wed, Mar 25, 2020 at 1:13 PM Wes McKinney 
> > > wrote:
> > > >
> > > > > hi Neal,
> > > > >
> > > > > Thanks for helping coordinate. I agree we should be in a position to
> > > > > release sometime next week.
> > > > >
> > > > > Can folks from the Rust and Java side review issues in the backlog?
> > > > > According to the dashboard there are 19 Rust issues open and 7 Java
> > > > > issues.
> > > > >
> > > > > Thanks
> > > > >
> > > > > On Tue, Mar 24, 2020 at 10:01 AM Neal Richardson
> > > > >  wrote:
> > > > > >
> > > > > > Hi all,
> > > > > > A few weeks ago, there seemed to be consensus (lazy, at least) for
> > a
> > > 0.17
> > > > > > release at the end of the month. Judging from
> > > > > >
> > > https://cwiki.apache.org/confluence/display/ARROW/Arrow+0.17.0+Release,
> > > > > it
> > > > > > looks like we're getting closer.
> > > > > >
> > > > > > I'd encourage everyone to review their backlogs and (1) bump from
> > > 0.17
> > > > > > scope any tickets they don't plan to finish this week, and (2) if
> > > there
> > > > > are
> > > > > > any issues that should block release, make sure they are flagged as
> > > > > > "blockers".
> > > > > >
> > > > > > Neal
> > > > > >
> > > > > > On Tue, Mar 10, 2020 at 7:39 AM Wes McKinney 
> > > > 

[jira] [Created] (ARROW-8340) [Documentation] Sphinx documentation does not build with just-released Sphinx 3.0.0

2020-04-05 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8340:
---

 Summary: [Documentation] Sphinx documentation does not build with 
just-released Sphinx 3.0.0
 Key: ARROW-8340
 URL: https://issues.apache.org/jira/browse/ARROW-8340
 Project: Apache Arrow
  Issue Type: Bug
  Components: Documentation, Python
Reporter: Wes McKinney
 Fix For: 0.17.0


I'll add a version pin in a docs PR I'm working on, but this needs to be fixed 
soon



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (ARROW-8339) [C++] Possibly allow null offsets and/or data buffer for BaseBinaryArray for 0-length arrays

2020-04-05 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8339:
---

 Summary: [C++] Possibly allow null offsets and/or data buffer for 
BaseBinaryArray for 0-length arrays
 Key: ARROW-8339
 URL: https://issues.apache.org/jira/browse/ARROW-8339
 Project: Apache Arrow
  Issue Type: Improvement
  Components: C++
Reporter: Wes McKinney


related to ARROW-8338. This issues was raised in ARROW-7008 but we maintained 
the status quo of requiring non-null buffers in both cases



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (ARROW-8338) [Format] Clarify whether 0-length variable offsets buffers are permissible for 0-length arrays in the IPC protocol

2020-04-05 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8338:
---

 Summary: [Format] Clarify whether 0-length variable offsets 
buffers are permissible for 0-length arrays in the IPC protocol
 Key: ARROW-8338
 URL: https://issues.apache.org/jira/browse/ARROW-8338
 Project: Apache Arrow
  Issue Type: Improvement
  Components: Documentation, Format
Reporter: Wes McKinney


This aspect of the columnar format / IPC protocol remains slightly unclear. As 
written, it would suggest that an offsets buffer of length 1 containing a 
single value 0 is required. It may be better to allow this to be length zero 
(corresponding to a 0-size or null buffer in the implementation)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (ARROW-8337) [Release] Verify release candidate wheels without using conda

2020-04-05 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-8337:
--

 Summary: [Release] Verify release candidate wheels without using 
conda
 Key: ARROW-8337
 URL: https://issues.apache.org/jira/browse/ARROW-8337
 Project: Apache Arrow
  Issue Type: Improvement
  Components: Developer Tools
Reporter: Neal Richardson


See final comments on ARROW-2880



--
This message was sent by Atlassian Jira
(v8.3.4#803005)