Rust crates are published. Filed https://issues.apache.org/jira/browse/ARROW-7794 for the arrow-flight issue.
On Fri, Feb 7, 2020 at 7:05 AM Andy Grove <andygrov...@gmail.com> wrote: > I'll look at the Rust issue now. > > On Fri, Feb 7, 2020 at 3:27 AM Krisztián Szűcs <szucs.kriszt...@gmail.com> > wrote: > >> Status of the post release tasks: >> >> - [DONE] marking the released version as "RELEASED" on JIRA >> - [DONE] rebase the master branch on top of the release branch >> We have failing builds on the master because of the bumped version >> numbers, those must be fixed. >> - [DONE] rebase the pull requests >> - [DONE] uploading source release artifacts to SVN >> - [DONE] uploading binary release artifacts to Bintray >> - [DONE] updating the Arrow website >> - [DONE] python source distribution >> - [DONE] ruby gems >> - [DONE] javascript npm packages >> - [DONE] .NET nuget packages >> - [DONE] java maven artifacts >> I had to re-stage the maven artifacts >> - [kszucs] python wheels >> Partially done, the manylinux2010 and manylinux2014 wheels have hit >> the 60MB limit of pypi, requested to increase it >> https://github.com/pypa/pypi-support/issues/186 >> - [xhochy] conda packages >> Uwe works on it, arrow-cpp is already merged. >> - [andygrove] rust packages >> Arrow-flight misses the format directory, didn't dig deeper. Andy >> could you take a look? >> - [nealrichardson] R packages >> Neal should handle this. >> - [ ] homebrew packages >> - [ ] updating website with new API documentation >> - [ ] announcing release >> >> On Fri, Feb 7, 2020 at 8:18 AM Krisztián Szűcs >> <szucs.kriszt...@gmail.com> wrote: >> > >> > The VOTE carries with 4 binding +1 votes, 3 non-binding +1 votes and >> > one binding +0 vote. >> > >> > I'm starting the post-release tasks, if anyone wants to help please let >> me know. >> > >> > On Fri, Feb 7, 2020 at 12:25 AM Krisztián Szűcs >> > <szucs.kriszt...@gmail.com> wrote: >> > > >> > > So far we have the following votes: >> > > >> > > +0 (binding) >> > > +1 (binding) >> > > +1 (non-binding) >> > > +1 (binding) >> > > +1 (non-binding) >> > > +1 (binding) >> > > +1 (non-binding) >> > > +1 (binding) >> > > ------------ >> > > 4 +1 (binding) >> > > 3 +1 (non-binding) >> > > >> > > I'm waiting for votes until tomorrow morning (UTC), then I'm closing >> the VOTE. >> > > >> > > Thanks everyone! >> > > >> > > - Krisztian >> > > >> > > On Fri, Feb 7, 2020 at 12:06 AM Krisztián Szűcs >> > > <szucs.kriszt...@gmail.com> wrote: >> > > > >> > > > Testing on macOS Catalina >> > > > >> > > > Binaries: OK >> > > > >> > > > Wheels: OK >> > > > Verified on macOS and on Linux. >> > > > On linux the verification script has failed for python 3.5 and >> manylinux2010 >> > > > and manylinux2014 with unsupported platform tag. I've manually >> checked >> > > > these wheels in the python:3.5 docker image, and the wheels were >> good >> > > > (this is automatically checked by crossbow too [1]). All other >> wheels were >> > > > passing using the verification script. >> > > > >> > > > Source: OK >> > > > I had to revert the nvm path [2] to pass the js and integration >> tests and >> > > > force the glib test to use my system python instead of the conda >> one. >> > > > >> > > > I vote with +1 (binding) >> > > > >> > > > [1]: >> https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml#L568 >> > > > [2]: >> https://github.com/apache/arrow/commit/37434fb34a1f2cd5273092ed3e1c61db90bb4dd2 >> > > > >> > > > >> > > > On Thu, Feb 6, 2020 at 7:42 PM Neal Richardson >> > > > <neal.p.richard...@gmail.com> wrote: >> > > > > >> > > > > I re-verified the macOS wheels and they worked but I had to >> hard-code >> > > > > `MACOSX_DEPLOYMENT_TARGET="10.14"` to get past the cython error I >> reported >> > > > > previously. I tried to set that env var dynamically based on your >> current >> > > > > OS version but didn't succeed in getting it passed through to >> pytest, >> > > > > despite many attempts to `export` it; someone with better bash >> skills than >> > > > > I should probably add that to the script. FTR `defaults read >> loginwindow >> > > > > SystemVersionStampAsString | sed s/\.[0-9]$//` returns the right >> macOS >> > > > > version. >> > > > > >> > > > > Neal >> > > > > >> > > > > On Wed, Feb 5, 2020 at 1:29 PM Wes McKinney <wesmck...@gmail.com> >> wrote: >> > > > > >> > > > > > +1 (binding) >> > > > > > >> > > > > > I was able to verify the Windows wheels with the following >> patch applied >> > > > > > >> > > > > > https://github.com/apache/arrow/pull/6364 >> > > > > > >> > > > > > On Wed, Feb 5, 2020 at 1:09 PM Krisztián Szűcs >> > > > > > <szucs.kriszt...@gmail.com> wrote: >> > > > > > > >> > > > > > > There were binary naming issues with the macosx and the >> win-cp38 >> > > > > > > wheels. >> > > > > > > I've uploaded them, all of the wheels should be available now >> [1] >> > > > > > > >> > > > > > > Note that the newly built macosx wheels have 10_9 platform tag >> > > > > > > instead of 10_6, so the verification script must be updated >> [2] to >> > > > > > > verify the macosx wheels. >> > > > > > > >> > > > > > > [1] >> https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files >> > > > > > > [2] >> > > > > > >> https://github.com/apache/arrow/pull/6362/files#diff-8cc7fa3ae5de30b356c17d7a4b59fe09R658 >> > > > > > > >> > > > > > > On Wed, Feb 5, 2020 at 6:30 PM Krisztián Szűcs >> > > > > > > <szucs.kriszt...@gmail.com> wrote: >> > > > > > > > >> > > > > > > > The wheel was built successfully and available under the >> crossbow >> > > > > > > > releases. Something must have gone wrong during >> download/upload >> > > > > > > > to bintray. I'm re-uploading the wheels again, waiting for >> the network. >> > > > > > > > >> > > > > > > > On Wed, Feb 5, 2020 at 6:14 PM Wes McKinney < >> wesmck...@gmail.com> >> > > > > > wrote: >> > > > > > > > > >> > > > > > > > > The Windows wheel RC script is broken >> > > > > > > > > >> > > > > > > > > wget --no-check-certificate -O >> > > > > > pyarrow-0.16.0-cp38-cp38m-win_amd64.whl >> > > > > > > > > >> > > > > > >> https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.1 >> > > > > > > > > 6.0-cp38-cp38m-win_amd64.whl || EXIT /B 1 >> > > > > > > > > --2020-02-05 11:11:15-- >> > > > > > > > > >> > > > > > >> https://bintray.com/apache/arrow/download_file?file_path=python-rc%2F0.16.0-rc2%2Fpyarrow-0.16.0-cp38-cp38m-win_amd64.whl >> > > > > > > > > Resolving bintray.com (bintray.com)... 75.126.208.206 >> > > > > > > > > Connecting to bintray.com (bintray.com >> )|75.126.208.206|:443... >> > > > > > > > > connected. >> > > > > > > > > HTTP request sent, awaiting response... 404 Not Found >> > > > > > > > > 2020-02-05 11:11:15 ERROR 404: Not Found. >> > > > > > > > > >> > > > > > > > > I will try to fix >> > > > > > > > > >> > > > > > > > > On Wed, Feb 5, 2020 at 7:31 AM Uwe L. Korn < >> uw...@xhochy.com> wrote: >> > > > > > > > > > >> > > > > > > > > > I'm failing to verify C++ on macOS as it seems that we >> nowadays >> > > > > > pull all dependencies from the system. Is there a known way to >> build & test >> > > > > > on OSX with the script and use conda for the requirements? >> > > > > > > > > > >> > > > > > > > > > Otherwise I probably need to investe to create such a >> way. >> > > > > > > > > > >> > > > > > > > > > Cheers >> > > > > > > > > > Uwe >> > > > > > > > > > >> > > > > > > > > > On Wed, Feb 5, 2020, at 2:54 AM, Krisztián Szűcs wrote: >> > > > > > > > > > > Hi, >> > > > > > > > > > > >> > > > > > > > > > > I've cherry-picked the wheel fix [1] on top of the >> 0.16 release >> > > > > > tag, >> > > > > > > > > > > re-built the wheels using crossbow [2], and uploaded >> them to >> > > > > > > > > > > bintray [3] (also removed win-py38m). >> > > > > > > > > > > >> > > > > > > > > > > Anyone who has voted after verifying the wheels, >> please re-run >> > > > > > > > > > > the verification script again for the wheels and >> re-vote. >> > > > > > > > > > > >> > > > > > > > > > > Thanks, Krisztian >> > > > > > > > > > > >> > > > > > > > > > > [1] >> > > > > > > > > > > >> > > > > > >> https://github.com/apache/arrow/commit/67e34c53b3be4c88348369f8109626b4a8a997aa >> > > > > > > > > > > [2] >> > > > > > >> https://github.com/ursa-labs/crossbow/branches/all?query=build-733 >> > > > > > > > > > > [3] >> https://bintray.com/apache/arrow/python-rc/0.16.0-rc2#files >> > > > > > > > > > > >> > > > > > > > > > > On Tue, Feb 4, 2020 at 7:08 PM Wes McKinney < >> wesmck...@gmail.com> >> > > > > > wrote: >> > > > > > > > > > > > >> > > > > > > > > > > > +1 (binding) >> > > > > > > > > > > > >> > > > > > > > > > > > Some patches were required to the verification >> scripts but I >> > > > > > have run: >> > > > > > > > > > > > >> > > > > > > > > > > > * Full source verification on Ubuntu 18.04 >> > > > > > > > > > > > * Linux binary verification >> > > > > > > > > > > > * Source verification on Windows 10 (needed >> ARROW-6757) >> > > > > > > > > > > > * Windows binary verification. Note that Python 3.8 >> wheel is >> > > > > > broken >> > > > > > > > > > > > (see ARROW-7755). Whoever uploads the wheels to >> PyPI _SHOULD >> > > > > > NOT_ >> > > > > > > > > > > > upload this 3.8 wheel until we know what's wrong >> (if we upload >> > > > > > a >> > > > > > > > > > > > broken wheel then `pip install pyarrow==0.16.0` >> will be >> > > > > > permanently >> > > > > > > > > > > > broken on Windows/Python 3.8) >> > > > > > > > > > > > >> > > > > > > > > > > > On Mon, Feb 3, 2020 at 9:26 PM Francois >> Saint-Jacques >> > > > > > > > > > > > <fsaintjacq...@gmail.com> wrote: >> > > > > > > > > > > > > >> > > > > > > > > > > > > Tested on ubuntu 18.04 for the source release. >> > > > > > > > > > > > > >> > > > > > > > > > > > > On Mon, Feb 3, 2020 at 10:07 PM Francois >> Saint-Jacques >> > > > > > > > > > > > > <fsaintjacq...@gmail.com> wrote: >> > > > > > > > > > > > > > >> > > > > > > > > > > > > > +1 >> > > > > > > > > > > > > > >> > > > > > > > > > > > > > Binaries verification didn't have any issues. >> > > > > > > > > > > > > > Sources verification worked with some local >> environment >> > > > > > hiccups >> > > > > > > > > > > > > > >> > > > > > > > > > > > > > François >> > > > > > > > > > > > > > >> > > > > > > > > > > > > > On Mon, Feb 3, 2020 at 8:46 PM Andy Grove < >> > > > > > andygrov...@gmail.com> wrote: >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > +1 (binding) based on running the Rust tests >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > Thanks. >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > On Thu, Jan 30, 2020 at 8:13 PM Krisztián >> Szűcs < >> > > > > > szucs.kriszt...@gmail.com> >> > > > > > > > > > > > > > > wrote: >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > Hi, >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > I would like to propose the following >> release >> > > > > > candidate (RC2) of Apache >> > > > > > > > > > > > > > > > Arrow version 0.16.0. This is a release >> consisting of >> > > > > > 728 >> > > > > > > > > > > > > > > > resolved JIRA issues[1]. >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > This release candidate is based on commit: >> > > > > > > > > > > > > > > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2] >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > The source release rc2 is hosted at [3]. >> > > > > > > > > > > > > > > > The binary artifacts are hosted at >> [4][5][6][7]. >> > > > > > > > > > > > > > > > The changelog is located at [8]. >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > Please download, verify checksums and >> signatures, run >> > > > > > the unit tests, >> > > > > > > > > > > > > > > > and vote on the release. See [9] for how to >> validate a >> > > > > > release candidate. >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > The vote will be open for at least 72 hours. >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > [ ] +1 Release this as Apache Arrow 0.16.0 >> > > > > > > > > > > > > > > > [ ] +0 >> > > > > > > > > > > > > > > > [ ] -1 Do not release this as Apache Arrow >> 0.16.0 >> > > > > > because... >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > [1]: >> > > > > > > > > > > > > > > > >> > > > > > >> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0 >> > > > > > > > > > > > > > > > [2]: >> > > > > > > > > > > > > > > > >> > > > > > >> https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5 >> > > > > > > > > > > > > > > > [3]: >> > > > > > >> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2 >> > > > > > > > > > > > > > > > [4]: >> > > > > > https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2 >> > > > > > > > > > > > > > > > [5]: >> > > > > > https://bintray.com/apache/arrow/debian-rc/0.16.0-rc2 >> > > > > > > > > > > > > > > > [6]: >> > > > > > https://bintray.com/apache/arrow/python-rc/0.16.0-rc2 >> > > > > > > > > > > > > > > > [7]: >> > > > > > https://bintray.com/apache/arrow/ubuntu-rc/0.16.0-rc2 >> > > > > > > > > > > > > > > > [8]: >> > > > > > > > > > > > > > > > >> > > > > > >> https://github.com/apache/arrow/blob/729a7689fd87572e6a14ad36f19cd579a8b8d9c5/CHANGELOG.md >> > > > > > > > > > > > > > > > [9]: >> > > > > > > > > > > > > > > > >> > > > > > >> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates >> > > > > > > > > > > > > > > > >> > > > > > > > > > > >> > > > > > >> >