Run the wheel verification on OS X and experienced the same. At the same time the wheel properly works for python 3.5 docker images without conda environment.
Conda forge doesn't maintain packages for python 3.5 anymore and something must have mixed with the numpy versions. I've created a PR to install all the dependencies for wheel verification from PyPI [1], it fixed the wheel verification locally for me. [1]: https://github.com/apache/arrow/pull/6339 On Sat, Feb 1, 2020 at 12:43 PM Sutou Kouhei <k...@clear-code.com> wrote: > > +0 (binding) > > I ran the followings on Debian GNU/Linux sid: > > * TEST_CSHARP=0 \ > PATH=$HOME/.local/bin \ > JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \ > CUDA_TOOLKIT_ROOT=/usr \ > dev/release/verify-release-candidate.sh source 0.16.0 2 > * dev/release/verify-release-candidate.sh binaries 0.16.0 2 > * dev/release/verify-release-candidate.sh wheels 0.16.0 2 > > with: > > * gcc (Debian 9.2.1-25) 9.2.1 20200123 > * openjdk version "1.8.0_242-ea" > * Node.JS v12.1.0 > * go version go1.13.6 linux/amd64 > * nvidia-cuda-dev 10.1.168-6 > > Notes: > > * wheels verification fails for Python 3.5. > I'm not sure this is a problem of verification script > or wheel problem. So I vote +0. > > Full log: > > https://gist.github.com/kou/8f187df43a2ccf9a74dc5d1840e2d1b6 > > Related log: > > ---- > + pytest --pyargs pyarrow > ============================= test session starts > ============================== > platform linux -- Python 3.5.5, pytest-3.8.1, py-1.8.1, pluggy-0.11.0 > rootdir: /tmp/arrow-0.16.0.phvUH/binaries, inifile: > plugins: lazy-fixture-0.6.2, faulthandler-1.5.0, hypothesis-5.4.1 > collected 2389 items / 3 skipped > > pyarrow/tests/test_array.py ....................s......F.......FF..FFF.. [ > 1%] > ..F...FFF.F.......FFF.FFF.........................FsssssssssFFFFFFFFFFFF [ > 4%] > F...FFFFFFFFFFFFFFFFFFFFFFFFF.F.............FssFF.F..F [ > 7%] > pyarrow/tests/test_builder.py ... [ > 7%] > pyarrow/tests/test_compute.py .................FFFFFFFFFF..........FFFFF [ > 8%] > FFFFF...... [ > 9%] > pyarrow/tests/test_convert_builtin.py ...........F....F....F....F....F.. [ > 10%] > ..F....FFFFFF....F....F....F....F....F....F....F....F....F....F....F.... [ > 13%] > F....F....F....F....F....F....F....F....F....F....F....F....F....F....F. [ > 16%] > ...F....F....F....F....F....F....F....F....FFFFFFFFFFFFFFFFFFFFFFFFFFFFF [ > 19%] > FFFFFFFFFFFF....F....FFF........F....F.FFFFFFFFFF....FFFFFFFFFFF....FFFF [ > 22%] > FFF.F..ssss..........F....F..........F................F.......... [ > 25%] > pyarrow/tests/test_csv.py .........................FF................... [ > 27%] > .....FF...FF. [ > 28%] > pyarrow/tests/test_cython.py . [ > 28%] > pyarrow/tests/test_dataset.py ..............F.....EEE [ > 29%] > pyarrow/tests/test_extension_type.py ..................F [ > 29%] > pyarrow/tests/test_feather.py FFFFFFFF..F.FFFFFsFFFFFFFFFFFFFFFsFs [ > 31%] > pyarrow/tests/test_filesystem.py .. [ > 31%] > pyarrow/tests/test_flight.py ...s.F.........s....s......sFF..ss..... [ > 33%] > pyarrow/tests/test_fs.py ....ss....ss....ss....ss....ss....ss....ss....s [ > 35%] > s....ss.............ssssssss.......ss.............ssssssss.............. [ > 38%] > ..ssssssss......ss........... [ > 39%] > pyarrow/tests/test_gandiva.py ....s.... [ > 39%] > pyarrow/tests/test_hdfs.py sssssssssssssssssssssssssssssssssssssssssssss [ > 41%] > ss [ > 41%] > pyarrow/tests/test_io.py ............................................... [ > 43%] > ................................................. [ > 45%] > pyarrow/tests/test_ipc.py .FFFFFFs.FFFFFF.FF.EEEE.FFFF.FFFFFFFFF.. [ > 47%] > pyarrow/tests/test_json.py ........FF......FF [ > 48%] > pyarrow/tests/test_memory.py .... [ > 48%] > pyarrow/tests/test_misc.py .s........................................... [ > 50%] > ........................................... [ > 51%] > pyarrow/tests/test_orc.py ssss [ > 52%] > pyarrow/tests/test_pandas.py FFFFFFFFFFFFFFFFFF..FFFFFFFFFFFFFFFFFFFFFFF [ > 53%] > FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFsF.FFFFFF..FF [ > 56%] > FFFFFFFFF.FFFFFFFFFFFFFFFFFFFFFFFFFFF.FFsFF.FFF.....FFFFFFFFFF.FFFFF.FFF [ > 59%] > .FFFsF.FF..FFF.FFFFFF.........................FFFFF.FFF.FFFatal Python error: > Segmentation fault > > Current thread 0x00007f26ad80c740 (most recent call first): > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/numpy/core/_internal.py", > line 705 in <listcomp> > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/numpy/core/_internal.py", > line 705 in array_ufunc_errmsg_formatter > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pandas/core/dtypes/missing.py", > line 431 in array_equivalent > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pandas/util/testing.py", > line 1244 in assert_series_equal > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pyarrow/tests/test_pandas.py", > line 3327 in test_dictionary_encoded_nested_to_pandas > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/_pytest/python.py", > line 198 in pytest_pyfunc_call > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/callers.py", > line 187 in _multicall > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/manager.py", > line 62 in <lambda> > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/manager.py", > line 68 in _hookexec > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/hooks.py", > line 289 in __call__ > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/_pytest/python.py", > line 1459 in runtest > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/_pytest/runner.py", > line 111 in pytest_runtest_call > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/callers.py", > line 187 in _multicall > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/manager.py", > line 62 in <lambda> > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/manager.py", > line 68 in _hookexec > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/hooks.py", > line 289 in __call__ > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/_pytest/runner.py", > line 183 in <lambda> > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/_pytest/runner.py", > line 201 in __init__ > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/_pytest/runner.py", > line 185 in call_runtest_hook > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/_pytest/runner.py", > line 161 in call_and_report > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/_pytest/runner.py", > line 81 in runtestprotocol > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/_pytest/runner.py", > line 66 in pytest_runtest_protocol > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/callers.py", > line 187 in _multicall > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/manager.py", > line 62 in <lambda> > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/manager.py", > line 68 in _hookexec > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/hooks.py", > line 289 in __call__ > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/_pytest/main.py", > line 236 in pytest_runtestloop > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/callers.py", > line 187 in _multicall > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/manager.py", > line 62 in <lambda> > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/manager.py", > line 68 in _hookexec > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/hooks.py", > line 289 in __call__ > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/_pytest/main.py", > line 215 in _main > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/_pytest/main.py", > line 178 in wrap_session > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/_pytest/main.py", > line 208 in pytest_cmdline_main > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/callers.py", > line 187 in _multicall > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/manager.py", > line 62 in <lambda> > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/manager.py", > line 68 in _hookexec > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/pluggy/hooks.py", > line 289 in __call__ > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/lib/python3.5/site-packages/_pytest/config/__init__.py", > line 67 in main > File > "/tmp/arrow-0.16.0.phvUH/test-miniconda/envs/_verify_wheel-3.5m/bin/pytest", > line 11 in <module> > dev/release/verify-release-candidate.sh: line 603: 3519535 Segmentation fault > pytest --pyargs pyarrow > ---- > > > Thanks, > -- > kou > > In <cahm19a73azqzndbonhvtpwekfkfjfxehkh2nxnyg6h1xsfo...@mail.gmail.com> > "[VOTE] Release Apache Arrow 0.16.0 - RC2" on Fri, 31 Jan 2020 04:13:12 > +0100, > Krisztián Szűcs <szucs.kriszt...@gmail.com> wrote: > > > Hi, > > > > I would like to propose the following release candidate (RC2) of Apache > > Arrow version 0.16.0. This is a release consisting of 728 > > resolved JIRA issues[1]. > > > > This release candidate is based on commit: > > 729a7689fd87572e6a14ad36f19cd579a8b8d9c5 [2] > > > > The source release rc2 is hosted at [3]. > > The binary artifacts are hosted at [4][5][6][7]. > > The changelog is located at [8]. > > > > Please download, verify checksums and signatures, run the unit tests, > > and vote on the release. See [9] for how to validate a release candidate. > > > > The vote will be open for at least 72 hours. > > > > [ ] +1 Release this as Apache Arrow 0.16.0 > > [ ] +0 > > [ ] -1 Do not release this as Apache Arrow 0.16.0 because... > > > > [1]: > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.16.0 > > [2]: > > https://github.com/apache/arrow/tree/729a7689fd87572e6a14ad36f19cd579a8b8d9c5 > > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.16.0-rc2 > > [4]: https://bintray.com/apache/arrow/centos-rc/0.16.0-rc2 > > [5]: https://bintray.com/apache/arrow/debian-rc/0.16.0-rc2 > > [6]: https://bintray.com/apache/arrow/python-rc/0.16.0-rc2 > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.16.0-rc2 > > [8]: > > https://github.com/apache/arrow/blob/729a7689fd87572e6a14ad36f19cd579a8b8d9c5/CHANGELOG.md > > [9]: > > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
