[jira] [Created] (ARROW-8857) [CI] MinGW builds break on system upgrade
Neal Richardson created ARROW-8857: -- Summary: [CI] MinGW builds break on system upgrade Key: ARROW-8857 URL: https://issues.apache.org/jira/browse/ARROW-8857 Project: Apache Arrow Issue Type: Bug Components: Continuous Integration, R, Ruby Reporter: Neal Richardson Assignee: Neal Richardson Fix For: 1.0.0 See e.g. https://github.com/apache/arrow/pull/7218/checks?check_run_id=687127263#step:7:69 Started failing sometime today. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-8856) [Rust] [Integration Testing] Reading types other than record batches not yet supported
Andy Grove created ARROW-8856:
-
Summary: [Rust] [Integration Testing] Reading types other than
record batches not yet supported
Key: ARROW-8856
URL: https://issues.apache.org/jira/browse/ARROW-8856
Project: Apache Arrow
Issue Type: Sub-task
Components: Rust
Reporter: Andy Grove
Fix For: 1.0.0
{code:java}
Error: IoError("Reading types other than record batches not yet supported")
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-8855) [Rust] [Integration Testing] data type Date32(Day) not supported
Andy Grove created ARROW-8855:
-
Summary: [Rust] [Integration Testing] data type Date32(Day) not
supported
Key: ARROW-8855
URL: https://issues.apache.org/jira/browse/ARROW-8855
Project: Apache Arrow
Issue Type: Sub-task
Components: Rust
Reporter: Andy Grove
Fix For: 1.0.0
{code:java}
Error: JsonError("data type Date32(Day) not supported") {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-8854) [Rust] [Integration Testing] Show output from arrow-json-integration-test
Andy Grove created ARROW-8854: - Summary: [Rust] [Integration Testing] Show output from arrow-json-integration-test Key: ARROW-8854 URL: https://issues.apache.org/jira/browse/ARROW-8854 Project: Apache Arrow Issue Type: Sub-task Components: Rust Reporter: Andy Grove Assignee: Andy Grove Fix For: 1.0.0 Show output from arrow-json-integration-test. It is currently hidden, making it hard to debug the test failures. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-8853) [Rust] [Integration Testing] Enable Flight tests
Andy Grove created ARROW-8853: - Summary: [Rust] [Integration Testing] Enable Flight tests Key: ARROW-8853 URL: https://issues.apache.org/jira/browse/ARROW-8853 Project: Apache Arrow Issue Type: Sub-task Components: Rust Reporter: Andy Grove Fix For: 1.0.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-8852) [R] Post-0.17.1 adjustments
Neal Richardson created ARROW-8852: -- Summary: [R] Post-0.17.1 adjustments Key: ARROW-8852 URL: https://issues.apache.org/jira/browse/ARROW-8852 Project: Apache Arrow Issue Type: Improvement Components: R Reporter: Neal Richardson Assignee: Neal Richardson Fix For: 1.0.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: [VOTE] Release Apache Arrow 0.17.1 - RC1
Current status: 1. [done] rebase (not required for a patch release) 2. [done] upload source 3. [done] upload binaries 4. [done|in-pr] update website 5. [done] upload ruby gems 6. [ ] upload js packages 8. [done] upload C# packages 9. [ ] upload rust crates 10. [in-progress|in-pr] update conda recipes 11. [done] upload wheels to pypi 12. [nealrichardson] update homebrew packages 13. [done] update maven artifacts 14. [done|in-pr] update msys2 15. [nealrichardson] update R packages 16. [done|in-pr] update docs On Mon, May 18, 2020 at 11:33 PM Sutou Kouhei wrote: > > >> 14. [ ] update msys2 > > > > I'll do this. > > Oh, sorry. Krisztián already did! > > In <20200519.062731.1037230979568376433@clear-code.com> > "Re: [VOTE] Release Apache Arrow 0.17.1 - RC1" on Tue, 19 May 2020 06:27:31 > +0900 (JST), > Sutou Kouhei wrote: > > >> 14. [ ] update msys2 > > > > I'll do this. > > > > In > > "Re: [VOTE] Release Apache Arrow 0.17.1 - RC1" on Mon, 18 May 2020 > > 22:37:50 +0200, > > Krisztián Szűcs wrote: > > > >> 1. [done] rebase (not required for a patch release) > >> 2. [done] upload source > >> 3. [done] upload binaries > >> 4. [done] update website > >> 5. [done] upload ruby gems > >> 6. [ ] upload js packages > >> No javascript changes were applied to the patch release, for > >> consistency we might want to choose to upload a 0.17.1 release though. > >> 8. [done] upload C# packages > >> 9. [ ] upload rust crates > >> @Andy Grove the patch release doesn't affect the rust implementation. > >> We can update the crates despite that no changes were made, not sure > >> what policy should we choose here (same as with JS) > >> 10. [ ] update conda recipes > >> @Uwe Korn seems like arrow-cpp-feedstock have not picked up the new > >> release once again > >> 11. [done] upload wheels to pypi > >> 12. [nealrichardson] update homebrew packages > >> 13. [done] update maven artifacts > >> 14. [ ] update msys2 > >> 15. [nealrichardson] update R packages > >> 16. [in-progress] update docs > >> > >> On Mon, May 18, 2020 at 10:29 PM Krisztián Szűcs > >> wrote: > >>> > >>> Current status: > >>> > >>> 1. [done] rebase (not required for a patch release) > >>> 2. [done] upload source > >>> 3. [done] upload binaries > >>> 4. [done] update website > >>> 5. [ ] upload ruby gems > >>> 6. [ ] upload js packages > >>> 8. [ ] upload C# packages > >>> 9. [ ] upload rust crates > >>> 10. [ ] update conda recipes > >>> 11. [done] upload wheels to pypi > >>> 12. [nealrichardson] update homebrew packages > >>> 13. [done] update maven artifacts > >>> 14. [ ] update msys2 > >>> 15. [nealrichardson] update R packages > >>> 16. [in-progress] update docs > >>> > >>> On Mon, May 18, 2020 at 9:39 PM Neal Richardson > >>> wrote: > >>> > > >>> > I'm working on the R stuff and can do Homebrew again. > >>> > > >>> > Neal > >>> > > >>> > On Mon, May 18, 2020 at 12:30 PM Krisztián Szűcs > >>> > > >>> > wrote: > >>> > > >>> > > Any help with the post release tasks is welcome! > >>> > > > >>> > > Checklist: > >>> > > 1. [done] rebase (not required for a patch release) > >>> > > 2. [done] upload source > >>> > > 3. [in-progress] upload binaries > >>> > > 4. [done] update website > >>> > > 5. [ ] upload ruby gems > >>> > > 6. [ ] upload js packages > >>> > > 8. [ ] upload C# packages > >>> > > 9. [ ] upload rust crates > >>> > > 10. [ ] update conda recipes > >>> > > 11. [kszucs] upload wheels to pypi > >>> > > 12. [ ] update homebrew packages > >>> > > 13. [kszucs] update maven artifacts > >>> > > 14. [ ] update msys2 > >>> > > 15. [ ] update R packages > >>> > > 16. [in-progress] update docs > >>> > > > >>> > > @Neal Richardson I think you need to handle the R packages. > >>> > > > >>> > > On Mon, May 18, 2020 at 8:08 PM Krisztián Szűcs > >>> > > wrote: > >>> > > > > >>> > > > The VOTE carries with 6 binding +1 votes and 1 non-binding +1 vote. > >>> > > > > >>> > > > I'm starting the post release tasks and keep posted about the > >>> > > > remaining > >>> > > tasks. > >>> > > > > >>> > > > Thanks everyone! > >>> > > > > >>> > > > > >>> > > > On Mon, May 18, 2020 at 7:03 PM Wes McKinney > >>> > > wrote: > >>> > > > > > >>> > > > > +1 (binding). Ran the source verification on Windows > >>> > > > > > >>> > > > > On Mon, May 18, 2020 at 9:28 AM Krisztián Szűcs > >>> > > > > wrote: > >>> > > > > > > >>> > > > > > Seems we don't have a windows verification yet, so I verified > >>> > > > > > the > >>> > > > > > windows wheels in a > >>> > > > > > mcr.microsoft.com/windows/servercore:ltsc2019 > >>> > > > > > docker container. > >>> > > > > > > >>> > > > > > Currently installing VS2017 to verify the source tarball on > >>> > > > > > windows, > >>> > > > > > but it takes some time. > >>> > > > > > If anyone has the environment set up, please confirm that the > >>> > > > > > source > >>> > > > > > verification passes on windows. > >>> > > > > > > >>> > > > > > > >>> > > > > > On Mon, May 18, 2020 at 3:41 PM Kri
[jira] [Created] (ARROW-8851) Fix FutureWarnings in Python Plasma docs
Weston Steimel created ARROW-8851: - Summary: Fix FutureWarnings in Python Plasma docs Key: ARROW-8851 URL: https://issues.apache.org/jira/browse/ARROW-8851 Project: Apache Arrow Issue Type: Improvement Components: Documentation, Python Affects Versions: 0.17.0 Reporter: Weston Steimel The documentation for Plasma in Python at [https://arrow.apache.org/docs/python/plasma.html] produces several FutureWarning messages for pyarrow.get_tensor_size, pyarrow.read_tensor and pyarrow.write_tensor In [9]: import numpy as np : import pyarrow as pa : : # Create a pyarrow.Tensor object from a numpy random 2-dimensional array : data = np.random.randn(10, 4) : tensor = pa.Tensor.from_numpy(data) : : # Create the object in Plasma : object_id = plasma.ObjectID(np.random.bytes(20)) : data_size = pa.get_tensor_size(tensor) : buf = client.create(object_id, data_size) /usr/local/lib/python3.8/site-packages/pyarrow/util.py:39: FutureWarning: pyarrow.get_tensor_size is deprecated as of 0.17.0, please use pyarrow.ipc.get_tensor_size instead warnings.warn(msg, FutureWarning) In [10]: # Write the tensor into the Plasma-allocated buffer : stream = pa.FixedSizeBufferWriter(buf) : pa.write_tensor(tensor, stream) # Writes tensor's 552 bytes to Plasma stream /usr/local/lib/python3.8/site-packages/pyarrow/util.py:39: FutureWarning: pyarrow.write_tensor is deprecated as of 0.17.0, please use pyarrow.ipc.write_tensor instead warnings.warn(msg, FutureWarning) In [13]: # Reconstruct the Arrow tensor object. : reader = pa.BufferReader(buf2) : tensor2 = pa.read_tensor(reader) /usr/local/lib/python3.8/site-packages/pyarrow/util.py:39: FutureWarning: pyarrow.read_tensor is deprecated as of 0.17.0, please use pyarrow.ipc.read_tensor instead warnings.warn(msg, FutureWarning) -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: [VOTE] Release Apache Arrow 0.17.1 - RC1
>> 14. [ ] update msys2 > > I'll do this. Oh, sorry. Krisztián already did! In <20200519.062731.1037230979568376433@clear-code.com> "Re: [VOTE] Release Apache Arrow 0.17.1 - RC1" on Tue, 19 May 2020 06:27:31 +0900 (JST), Sutou Kouhei wrote: >> 14. [ ] update msys2 > > I'll do this. > > In > "Re: [VOTE] Release Apache Arrow 0.17.1 - RC1" on Mon, 18 May 2020 22:37:50 > +0200, > Krisztián Szűcs wrote: > >> 1. [done] rebase (not required for a patch release) >> 2. [done] upload source >> 3. [done] upload binaries >> 4. [done] update website >> 5. [done] upload ruby gems >> 6. [ ] upload js packages >> No javascript changes were applied to the patch release, for >> consistency we might want to choose to upload a 0.17.1 release though. >> 8. [done] upload C# packages >> 9. [ ] upload rust crates >> @Andy Grove the patch release doesn't affect the rust implementation. >> We can update the crates despite that no changes were made, not sure >> what policy should we choose here (same as with JS) >> 10. [ ] update conda recipes >> @Uwe Korn seems like arrow-cpp-feedstock have not picked up the new >> release once again >> 11. [done] upload wheels to pypi >> 12. [nealrichardson] update homebrew packages >> 13. [done] update maven artifacts >> 14. [ ] update msys2 >> 15. [nealrichardson] update R packages >> 16. [in-progress] update docs >> >> On Mon, May 18, 2020 at 10:29 PM Krisztián Szűcs >> wrote: >>> >>> Current status: >>> >>> 1. [done] rebase (not required for a patch release) >>> 2. [done] upload source >>> 3. [done] upload binaries >>> 4. [done] update website >>> 5. [ ] upload ruby gems >>> 6. [ ] upload js packages >>> 8. [ ] upload C# packages >>> 9. [ ] upload rust crates >>> 10. [ ] update conda recipes >>> 11. [done] upload wheels to pypi >>> 12. [nealrichardson] update homebrew packages >>> 13. [done] update maven artifacts >>> 14. [ ] update msys2 >>> 15. [nealrichardson] update R packages >>> 16. [in-progress] update docs >>> >>> On Mon, May 18, 2020 at 9:39 PM Neal Richardson >>> wrote: >>> > >>> > I'm working on the R stuff and can do Homebrew again. >>> > >>> > Neal >>> > >>> > On Mon, May 18, 2020 at 12:30 PM Krisztián Szűcs >>> > >>> > wrote: >>> > >>> > > Any help with the post release tasks is welcome! >>> > > >>> > > Checklist: >>> > > 1. [done] rebase (not required for a patch release) >>> > > 2. [done] upload source >>> > > 3. [in-progress] upload binaries >>> > > 4. [done] update website >>> > > 5. [ ] upload ruby gems >>> > > 6. [ ] upload js packages >>> > > 8. [ ] upload C# packages >>> > > 9. [ ] upload rust crates >>> > > 10. [ ] update conda recipes >>> > > 11. [kszucs] upload wheels to pypi >>> > > 12. [ ] update homebrew packages >>> > > 13. [kszucs] update maven artifacts >>> > > 14. [ ] update msys2 >>> > > 15. [ ] update R packages >>> > > 16. [in-progress] update docs >>> > > >>> > > @Neal Richardson I think you need to handle the R packages. >>> > > >>> > > On Mon, May 18, 2020 at 8:08 PM Krisztián Szűcs >>> > > wrote: >>> > > > >>> > > > The VOTE carries with 6 binding +1 votes and 1 non-binding +1 vote. >>> > > > >>> > > > I'm starting the post release tasks and keep posted about the >>> > > > remaining >>> > > tasks. >>> > > > >>> > > > Thanks everyone! >>> > > > >>> > > > >>> > > > On Mon, May 18, 2020 at 7:03 PM Wes McKinney >>> > > wrote: >>> > > > > >>> > > > > +1 (binding). Ran the source verification on Windows >>> > > > > >>> > > > > On Mon, May 18, 2020 at 9:28 AM Krisztián Szűcs >>> > > > > wrote: >>> > > > > > >>> > > > > > Seems we don't have a windows verification yet, so I verified the >>> > > > > > windows wheels in a mcr.microsoft.com/windows/servercore:ltsc2019 >>> > > > > > docker container. >>> > > > > > >>> > > > > > Currently installing VS2017 to verify the source tarball on >>> > > > > > windows, >>> > > > > > but it takes some time. >>> > > > > > If anyone has the environment set up, please confirm that the >>> > > > > > source >>> > > > > > verification passes on windows. >>> > > > > > >>> > > > > > >>> > > > > > On Mon, May 18, 2020 at 3:41 PM Krisztián Szűcs >>> > > > > > wrote: >>> > > > > > > >>> > > > > > > +1 (binding) >>> > > > > > > >>> > > > > > > Ran the following on macOS 10.15.4: >>> > > > > > > >>> > > > > > > Java: OK >>> > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JAVA=1 >>> > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` >>> > > > > > > >>> > > > > > > C++: OK >>> > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_CPP=1 >>> > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` >>> > > > > > > >>> > > > > > > Glib, Ruby: OK >>> > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GLIB=1 >>> > > TEST_RUBY=1 >>> > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` >>> > > > > > > >>> > > > > > > Python: OK >>> > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_PYTHON=1 >>> > > > >
Re: [VOTE] Release Apache Arrow 0.17.1 - RC1
> 14. [ ] update msys2 I'll do this. In "Re: [VOTE] Release Apache Arrow 0.17.1 - RC1" on Mon, 18 May 2020 22:37:50 +0200, Krisztián Szűcs wrote: > 1. [done] rebase (not required for a patch release) > 2. [done] upload source > 3. [done] upload binaries > 4. [done] update website > 5. [done] upload ruby gems > 6. [ ] upload js packages > No javascript changes were applied to the patch release, for > consistency we might want to choose to upload a 0.17.1 release though. > 8. [done] upload C# packages > 9. [ ] upload rust crates > @Andy Grove the patch release doesn't affect the rust implementation. > We can update the crates despite that no changes were made, not sure > what policy should we choose here (same as with JS) > 10. [ ] update conda recipes > @Uwe Korn seems like arrow-cpp-feedstock have not picked up the new > release once again > 11. [done] upload wheels to pypi > 12. [nealrichardson] update homebrew packages > 13. [done] update maven artifacts > 14. [ ] update msys2 > 15. [nealrichardson] update R packages > 16. [in-progress] update docs > > On Mon, May 18, 2020 at 10:29 PM Krisztián Szűcs > wrote: >> >> Current status: >> >> 1. [done] rebase (not required for a patch release) >> 2. [done] upload source >> 3. [done] upload binaries >> 4. [done] update website >> 5. [ ] upload ruby gems >> 6. [ ] upload js packages >> 8. [ ] upload C# packages >> 9. [ ] upload rust crates >> 10. [ ] update conda recipes >> 11. [done] upload wheels to pypi >> 12. [nealrichardson] update homebrew packages >> 13. [done] update maven artifacts >> 14. [ ] update msys2 >> 15. [nealrichardson] update R packages >> 16. [in-progress] update docs >> >> On Mon, May 18, 2020 at 9:39 PM Neal Richardson >> wrote: >> > >> > I'm working on the R stuff and can do Homebrew again. >> > >> > Neal >> > >> > On Mon, May 18, 2020 at 12:30 PM Krisztián Szűcs >> > >> > wrote: >> > >> > > Any help with the post release tasks is welcome! >> > > >> > > Checklist: >> > > 1. [done] rebase (not required for a patch release) >> > > 2. [done] upload source >> > > 3. [in-progress] upload binaries >> > > 4. [done] update website >> > > 5. [ ] upload ruby gems >> > > 6. [ ] upload js packages >> > > 8. [ ] upload C# packages >> > > 9. [ ] upload rust crates >> > > 10. [ ] update conda recipes >> > > 11. [kszucs] upload wheels to pypi >> > > 12. [ ] update homebrew packages >> > > 13. [kszucs] update maven artifacts >> > > 14. [ ] update msys2 >> > > 15. [ ] update R packages >> > > 16. [in-progress] update docs >> > > >> > > @Neal Richardson I think you need to handle the R packages. >> > > >> > > On Mon, May 18, 2020 at 8:08 PM Krisztián Szűcs >> > > wrote: >> > > > >> > > > The VOTE carries with 6 binding +1 votes and 1 non-binding +1 vote. >> > > > >> > > > I'm starting the post release tasks and keep posted about the remaining >> > > tasks. >> > > > >> > > > Thanks everyone! >> > > > >> > > > >> > > > On Mon, May 18, 2020 at 7:03 PM Wes McKinney >> > > wrote: >> > > > > >> > > > > +1 (binding). Ran the source verification on Windows >> > > > > >> > > > > On Mon, May 18, 2020 at 9:28 AM Krisztián Szűcs >> > > > > wrote: >> > > > > > >> > > > > > Seems we don't have a windows verification yet, so I verified the >> > > > > > windows wheels in a mcr.microsoft.com/windows/servercore:ltsc2019 >> > > > > > docker container. >> > > > > > >> > > > > > Currently installing VS2017 to verify the source tarball on >> > > > > > windows, >> > > > > > but it takes some time. >> > > > > > If anyone has the environment set up, please confirm that the >> > > > > > source >> > > > > > verification passes on windows. >> > > > > > >> > > > > > >> > > > > > On Mon, May 18, 2020 at 3:41 PM Krisztián Szűcs >> > > > > > wrote: >> > > > > > > >> > > > > > > +1 (binding) >> > > > > > > >> > > > > > > Ran the following on macOS 10.15.4: >> > > > > > > >> > > > > > > Java: OK >> > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JAVA=1 >> > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` >> > > > > > > >> > > > > > > C++: OK >> > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_CPP=1 >> > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` >> > > > > > > >> > > > > > > Glib, Ruby: OK >> > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GLIB=1 >> > > TEST_RUBY=1 >> > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` >> > > > > > > >> > > > > > > Python: OK >> > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_PYTHON=1 >> > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` >> > > > > > > >> > > > > > > Go: OK >> > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GO=1 >> > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` >> > > > > > > >> > > > > > > Rust: OK >> > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_RUST=1 >> > > > > > > dev/release/verify-release-candidate.sh source
Re: [VOTE] Release Apache Arrow 0.17.1 - RC1
1. [done] rebase (not required for a patch release) 2. [done] upload source 3. [done] upload binaries 4. [done] update website 5. [done] upload ruby gems 6. [ ] upload js packages No javascript changes were applied to the patch release, for consistency we might want to choose to upload a 0.17.1 release though. 8. [done] upload C# packages 9. [ ] upload rust crates @Andy Grove the patch release doesn't affect the rust implementation. We can update the crates despite that no changes were made, not sure what policy should we choose here (same as with JS) 10. [ ] update conda recipes @Uwe Korn seems like arrow-cpp-feedstock have not picked up the new release once again 11. [done] upload wheels to pypi 12. [nealrichardson] update homebrew packages 13. [done] update maven artifacts 14. [ ] update msys2 15. [nealrichardson] update R packages 16. [in-progress] update docs On Mon, May 18, 2020 at 10:29 PM Krisztián Szűcs wrote: > > Current status: > > 1. [done] rebase (not required for a patch release) > 2. [done] upload source > 3. [done] upload binaries > 4. [done] update website > 5. [ ] upload ruby gems > 6. [ ] upload js packages > 8. [ ] upload C# packages > 9. [ ] upload rust crates > 10. [ ] update conda recipes > 11. [done] upload wheels to pypi > 12. [nealrichardson] update homebrew packages > 13. [done] update maven artifacts > 14. [ ] update msys2 > 15. [nealrichardson] update R packages > 16. [in-progress] update docs > > On Mon, May 18, 2020 at 9:39 PM Neal Richardson > wrote: > > > > I'm working on the R stuff and can do Homebrew again. > > > > Neal > > > > On Mon, May 18, 2020 at 12:30 PM Krisztián Szűcs > > wrote: > > > > > Any help with the post release tasks is welcome! > > > > > > Checklist: > > > 1. [done] rebase (not required for a patch release) > > > 2. [done] upload source > > > 3. [in-progress] upload binaries > > > 4. [done] update website > > > 5. [ ] upload ruby gems > > > 6. [ ] upload js packages > > > 8. [ ] upload C# packages > > > 9. [ ] upload rust crates > > > 10. [ ] update conda recipes > > > 11. [kszucs] upload wheels to pypi > > > 12. [ ] update homebrew packages > > > 13. [kszucs] update maven artifacts > > > 14. [ ] update msys2 > > > 15. [ ] update R packages > > > 16. [in-progress] update docs > > > > > > @Neal Richardson I think you need to handle the R packages. > > > > > > On Mon, May 18, 2020 at 8:08 PM Krisztián Szűcs > > > wrote: > > > > > > > > The VOTE carries with 6 binding +1 votes and 1 non-binding +1 vote. > > > > > > > > I'm starting the post release tasks and keep posted about the remaining > > > tasks. > > > > > > > > Thanks everyone! > > > > > > > > > > > > On Mon, May 18, 2020 at 7:03 PM Wes McKinney > > > wrote: > > > > > > > > > > +1 (binding). Ran the source verification on Windows > > > > > > > > > > On Mon, May 18, 2020 at 9:28 AM Krisztián Szűcs > > > > > wrote: > > > > > > > > > > > > Seems we don't have a windows verification yet, so I verified the > > > > > > windows wheels in a mcr.microsoft.com/windows/servercore:ltsc2019 > > > > > > docker container. > > > > > > > > > > > > Currently installing VS2017 to verify the source tarball on windows, > > > > > > but it takes some time. > > > > > > If anyone has the environment set up, please confirm that the source > > > > > > verification passes on windows. > > > > > > > > > > > > > > > > > > On Mon, May 18, 2020 at 3:41 PM Krisztián Szűcs > > > > > > wrote: > > > > > > > > > > > > > > +1 (binding) > > > > > > > > > > > > > > Ran the following on macOS 10.15.4: > > > > > > > > > > > > > > Java: OK > > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JAVA=1 > > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > > > > > C++: OK > > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_CPP=1 > > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > > > > > Glib, Ruby: OK > > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GLIB=1 > > > TEST_RUBY=1 > > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > > > > > Python: OK > > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_PYTHON=1 > > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > > > > > Go: OK > > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GO=1 > > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > > > > > Rust: OK > > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_RUST=1 > > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > > > > > JS: OK > > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JS=1 > > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > > > > > C#: OK > > > > > > > `TEST_DEFAULT=0 TEST_CSHARP=1 > > > dev/release/verify-release-candidate.sh > > > > > > > source 0.17.1 1` > > > > >
Re: [VOTE] Release Apache Arrow 0.17.1 - RC1
Current status: 1. [done] rebase (not required for a patch release) 2. [done] upload source 3. [done] upload binaries 4. [done] update website 5. [ ] upload ruby gems 6. [ ] upload js packages 8. [ ] upload C# packages 9. [ ] upload rust crates 10. [ ] update conda recipes 11. [done] upload wheels to pypi 12. [nealrichardson] update homebrew packages 13. [done] update maven artifacts 14. [ ] update msys2 15. [nealrichardson] update R packages 16. [in-progress] update docs On Mon, May 18, 2020 at 9:39 PM Neal Richardson wrote: > > I'm working on the R stuff and can do Homebrew again. > > Neal > > On Mon, May 18, 2020 at 12:30 PM Krisztián Szűcs > wrote: > > > Any help with the post release tasks is welcome! > > > > Checklist: > > 1. [done] rebase (not required for a patch release) > > 2. [done] upload source > > 3. [in-progress] upload binaries > > 4. [done] update website > > 5. [ ] upload ruby gems > > 6. [ ] upload js packages > > 8. [ ] upload C# packages > > 9. [ ] upload rust crates > > 10. [ ] update conda recipes > > 11. [kszucs] upload wheels to pypi > > 12. [ ] update homebrew packages > > 13. [kszucs] update maven artifacts > > 14. [ ] update msys2 > > 15. [ ] update R packages > > 16. [in-progress] update docs > > > > @Neal Richardson I think you need to handle the R packages. > > > > On Mon, May 18, 2020 at 8:08 PM Krisztián Szűcs > > wrote: > > > > > > The VOTE carries with 6 binding +1 votes and 1 non-binding +1 vote. > > > > > > I'm starting the post release tasks and keep posted about the remaining > > tasks. > > > > > > Thanks everyone! > > > > > > > > > On Mon, May 18, 2020 at 7:03 PM Wes McKinney > > wrote: > > > > > > > > +1 (binding). Ran the source verification on Windows > > > > > > > > On Mon, May 18, 2020 at 9:28 AM Krisztián Szűcs > > > > wrote: > > > > > > > > > > Seems we don't have a windows verification yet, so I verified the > > > > > windows wheels in a mcr.microsoft.com/windows/servercore:ltsc2019 > > > > > docker container. > > > > > > > > > > Currently installing VS2017 to verify the source tarball on windows, > > > > > but it takes some time. > > > > > If anyone has the environment set up, please confirm that the source > > > > > verification passes on windows. > > > > > > > > > > > > > > > On Mon, May 18, 2020 at 3:41 PM Krisztián Szűcs > > > > > wrote: > > > > > > > > > > > > +1 (binding) > > > > > > > > > > > > Ran the following on macOS 10.15.4: > > > > > > > > > > > > Java: OK > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JAVA=1 > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > > > C++: OK > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_CPP=1 > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > > > Glib, Ruby: OK > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GLIB=1 > > TEST_RUBY=1 > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > > > Python: OK > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_PYTHON=1 > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > > > Go: OK > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GO=1 > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > > > Rust: OK > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_RUST=1 > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > > > JS: OK > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JS=1 > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > > > C#: OK > > > > > > `TEST_DEFAULT=0 TEST_CSHARP=1 > > dev/release/verify-release-candidate.sh > > > > > > source 0.17.1 1` > > > > > > > > > > > > Integration: OK > > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_INTEGRATION=1 > > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > > > Binaries: OK > > > > > > `BINTRAY_REPOSITORY=apache/arrow ARROW_TMPDIR=/tmp/arrow-test > > > > > > dev/release/verify-release-candidate.sh binaries 0.17.1 1` > > > > > > > > > > > > Wheels: OK > > > > > > `BINTRAY_REPOSITORY=apache/arrow TMPDIR=/tmp/arrow > > > > > > dev/release/verify-release-candidate.sh wheels 0.17.1 1` > > > > > > > > > > > > On Thu, May 14, 2020 at 6:23 PM Krisztián Szűcs > > > > > > wrote: > > > > > > > > > > > > > > Hi, > > > > > > > > > > > > > > I would like to propose the following release candidate (RC1) of > > Apache > > > > > > > Arrow version 0.17.1. This is a release consisting of 19 > > > > > > > resolved JIRA issues[1]. > > > > > > > > > > > > > > This release candidate is based on commit: > > > > > > > ff7ee06020949daf66ac05090753e1a17736d9fa [2] > > > > > > > > > > > > > > The source release rc1 is hosted at [3]. > > > > > > > The binary artifacts are hosted at [4][5][6][7]. > > > > > > > The changelog is located at [8]. > > > >
Re: [VOTE] Release Apache Arrow 0.17.1 - RC1
I'm working on the R stuff and can do Homebrew again. Neal On Mon, May 18, 2020 at 12:30 PM Krisztián Szűcs wrote: > Any help with the post release tasks is welcome! > > Checklist: > 1. [done] rebase (not required for a patch release) > 2. [done] upload source > 3. [in-progress] upload binaries > 4. [done] update website > 5. [ ] upload ruby gems > 6. [ ] upload js packages > 8. [ ] upload C# packages > 9. [ ] upload rust crates > 10. [ ] update conda recipes > 11. [kszucs] upload wheels to pypi > 12. [ ] update homebrew packages > 13. [kszucs] update maven artifacts > 14. [ ] update msys2 > 15. [ ] update R packages > 16. [in-progress] update docs > > @Neal Richardson I think you need to handle the R packages. > > On Mon, May 18, 2020 at 8:08 PM Krisztián Szűcs > wrote: > > > > The VOTE carries with 6 binding +1 votes and 1 non-binding +1 vote. > > > > I'm starting the post release tasks and keep posted about the remaining > tasks. > > > > Thanks everyone! > > > > > > On Mon, May 18, 2020 at 7:03 PM Wes McKinney > wrote: > > > > > > +1 (binding). Ran the source verification on Windows > > > > > > On Mon, May 18, 2020 at 9:28 AM Krisztián Szűcs > > > wrote: > > > > > > > > Seems we don't have a windows verification yet, so I verified the > > > > windows wheels in a mcr.microsoft.com/windows/servercore:ltsc2019 > > > > docker container. > > > > > > > > Currently installing VS2017 to verify the source tarball on windows, > > > > but it takes some time. > > > > If anyone has the environment set up, please confirm that the source > > > > verification passes on windows. > > > > > > > > > > > > On Mon, May 18, 2020 at 3:41 PM Krisztián Szűcs > > > > wrote: > > > > > > > > > > +1 (binding) > > > > > > > > > > Ran the following on macOS 10.15.4: > > > > > > > > > > Java: OK > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JAVA=1 > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > C++: OK > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_CPP=1 > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > Glib, Ruby: OK > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GLIB=1 > TEST_RUBY=1 > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > Python: OK > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_PYTHON=1 > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > Go: OK > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GO=1 > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > Rust: OK > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_RUST=1 > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > JS: OK > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JS=1 > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > C#: OK > > > > > `TEST_DEFAULT=0 TEST_CSHARP=1 > dev/release/verify-release-candidate.sh > > > > > source 0.17.1 1` > > > > > > > > > > Integration: OK > > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_INTEGRATION=1 > > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > > > Binaries: OK > > > > > `BINTRAY_REPOSITORY=apache/arrow ARROW_TMPDIR=/tmp/arrow-test > > > > > dev/release/verify-release-candidate.sh binaries 0.17.1 1` > > > > > > > > > > Wheels: OK > > > > > `BINTRAY_REPOSITORY=apache/arrow TMPDIR=/tmp/arrow > > > > > dev/release/verify-release-candidate.sh wheels 0.17.1 1` > > > > > > > > > > On Thu, May 14, 2020 at 6:23 PM Krisztián Szűcs > > > > > wrote: > > > > > > > > > > > > Hi, > > > > > > > > > > > > I would like to propose the following release candidate (RC1) of > Apache > > > > > > Arrow version 0.17.1. This is a release consisting of 19 > > > > > > resolved JIRA issues[1]. > > > > > > > > > > > > This release candidate is based on commit: > > > > > > ff7ee06020949daf66ac05090753e1a17736d9fa [2] > > > > > > > > > > > > The source release rc1 is hosted at [3]. > > > > > > The binary artifacts are hosted at [4][5][6][7]. > > > > > > The changelog is located at [8]. > > > > > > > > > > > > Please download, verify checksums and signatures, run the unit > tests, > > > > > > and vote on the release. See [9] for how to validate a release > candidate. > > > > > > > > > > > > The vote will be open for at least 72 hours. > > > > > > > > > > > > [ ] +1 Release this as Apache Arrow 0.17.1 > > > > > > [ ] +0 > > > > > > [ ] -1 Do not release this as Apache Arrow 0.17.1 because... > > > > > > > > > > > > [1]: > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.17.1 > > > > > > [2]: > https://github.com/apache/arrow/tree/ff7ee06020949daf66ac05090753e1a17736d9fa > > > > > > [3]: > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.17.1-rc1 > > > > > > [4]: https://
[jira] [Created] (ARROW-8850) [Release] Calculate the committer statistics from the master branch
Krisztian Szucs created ARROW-8850: -- Summary: [Release] Calculate the committer statistics from the master branch Key: ARROW-8850 URL: https://issues.apache.org/jira/browse/ARROW-8850 Project: Apache Arrow Issue Type: Improvement Components: Developer Tools Reporter: Krisztian Szucs Out current workflow for patch releases starts with cherry picking the selected patches from the master branch to a maint-* branch which means that the original committer data gets lost. -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: [VOTE] Release Apache Arrow 0.17.1 - RC1
Any help with the post release tasks is welcome! Checklist: 1. [done] rebase (not required for a patch release) 2. [done] upload source 3. [in-progress] upload binaries 4. [done] update website 5. [ ] upload ruby gems 6. [ ] upload js packages 8. [ ] upload C# packages 9. [ ] upload rust crates 10. [ ] update conda recipes 11. [kszucs] upload wheels to pypi 12. [ ] update homebrew packages 13. [kszucs] update maven artifacts 14. [ ] update msys2 15. [ ] update R packages 16. [in-progress] update docs @Neal Richardson I think you need to handle the R packages. On Mon, May 18, 2020 at 8:08 PM Krisztián Szűcs wrote: > > The VOTE carries with 6 binding +1 votes and 1 non-binding +1 vote. > > I'm starting the post release tasks and keep posted about the remaining tasks. > > Thanks everyone! > > > On Mon, May 18, 2020 at 7:03 PM Wes McKinney wrote: > > > > +1 (binding). Ran the source verification on Windows > > > > On Mon, May 18, 2020 at 9:28 AM Krisztián Szűcs > > wrote: > > > > > > Seems we don't have a windows verification yet, so I verified the > > > windows wheels in a mcr.microsoft.com/windows/servercore:ltsc2019 > > > docker container. > > > > > > Currently installing VS2017 to verify the source tarball on windows, > > > but it takes some time. > > > If anyone has the environment set up, please confirm that the source > > > verification passes on windows. > > > > > > > > > On Mon, May 18, 2020 at 3:41 PM Krisztián Szűcs > > > wrote: > > > > > > > > +1 (binding) > > > > > > > > Ran the following on macOS 10.15.4: > > > > > > > > Java: OK > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JAVA=1 > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > C++: OK > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_CPP=1 > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > Glib, Ruby: OK > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GLIB=1 TEST_RUBY=1 > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > Python: OK > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_PYTHON=1 > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > Go: OK > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GO=1 > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > Rust: OK > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_RUST=1 > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > JS: OK > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JS=1 > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > C#: OK > > > > `TEST_DEFAULT=0 TEST_CSHARP=1 dev/release/verify-release-candidate.sh > > > > source 0.17.1 1` > > > > > > > > Integration: OK > > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_INTEGRATION=1 > > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > > > Binaries: OK > > > > `BINTRAY_REPOSITORY=apache/arrow ARROW_TMPDIR=/tmp/arrow-test > > > > dev/release/verify-release-candidate.sh binaries 0.17.1 1` > > > > > > > > Wheels: OK > > > > `BINTRAY_REPOSITORY=apache/arrow TMPDIR=/tmp/arrow > > > > dev/release/verify-release-candidate.sh wheels 0.17.1 1` > > > > > > > > On Thu, May 14, 2020 at 6:23 PM Krisztián Szűcs > > > > wrote: > > > > > > > > > > Hi, > > > > > > > > > > I would like to propose the following release candidate (RC1) of > > > > > Apache > > > > > Arrow version 0.17.1. This is a release consisting of 19 > > > > > resolved JIRA issues[1]. > > > > > > > > > > This release candidate is based on commit: > > > > > ff7ee06020949daf66ac05090753e1a17736d9fa [2] > > > > > > > > > > The source release rc1 is hosted at [3]. > > > > > The binary artifacts are hosted at [4][5][6][7]. > > > > > The changelog is located at [8]. > > > > > > > > > > Please download, verify checksums and signatures, run the unit tests, > > > > > and vote on the release. See [9] for how to validate a release > > > > > candidate. > > > > > > > > > > The vote will be open for at least 72 hours. > > > > > > > > > > [ ] +1 Release this as Apache Arrow 0.17.1 > > > > > [ ] +0 > > > > > [ ] -1 Do not release this as Apache Arrow 0.17.1 because... > > > > > > > > > > [1]: > > > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.17.1 > > > > > [2]: > > > > > https://github.com/apache/arrow/tree/ff7ee06020949daf66ac05090753e1a17736d9fa > > > > > [3]: > > > > > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.17.1-rc1 > > > > > [4]: https://bintray.com/apache/arrow/centos-rc/0.17.1-rc1 > > > > > [5]: https://bintray.com/apache/arrow/debian-rc/0.17.1-rc1 > > > > > [6]: https://bintray.com/apache/arrow/python-rc/0.17.1-rc1 > > > > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.17.1-rc1 > > > > > [8]: > > > > > https://github.com/apache/arrow/blob/ff7ee06020949daf66ac0
[jira] [Created] (ARROW-8849) [Release] Website release notes count not strictly release associated patches
Krisztian Szucs created ARROW-8849: -- Summary: [Release] Website release notes count not strictly release associated patches Key: ARROW-8849 URL: https://issues.apache.org/jira/browse/ARROW-8849 Project: Apache Arrow Issue Type: Improvement Components: Developer Tools Reporter: Krisztian Szucs For example in the 0.17.1 release notes show 27 commits while the jira release only contains 19 patches. This is because the release specific commits (like the versions bumbs) are also accumulated. See the patch release notes here https://github.com/apache/arrow-site/pull/59/files -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-8848) [CI][C/Glib] MinGW build error
Antoine Pitrou created ARROW-8848:
-
Summary: [CI][C/Glib] MinGW build error
Key: ARROW-8848
URL: https://issues.apache.org/jira/browse/ARROW-8848
Project: Apache Arrow
Issue Type: Bug
Components: C, Continuous Integration, GLib
Reporter: Antoine Pitrou
https://github.com/apache/arrow/pull/7216/checks?check_run_id=686415769#step:6:66
{code}
:: Processing package changes...
upgrading msys2-runtime...
0 [main] pacman (5056)
C:\hostedtoolcache\windows\Ruby\2.6.6\x64\msys64\usr\bin\pacman.exe: *** fatal
error - cygheap base mismatch detected - 0x180330408/0x180317408.
This problem is probably due to using incompatible versions of the cygwin DLL.
Search for cygwin1.dll using the Windows Start->Find/Search facility
and delete all but the most recent version. The most recent version *should*
reside in x:\cygwin\bin, where 'x' is the drive on which you have
installed the cygwin distribution. Rebooting is also suggested if you
are unable to find another cygwin DLL.
0 [main] pacman 246 dofork: child -1 - forked process 5056 died
unexpectedly, retry 0, exit code 0xC142, errno 11
error: could not open file
/var/cache/pacman/pkg/msys2-runtime-3.1.4-1-x86_64.pkg.tar.zst: Can't
initialize filter; unable to run program "zstd -d -qq"
error: could not commit transaction
error: failed to commit transaction (transaction aborted)
Errors occurred, no packages were upgraded.
MSYS2 could not be found. Please run 'ridk install'
or download and install MSYS2 manually from https://msys2.github.io/
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
Re: [VOTE] Release Apache Arrow 0.17.1 - RC1
The VOTE carries with 6 binding +1 votes and 1 non-binding +1 vote. I'm starting the post release tasks and keep posted about the remaining tasks. Thanks everyone! On Mon, May 18, 2020 at 7:03 PM Wes McKinney wrote: > > +1 (binding). Ran the source verification on Windows > > On Mon, May 18, 2020 at 9:28 AM Krisztián Szűcs > wrote: > > > > Seems we don't have a windows verification yet, so I verified the > > windows wheels in a mcr.microsoft.com/windows/servercore:ltsc2019 > > docker container. > > > > Currently installing VS2017 to verify the source tarball on windows, > > but it takes some time. > > If anyone has the environment set up, please confirm that the source > > verification passes on windows. > > > > > > On Mon, May 18, 2020 at 3:41 PM Krisztián Szűcs > > wrote: > > > > > > +1 (binding) > > > > > > Ran the following on macOS 10.15.4: > > > > > > Java: OK > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JAVA=1 > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > C++: OK > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_CPP=1 > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > Glib, Ruby: OK > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GLIB=1 TEST_RUBY=1 > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > Python: OK > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_PYTHON=1 > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > Go: OK > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GO=1 > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > Rust: OK > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_RUST=1 > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > JS: OK > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JS=1 > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > C#: OK > > > `TEST_DEFAULT=0 TEST_CSHARP=1 dev/release/verify-release-candidate.sh > > > source 0.17.1 1` > > > > > > Integration: OK > > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_INTEGRATION=1 > > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > > > Binaries: OK > > > `BINTRAY_REPOSITORY=apache/arrow ARROW_TMPDIR=/tmp/arrow-test > > > dev/release/verify-release-candidate.sh binaries 0.17.1 1` > > > > > > Wheels: OK > > > `BINTRAY_REPOSITORY=apache/arrow TMPDIR=/tmp/arrow > > > dev/release/verify-release-candidate.sh wheels 0.17.1 1` > > > > > > On Thu, May 14, 2020 at 6:23 PM Krisztián Szűcs > > > wrote: > > > > > > > > Hi, > > > > > > > > I would like to propose the following release candidate (RC1) of Apache > > > > Arrow version 0.17.1. This is a release consisting of 19 > > > > resolved JIRA issues[1]. > > > > > > > > This release candidate is based on commit: > > > > ff7ee06020949daf66ac05090753e1a17736d9fa [2] > > > > > > > > The source release rc1 is hosted at [3]. > > > > The binary artifacts are hosted at [4][5][6][7]. > > > > The changelog is located at [8]. > > > > > > > > Please download, verify checksums and signatures, run the unit tests, > > > > and vote on the release. See [9] for how to validate a release > > > > candidate. > > > > > > > > The vote will be open for at least 72 hours. > > > > > > > > [ ] +1 Release this as Apache Arrow 0.17.1 > > > > [ ] +0 > > > > [ ] -1 Do not release this as Apache Arrow 0.17.1 because... > > > > > > > > [1]: > > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.17.1 > > > > [2]: > > > > https://github.com/apache/arrow/tree/ff7ee06020949daf66ac05090753e1a17736d9fa > > > > [3]: > > > > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.17.1-rc1 > > > > [4]: https://bintray.com/apache/arrow/centos-rc/0.17.1-rc1 > > > > [5]: https://bintray.com/apache/arrow/debian-rc/0.17.1-rc1 > > > > [6]: https://bintray.com/apache/arrow/python-rc/0.17.1-rc1 > > > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.17.1-rc1 > > > > [8]: > > > > https://github.com/apache/arrow/blob/ff7ee06020949daf66ac05090753e1a17736d9fa/CHANGELOG.md > > > > [9]: > > > > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
Re: [VOTE] Release Apache Arrow 0.17.1 - RC1
+1 (binding). Ran the source verification on Windows On Mon, May 18, 2020 at 9:28 AM Krisztián Szűcs wrote: > > Seems we don't have a windows verification yet, so I verified the > windows wheels in a mcr.microsoft.com/windows/servercore:ltsc2019 > docker container. > > Currently installing VS2017 to verify the source tarball on windows, > but it takes some time. > If anyone has the environment set up, please confirm that the source > verification passes on windows. > > > On Mon, May 18, 2020 at 3:41 PM Krisztián Szűcs > wrote: > > > > +1 (binding) > > > > Ran the following on macOS 10.15.4: > > > > Java: OK > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JAVA=1 > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > C++: OK > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_CPP=1 > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > Glib, Ruby: OK > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GLIB=1 TEST_RUBY=1 > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > Python: OK > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_PYTHON=1 > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > Go: OK > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GO=1 > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > Rust: OK > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_RUST=1 > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > JS: OK > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JS=1 > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > C#: OK > > `TEST_DEFAULT=0 TEST_CSHARP=1 dev/release/verify-release-candidate.sh > > source 0.17.1 1` > > > > Integration: OK > > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_INTEGRATION=1 > > dev/release/verify-release-candidate.sh source 0.17.1 1` > > > > Binaries: OK > > `BINTRAY_REPOSITORY=apache/arrow ARROW_TMPDIR=/tmp/arrow-test > > dev/release/verify-release-candidate.sh binaries 0.17.1 1` > > > > Wheels: OK > > `BINTRAY_REPOSITORY=apache/arrow TMPDIR=/tmp/arrow > > dev/release/verify-release-candidate.sh wheels 0.17.1 1` > > > > On Thu, May 14, 2020 at 6:23 PM Krisztián Szűcs > > wrote: > > > > > > Hi, > > > > > > I would like to propose the following release candidate (RC1) of Apache > > > Arrow version 0.17.1. This is a release consisting of 19 > > > resolved JIRA issues[1]. > > > > > > This release candidate is based on commit: > > > ff7ee06020949daf66ac05090753e1a17736d9fa [2] > > > > > > The source release rc1 is hosted at [3]. > > > The binary artifacts are hosted at [4][5][6][7]. > > > The changelog is located at [8]. > > > > > > Please download, verify checksums and signatures, run the unit tests, > > > and vote on the release. See [9] for how to validate a release candidate. > > > > > > The vote will be open for at least 72 hours. > > > > > > [ ] +1 Release this as Apache Arrow 0.17.1 > > > [ ] +0 > > > [ ] -1 Do not release this as Apache Arrow 0.17.1 because... > > > > > > [1]: > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.17.1 > > > [2]: > > > https://github.com/apache/arrow/tree/ff7ee06020949daf66ac05090753e1a17736d9fa > > > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.17.1-rc1 > > > [4]: https://bintray.com/apache/arrow/centos-rc/0.17.1-rc1 > > > [5]: https://bintray.com/apache/arrow/debian-rc/0.17.1-rc1 > > > [6]: https://bintray.com/apache/arrow/python-rc/0.17.1-rc1 > > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.17.1-rc1 > > > [8]: > > > https://github.com/apache/arrow/blob/ff7ee06020949daf66ac05090753e1a17736d9fa/CHANGELOG.md > > > [9]: > > > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
[jira] [Created] (ARROW-8847) [C++] Pass task size / metrics in Executor API
Antoine Pitrou created ARROW-8847: - Summary: [C++] Pass task size / metrics in Executor API Key: ARROW-8847 URL: https://issues.apache.org/jira/browse/ARROW-8847 Project: Apache Arrow Issue Type: Wish Components: C++ Reporter: Antoine Pitrou Assignee: Antoine Pitrou For now, our ThreadPool implementation would ignore those metrics, but other implementations may use it for custom ordering. Example metrics: * IO size (number of bytes) * CPU cost (~ number of instructions) * Priority (opaque integer? lower is more urgent) -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: [VOTE] Release Apache Arrow 0.17.1 - RC1
Seems we don't have a windows verification yet, so I verified the windows wheels in a mcr.microsoft.com/windows/servercore:ltsc2019 docker container. Currently installing VS2017 to verify the source tarball on windows, but it takes some time. If anyone has the environment set up, please confirm that the source verification passes on windows. On Mon, May 18, 2020 at 3:41 PM Krisztián Szűcs wrote: > > +1 (binding) > > Ran the following on macOS 10.15.4: > > Java: OK > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JAVA=1 > dev/release/verify-release-candidate.sh source 0.17.1 1` > > C++: OK > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_CPP=1 > dev/release/verify-release-candidate.sh source 0.17.1 1` > > Glib, Ruby: OK > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GLIB=1 TEST_RUBY=1 > dev/release/verify-release-candidate.sh source 0.17.1 1` > > Python: OK > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_PYTHON=1 > dev/release/verify-release-candidate.sh source 0.17.1 1` > > Go: OK > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GO=1 > dev/release/verify-release-candidate.sh source 0.17.1 1` > > Rust: OK > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_RUST=1 > dev/release/verify-release-candidate.sh source 0.17.1 1` > > JS: OK > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JS=1 > dev/release/verify-release-candidate.sh source 0.17.1 1` > > C#: OK > `TEST_DEFAULT=0 TEST_CSHARP=1 dev/release/verify-release-candidate.sh > source 0.17.1 1` > > Integration: OK > `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_INTEGRATION=1 > dev/release/verify-release-candidate.sh source 0.17.1 1` > > Binaries: OK > `BINTRAY_REPOSITORY=apache/arrow ARROW_TMPDIR=/tmp/arrow-test > dev/release/verify-release-candidate.sh binaries 0.17.1 1` > > Wheels: OK > `BINTRAY_REPOSITORY=apache/arrow TMPDIR=/tmp/arrow > dev/release/verify-release-candidate.sh wheels 0.17.1 1` > > On Thu, May 14, 2020 at 6:23 PM Krisztián Szűcs > wrote: > > > > Hi, > > > > I would like to propose the following release candidate (RC1) of Apache > > Arrow version 0.17.1. This is a release consisting of 19 > > resolved JIRA issues[1]. > > > > This release candidate is based on commit: > > ff7ee06020949daf66ac05090753e1a17736d9fa [2] > > > > The source release rc1 is hosted at [3]. > > The binary artifacts are hosted at [4][5][6][7]. > > The changelog is located at [8]. > > > > Please download, verify checksums and signatures, run the unit tests, > > and vote on the release. See [9] for how to validate a release candidate. > > > > The vote will be open for at least 72 hours. > > > > [ ] +1 Release this as Apache Arrow 0.17.1 > > [ ] +0 > > [ ] -1 Do not release this as Apache Arrow 0.17.1 because... > > > > [1]: > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.17.1 > > [2]: > > https://github.com/apache/arrow/tree/ff7ee06020949daf66ac05090753e1a17736d9fa > > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.17.1-rc1 > > [4]: https://bintray.com/apache/arrow/centos-rc/0.17.1-rc1 > > [5]: https://bintray.com/apache/arrow/debian-rc/0.17.1-rc1 > > [6]: https://bintray.com/apache/arrow/python-rc/0.17.1-rc1 > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.17.1-rc1 > > [8]: > > https://github.com/apache/arrow/blob/ff7ee06020949daf66ac05090753e1a17736d9fa/CHANGELOG.md > > [9]: > > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
[jira] [Created] (ARROW-8846) [Dev][Python] Autoformat Python sources with Archery
Antoine Pitrou created ARROW-8846: - Summary: [Dev][Python] Autoformat Python sources with Archery Key: ARROW-8846 URL: https://issues.apache.org/jira/browse/ARROW-8846 Project: Apache Arrow Issue Type: Improvement Components: Archery, Developer Tools, Python Reporter: Antoine Pitrou Assignee: Antoine Pitrou -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: [VOTE] Release Apache Arrow 0.17.1 - RC1
+1 (binding) Ran the following on macOS 10.15.4: Java: OK `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JAVA=1 dev/release/verify-release-candidate.sh source 0.17.1 1` C++: OK `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_CPP=1 dev/release/verify-release-candidate.sh source 0.17.1 1` Glib, Ruby: OK `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GLIB=1 TEST_RUBY=1 dev/release/verify-release-candidate.sh source 0.17.1 1` Python: OK `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_PYTHON=1 dev/release/verify-release-candidate.sh source 0.17.1 1` Go: OK `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_GO=1 dev/release/verify-release-candidate.sh source 0.17.1 1` Rust: OK `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_RUST=1 dev/release/verify-release-candidate.sh source 0.17.1 1` JS: OK `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_JS=1 dev/release/verify-release-candidate.sh source 0.17.1 1` C#: OK `TEST_DEFAULT=0 TEST_CSHARP=1 dev/release/verify-release-candidate.sh source 0.17.1 1` Integration: OK `ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_INTEGRATION=1 dev/release/verify-release-candidate.sh source 0.17.1 1` Binaries: OK `BINTRAY_REPOSITORY=apache/arrow ARROW_TMPDIR=/tmp/arrow-test dev/release/verify-release-candidate.sh binaries 0.17.1 1` Wheels: OK `BINTRAY_REPOSITORY=apache/arrow TMPDIR=/tmp/arrow dev/release/verify-release-candidate.sh wheels 0.17.1 1` On Thu, May 14, 2020 at 6:23 PM Krisztián Szűcs wrote: > > Hi, > > I would like to propose the following release candidate (RC1) of Apache > Arrow version 0.17.1. This is a release consisting of 19 > resolved JIRA issues[1]. > > This release candidate is based on commit: > ff7ee06020949daf66ac05090753e1a17736d9fa [2] > > The source release rc1 is hosted at [3]. > The binary artifacts are hosted at [4][5][6][7]. > The changelog is located at [8]. > > Please download, verify checksums and signatures, run the unit tests, > and vote on the release. See [9] for how to validate a release candidate. > > The vote will be open for at least 72 hours. > > [ ] +1 Release this as Apache Arrow 0.17.1 > [ ] +0 > [ ] -1 Do not release this as Apache Arrow 0.17.1 because... > > [1]: > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.17.1 > [2]: > https://github.com/apache/arrow/tree/ff7ee06020949daf66ac05090753e1a17736d9fa > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.17.1-rc1 > [4]: https://bintray.com/apache/arrow/centos-rc/0.17.1-rc1 > [5]: https://bintray.com/apache/arrow/debian-rc/0.17.1-rc1 > [6]: https://bintray.com/apache/arrow/python-rc/0.17.1-rc1 > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.17.1-rc1 > [8]: > https://github.com/apache/arrow/blob/ff7ee06020949daf66ac05090753e1a17736d9fa/CHANGELOG.md > [9]: > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
[NIGHTLY] Arrow Build Report for Job nightly-2020-05-18-0
Arrow Build Report for Job nightly-2020-05-18-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0 Failed Tasks: - conda-linux-gcc-py36: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-azure-conda-linux-gcc-py36 - conda-linux-gcc-py37: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-azure-conda-linux-gcc-py37 - homebrew-cpp: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-travis-homebrew-cpp - homebrew-r-autobrew: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-travis-homebrew-r-autobrew - test-conda-python-3.7-spark-master: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-github-test-conda-python-3.7-spark-master - test-conda-python-3.8-dask-master: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-github-test-conda-python-3.8-dask-master Succeeded Tasks: - centos-6-amd64: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-github-centos-6-amd64 - centos-7-aarch64: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-travis-centos-7-aarch64 - centos-7-amd64: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-github-centos-7-amd64 - centos-8-aarch64: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-travis-centos-8-aarch64 - centos-8-amd64: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-github-centos-8-amd64 - conda-linux-gcc-py38: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-azure-conda-linux-gcc-py38 - conda-osx-clang-py36: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-azure-conda-osx-clang-py36 - conda-osx-clang-py37: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-azure-conda-osx-clang-py37 - conda-osx-clang-py38: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-azure-conda-osx-clang-py38 - conda-win-vs2015-py36: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-azure-conda-win-vs2015-py36 - conda-win-vs2015-py37: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-azure-conda-win-vs2015-py37 - conda-win-vs2015-py38: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-azure-conda-win-vs2015-py38 - debian-buster-amd64: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-github-debian-buster-amd64 - debian-buster-arm64: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-travis-debian-buster-arm64 - debian-stretch-amd64: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-github-debian-stretch-amd64 - debian-stretch-arm64: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-travis-debian-stretch-arm64 - gandiva-jar-osx: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-travis-gandiva-jar-osx - gandiva-jar-xenial: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-travis-gandiva-jar-xenial - nuget: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-github-nuget - test-conda-cpp-valgrind: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-github-test-conda-cpp-valgrind - test-conda-cpp: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-github-test-conda-cpp - test-conda-python-3.6-pandas-0.23: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-github-test-conda-python-3.6-pandas-0.23 - test-conda-python-3.6: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-github-test-conda-python-3.6 - test-conda-python-3.7-dask-latest: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-github-test-conda-python-3.7-dask-latest - test-conda-python-3.7-hdfs-2.9.2: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-github-test-conda-python-3.7-hdfs-2.9.2 - test-conda-python-3.7-kartothek-latest: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-github-test-conda-python-3.7-kartothek-latest - test-conda-python-3.7-kartothek-master: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-github-test-conda-python-3.7-kartothek-master - test-conda-python-3.7-pandas-latest: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-18-0-github-test-conda-python-3.7-pandas-latest - test-conda-python-3.7-pa
[jira] [Created] (ARROW-8845) Selective compression on the wire
Amol Umbarkar created ARROW-8845: Summary: Selective compression on the wire Key: ARROW-8845 URL: https://issues.apache.org/jira/browse/ARROW-8845 Project: Apache Arrow Issue Type: Improvement Components: FlightRPC Reporter: Amol Umbarkar Dask seems to be selectively do compression if it is found to be useful. They sort of pick 10kb of sample upfront to calculate compression and if the results are good then the whole batch is compressed. This seems to save de-compression effort on receiver side. Please take a look at [https://blog.dask.org/2016/04/14/dask-distributed-optimizing-protocol#problem-3-unwanted-compression] Thought this could be relevant to arrow batch transfers as well. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-8844) [C++] Optimize TransferBitmap unaligned case
Yibo Cai created ARROW-8844: --- Summary: [C++] Optimize TransferBitmap unaligned case Key: ARROW-8844 URL: https://issues.apache.org/jira/browse/ARROW-8844 Project: Apache Arrow Issue Type: Improvement Components: C++ Reporter: Yibo Cai Assignee: Yibo Cai TransferBitmap(CopyBitmap, InvertBitmap) unaligned case is processed bit-by-bit[1]. Similar trick in this PR[2] may also be helpful here to improve performance by processing in words. [1] https://github.com/apache/arrow/blob/e5a33f1220705aec6a224b55d2a6f47fbd957603/cpp/src/arrow/util/bit_util.cc#L121-L134 [2] https://github.com/apache/arrow/pull/7135 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-8843) [C++] Optimize BItmapEquals unaligned case
Yibo Cai created ARROW-8843: --- Summary: [C++] Optimize BItmapEquals unaligned case Key: ARROW-8843 URL: https://issues.apache.org/jira/browse/ARROW-8843 Project: Apache Arrow Issue Type: Improvement Components: C++ Reporter: Yibo Cai Assignee: Yibo Cai BitmapEquals unaligned case compares two bitmap bit-by-bit[1]. Similar tricks in this PR[2] may also be helpful here to improve performance by processing in words. [1] https://github.com/apache/arrow/blob/e5a33f1220705aec6a224b55d2a6f47fbd957603/cpp/src/arrow/util/bit_util.cc#L248-L254 [2] https://github.com/apache/arrow/pull/7135 -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: [NIGHTLY] Arrow Build Report for Job nightly-2020-05-17-0
The new dask-master failure seems to be something on their end, I commented about it here: https://github.com/dask/dask/pull/6198#issuecomment-629993387 On Sun, 17 May 2020 at 12:09, Crossbow wrote: > > Arrow Build Report for Job nightly-2020-05-17-0 > > All tasks: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0 > > Failed Tasks: > - homebrew-cpp: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-travis-homebrew-cpp > - homebrew-r-autobrew: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-travis-homebrew-r-autobrew > - test-conda-python-3.7-spark-master: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-github-test-conda-python-3.7-spark-master > - test-conda-python-3.8-dask-master: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-github-test-conda-python-3.8-dask-master > > Succeeded Tasks: > - centos-6-amd64: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-github-centos-6-amd64 > - centos-7-aarch64: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-travis-centos-7-aarch64 > - centos-7-amd64: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-github-centos-7-amd64 > - centos-8-aarch64: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-travis-centos-8-aarch64 > - centos-8-amd64: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-github-centos-8-amd64 > - conda-linux-gcc-py36: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-azure-conda-linux-gcc-py36 > - conda-linux-gcc-py37: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-azure-conda-linux-gcc-py37 > - conda-linux-gcc-py38: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-azure-conda-linux-gcc-py38 > - conda-osx-clang-py36: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-azure-conda-osx-clang-py36 > - conda-osx-clang-py37: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-azure-conda-osx-clang-py37 > - conda-osx-clang-py38: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-azure-conda-osx-clang-py38 > - conda-win-vs2015-py36: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-azure-conda-win-vs2015-py36 > - conda-win-vs2015-py37: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-azure-conda-win-vs2015-py37 > - conda-win-vs2015-py38: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-azure-conda-win-vs2015-py38 > - debian-buster-amd64: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-github-debian-buster-amd64 > - debian-buster-arm64: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-travis-debian-buster-arm64 > - debian-stretch-amd64: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-github-debian-stretch-amd64 > - debian-stretch-arm64: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-travis-debian-stretch-arm64 > - gandiva-jar-osx: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-travis-gandiva-jar-osx > - gandiva-jar-xenial: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-travis-gandiva-jar-xenial > - nuget: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-github-nuget > - test-conda-cpp-valgrind: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-github-test-conda-cpp-valgrind > - test-conda-cpp: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-github-test-conda-cpp > - test-conda-python-3.6-pandas-0.23: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-github-test-conda-python-3.6-pandas-0.23 > - test-conda-python-3.6: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-github-test-conda-python-3.6 > - test-conda-python-3.7-dask-latest: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-github-test-conda-python-3.7-dask-latest > - test-conda-python-3.7-hdfs-2.9.2: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-github-test-conda-python-3.7-hdfs-2.9.2 > - test-conda-python-3.7-kartothek-latest: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-05-17-0-github-test-conda-python-3.7-kartothek-l
