Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread Wang Xudong
Congrats Kou!!!

Niranda Perera  于2022年1月26日周三 10:05写道:

> Congrats Kou! :-)
>
> On Tue, Jan 25, 2022, 20:53 Keith Kraus  wrote:
>
> > Congrats Kou! Thanks for all of your work!
> >
> > On Tue, Jan 25, 2022 at 8:04 PM Weston Pace 
> wrote:
> >
> > > Congratulations Kou!
> > >
> > > On Tue, Jan 25, 2022 at 8:22 AM Neal Richardson
> > >  wrote:
> > > >
> > > > Congratulations!
> > > >
> > > > Neal
> > > >
> > > > On Tue, Jan 25, 2022 at 12:53 PM Benson Muite <
> > > benson_mu...@emailplus.org>
> > > > wrote:
> > > >
> > > > > Congratulations Kou!
> > > > > On 1/25/22 8:44 PM, Vibhatha Abeykoon wrote:
> > > > > > Congrats Kou!
> > > > > >
> > > > > >
> > > > > > On Tue, Jan 25, 2022 at 11:13 PM Ian Joiner <
> iajoiner...@gmail.com
> > >
> > > > > wrote:
> > > > > >
> > > > > >> Congrats Kou!
> > > > > >>
> > > > > >> On Tuesday, January 25, 2022, Wes McKinney  >
> > > wrote:
> > > > > >>
> > > > > >>> I am pleased to announce that we have a new PMC chair and VP as
> > per
> > > > > >>> our newly started tradition of rotating the chair once a year.
> I
> > > have
> > > > > >>> resigned and Kouhei was duly elected by the PMC and approved
> > > > > >>> unanimously by the board. Please join me in congratulating Kou!
> > > > > >>>
> > > > > >>> Thanks,
> > > > > >>> Wes
> > > > > >>>
> > > > > >>
> > > > > >
> > > > >
> > > > >
> > >
> >
>


Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread Niranda Perera
Congrats Kou! :-)

On Tue, Jan 25, 2022, 20:53 Keith Kraus  wrote:

> Congrats Kou! Thanks for all of your work!
>
> On Tue, Jan 25, 2022 at 8:04 PM Weston Pace  wrote:
>
> > Congratulations Kou!
> >
> > On Tue, Jan 25, 2022 at 8:22 AM Neal Richardson
> >  wrote:
> > >
> > > Congratulations!
> > >
> > > Neal
> > >
> > > On Tue, Jan 25, 2022 at 12:53 PM Benson Muite <
> > benson_mu...@emailplus.org>
> > > wrote:
> > >
> > > > Congratulations Kou!
> > > > On 1/25/22 8:44 PM, Vibhatha Abeykoon wrote:
> > > > > Congrats Kou!
> > > > >
> > > > >
> > > > > On Tue, Jan 25, 2022 at 11:13 PM Ian Joiner  >
> > > > wrote:
> > > > >
> > > > >> Congrats Kou!
> > > > >>
> > > > >> On Tuesday, January 25, 2022, Wes McKinney 
> > wrote:
> > > > >>
> > > > >>> I am pleased to announce that we have a new PMC chair and VP as
> per
> > > > >>> our newly started tradition of rotating the chair once a year. I
> > have
> > > > >>> resigned and Kouhei was duly elected by the PMC and approved
> > > > >>> unanimously by the board. Please join me in congratulating Kou!
> > > > >>>
> > > > >>> Thanks,
> > > > >>> Wes
> > > > >>>
> > > > >>
> > > > >
> > > >
> > > >
> >
>


Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread Keith Kraus
Congrats Kou! Thanks for all of your work!

On Tue, Jan 25, 2022 at 8:04 PM Weston Pace  wrote:

> Congratulations Kou!
>
> On Tue, Jan 25, 2022 at 8:22 AM Neal Richardson
>  wrote:
> >
> > Congratulations!
> >
> > Neal
> >
> > On Tue, Jan 25, 2022 at 12:53 PM Benson Muite <
> benson_mu...@emailplus.org>
> > wrote:
> >
> > > Congratulations Kou!
> > > On 1/25/22 8:44 PM, Vibhatha Abeykoon wrote:
> > > > Congrats Kou!
> > > >
> > > >
> > > > On Tue, Jan 25, 2022 at 11:13 PM Ian Joiner 
> > > wrote:
> > > >
> > > >> Congrats Kou!
> > > >>
> > > >> On Tuesday, January 25, 2022, Wes McKinney 
> wrote:
> > > >>
> > > >>> I am pleased to announce that we have a new PMC chair and VP as per
> > > >>> our newly started tradition of rotating the chair once a year. I
> have
> > > >>> resigned and Kouhei was duly elected by the PMC and approved
> > > >>> unanimously by the board. Please join me in congratulating Kou!
> > > >>>
> > > >>> Thanks,
> > > >>> Wes
> > > >>>
> > > >>
> > > >
> > >
> > >
>


Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread Weston Pace
Congratulations Kou!

On Tue, Jan 25, 2022 at 8:22 AM Neal Richardson
 wrote:
>
> Congratulations!
>
> Neal
>
> On Tue, Jan 25, 2022 at 12:53 PM Benson Muite 
> wrote:
>
> > Congratulations Kou!
> > On 1/25/22 8:44 PM, Vibhatha Abeykoon wrote:
> > > Congrats Kou!
> > >
> > >
> > > On Tue, Jan 25, 2022 at 11:13 PM Ian Joiner 
> > wrote:
> > >
> > >> Congrats Kou!
> > >>
> > >> On Tuesday, January 25, 2022, Wes McKinney  wrote:
> > >>
> > >>> I am pleased to announce that we have a new PMC chair and VP as per
> > >>> our newly started tradition of rotating the chair once a year. I have
> > >>> resigned and Kouhei was duly elected by the PMC and approved
> > >>> unanimously by the board. Please join me in congratulating Kou!
> > >>>
> > >>> Thanks,
> > >>> Wes
> > >>>
> > >>
> > >
> >
> >


Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread Neal Richardson
Congratulations!

Neal

On Tue, Jan 25, 2022 at 12:53 PM Benson Muite 
wrote:

> Congratulations Kou!
> On 1/25/22 8:44 PM, Vibhatha Abeykoon wrote:
> > Congrats Kou!
> >
> >
> > On Tue, Jan 25, 2022 at 11:13 PM Ian Joiner 
> wrote:
> >
> >> Congrats Kou!
> >>
> >> On Tuesday, January 25, 2022, Wes McKinney  wrote:
> >>
> >>> I am pleased to announce that we have a new PMC chair and VP as per
> >>> our newly started tradition of rotating the chair once a year. I have
> >>> resigned and Kouhei was duly elected by the PMC and approved
> >>> unanimously by the board. Please join me in congratulating Kou!
> >>>
> >>> Thanks,
> >>> Wes
> >>>
> >>
> >
>
>


Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread Jorge Cardoso Leitão
Thank you so much for all your contributions to open source and to Apache
Arrow in particular, and for accepting taking this role.

On Tue, Jan 25, 2022 at 7:10 PM QP Hou  wrote:

> Congrats Kou, very well deserved.
>
> On Tue, Jan 25, 2022 at 9:53 AM Benson Muite 
> wrote:
> >
> > Congratulations Kou!
> > On 1/25/22 8:44 PM, Vibhatha Abeykoon wrote:
> > > Congrats Kou!
> > >
> > >
> > > On Tue, Jan 25, 2022 at 11:13 PM Ian Joiner 
> wrote:
> > >
> > >> Congrats Kou!
> > >>
> > >> On Tuesday, January 25, 2022, Wes McKinney 
> wrote:
> > >>
> > >>> I am pleased to announce that we have a new PMC chair and VP as per
> > >>> our newly started tradition of rotating the chair once a year. I have
> > >>> resigned and Kouhei was duly elected by the PMC and approved
> > >>> unanimously by the board. Please join me in congratulating Kou!
> > >>>
> > >>> Thanks,
> > >>> Wes
> > >>>
> > >>
> > >
> >
>


Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread QP Hou
Congrats Kou, very well deserved.

On Tue, Jan 25, 2022 at 9:53 AM Benson Muite  wrote:
>
> Congratulations Kou!
> On 1/25/22 8:44 PM, Vibhatha Abeykoon wrote:
> > Congrats Kou!
> >
> >
> > On Tue, Jan 25, 2022 at 11:13 PM Ian Joiner  wrote:
> >
> >> Congrats Kou!
> >>
> >> On Tuesday, January 25, 2022, Wes McKinney  wrote:
> >>
> >>> I am pleased to announce that we have a new PMC chair and VP as per
> >>> our newly started tradition of rotating the chair once a year. I have
> >>> resigned and Kouhei was duly elected by the PMC and approved
> >>> unanimously by the board. Please join me in congratulating Kou!
> >>>
> >>> Thanks,
> >>> Wes
> >>>
> >>
> >
>


Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread Benson Muite

Congratulations Kou!
On 1/25/22 8:44 PM, Vibhatha Abeykoon wrote:

Congrats Kou!


On Tue, Jan 25, 2022 at 11:13 PM Ian Joiner  wrote:


Congrats Kou!

On Tuesday, January 25, 2022, Wes McKinney  wrote:


I am pleased to announce that we have a new PMC chair and VP as per
our newly started tradition of rotating the chair once a year. I have
resigned and Kouhei was duly elected by the PMC and approved
unanimously by the board. Please join me in congratulating Kou!

Thanks,
Wes









Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread Vibhatha Abeykoon
Congrats Kou!


On Tue, Jan 25, 2022 at 11:13 PM Ian Joiner  wrote:

> Congrats Kou!
>
> On Tuesday, January 25, 2022, Wes McKinney  wrote:
>
> > I am pleased to announce that we have a new PMC chair and VP as per
> > our newly started tradition of rotating the chair once a year. I have
> > resigned and Kouhei was duly elected by the PMC and approved
> > unanimously by the board. Please join me in congratulating Kou!
> >
> > Thanks,
> > Wes
> >
>


Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread Ian Joiner
Congrats Kou!

On Tuesday, January 25, 2022, Wes McKinney  wrote:

> I am pleased to announce that we have a new PMC chair and VP as per
> our newly started tradition of rotating the chair once a year. I have
> resigned and Kouhei was duly elected by the PMC and approved
> unanimously by the board. Please join me in congratulating Kou!
>
> Thanks,
> Wes
>


Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread Rok Mihevc
Congrats Kou!

On Tue, Jan 25, 2022 at 6:08 PM Micah Kornfield  wrote:
>
> Congratulations Kou, thank you for taking on the responsibility.
>
> On Tue, Jan 25, 2022 at 8:42 AM Antoine Pitrou  wrote:
>
> >
> > Warm congratulations as well :-)
> >
> >
> >
> > Le 25/01/2022 à 17:41, David Li a écrit :
> > > Congrats, Kou!
> > >
> > > On Tue, Jan 25, 2022, at 11:39, Krisztián Szűcs wrote:
> > >> Congratulations Kou!
> > >>
> > >> On Tue, Jan 25, 2022 at 5:33 PM Wes McKinney 
> > wrote:
> > >>>
> > >>> I am pleased to announce that we have a new PMC chair and VP as per
> > >>> our newly started tradition of rotating the chair once a year. I have
> > >>> resigned and Kouhei was duly elected by the PMC and approved
> > >>> unanimously by the board. Please join me in congratulating Kou!
> > >>>
> > >>> Thanks,
> > >>> Wes
> > >>
> >


Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread Micah Kornfield
Congratulations Kou, thank you for taking on the responsibility.

On Tue, Jan 25, 2022 at 8:42 AM Antoine Pitrou  wrote:

>
> Warm congratulations as well :-)
>
>
>
> Le 25/01/2022 à 17:41, David Li a écrit :
> > Congrats, Kou!
> >
> > On Tue, Jan 25, 2022, at 11:39, Krisztián Szűcs wrote:
> >> Congratulations Kou!
> >>
> >> On Tue, Jan 25, 2022 at 5:33 PM Wes McKinney 
> wrote:
> >>>
> >>> I am pleased to announce that we have a new PMC chair and VP as per
> >>> our newly started tradition of rotating the chair once a year. I have
> >>> resigned and Kouhei was duly elected by the PMC and approved
> >>> unanimously by the board. Please join me in congratulating Kou!
> >>>
> >>> Thanks,
> >>> Wes
> >>
>


Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread Antoine Pitrou



Warm congratulations as well :-)



Le 25/01/2022 à 17:41, David Li a écrit :

Congrats, Kou!

On Tue, Jan 25, 2022, at 11:39, Krisztián Szűcs wrote:

Congratulations Kou!

On Tue, Jan 25, 2022 at 5:33 PM Wes McKinney  wrote:


I am pleased to announce that we have a new PMC chair and VP as per
our newly started tradition of rotating the chair once a year. I have
resigned and Kouhei was duly elected by the PMC and approved
unanimously by the board. Please join me in congratulating Kou!

Thanks,
Wes




Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread David Li
Congrats, Kou!

On Tue, Jan 25, 2022, at 11:39, Krisztián Szűcs wrote:
> Congratulations Kou!
> 
> On Tue, Jan 25, 2022 at 5:33 PM Wes McKinney  wrote:
> >
> > I am pleased to announce that we have a new PMC chair and VP as per
> > our newly started tradition of rotating the chair once a year. I have
> > resigned and Kouhei was duly elected by the PMC and approved
> > unanimously by the board. Please join me in congratulating Kou!
> >
> > Thanks,
> > Wes
> 

Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread Krisztián Szűcs
Congratulations Kou!

On Tue, Jan 25, 2022 at 5:33 PM Wes McKinney  wrote:
>
> I am pleased to announce that we have a new PMC chair and VP as per
> our newly started tradition of rotating the chair once a year. I have
> resigned and Kouhei was duly elected by the PMC and approved
> unanimously by the board. Please join me in congratulating Kou!
>
> Thanks,
> Wes


[ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread Wes McKinney
I am pleased to announce that we have a new PMC chair and VP as per
our newly started tradition of rotating the chair once a year. I have
resigned and Kouhei was duly elected by the PMC and approved
unanimously by the board. Please join me in congratulating Kou!

Thanks,
Wes


[RESULT] [VOTE][RUST] Release Apache Arrow Rust 8.0.0 RC1

2022-01-25 Thread Andrew Lamb
With 3 +1 votes, the release is approved.

The release is available here:
  https://dist.apache.org/repos/dist/release/arrow/arrow-rs-8.0.0

It has also been uploaded to crates.io:
https://crates.io/crates/arrow/8.0.0
https://crates.io/crates/arrow-flight/8.0.0
https://crates.io/crates/parquet/8.0.0
https://crates.io/crates/parquet-derive/8.0.0

Thank you everyone who contributed to this release. As always I think it is
the best one yet ;)

Andrew

On Tue, Jan 25, 2022 at 7:24 AM Neville Dipale 
wrote:

> Good day
>
> +1 (binding), verified on macos-aarch64
>
> On Tue, 25 Jan 2022 at 05:08, Wang Xudong  wrote:
>
> > +1(non-binding)
> > Verified on macos
> > "Release candidate looks good!"
> >
> > --
> > xudong963
> >
> > Andy Grove  于2022年1月25日周二 09:07写道:
> >
> > > +1 (binding). Verified on Ubuntu 20.04.3 LTS.
> > >
> > > On Fri, Jan 21, 2022 at 5:23 AM Andrew Lamb 
> > wrote:
> > >
> > > > As we have discussed [5], the Rust bi-weekly releases are going to
> come
> > > off
> > > > master now, and this is the first such release.
> > > >
> > > > Therefore, it is with great excitement that I would like to propose a
> > > > release of Apache Arrow Rust Implementation, version 8.0.0. Among
> other
> > > > things, this resolves the last outstanding specific security issues
> > > [6][7]
> > > > we know of.
> > > >
> > > > This release candidate is based on commit:
> > > > 0377aaed5ff46214359d1b8d66c27f3afd9323c3 [1]
> > > >
> > > > The proposed release tarball and signatures are hosted at [2].
> > > >
> > > > The changelog is located at [3].
> > > >
> > > > Please download, verify checksums and signatures, run the unit tests,
> > > > and vote on the release. There is a script [4] that automates some of
> > > > the verification.
> > > >
> > > > The vote will be open for at least 72 hours.
> > > >
> > > > [ ] +1 Release this as Apache Arrow Rust
> > > > [ ] +0
> > > > [ ] -1 Do not release this as Apache Arrow Rust  because...
> > > >
> > > > [1]:
> > > >
> > > >
> > >
> >
> https://github.com/apache/arrow-rs/tree/0377aaed5ff46214359d1b8d66c27f3afd9323c3
> > > > [2]:
> > > >
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-rs-8.0.0-rc1
> > > > [3]:
> > > >
> > > >
> > >
> >
> https://github.com/apache/arrow-rs/blob/0377aaed5ff46214359d1b8d66c27f3afd9323c3/CHANGELOG.md
> > > > [4]:
> > > >
> > > >
> > >
> >
> https://github.com/apache/arrow-rs/blob/master/dev/release/verify-release-candidate.sh
> > > > [5] https://github.com/apache/arrow-rs/issues/1120
> > > > [6] https://github.com/apache/arrow-rs/issues/197
> > > > [7] https://github.com/apache/arrow-rs/issues/786
> > > >
> > >
> >
>


Re: VOTE][RUST] Release Apache Arrow Rust 8.0.0 RC1

2022-01-25 Thread Neville Dipale
Good day

+1 (binding), verified on macos-aarch64

On Tue, 25 Jan 2022 at 05:08, Wang Xudong  wrote:

> +1(non-binding)
> Verified on macos
> "Release candidate looks good!"
>
> --
> xudong963
>
> Andy Grove  于2022年1月25日周二 09:07写道:
>
> > +1 (binding). Verified on Ubuntu 20.04.3 LTS.
> >
> > On Fri, Jan 21, 2022 at 5:23 AM Andrew Lamb 
> wrote:
> >
> > > As we have discussed [5], the Rust bi-weekly releases are going to come
> > off
> > > master now, and this is the first such release.
> > >
> > > Therefore, it is with great excitement that I would like to propose a
> > > release of Apache Arrow Rust Implementation, version 8.0.0. Among other
> > > things, this resolves the last outstanding specific security issues
> > [6][7]
> > > we know of.
> > >
> > > This release candidate is based on commit:
> > > 0377aaed5ff46214359d1b8d66c27f3afd9323c3 [1]
> > >
> > > The proposed release tarball and signatures are hosted at [2].
> > >
> > > The changelog is located at [3].
> > >
> > > Please download, verify checksums and signatures, run the unit tests,
> > > and vote on the release. There is a script [4] that automates some of
> > > the verification.
> > >
> > > The vote will be open for at least 72 hours.
> > >
> > > [ ] +1 Release this as Apache Arrow Rust
> > > [ ] +0
> > > [ ] -1 Do not release this as Apache Arrow Rust  because...
> > >
> > > [1]:
> > >
> > >
> >
> https://github.com/apache/arrow-rs/tree/0377aaed5ff46214359d1b8d66c27f3afd9323c3
> > > [2]:
> > > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-rs-8.0.0-rc1
> > > [3]:
> > >
> > >
> >
> https://github.com/apache/arrow-rs/blob/0377aaed5ff46214359d1b8d66c27f3afd9323c3/CHANGELOG.md
> > > [4]:
> > >
> > >
> >
> https://github.com/apache/arrow-rs/blob/master/dev/release/verify-release-candidate.sh
> > > [5] https://github.com/apache/arrow-rs/issues/1120
> > > [6] https://github.com/apache/arrow-rs/issues/197
> > > [7] https://github.com/apache/arrow-rs/issues/786
> > >
> >
>


Re: [VOTE] Release Apache Arrow 7.0.0 - RC6

2022-01-25 Thread Uwe L. Korn
Hello all,

I sadly get an issue with compiling with GCC 7.5 at the moment as reported in 
https://issues.apache.org/jira/browse/ARROW-15444

We need this version to support CUDA-enabled and ppc64le builds on conda-forge.

Cheers
Uwe

On Tue, Jan 25, 2022, at 10:35 AM, Krisztián Szűcs wrote:
> Thanks David for verifying!
>
> On Tue, Jan 25, 2022 at 1:07 AM David Li  wrote:
>>
>> Unfortunately I get a few errors during source verification of Python due to 
>> flaky tests.
>>
>> I filed https://issues.apache.org/jira/browse/ARROW-15437 and 
>> https://issues.apache.org/jira/browse/ARROW-15438
> Luckily these shouldn't be blocker issues.
>>
>> I'll try to have a patch for the former later tonight.
>>
>> Also I had to uninstall gdb before doing verification as the GDB tests fail 
>> for me due to not being able to find libarrow.so.
> Created a jira https://issues.apache.org/jira/browse/ARROW-15442
>
> Meanwhile you can disable the GDB tests by `export PYARROW_TEST_GDB=OFF`
>>
>> -David
>>
>> On Mon, Jan 24, 2022, at 13:02, Krisztián Szűcs wrote:
>> > Hi,
>> >
>> > I would like to propose the following release candidate (RC6) of Apache
>> > Arrow version 7.0.0. This is a release consisting of 608
>> > resolved JIRA issues[1].
>> >
>> > This release candidate is based on commit:
>> > cc809bd98a04f562a38107858cab669db0768cc1 [2]
>> >
>> > The source release rc6 is hosted at [3].
>> > The binary artifacts are hosted at [4][5][6][7][8][9][10][11].
>> > The changelog is located at [12].
>> >
>> > Please download, verify checksums and signatures, run the unit tests,
>> > and vote on the release. See [13] for how to validate a release candidate.
>> >
>> > The vote will be open for at least 72 hours.
>> >
>> > [ ] +1 Release this as Apache Arrow 7.0.0
>> > [ ] +0
>> > [ ] -1 Do not release this as Apache Arrow 7.0.0 because...
>> >
>> > [1]: 
>> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%207.0.0
>> > [2]: 
>> > https://github.com/apache/arrow/tree/cc809bd98a04f562a38107858cab669db0768cc1
>> > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-7.0.0-rc6
>> > [4]: https://apache.jfrog.io/artifactory/arrow/almalinux-rc/
>> > [5]: https://apache.jfrog.io/artifactory/arrow/amazon-linux-rc/
>> > [6]: https://apache.jfrog.io/artifactory/arrow/centos-rc/
>> > [7]: https://apache.jfrog.io/artifactory/arrow/debian-rc/
>> > [8]: https://apache.jfrog.io/artifactory/arrow/java-rc/7.0.0-rc6
>> > [9]: https://apache.jfrog.io/artifactory/arrow/nuget-rc/7.0.0-rc6
>> > [10]: https://apache.jfrog.io/artifactory/arrow/python-rc/7.0.0-rc6
>> > [11]: https://apache.jfrog.io/artifactory/arrow/ubuntu-rc/
>> > [12]: 
>> > https://github.com/apache/arrow/blob/cc809bd98a04f562a38107858cab669db0768cc1/CHANGELOG.md
>> > [13]: 
>> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>> >


Re: [VOTE] Release Apache Arrow 7.0.0 - RC6

2022-01-25 Thread Krisztián Szűcs
Thanks David for verifying!

On Tue, Jan 25, 2022 at 1:07 AM David Li  wrote:
>
> Unfortunately I get a few errors during source verification of Python due to 
> flaky tests.
>
> I filed https://issues.apache.org/jira/browse/ARROW-15437 and 
> https://issues.apache.org/jira/browse/ARROW-15438
Luckily these shouldn't be blocker issues.
>
> I'll try to have a patch for the former later tonight.
>
> Also I had to uninstall gdb before doing verification as the GDB tests fail 
> for me due to not being able to find libarrow.so.
Created a jira https://issues.apache.org/jira/browse/ARROW-15442

Meanwhile you can disable the GDB tests by `export PYARROW_TEST_GDB=OFF`
>
> -David
>
> On Mon, Jan 24, 2022, at 13:02, Krisztián Szűcs wrote:
> > Hi,
> >
> > I would like to propose the following release candidate (RC6) of Apache
> > Arrow version 7.0.0. This is a release consisting of 608
> > resolved JIRA issues[1].
> >
> > This release candidate is based on commit:
> > cc809bd98a04f562a38107858cab669db0768cc1 [2]
> >
> > The source release rc6 is hosted at [3].
> > The binary artifacts are hosted at [4][5][6][7][8][9][10][11].
> > The changelog is located at [12].
> >
> > Please download, verify checksums and signatures, run the unit tests,
> > and vote on the release. See [13] for how to validate a release candidate.
> >
> > The vote will be open for at least 72 hours.
> >
> > [ ] +1 Release this as Apache Arrow 7.0.0
> > [ ] +0
> > [ ] -1 Do not release this as Apache Arrow 7.0.0 because...
> >
> > [1]: 
> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%207.0.0
> > [2]: 
> > https://github.com/apache/arrow/tree/cc809bd98a04f562a38107858cab669db0768cc1
> > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-7.0.0-rc6
> > [4]: https://apache.jfrog.io/artifactory/arrow/almalinux-rc/
> > [5]: https://apache.jfrog.io/artifactory/arrow/amazon-linux-rc/
> > [6]: https://apache.jfrog.io/artifactory/arrow/centos-rc/
> > [7]: https://apache.jfrog.io/artifactory/arrow/debian-rc/
> > [8]: https://apache.jfrog.io/artifactory/arrow/java-rc/7.0.0-rc6
> > [9]: https://apache.jfrog.io/artifactory/arrow/nuget-rc/7.0.0-rc6
> > [10]: https://apache.jfrog.io/artifactory/arrow/python-rc/7.0.0-rc6
> > [11]: https://apache.jfrog.io/artifactory/arrow/ubuntu-rc/
> > [12]: 
> > https://github.com/apache/arrow/blob/cc809bd98a04f562a38107858cab669db0768cc1/CHANGELOG.md
> > [13]: 
> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >


Re: [DISCUSS] New Types (Schema.fbs vs Extension Types)

2022-01-25 Thread Antoine Pitrou



Le 25/01/2022 à 10:12, Joris Van den Bossche a écrit :

On Sat, 22 Jan 2022 at 20:27, Rok Mihevc  wrote:


Thanks for the input Weston!

How about arrow/experimental/format/ExtensionTypes.fbs or
arrow/format/ExtensionTypes.fbs for language independent schema and
loosely arrow//extensions for implementations?

Having machine readable definitions could perhaps be useful for
generating implementations in some cases.


Is it useful to put this in a flatbuffer file? Based on the list from
Weston just below, I think this will mostly contain a *description* of
those different aspect (a specification of the extension type), and
there is no data that actually fits in a flatbuffer table? In that
case a plain text (eg markdown) file seems more fitting?


I agree this is mostly a plain text (or, rather, reST :-)) specification 
task.


Regards

Antoine.


Re: [DISCUSS] New Types (Schema.fbs vs Extension Types)

2022-01-25 Thread Joris Van den Bossche
On Sat, 22 Jan 2022 at 20:27, Rok Mihevc  wrote:
>
> Thanks for the input Weston!
>
> How about arrow/experimental/format/ExtensionTypes.fbs or
> arrow/format/ExtensionTypes.fbs for language independent schema and
> loosely arrow//extensions for implementations?
>
> Having machine readable definitions could perhaps be useful for
> generating implementations in some cases.

Is it useful to put this in a flatbuffer file? Based on the list from
Weston just below, I think this will mostly contain a *description* of
those different aspect (a specification of the extension type), and
there is no data that actually fits in a flatbuffer table? In that
case a plain text (eg markdown) file seems more fitting?

>
> > * The name of the extension type (to go in ARROW:extension:name)
> > * A description of the extension type and how it should be used
> > * The storage type of the extension type
> > * The format and meaning of the content that will go into 
> > ARROW:extension:metadata
>
> These sound pretty complete!
>
> I'll wait for a couple of days to see if there's more input and then
> draft a PR. Do we need a vote on this?
>
>
> Best,
> Rok
>
> On Fri, Jan 21, 2022 at 3:07 AM Weston Pace  wrote:
> >
> > Those all seem to be C++ locations.  If we want to define
> > cross-implementation "Well Known Extension Types" then it seems we
> > would want to come up with some kind of language independent agreement
> > (could just be a markdown file but maybe there is some advantage to
> > having something programmatically consumable) describing:
> >
> > * The name of the extension type (to go in ARROW:extension:name)
> > * A description of the extension type and how it should be used
> > * The storage type of the extension type
> > * The format and meaning of the content that will go into
> > ARROW:extension:metadata
> >
> > I think (but am not sure) that, since these are metadata keys, we are
> > supposed to stick to printable ASCII for values (for backwards
> > compatibility).
> >
> > For example, in the docs, we currently have this little blurb about a
> > theoretical tensor extension type:
> >
> > > tensor (multidimensional array) stored as Binary values and
> > > having serialized metadata indicating the data type and shape
> > > of each value. This could be JSON like {'type': 'int8', 'shape':
> > > [4, 5]} for a 4x5 cell tensor.
> >
> > In my mind this file would be somewhat analogous to the way that
> > schema.fbs is the cross implementation "ground truth" for our logical
> > types.
> >
> > Then the C++ implementation would be free to put the implementation
> > (I'd vote for arrow/cpp/extensions but a separate repo is probably ok.
> > I'm -1 on arrow/extensions/...)
> >
> > On Thu, Jan 20, 2022 at 3:20 PM Rok Mihevc  wrote:
> > >
> > > To continue the ExtensionType part of this thread - I would like to
> > > add TensorArray [1] as an ExtensionType to Arrow but we have not yet
> > > agreed on an "official" location for "Well Known Extension Types".
> > >
> > > Where could we put these? Some suggestions:
> > >
> > > * implementation folders (e.g. arrow/cpp/extensions/tensor_array.h)
> > > * extensions folder (e.g. arrow/extensions/cpp/tensor_array.h)
> > > * separate repo (e.g. 
> > > github.com/apache/arrow_extensions/cpp/tensor_array.h)
> > >
> > > I'd be happy to also gather other Well Known Extension Types into one
> > > location if this moves forward.
> > >
> > > Rok
> > >
> > > [1] https://github.com/apache/arrow/pull/8510#issuecomment-991150389
> > >
> > > On Sat, May 1, 2021 at 12:12 PM Andrew Lamb  wrote:
> > > >
> > > > I agree with others on this thread. Thanks for writing this down Micah
> > > >
> > > > On Fri, Apr 30, 2021 at 11:16 AM Antoine Pitrou  
> > > > wrote:
> > > >
> > > > >
> > > > > I concur with both what Wes and Micah said.
> > > > >
> > > > > As for temporal types, they have wide-spread use and their semantics
> > > > > require dedicated treatment for arithmetic and conversion, so it's
> > > > > helpful to define dedicated types for them, as opposed to mere 
> > > > > annotations.
> > > > >
> > > > > Regards
> > > > >
> > > > > Antoine.
> > > > >
> > > > >
> > > > > Le 30/04/2021 à 16:40, Wes McKinney a écrit :
> > > > > > I agree that the bar for adding new types to the Type union in 
> > > > > > Schema.fbs
> > > > > > should be quite high going forward. Using extension types 
> > > > > > increasingly
> > > > > for
> > > > > > adding specializations of built-in types will mean less burden for
> > > > > > implementations to simply "propagate forward" this data (by 
> > > > > > preserving
> > > > > the
> > > > > > extra metadata) even if they don't understand what it does. It 
> > > > > > would be
> > > > > > nice, therefore, to put us on a path to expanding our set of 
> > > > > > "official"
> > > > > > extension types (which would include things like JSON or UUID) 
> > > > > > since some
> > > > > > libraries may choose to implement convenience containers for these 
> > > > > > for
> > > > > 

Re: Need contributor permission for JIRA

2022-01-25 Thread Sutou Kouhei
Done!

In 
  "Need contributor permission for JIRA" on Tue, 25 Jan 2022 07:27:56 +,
  DOGRA Diwakar  wrote:

> Hi,
> 
> I want to contribute to Apache Arrow. Would you please give me the 
> contributor permission? My JIRA ID is dogra.diwa...@gmail.com  Thanks.
> 
> Regards
> Diwakar
> This email and any attachments are intended solely for the use of the 
> individual or entity to whom it is addressed and may be confidential and/or 
> privileged.
> 
> If you are not one of the named recipients or have received this email in 
> error,
> 
> (i) you should not read, disclose, or copy it,
> 
> (ii) please notify sender of your receipt by reply email and delete this 
> email and all attachments,
> 
> (iii) Dassault Systèmes does not accept or assume any liability or 
> responsibility for any use of or reliance on this email.
> 
> 
> Please be informed that your personal data are processed according to our 
> data privacy policy as described on our website. Should you have any 
> questions related to personal data protection, please contact 3DS Data 
> Protection Officer at 
> 3ds.compliance-priv...@3ds.com
> 
> 
> For other languages, go to https://www.3ds.com/terms/email-disclaimer