Re: [VOTE] Move issue tracking to GitHub Issues
+1 On Wed, Oct 26, 2022 at 5:04 PM Neal Richardson wrote: > I propose that we move issue tracking from the ASF's Jira to GitHub Issues. > This has been discussed on [1] and [2] and there seems to be consensus. A > number of Arrow subprojects already use GitHub Issues; this moves the issue > tracking for `apache/arrow` into GitHub along with the source code. > > The vote will be open for at least 72 hours. > > [ ] +1 Leave ASF Jira and move to GitHub Issues > [ ] +0 > [ ] -1 Remain in Jira because... > > My vote: +1 > > Neal > > > [1]: https://lists.apache.org/thread/l545m95xmf3w47oxwqxvg811or7b93tb > [2]: https://lists.apache.org/thread/0vwj8gdo55jly5zn16wksrotyqqm0zqr >
Re: [ANNOUNCE] New Arrow committer: Eric Patrick Hanson
Congrats Eric! On Wed, Oct 26, 2022 at 2:05 PM David Li wrote: > > Welcome Eric! > > On Wed, Oct 26, 2022, at 17:57, Ian Joiner wrote: > > Congrats Eric! > > > > Ian > > > > On Wednesday, October 26, 2022, Sutou Kouhei wrote: > > > >> On behalf of the Arrow PMC, I'm happy to announce that Eric Patrick Hanson > >> has accepted an invitation to become a committer on Apache > >> Arrow. Welcome, and thank you for your contributions! > >> > >> kou > >>
Re: [ANNOUNCE] New Arrow committer: Ben Baumgold
Congratulations Ben! On Wed, Oct 26, 2022 at 2:05 PM David Li wrote: > > Welcome Ben! > > On Wed, Oct 26, 2022, at 17:57, Ian Joiner wrote: > > Congrats Ben! > > > > Ian > > > > On Wednesday, October 26, 2022, Sutou Kouhei wrote: > > > >> On behalf of the Arrow PMC, I'm happy to announce that Ben Baumgold > >> has accepted an invitation to become a committer on Apache > >> Arrow. Welcome, and thank you for your contributions! > >> > >> kou > >>
Re: [VOTE] Move issue tracking to GitHub Issues
+1, I'm very glad to see what will hopefully be a _slightly smoother_ experience for new contributors + issue reporters -Jon On Wed, Oct 26, 2022 at 7:05 PM David Li wrote: > +1 > > On Wed, Oct 26, 2022, at 20:01, Andy Grove wrote: > > +1 > > > > On Wed, Oct 26, 2022 at 5:50 PM L. C. Hsieh wrote: > > > >> +1 > >> > >> > >> > >> On Wed, Oct 26, 2022 at 4:08 PM Raphael Taylor-Davies > >> wrote: > >> > > >> > +1 > >> > > >> > On 27/10/2022 12:02, Neal Richardson wrote: > >> > > I propose that we move issue tracking from the ASF's Jira to GitHub > >> Issues. > >> > > This has been discussed on [1] and [2] and there seems to be > >> consensus. A > >> > > number of Arrow subprojects already use GitHub Issues; this moves > the > >> issue > >> > > tracking for `apache/arrow` into GitHub along with the source code. > >> > > > >> > > The vote will be open for at least 72 hours. > >> > > > >> > > [ ] +1 Leave ASF Jira and move to GitHub Issues > >> > > [ ] +0 > >> > > [ ] -1 Remain in Jira because... > >> > > > >> > > My vote: +1 > >> > > > >> > > Neal > >> > > > >> > > > >> > > [1]: > https://lists.apache.org/thread/l545m95xmf3w47oxwqxvg811or7b93tb > >> > > [2]: > https://lists.apache.org/thread/0vwj8gdo55jly5zn16wksrotyqqm0zqr > >> > > > >> >
Re: [ANNOUNCE] New Arrow committer: Eric Patrick Hanson
Welcome Eric! On Wed, Oct 26, 2022, at 17:57, Ian Joiner wrote: > Congrats Eric! > > Ian > > On Wednesday, October 26, 2022, Sutou Kouhei wrote: > >> On behalf of the Arrow PMC, I'm happy to announce that Eric Patrick Hanson >> has accepted an invitation to become a committer on Apache >> Arrow. Welcome, and thank you for your contributions! >> >> kou >>
Re: [ANNOUNCE] New Arrow committer: Ben Baumgold
Welcome Ben! On Wed, Oct 26, 2022, at 17:57, Ian Joiner wrote: > Congrats Ben! > > Ian > > On Wednesday, October 26, 2022, Sutou Kouhei wrote: > >> On behalf of the Arrow PMC, I'm happy to announce that Ben Baumgold >> has accepted an invitation to become a committer on Apache >> Arrow. Welcome, and thank you for your contributions! >> >> kou >>
Re: [VOTE] Move issue tracking to GitHub Issues
+1 On Wed, Oct 26, 2022, at 20:01, Andy Grove wrote: > +1 > > On Wed, Oct 26, 2022 at 5:50 PM L. C. Hsieh wrote: > >> +1 >> >> >> >> On Wed, Oct 26, 2022 at 4:08 PM Raphael Taylor-Davies >> wrote: >> > >> > +1 >> > >> > On 27/10/2022 12:02, Neal Richardson wrote: >> > > I propose that we move issue tracking from the ASF's Jira to GitHub >> Issues. >> > > This has been discussed on [1] and [2] and there seems to be >> consensus. A >> > > number of Arrow subprojects already use GitHub Issues; this moves the >> issue >> > > tracking for `apache/arrow` into GitHub along with the source code. >> > > >> > > The vote will be open for at least 72 hours. >> > > >> > > [ ] +1 Leave ASF Jira and move to GitHub Issues >> > > [ ] +0 >> > > [ ] -1 Remain in Jira because... >> > > >> > > My vote: +1 >> > > >> > > Neal >> > > >> > > >> > > [1]: https://lists.apache.org/thread/l545m95xmf3w47oxwqxvg811or7b93tb >> > > [2]: https://lists.apache.org/thread/0vwj8gdo55jly5zn16wksrotyqqm0zqr >> > > >>
Re: [VOTE] Move issue tracking to GitHub Issues
+1 On Wed, Oct 26, 2022 at 5:50 PM L. C. Hsieh wrote: > +1 > > > > On Wed, Oct 26, 2022 at 4:08 PM Raphael Taylor-Davies > wrote: > > > > +1 > > > > On 27/10/2022 12:02, Neal Richardson wrote: > > > I propose that we move issue tracking from the ASF's Jira to GitHub > Issues. > > > This has been discussed on [1] and [2] and there seems to be > consensus. A > > > number of Arrow subprojects already use GitHub Issues; this moves the > issue > > > tracking for `apache/arrow` into GitHub along with the source code. > > > > > > The vote will be open for at least 72 hours. > > > > > > [ ] +1 Leave ASF Jira and move to GitHub Issues > > > [ ] +0 > > > [ ] -1 Remain in Jira because... > > > > > > My vote: +1 > > > > > > Neal > > > > > > > > > [1]: https://lists.apache.org/thread/l545m95xmf3w47oxwqxvg811or7b93tb > > > [2]: https://lists.apache.org/thread/0vwj8gdo55jly5zn16wksrotyqqm0zqr > > > >
Re: [VOTE] Move issue tracking to GitHub Issues
+1 On Wed, Oct 26, 2022 at 4:08 PM Raphael Taylor-Davies wrote: > > +1 > > On 27/10/2022 12:02, Neal Richardson wrote: > > I propose that we move issue tracking from the ASF's Jira to GitHub Issues. > > This has been discussed on [1] and [2] and there seems to be consensus. A > > number of Arrow subprojects already use GitHub Issues; this moves the issue > > tracking for `apache/arrow` into GitHub along with the source code. > > > > The vote will be open for at least 72 hours. > > > > [ ] +1 Leave ASF Jira and move to GitHub Issues > > [ ] +0 > > [ ] -1 Remain in Jira because... > > > > My vote: +1 > > > > Neal > > > > > > [1]: https://lists.apache.org/thread/l545m95xmf3w47oxwqxvg811or7b93tb > > [2]: https://lists.apache.org/thread/0vwj8gdo55jly5zn16wksrotyqqm0zqr > >
Re: [VOTE] Move issue tracking to GitHub Issues
+1 On 27/10/2022 12:02, Neal Richardson wrote: I propose that we move issue tracking from the ASF's Jira to GitHub Issues. This has been discussed on [1] and [2] and there seems to be consensus. A number of Arrow subprojects already use GitHub Issues; this moves the issue tracking for `apache/arrow` into GitHub along with the source code. The vote will be open for at least 72 hours. [ ] +1 Leave ASF Jira and move to GitHub Issues [ ] +0 [ ] -1 Remain in Jira because... My vote: +1 Neal [1]: https://lists.apache.org/thread/l545m95xmf3w47oxwqxvg811or7b93tb [2]: https://lists.apache.org/thread/0vwj8gdo55jly5zn16wksrotyqqm0zqr
[VOTE] Move issue tracking to GitHub Issues
I propose that we move issue tracking from the ASF's Jira to GitHub Issues. This has been discussed on [1] and [2] and there seems to be consensus. A number of Arrow subprojects already use GitHub Issues; this moves the issue tracking for `apache/arrow` into GitHub along with the source code. The vote will be open for at least 72 hours. [ ] +1 Leave ASF Jira and move to GitHub Issues [ ] +0 [ ] -1 Remain in Jira because... My vote: +1 Neal [1]: https://lists.apache.org/thread/l545m95xmf3w47oxwqxvg811or7b93tb [2]: https://lists.apache.org/thread/0vwj8gdo55jly5zn16wksrotyqqm0zqr
Re: [ANNOUNCE] New Arrow committer: Ben Baumgold
Congrats Ben! Ian On Wednesday, October 26, 2022, Sutou Kouhei wrote: > On behalf of the Arrow PMC, I'm happy to announce that Ben Baumgold > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > kou >
Re: [ANNOUNCE] New Arrow committer: Eric Patrick Hanson
Congrats Eric! Ian On Wednesday, October 26, 2022, Sutou Kouhei wrote: > On behalf of the Arrow PMC, I'm happy to announce that Eric Patrick Hanson > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > kou >
Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane
Congrats Nic! Ian On Tuesday, October 25, 2022, Sutou Kouhei wrote: > The Project Management Committee (PMC) for Apache Arrow has invited > Nicola Crane to become a PMC member and we are pleased to announce > that Nicola Crane has accepted. > > Congratulations and welcome! >
Re: [ANNOUNCE] New Arrow PMC member: Jacob Quinn
Congrats Jacob! Ian On Tuesday, October 25, 2022, Sutou Kouhei wrote: > The Project Management Committee (PMC) for Apache Arrow has invited > Jacob Quinn to become a PMC member and we are pleased to announce > that Jacob Quinn has accepted. > > Congratulations and welcome! >
Re: [ANNOUNCE] New Arrow committer: Bogumił Kamiński
Congrats Bogumił! Ian On Tuesday, October 25, 2022, Sutou Kouhei wrote: > Hi, > > On behalf of the Arrow PMC, I'm happy to announce that Bogumił Kamiński > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > Thanks, > -- > kou >
[ANNOUNCE] New Arrow committer: Ben Baumgold
On behalf of the Arrow PMC, I'm happy to announce that Ben Baumgold has accepted an invitation to become a committer on Apache Arrow. Welcome, and thank you for your contributions! kou
[ANNOUNCE] New Arrow committer: Eric Patrick Hanson
On behalf of the Arrow PMC, I'm happy to announce that Eric Patrick Hanson has accepted an invitation to become a committer on Apache Arrow. Welcome, and thank you for your contributions! kou
RE: pyarrow.parquet.write_to_dataset - Seeking an help in addressing some customer request
I couldn't find anything in the docs, but you could just append a duplicate
set of column values to the table before calling write_to_dataset().
>>> for column in partitionCols:
... table = table.append_column(column + '_new', table[column])
...
>>> table
pyarrow.Table
animals: string
animals_new: string
animals: [["Flamingo"]]
animals_new: [["Flamingo"]]
-Original Message-
From: Mahesha Nayak
Sent: Wednesday, October 26, 2022 1:00 PM
To: dev@arrow.apache.org
Subject: pyarrow.parquet.write_to_dataset - Seeking an help in addressing some
customer request
External Email: Use caution with links and attachments
Hello Team,
I'm glad that I would be connecting with people who are helping in 'pyarrow'
usages.
my question is below snippet creating datafiles in s3 with partition keys
however partition columns are not part of datafiles hence is there any way we
can add the partition column in the datafiles so that customer query the
datafile will see the data for all columns + partition column.
kindly help me. onthis.
"targetKey = self.s3BucketName + '/' + outputDirectory + targetDirectory[:-1]
log.debug("Single or Multiple Partition columns being passed.",partitionCols
,[partitionCols], targetKey) pq.write_to_dataset(table=table,
root_path=targetKey, row_group_size=self.
chunkSizeLimit, partition_cols=[partitionCols], filesystem=s3, compression=
'snappy',partition_filename_cb=lambda x:'-'.join(str(x))+'.parquet')
--
Regards,
Mahesha S
Cell:8015127140
This message may contain information that is confidential or privileged. If you
are not the intended recipient, please advise the sender immediately and delete
this message. See
http://www.blackrock.com/corporate/compliance/email-disclaimers for further
information. Please refer to
http://www.blackrock.com/corporate/compliance/privacy-policy for more
information about BlackRock’s Privacy Policy.
For a list of BlackRock's office addresses worldwide, see
http://www.blackrock.com/corporate/about-us/contacts-locations.
© 2022 BlackRock, Inc. All rights reserved.
[RESULT][VOTE][Julia] Release Apache Arrow Julia 2.4.0 RC1
Hi, The vote carries with 3 +1 binding votes and 2 +1 non-binding votes. I'll publish this release to https://dist.apache.org/repos/dist/release/arrow/ . Thanks, -- kou In <20221026.055226.202954124253405503@clear-code.com> "[VOTE][Julia] Release Apache Arrow Julia 2.4.0 RC1" on Wed, 26 Oct 2022 05:52:26 +0900 (JST), Sutou Kouhei wrote: > Hi, > > I would like to propose the following release candidate (RC1) of > Apache Arrow Julia version 2.4.0. > > This release candidate is based on commit: > 571a8fcf6866956d6a47390769e765d1ed0782c7 [1] > > The source release rc1 is hosted at [2]. > > Please download, verify checksums and signatures, run the unit tests, > and vote on the release. See [3] for how to validate a release candidate. > > The vote will be open for at least 24 hours. > > [ ] +1 Release this as Apache Arrow Julia 2.4.0 > [ ] +0 > [ ] -1 Do not release this as Apache Arrow Julia 2.4.0 because... > > [1]: > https://github.com/apache/arrow-julia/tree/571a8fcf6866956d6a47390769e765d1ed0782c7 > [2]: > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-julia-2.4.0-rc1/ > [3]: > https://github.com/apache/arrow-julia/blob/main/dev/release/README.md#verify
[RESULT][VOTE][RUST][Ballista] Release Apache Arrow Ballista 0.9.0 RC2
With four binding +1 votes, the vote passes. Thank you to everyone who contributed to this release and helped with the release verification process. I will release the artifacts this evening. Thanks, Andy. On Mon, Oct 24, 2022 at 7:49 PM L. C. Hsieh wrote: > +1 (binding) > > Thanks Andy! > > > On Mon, Oct 24, 2022 at 4:54 PM Andy Grove wrote: > > > > Thanks for the feedback. Perhaps a better approach would be to create > some > > documentation in the repo with recommendations for verifying a release > and > > leave the automated script to just run "cargo test". > > > > On Mon, Oct 24, 2022 at 2:11 PM Andrew Lamb > wrote: > > > > > +1 > > > > > > The verification process was very heavy weight (running TPCH, etc) and > I > > > didn't let it complete. -- I wonder if we really need to run the full > test > > > suites as part of doing so > > > > > > Finished release [optimized] target(s) in 27m 55s > > > > > > The changelog shows a very impressive list of features. Well done > > > > > > Andrew > > > > > > On Mon, Oct 24, 2022 at 2:11 AM Daniël Heres > > > wrote: > > > > > > > +1 (binding) > > > > > > > > Thanks for this exciting release! > > > > > > > > Best regards, > > > > > > > > Daniël Heres > > > > > > > > Op zo 23 okt. 2022 om 22:06 schreef Andy Grove < > andygrov...@gmail.com>: > > > > > > > > > Hi, > > > > > > > > > > I would like to propose a release of Apache Arrow Ballista > > > > Implementation, > > > > > version 0.9.0. > > > > > > > > > > This release candidate is based on commit: > > > > > 018b542716de13838ad1e2f803d38e47355183af [1] > > > > > The proposed release tarball and signatures are hosted at [2]. > > > > > The changelog is located at [3]. > > > > > > > > > > Please download, verify checksums and signatures, run the unit > tests, > > > and > > > > > vote > > > > > on the release. The vote will be open for at least 72 hours. > > > > > > > > > > Only votes from PMC members are binding, but all members of the > > > community > > > > > are > > > > > encouraged to test the release and vote with "(non-binding)". > > > > > > > > > > The standard verification procedure is documented at > > > > > > > > > > > > > > > > > > https://github.com/apache/arrow-ballista/blob/master/dev/release/README.md#verifying-release-candidates > > > > > . > > > > > > > > > > [ ] +1 Release this as Apache Arrow Ballista 0.9.0 > > > > > [ ] +0 > > > > > [ ] -1 Do not release this as Apache Arrow Ballista 0.9.0 > because... > > > > > > > > > > *NOTES:* > > > > > *- This is rc1 because I ran into an issue with rc1* > > > > > *- The verification test will run integration tests and requires > Docker > > > > > Compose version 3.3 or later to be installed* > > > > > > > > > > [1]: > > > > > > > > > > > > > > > > > > https://github.com/apache/arrow-ballista/tree/018b542716de13838ad1e2f803d38e47355183af > > > > > [2]: > > > > > > > > > > > > > > > > > > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-ballista-0.9.0-rc2 > > > > > [3]: > > > > > > > > > > > > > > > > > > https://github.com/apache/arrow-ballista/blob/018b542716de13838ad1e2f803d38e47355183af/CHANGELOG.md > > > > > > > > > > > > > > > > > -- > > > > Daniël Heres > > > > > > > >
pyarrow.parquet.write_to_dataset - Seeking an help in addressing some customer request
Hello Team,
I'm glad that I would be connecting with people who are helping in
'pyarrow' usages.
my question is below snippet creating datafiles in s3 with partition keys
however partition columns are not part of datafiles hence is there any way
we can add the partition column in the datafiles so that customer query the
datafile will see the data for all columns + partition column.
kindly help me. onthis.
"targetKey = self.s3BucketName + '/' + outputDirectory + targetDirectory[:-1]
log.debug("Single or Multiple Partition columns being passed.",partitionCols
,[partitionCols], targetKey)
pq.write_to_dataset(table=table, root_path=targetKey, row_group_size=self.
chunkSizeLimit, partition_cols=[partitionCols], filesystem=s3, compression=
'snappy',partition_filename_cb=lambda x:'-'.join(str(x))+'.parquet')
--
Regards,
Mahesha S
Cell:8015127140
Re: [DISCUSS] Move issue tracking to
I updated this user mapping list to include both the "key" and "name" fields for each Jira account. These fields sometimes do not match, and the "key" field sometimes contains unfriendly values like JIRAUSER123456. To follow further discussion about this, please see https://github.com/apache/arrow/issues/14510 Ian On Wed, Oct 26, 2022 at 1:30 PM Ian Cook wrote: > > Todd said: > >User identifiers differ between systems... > > To help with this, I created a couple of small scripts [1] that > extract details from resolved Arrow Jira issues and the associated > merged GitHub PRs, then perform some cleaning, to generate a list [2] > of matching Jira user identifiers and GitHub user identifiers. > > This is an incomplete list: it does not include users who have created > Arrow Jira issues but never created an Arrow PR that was merged. > > Please do some sanity-checking on this list before using it. > > [1] https://gist.github.com/ianmcook/0f1538ebc8268a88cd4e0a0a61445287 > [2] > https://docs.google.com/spreadsheets/d/1C8Pxmad93TJjIeN1lX9wkw1KORKocNSLYtUUPlxHmG0/ > > Ian > > On Wed, Oct 26, 2022 at 8:12 AM Neal Richardson > wrote: > > > > Thanks Todd! That's really helpful. > > > > Neal > > > > On Tue, Oct 25, 2022 at 7:47 PM Todd Farmer > > wrote: > > > > > I'm beginning to track decisions needing to be made and problems needing > > > to > > > be solved in the Arrow project GitHub issues, prefixing all such issues > > > with "MIGRATION: ..". They can be found here: > > > > > > https://github.com/apache/arrow/issues?q=is%3Aissue+is%3Aopen+MIGRATION > > > > > > I feel this will be a better forum to talk through specific challenges or > > > decisions if a future vote supports migration to GitHub issues. Please > > > feel free to comment or to create an issue to track a decision/concern > > > that's not already defined. > > > > > > On Tue, Oct 25, 2022 at 6:37 AM Neal Richardson < > > > neal.p.richard...@gmail.com> > > > wrote: > > > > > > > I'll start a vote on this in the next day or so since it seems like we > > > have > > > > consensus on the main issue (moving from Jira to GitHub Issues) and are > > > > working out the finer points on how we'll migrate and how we'll map Jira > > > > concepts to Issues. > > > > > > > > Speaking of the migration: now would be an *excellent* time for folks to > > > go > > > > through the Jira backlog and close out some old, stale, invalid issues > > > > so > > > > that we don't have to import a bunch of stuff we don't need. > > > > > > > > Neal > > > > > > > > > > > > On Tue, Oct 25, 2022 at 5:33 AM Alessandro Molina > > > > wrote: > > > > > > > > > On Tue, Oct 25, 2022 at 1:55 AM Joris Van den Bossche < > > > > > jorisvandenboss...@gmail.com> wrote: > > > > > > > > > > > > > > > > > I think the main thing we will miss are the Links (relation between > > > > > > issues), but we can try to promote some consistent usage of adding > > > > > > "Duplicate of #...", "Related to #..." in top post of an issue when > > > > > > appropriate. > > > > > > > > > > > > > > > > If we plan to migrate to GitHub, I think we should add an Issue > > > Template > > > > ( > > > > > > > > > > > > > > > > > https://docs.github.com/en/communities/using-templates-to-encourage-useful-issues-and-pull-requests/configuring-issue-templates-for-your-repository > > > > > ) to make sure we don't proliferate too many ways to do the same thing > > > in > > > > > terms of categorizing issues properly > > > > > > > > > > > >
RE: Apache Arrow filesystem question
Or this.. https://arrow.apache.org/docs/python/filesystems.html#using-fsspec-compatible-filesystems-with-arrow import adlfs # ... load your credentials and configure the filesystem fs = adlfs.AzureBlobFileSystem(account_name=account_name, account_key=account_key) -Original Message- From: Lee, David Sent: Wednesday, October 26, 2022 11:04 AM To: dev@arrow.apache.org Subject: RE: Apache Arrow filesystem question There are fsspec implementations to support other filesystems. https://pypi.org/project/pyarrowfs-adlgen2/ -Original Message- From: Jerry Adair Sent: Wednesday, October 26, 2022 10:59 AM To: dev@arrow.apache.org Subject: RE: Apache Arrow filesystem question External Email: Use caution with links and attachments Hi- I am curious about the Apache Arrow filesystem support. I noticed that there are classes for S3 and GCS. I am currently using those classes to read/write from/to those cloud storage options. However I noticed that there is no class for Azure (ADLS). And so I am curious why that is? Does anyone know? Thanks! Jerry This message may contain information that is confidential or privileged. If you are not the intended recipient, please advise the sender immediately and delete this message. See http://www.blackrock.com/corporate/compliance/email-disclaimers for further information. Please refer to http://www.blackrock.com/corporate/compliance/privacy-policy for more information about BlackRock’s Privacy Policy. For a list of BlackRock's office addresses worldwide, see http://www.blackrock.com/corporate/about-us/contacts-locations. © 2022 BlackRock, Inc. All rights reserved.
Re: Apache Arrow filesystem question
The azure implementation is underway but did not make it into 10.0.0: https://issues.apache.org/jira/browse/ARROW-2034 On Wed, Oct 26, 2022 at 7:59 PM Jerry Adair wrote: > Hi- > > I am curious about the Apache Arrow filesystem support. I noticed that > there are classes for S3 and GCS. I am currently using those classes to > read/write from/to those cloud storage options. However I noticed that > there is no class for Azure (ADLS). And so I am curious why that is? Does > anyone know? > > Thanks! > Jerry >
RE: Apache Arrow filesystem question
There are fsspec implementations to support other filesystems. https://pypi.org/project/pyarrowfs-adlgen2/ -Original Message- From: Jerry Adair Sent: Wednesday, October 26, 2022 10:59 AM To: dev@arrow.apache.org Subject: RE: Apache Arrow filesystem question External Email: Use caution with links and attachments Hi- I am curious about the Apache Arrow filesystem support. I noticed that there are classes for S3 and GCS. I am currently using those classes to read/write from/to those cloud storage options. However I noticed that there is no class for Azure (ADLS). And so I am curious why that is? Does anyone know? Thanks! Jerry This message may contain information that is confidential or privileged. If you are not the intended recipient, please advise the sender immediately and delete this message. See http://www.blackrock.com/corporate/compliance/email-disclaimers for further information. Please refer to http://www.blackrock.com/corporate/compliance/privacy-policy for more information about BlackRock’s Privacy Policy. For a list of BlackRock's office addresses worldwide, see http://www.blackrock.com/corporate/about-us/contacts-locations. © 2022 BlackRock, Inc. All rights reserved.
RE: Apache Arrow filesystem question
Hi- I am curious about the Apache Arrow filesystem support. I noticed that there are classes for S3 and GCS. I am currently using those classes to read/write from/to those cloud storage options. However I noticed that there is no class for Azure (ADLS). And so I am curious why that is? Does anyone know? Thanks! Jerry
Re: [ANNOUNCE] New Arrow PMC member: Jacob Quinn
Congratulations! On Wed, 26 Oct 2022 at 19:25, Weston Pace wrote: > > Congrats Jacob! > > On Wed, Oct 26, 2022 at 6:10 AM Jacob Wujciak > wrote: > > > > Congrats! > > > > On Wed, Oct 26, 2022 at 8:31 AM Alenka Frim > > wrote: > > > > > Congratulations! > > > > > > On Wed, Oct 26, 2022 at 7:54 AM Daniël Heres > > > wrote: > > > > > > > Congratulations! > > > > > > > > On Wed, Oct 26, 2022, 07:50 Benson Muite > > > > wrote: > > > > > > > > > Congratulations Jacob! > > > > > On 10/26/22 04:12, Vibhatha Abeykoon wrote: > > > > > > Congratulations Jacob! > > > > > > > > > > > > On Wed, Oct 26, 2022 at 4:23 AM Rok Mihevc > > > > wrote: > > > > > > > > > > > >> Congratulations Jacob! > > > > > >> > > > > > >> Rok > > > > > >> > > > > > >> On Tue, Oct 25, 2022 at 11:15 PM David Li > > > > wrote: > > > > > >> > > > > > >>> Congrats Jacob!! > > > > > >>> > > > > > >>> On Tue, Oct 25, 2022, at 17:06, Sutou Kouhei wrote: > > > > > The Project Management Committee (PMC) for Apache Arrow has > > > invited > > > > > Jacob Quinn to become a PMC member and we are pleased to announce > > > > > that Jacob Quinn has accepted. > > > > > > > > > > Congratulations and welcome! > > > > > >>> > > > > > >> > > > > > > > > > > > > > > > > >
Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane
Congratulations Nic! ;) On Wed, 26 Oct 2022 at 19:26, Weston Pace wrote: > > Thanks Nic and congratulations! > > On Wed, Oct 26, 2022 at 8:28 AM Raúl Cumplido wrote: > > > > Thanks Nic for your contributions! > > > > El mié, 26 oct 2022 a las 17:17, Antoine Pitrou () > > escribió: > > > > > > > > Welcome, Nic! > > > > > > > > > Le 26/10/2022 à 16:37, Dewey Dunnington a écrit : > > > > Congrats, Nic! > > > > > > > > On Wed, Oct 26, 2022 at 10:10 AM Jacob Wujciak > > > > wrote: > > > > > > > >> Congratulations! 🎉 > > > >> > > > >> On Wed, Oct 26, 2022 at 3:04 PM Larry White wrote: > > > >> > > > >>> Congratulations, Nic! > > > >>> > > > >>> On Wed, Oct 26, 2022 at 2:31 AM Alenka Frim > > >>> .invalid> > > > >>> wrote: > > > >>> > > > 🎉 Congratulations Nic! Well deserved!! > > > > > > On Wed, Oct 26, 2022 at 7:54 AM Daniël Heres > > > wrote: > > > > > > > Congratulations! > > > > > > > > On Wed, Oct 26, 2022, 07:50 Benson Muite > > >>> > > > > wrote: > > > > > > > >> Congratulations Nic! > > > >> On 10/26/22 04:11, Vibhatha Abeykoon wrote: > > > >>> Congrats Nic! > > > >>> > > > >>> On Wed, Oct 26, 2022 at 5:30 AM Ashish > > > > wrote: > > > >>> > > > Congrats ! > > > > > > On Wednesday, October 26, 2022, Anja > > > >>> wrote: > > > > > > > Congrats!! > > > > > > > > On Tue, 25 Oct 2022 at 15:45, Rok Mihevc > > >>> > > > > wrote: > > > > > > > >> Congrats Nic! > > > >> > > > >> Rok > > > >> > > > >> On Tue, Oct 25, 2022 at 11:16 PM Will Jones < > > > > will.jones...@gmail.com> > > > >> wrote: > > > >> > > > >>> Congrats Nic! > > > >>> > > > >>> On Tue, Oct 25, 2022 at 2:14 PM David Li < > > > >> lidav...@apache.org> > > > wrote: > > > >>> > > > Congrats & welcome Nic! > > > > > > On Tue, Oct 25, 2022, at 17:07, Matt Topol wrote: > > > > Congrats!! > > > > > > > > On Tue, Oct 25, 2022 at 5:06 PM Sutou Kouhei < > > > k...@clear-code.com > > > > > > > >>> wrote: > > > > > > > >> The Project Management Committee (PMC) for Apache Arrow > > > >> has > > > > invited > > > >> Nicola Crane to become a PMC member and we are pleased to > > > announce > > > >> that Nicola Crane has accepted. > > > >> > > > >> Congratulations and welcome! > > > >> > > > > > > >>> > > > >> > > > > > > > > > > > > > -- > > > thanks > > > ashish > > > > > > >> > > > >> > > > > > > > > > > >>> > > > >> > > > > > > >
Re: [DISCUSS] Move issue tracking to
Todd said: >User identifiers differ between systems... To help with this, I created a couple of small scripts [1] that extract details from resolved Arrow Jira issues and the associated merged GitHub PRs, then perform some cleaning, to generate a list [2] of matching Jira user identifiers and GitHub user identifiers. This is an incomplete list: it does not include users who have created Arrow Jira issues but never created an Arrow PR that was merged. Please do some sanity-checking on this list before using it. [1] https://gist.github.com/ianmcook/0f1538ebc8268a88cd4e0a0a61445287 [2] https://docs.google.com/spreadsheets/d/1C8Pxmad93TJjIeN1lX9wkw1KORKocNSLYtUUPlxHmG0/ Ian On Wed, Oct 26, 2022 at 8:12 AM Neal Richardson wrote: > > Thanks Todd! That's really helpful. > > Neal > > On Tue, Oct 25, 2022 at 7:47 PM Todd Farmer > wrote: > > > I'm beginning to track decisions needing to be made and problems needing to > > be solved in the Arrow project GitHub issues, prefixing all such issues > > with "MIGRATION: ..". They can be found here: > > > > https://github.com/apache/arrow/issues?q=is%3Aissue+is%3Aopen+MIGRATION > > > > I feel this will be a better forum to talk through specific challenges or > > decisions if a future vote supports migration to GitHub issues. Please > > feel free to comment or to create an issue to track a decision/concern > > that's not already defined. > > > > On Tue, Oct 25, 2022 at 6:37 AM Neal Richardson < > > neal.p.richard...@gmail.com> > > wrote: > > > > > I'll start a vote on this in the next day or so since it seems like we > > have > > > consensus on the main issue (moving from Jira to GitHub Issues) and are > > > working out the finer points on how we'll migrate and how we'll map Jira > > > concepts to Issues. > > > > > > Speaking of the migration: now would be an *excellent* time for folks to > > go > > > through the Jira backlog and close out some old, stale, invalid issues so > > > that we don't have to import a bunch of stuff we don't need. > > > > > > Neal > > > > > > > > > On Tue, Oct 25, 2022 at 5:33 AM Alessandro Molina > > > wrote: > > > > > > > On Tue, Oct 25, 2022 at 1:55 AM Joris Van den Bossche < > > > > jorisvandenboss...@gmail.com> wrote: > > > > > > > > > > > > > > I think the main thing we will miss are the Links (relation between > > > > > issues), but we can try to promote some consistent usage of adding > > > > > "Duplicate of #...", "Related to #..." in top post of an issue when > > > > > appropriate. > > > > > > > > > > > > > If we plan to migrate to GitHub, I think we should add an Issue > > Template > > > ( > > > > > > > > > > > > > https://docs.github.com/en/communities/using-templates-to-encourage-useful-issues-and-pull-requests/configuring-issue-templates-for-your-repository > > > > ) to make sure we don't proliferate too many ways to do the same thing > > in > > > > terms of categorizing issues properly > > > > > > > > >
Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane
Thanks Nic and congratulations! On Wed, Oct 26, 2022 at 8:28 AM Raúl Cumplido wrote: > > Thanks Nic for your contributions! > > El mié, 26 oct 2022 a las 17:17, Antoine Pitrou () > escribió: > > > > > Welcome, Nic! > > > > > > Le 26/10/2022 à 16:37, Dewey Dunnington a écrit : > > > Congrats, Nic! > > > > > > On Wed, Oct 26, 2022 at 10:10 AM Jacob Wujciak > > > wrote: > > > > > >> Congratulations! 🎉 > > >> > > >> On Wed, Oct 26, 2022 at 3:04 PM Larry White wrote: > > >> > > >>> Congratulations, Nic! > > >>> > > >>> On Wed, Oct 26, 2022 at 2:31 AM Alenka Frim > >>> .invalid> > > >>> wrote: > > >>> > > 🎉 Congratulations Nic! Well deserved!! > > > > On Wed, Oct 26, 2022 at 7:54 AM Daniël Heres > > wrote: > > > > > Congratulations! > > > > > > On Wed, Oct 26, 2022, 07:50 Benson Muite > >>> > > > wrote: > > > > > >> Congratulations Nic! > > >> On 10/26/22 04:11, Vibhatha Abeykoon wrote: > > >>> Congrats Nic! > > >>> > > >>> On Wed, Oct 26, 2022 at 5:30 AM Ashish > > > wrote: > > >>> > > Congrats ! > > > > On Wednesday, October 26, 2022, Anja > > >>> wrote: > > > > > Congrats!! > > > > > > On Tue, 25 Oct 2022 at 15:45, Rok Mihevc > >>> > > > wrote: > > > > > >> Congrats Nic! > > >> > > >> Rok > > >> > > >> On Tue, Oct 25, 2022 at 11:16 PM Will Jones < > > > will.jones...@gmail.com> > > >> wrote: > > >> > > >>> Congrats Nic! > > >>> > > >>> On Tue, Oct 25, 2022 at 2:14 PM David Li < > > >> lidav...@apache.org> > > wrote: > > >>> > > Congrats & welcome Nic! > > > > On Tue, Oct 25, 2022, at 17:07, Matt Topol wrote: > > > Congrats!! > > > > > > On Tue, Oct 25, 2022 at 5:06 PM Sutou Kouhei < > > k...@clear-code.com > > > > > >>> wrote: > > > > > >> The Project Management Committee (PMC) for Apache Arrow > > >> has > > > invited > > >> Nicola Crane to become a PMC member and we are pleased to > > announce > > >> that Nicola Crane has accepted. > > >> > > >> Congratulations and welcome! > > >> > > > > >>> > > >> > > > > > > > > > -- > > thanks > > ashish > > > > >> > > >> > > > > > > > >>> > > >> > > > > >
Re: [ANNOUNCE] New Arrow PMC member: Jacob Quinn
Congrats Jacob! On Wed, Oct 26, 2022 at 6:10 AM Jacob Wujciak wrote: > > Congrats! > > On Wed, Oct 26, 2022 at 8:31 AM Alenka Frim > wrote: > > > Congratulations! > > > > On Wed, Oct 26, 2022 at 7:54 AM Daniël Heres > > wrote: > > > > > Congratulations! > > > > > > On Wed, Oct 26, 2022, 07:50 Benson Muite > > > wrote: > > > > > > > Congratulations Jacob! > > > > On 10/26/22 04:12, Vibhatha Abeykoon wrote: > > > > > Congratulations Jacob! > > > > > > > > > > On Wed, Oct 26, 2022 at 4:23 AM Rok Mihevc > > > wrote: > > > > > > > > > >> Congratulations Jacob! > > > > >> > > > > >> Rok > > > > >> > > > > >> On Tue, Oct 25, 2022 at 11:15 PM David Li > > > wrote: > > > > >> > > > > >>> Congrats Jacob!! > > > > >>> > > > > >>> On Tue, Oct 25, 2022, at 17:06, Sutou Kouhei wrote: > > > > The Project Management Committee (PMC) for Apache Arrow has > > invited > > > > Jacob Quinn to become a PMC member and we are pleased to announce > > > > that Jacob Quinn has accepted. > > > > > > > > Congratulations and welcome! > > > > >>> > > > > >> > > > > > > > > > > > > >
Re: [ANNOUNCE] New Arrow committer: Bogumił Kamiński
Congratulations Bogumił. On Wed, Oct 26, 2022 at 6:10 AM Jacob Wujciak wrote: > > Congrats! > > On Wed, Oct 26, 2022 at 8:31 AM Alenka Frim > wrote: > > > Congratulations! > > > > On Wed, Oct 26, 2022 at 7:55 AM Daniël Heres > > wrote: > > > > > Congratulations! > > > > > > On Wed, Oct 26, 2022, 07:50 Benson Muite > > > wrote: > > > > > > > Congratulations Bogumił! > > > > On 10/26/22 04:13, Vibhatha Abeykoon wrote: > > > > > Congrats Bogumił! > > > > > > > > > > On Wed, Oct 26, 2022 at 4:24 AM Rok Mihevc > > > wrote: > > > > > > > > > >> Congrats Bogumił! > > > > >> > > > > >> Rok > > > > >> > > > > >> On Tue, Oct 25, 2022 at 11:15 PM David Li > > > wrote: > > > > >> > > > > >>> Welcome Bogumił! > > > > >>> > > > > >>> On Tue, Oct 25, 2022, at 17:05, Sutou Kouhei wrote: > > > > Hi, > > > > > > > > On behalf of the Arrow PMC, I'm happy to announce that Bogumił > > > > Kamiński > > > > has accepted an invitation to become a committer on Apache > > > > Arrow. Welcome, and thank you for your contributions! > > > > > > > > Thanks, > > > > -- > > > > kou > > > > >>> > > > > >> > > > > > > > > > > > > >
Re: [VOTE][Julia] Release Apache Arrow Julia 2.4.0 RC1
+1 non binding, Rocky linux 9 $ dev/release/verify_rc.sh 2.4.0 1 and also Cent OS 7 (Signature verification fails due to older libraries) $ VERIFY_SIGN=0 dev/release/verify_rc.sh 2.4.0 1
Re: Arrow sync call October 26 at 12:00 US/Eastern, 16:00 UTC
Attendees: Vibhatha Abeykoon Raúl Cumplido James Duong Sean Gallagher Ian Joiner Will Jones David Li Antoine Pitrou Neal Richardson Matt Topol Jacob Wujciak Discussion: Release 10.0.0: it's done, and it seemed to go smoothly. Kudos to all who have been working to make releases easier! * But since Python 3.11 happened, we'll need to follow up to build wheels for that. Discussion to follow on the ML * Also need to wrap up the release blog post CI runner with CUDA now available. Some discussion of which jobs should be set to run on it, tests we can add that would run there (e.g. Flight with UCX) JIRA to GitHub Issue migration: see mailing list discussion and GitHub Issues about migration * need to map out all of the work, in addition to the migration itself: like asking INFRA to disable new Jira issues, updating release and merge scripts, updating contributor guides, etc. On Wed, Oct 26, 2022 at 9:12 AM Ian Cook wrote: > Hi all, > > Our biweekly sync call is today at 12:00 noon Eastern time. > > The Zoom meeting URL for this and other biweekly Arrow sync calls is: > https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 > > Alternatively, enter this information into the Zoom website or app to > join the call: > Meeting ID: 876 4903 3008 > Passcode: 958092 > > Thanks, > Ian >
Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane
Thanks Nic for your contributions! El mié, 26 oct 2022 a las 17:17, Antoine Pitrou () escribió: > > Welcome, Nic! > > > Le 26/10/2022 à 16:37, Dewey Dunnington a écrit : > > Congrats, Nic! > > > > On Wed, Oct 26, 2022 at 10:10 AM Jacob Wujciak > > wrote: > > > >> Congratulations! 🎉 > >> > >> On Wed, Oct 26, 2022 at 3:04 PM Larry White wrote: > >> > >>> Congratulations, Nic! > >>> > >>> On Wed, Oct 26, 2022 at 2:31 AM Alenka Frim >>> .invalid> > >>> wrote: > >>> > 🎉 Congratulations Nic! Well deserved!! > > On Wed, Oct 26, 2022 at 7:54 AM Daniël Heres > wrote: > > > Congratulations! > > > > On Wed, Oct 26, 2022, 07:50 Benson Muite >>> > > wrote: > > > >> Congratulations Nic! > >> On 10/26/22 04:11, Vibhatha Abeykoon wrote: > >>> Congrats Nic! > >>> > >>> On Wed, Oct 26, 2022 at 5:30 AM Ashish > > wrote: > >>> > Congrats ! > > On Wednesday, October 26, 2022, Anja > >>> wrote: > > > Congrats!! > > > > On Tue, 25 Oct 2022 at 15:45, Rok Mihevc >>> > > wrote: > > > >> Congrats Nic! > >> > >> Rok > >> > >> On Tue, Oct 25, 2022 at 11:16 PM Will Jones < > > will.jones...@gmail.com> > >> wrote: > >> > >>> Congrats Nic! > >>> > >>> On Tue, Oct 25, 2022 at 2:14 PM David Li < > >> lidav...@apache.org> > wrote: > >>> > Congrats & welcome Nic! > > On Tue, Oct 25, 2022, at 17:07, Matt Topol wrote: > > Congrats!! > > > > On Tue, Oct 25, 2022 at 5:06 PM Sutou Kouhei < > k...@clear-code.com > > > >>> wrote: > > > >> The Project Management Committee (PMC) for Apache Arrow > >> has > > invited > >> Nicola Crane to become a PMC member and we are pleased to > announce > >> that Nicola Crane has accepted. > >> > >> Congratulations and welcome! > >> > > >>> > >> > > > > > -- > thanks > ashish > > >> > >> > > > > >>> > >> > > >
Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane
Welcome, Nic! Le 26/10/2022 à 16:37, Dewey Dunnington a écrit : Congrats, Nic! On Wed, Oct 26, 2022 at 10:10 AM Jacob Wujciak wrote: Congratulations! 🎉 On Wed, Oct 26, 2022 at 3:04 PM Larry White wrote: Congratulations, Nic! On Wed, Oct 26, 2022 at 2:31 AM Alenka Frim wrote: 🎉 Congratulations Nic! Well deserved!! On Wed, Oct 26, 2022 at 7:54 AM Daniël Heres wrote: Congratulations! On Wed, Oct 26, 2022, 07:50 Benson Muite wrote: Congratulations Nic! On 10/26/22 04:11, Vibhatha Abeykoon wrote: Congrats Nic! On Wed, Oct 26, 2022 at 5:30 AM Ashish wrote: Congrats ! On Wednesday, October 26, 2022, Anja wrote: Congrats!! On Tue, 25 Oct 2022 at 15:45, Rok Mihevc wrote: Congrats Nic! Rok On Tue, Oct 25, 2022 at 11:16 PM Will Jones < will.jones...@gmail.com> wrote: Congrats Nic! On Tue, Oct 25, 2022 at 2:14 PM David Li < lidav...@apache.org> wrote: Congrats & welcome Nic! On Tue, Oct 25, 2022, at 17:07, Matt Topol wrote: Congrats!! On Tue, Oct 25, 2022 at 5:06 PM Sutou Kouhei < k...@clear-code.com wrote: The Project Management Committee (PMC) for Apache Arrow has invited Nicola Crane to become a PMC member and we are pleased to announce that Nicola Crane has accepted. Congratulations and welcome! -- thanks ashish
Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane
Congrats, Nic! On Wed, Oct 26, 2022 at 10:10 AM Jacob Wujciak wrote: > Congratulations! 🎉 > > On Wed, Oct 26, 2022 at 3:04 PM Larry White wrote: > > > Congratulations, Nic! > > > > On Wed, Oct 26, 2022 at 2:31 AM Alenka Frim > .invalid> > > wrote: > > > > > 🎉 Congratulations Nic! Well deserved!! > > > > > > On Wed, Oct 26, 2022 at 7:54 AM Daniël Heres > > > wrote: > > > > > > > Congratulations! > > > > > > > > On Wed, Oct 26, 2022, 07:50 Benson Muite > > > > > wrote: > > > > > > > > > Congratulations Nic! > > > > > On 10/26/22 04:11, Vibhatha Abeykoon wrote: > > > > > > Congrats Nic! > > > > > > > > > > > > On Wed, Oct 26, 2022 at 5:30 AM Ashish > > > > wrote: > > > > > > > > > > > >> Congrats ! > > > > > >> > > > > > >> On Wednesday, October 26, 2022, Anja > > wrote: > > > > > >> > > > > > >>> Congrats!! > > > > > >>> > > > > > >>> On Tue, 25 Oct 2022 at 15:45, Rok Mihevc > > > > > wrote: > > > > > >>> > > > > > Congrats Nic! > > > > > > > > > > Rok > > > > > > > > > > On Tue, Oct 25, 2022 at 11:16 PM Will Jones < > > > > will.jones...@gmail.com> > > > > > wrote: > > > > > > > > > > > Congrats Nic! > > > > > > > > > > > > On Tue, Oct 25, 2022 at 2:14 PM David Li < > lidav...@apache.org> > > > > > >> wrote: > > > > > > > > > > > >> Congrats & welcome Nic! > > > > > >> > > > > > >> On Tue, Oct 25, 2022, at 17:07, Matt Topol wrote: > > > > > >>> Congrats!! > > > > > >>> > > > > > >>> On Tue, Oct 25, 2022 at 5:06 PM Sutou Kouhei < > > > k...@clear-code.com > > > > > >>> > > > > > > wrote: > > > > > >>> > > > > > The Project Management Committee (PMC) for Apache Arrow > has > > > > > >>> invited > > > > > Nicola Crane to become a PMC member and we are pleased to > > > > > >> announce > > > > > that Nicola Crane has accepted. > > > > > > > > > > Congratulations and welcome! > > > > > > > > > > >> > > > > > > > > > > > > > > > > >>> > > > > > >> > > > > > >> > > > > > >> -- > > > > > >> thanks > > > > > >> ashish > > > > > >> > > > > > > > > > > > > > > > > > > > >
Arrow sync call October 26 at 12:00 US/Eastern, 16:00 UTC
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meeting ID: 876 4903 3008 Passcode: 958092 Thanks, Ian
Re: [ANNOUNCE] New Arrow committer: Bogumił Kamiński
Congrats! On Wed, Oct 26, 2022 at 8:31 AM Alenka Frim wrote: > Congratulations! > > On Wed, Oct 26, 2022 at 7:55 AM Daniël Heres > wrote: > > > Congratulations! > > > > On Wed, Oct 26, 2022, 07:50 Benson Muite > > wrote: > > > > > Congratulations Bogumił! > > > On 10/26/22 04:13, Vibhatha Abeykoon wrote: > > > > Congrats Bogumił! > > > > > > > > On Wed, Oct 26, 2022 at 4:24 AM Rok Mihevc > > wrote: > > > > > > > >> Congrats Bogumił! > > > >> > > > >> Rok > > > >> > > > >> On Tue, Oct 25, 2022 at 11:15 PM David Li > > wrote: > > > >> > > > >>> Welcome Bogumił! > > > >>> > > > >>> On Tue, Oct 25, 2022, at 17:05, Sutou Kouhei wrote: > > > Hi, > > > > > > On behalf of the Arrow PMC, I'm happy to announce that Bogumił > > > Kamiński > > > has accepted an invitation to become a committer on Apache > > > Arrow. Welcome, and thank you for your contributions! > > > > > > Thanks, > > > -- > > > kou > > > >>> > > > >> > > > > > > > > >
Re: [ANNOUNCE] New Arrow PMC member: Jacob Quinn
Congrats! On Wed, Oct 26, 2022 at 8:31 AM Alenka Frim wrote: > Congratulations! > > On Wed, Oct 26, 2022 at 7:54 AM Daniël Heres > wrote: > > > Congratulations! > > > > On Wed, Oct 26, 2022, 07:50 Benson Muite > > wrote: > > > > > Congratulations Jacob! > > > On 10/26/22 04:12, Vibhatha Abeykoon wrote: > > > > Congratulations Jacob! > > > > > > > > On Wed, Oct 26, 2022 at 4:23 AM Rok Mihevc > > wrote: > > > > > > > >> Congratulations Jacob! > > > >> > > > >> Rok > > > >> > > > >> On Tue, Oct 25, 2022 at 11:15 PM David Li > > wrote: > > > >> > > > >>> Congrats Jacob!! > > > >>> > > > >>> On Tue, Oct 25, 2022, at 17:06, Sutou Kouhei wrote: > > > The Project Management Committee (PMC) for Apache Arrow has > invited > > > Jacob Quinn to become a PMC member and we are pleased to announce > > > that Jacob Quinn has accepted. > > > > > > Congratulations and welcome! > > > >>> > > > >> > > > > > > > > >
Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane
Congratulations! 🎉 On Wed, Oct 26, 2022 at 3:04 PM Larry White wrote: > Congratulations, Nic! > > On Wed, Oct 26, 2022 at 2:31 AM Alenka Frim .invalid> > wrote: > > > 🎉 Congratulations Nic! Well deserved!! > > > > On Wed, Oct 26, 2022 at 7:54 AM Daniël Heres > > wrote: > > > > > Congratulations! > > > > > > On Wed, Oct 26, 2022, 07:50 Benson Muite > > > wrote: > > > > > > > Congratulations Nic! > > > > On 10/26/22 04:11, Vibhatha Abeykoon wrote: > > > > > Congrats Nic! > > > > > > > > > > On Wed, Oct 26, 2022 at 5:30 AM Ashish > > > wrote: > > > > > > > > > >> Congrats ! > > > > >> > > > > >> On Wednesday, October 26, 2022, Anja > wrote: > > > > >> > > > > >>> Congrats!! > > > > >>> > > > > >>> On Tue, 25 Oct 2022 at 15:45, Rok Mihevc > > > wrote: > > > > >>> > > > > Congrats Nic! > > > > > > > > Rok > > > > > > > > On Tue, Oct 25, 2022 at 11:16 PM Will Jones < > > > will.jones...@gmail.com> > > > > wrote: > > > > > > > > > Congrats Nic! > > > > > > > > > > On Tue, Oct 25, 2022 at 2:14 PM David Li > > > > >> wrote: > > > > > > > > > >> Congrats & welcome Nic! > > > > >> > > > > >> On Tue, Oct 25, 2022, at 17:07, Matt Topol wrote: > > > > >>> Congrats!! > > > > >>> > > > > >>> On Tue, Oct 25, 2022 at 5:06 PM Sutou Kouhei < > > k...@clear-code.com > > > > >>> > > > > > wrote: > > > > >>> > > > > The Project Management Committee (PMC) for Apache Arrow has > > > > >>> invited > > > > Nicola Crane to become a PMC member and we are pleased to > > > > >> announce > > > > that Nicola Crane has accepted. > > > > > > > > Congratulations and welcome! > > > > > > > > >> > > > > > > > > > > > > > >>> > > > > >> > > > > >> > > > > >> -- > > > > >> thanks > > > > >> ashish > > > > >> > > > > > > > > > > > > > >
Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane
Congratulations, Nic! On Wed, Oct 26, 2022 at 2:31 AM Alenka Frim wrote: > 🎉 Congratulations Nic! Well deserved!! > > On Wed, Oct 26, 2022 at 7:54 AM Daniël Heres > wrote: > > > Congratulations! > > > > On Wed, Oct 26, 2022, 07:50 Benson Muite > > wrote: > > > > > Congratulations Nic! > > > On 10/26/22 04:11, Vibhatha Abeykoon wrote: > > > > Congrats Nic! > > > > > > > > On Wed, Oct 26, 2022 at 5:30 AM Ashish > > wrote: > > > > > > > >> Congrats ! > > > >> > > > >> On Wednesday, October 26, 2022, Anja wrote: > > > >> > > > >>> Congrats!! > > > >>> > > > >>> On Tue, 25 Oct 2022 at 15:45, Rok Mihevc > > wrote: > > > >>> > > > Congrats Nic! > > > > > > Rok > > > > > > On Tue, Oct 25, 2022 at 11:16 PM Will Jones < > > will.jones...@gmail.com> > > > wrote: > > > > > > > Congrats Nic! > > > > > > > > On Tue, Oct 25, 2022 at 2:14 PM David Li > > > >> wrote: > > > > > > > >> Congrats & welcome Nic! > > > >> > > > >> On Tue, Oct 25, 2022, at 17:07, Matt Topol wrote: > > > >>> Congrats!! > > > >>> > > > >>> On Tue, Oct 25, 2022 at 5:06 PM Sutou Kouhei < > k...@clear-code.com > > > >>> > > > > wrote: > > > >>> > > > The Project Management Committee (PMC) for Apache Arrow has > > > >>> invited > > > Nicola Crane to become a PMC member and we are pleased to > > > >> announce > > > that Nicola Crane has accepted. > > > > > > Congratulations and welcome! > > > > > > >> > > > > > > > > > > >>> > > > >> > > > >> > > > >> -- > > > >> thanks > > > >> ashish > > > >> > > > > > > > > >
Re: [DISCUSS] Move issue tracking to
Thanks Todd! That's really helpful. Neal On Tue, Oct 25, 2022 at 7:47 PM Todd Farmer wrote: > I'm beginning to track decisions needing to be made and problems needing to > be solved in the Arrow project GitHub issues, prefixing all such issues > with "MIGRATION: ..". They can be found here: > > https://github.com/apache/arrow/issues?q=is%3Aissue+is%3Aopen+MIGRATION > > I feel this will be a better forum to talk through specific challenges or > decisions if a future vote supports migration to GitHub issues. Please > feel free to comment or to create an issue to track a decision/concern > that's not already defined. > > On Tue, Oct 25, 2022 at 6:37 AM Neal Richardson < > neal.p.richard...@gmail.com> > wrote: > > > I'll start a vote on this in the next day or so since it seems like we > have > > consensus on the main issue (moving from Jira to GitHub Issues) and are > > working out the finer points on how we'll migrate and how we'll map Jira > > concepts to Issues. > > > > Speaking of the migration: now would be an *excellent* time for folks to > go > > through the Jira backlog and close out some old, stale, invalid issues so > > that we don't have to import a bunch of stuff we don't need. > > > > Neal > > > > > > On Tue, Oct 25, 2022 at 5:33 AM Alessandro Molina > > wrote: > > > > > On Tue, Oct 25, 2022 at 1:55 AM Joris Van den Bossche < > > > jorisvandenboss...@gmail.com> wrote: > > > > > > > > > > > I think the main thing we will miss are the Links (relation between > > > > issues), but we can try to promote some consistent usage of adding > > > > "Duplicate of #...", "Related to #..." in top post of an issue when > > > > appropriate. > > > > > > > > > > If we plan to migrate to GitHub, I think we should add an Issue > Template > > ( > > > > > > > > > https://docs.github.com/en/communities/using-templates-to-encourage-useful-issues-and-pull-requests/configuring-issue-templates-for-your-repository > > > ) to make sure we don't proliferate too many ways to do the same thing > in > > > terms of categorizing issues properly > > > > > >
Re: [RESULT][VOTE] Release Apache Arrow 10.0.0 - RC0
I will submit the R package to CRAN. Neal On Wed, Oct 26, 2022 at 4:40 AM Sutou Kouhei wrote: > Thanks!!! > > Current status: > > - [Done] Make the released version as “RELEASED” on JIRA > - [Done] Make the CPP PARQUET related version as “RELEASED” on JIRA > - [Done] Start the new version on JIRA on the ARROW project > - [Done] Start the new version on JIRA for the related CPP PARQUET version > - [Done] Merge changes on release branch to maintenance branch for patch > releases > - [Done] Upload source > - [Done] Upload binaries > - [PR] Update website > - [PR] Update Homebrew packages > - [kou] Update MSYS2 package > - [kou] Upload RubyGems > - [Done] Upload JS packages > - [Done] Upload C# packages > - [?] Update conda recipes > - [?] Upload wheels/sdist to pypi > - [Done] Publish Maven artifacts > - [?] Update R packages > - [?] Update vcpkg port > - [Done] Bump versions > - [Done] Update tags for Go modules > - [?] Update docs > - [kou] Remove old artifacts > > In <1eb698f7-0d96-caa0-3527-09ee0ec34...@python.org> > "Re: [RESULT][VOTE] Release Apache Arrow 10.0.0 - RC0" on Wed, 26 Oct > 2022 09:24:38 +0200, > Antoine Pitrou wrote: > > > > > Le 26/10/2022 à 07:37, Sutou Kouhei a écrit : > >> Two more: > >> - Make the CPP PARQUET related version as "RELEASED" on JIRA > >> - Start the new version on JIRA for the related CPP PARQUET version > >> I don't have admin permission on PARQUET. Could someone who > >> has admin permission on PARQUET do them? > > > > Ok, I did it. > > > > Regards > > > > Antoine. >
Re: [VOTE][Julia] Release Apache Arrow Julia 2.4.0 RC1
+1
Re: [RESULT][VOTE] Release Apache Arrow 10.0.0 - RC0
Thanks!!! Current status: - [Done] Make the released version as “RELEASED” on JIRA - [Done] Make the CPP PARQUET related version as “RELEASED” on JIRA - [Done] Start the new version on JIRA on the ARROW project - [Done] Start the new version on JIRA for the related CPP PARQUET version - [Done] Merge changes on release branch to maintenance branch for patch releases - [Done] Upload source - [Done] Upload binaries - [PR] Update website - [PR] Update Homebrew packages - [kou] Update MSYS2 package - [kou] Upload RubyGems - [Done] Upload JS packages - [Done] Upload C# packages - [?] Update conda recipes - [?] Upload wheels/sdist to pypi - [Done] Publish Maven artifacts - [?] Update R packages - [?] Update vcpkg port - [Done] Bump versions - [Done] Update tags for Go modules - [?] Update docs - [kou] Remove old artifacts In <1eb698f7-0d96-caa0-3527-09ee0ec34...@python.org> "Re: [RESULT][VOTE] Release Apache Arrow 10.0.0 - RC0" on Wed, 26 Oct 2022 09:24:38 +0200, Antoine Pitrou wrote: > > Le 26/10/2022 à 07:37, Sutou Kouhei a écrit : >> Two more: >> - Make the CPP PARQUET related version as "RELEASED" on JIRA >> - Start the new version on JIRA for the related CPP PARQUET version >> I don't have admin permission on PARQUET. Could someone who >> has admin permission on PARQUET do them? > > Ok, I did it. > > Regards > > Antoine.
Re: [RESULT][VOTE] Release Apache Arrow 10.0.0 - RC0
Le 26/10/2022 à 07:37, Sutou Kouhei a écrit : Two more: - Make the CPP PARQUET related version as "RELEASED" on JIRA - Start the new version on JIRA for the related CPP PARQUET version I don't have admin permission on PARQUET. Could someone who has admin permission on PARQUET do them? Ok, I did it. Regards Antoine.
