Re: [Java] Source control of generated flatbuffers code

Hey Bob, Someone did publish a 1.12 version of the flatc maven plugin. I double checked that the plugin and binaries look correct and legit.. but you know, it's always shady to download some random executable from the internet and run it. However, I have been using it to generate the arrow

Re: [VOTE] Move Rust components to new repos and process

+1 On Thu, 15 Apr 2021, 05:57 Sutou Kouhei, wrote: > +1 > > In > "[VOTE] Move Rust components to new repos and process" on Wed, 14 Apr > 2021 18:04:44 -0600, > Andy Grove wrote: > > > This vote is to determine if the Arrow PMC is in favor of the Rust > > community moving the Rust

Re: [VOTE] Move Rust components to new repos and process

+1 In "[VOTE] Move Rust components to new repos and process" on Wed, 14 Apr 2021 18:04:44 -0600, Andy Grove wrote: > This vote is to determine if the Arrow PMC is in favor of the Rust > community moving the Rust implementation of Apache Arrow as well as the > related projects (such as

Re: [Java] Source control of generated flatbuffers code

I apologize for leaving this hanging, but it looks like 4.0 is leaving the station :( Yes, it makes sense to bump it to 1.12, but you can't do that in isolation, because the flatc binary which is fetched as a Maven dependency is only available for 1.9. I will get back onto this and finish it

Re: [VOTE] Move Rust components to new repos and process

Hi Arrow devs, +1 On Thu, 15 Apr 2021 at 05:28, Jorge Cardoso Leitão wrote: > +1 binding. > > On Thu, Apr 15, 2021 at 4:10 AM Micah Kornfield > wrote: > > > +1 binding. Does this also cover other changes (issue management) +1 to > > those as well. > > > > On Wednesday, April 14, 2021, Andy

Re: [VOTE] Move Rust components to new repos and process

+1 binding. On Thu, Apr 15, 2021 at 4:10 AM Micah Kornfield wrote: > +1 binding. Does this also cover other changes (issue management) +1 to > those as well. > > On Wednesday, April 14, 2021, Andy Grove wrote: > > > This vote is to determine if the Arrow PMC is in favor of the Rust > >

Re: 4.0 release preparation

Thanks for your feedback last night all of which has been addressed! I will address all comments at least daily so that the ORC writer can be included without blocking the release! Ying > On Apr 13, 2021, at 9:07 PM, Micah Kornfield wrote: > > I'll try to take a look tonight but it might be

Re: [VOTE] Move Rust components to new repos and process

+1 binding. Does this also cover other changes (issue management) +1 to those as well. On Wednesday, April 14, 2021, Andy Grove wrote: > This vote is to determine if the Arrow PMC is in favor of the Rust > community moving the Rust implementation of Apache Arrow as well as the > related

Re: CI feedback time

As we know this is a common issue among Apache projects. While the projects do not have the final solution, Apache Spark project has a mechanism [1][2] to run a test in own local (forked) repository. Can we alleviate the problem a little bit? [1] https://github.com/apache/spark/pull/29504 [2]

Re: CI feedback time

It may be worth reaching out to the Airflow project. Based on https://cwiki.apache.org/confluence/display/BUILDS/GitHub+Actions+status it seems they have been investing time into figuring how to make self-hosted runners work (it seems Github's patching model makes this somewhat difficult). On

[VOTE] Move Rust components to new repos and process

This vote is to determine if the Arrow PMC is in favor of the Rust community moving the Rust implementation of Apache Arrow as well as the related projects (such as Parquet, DataFusion, Ballista, etc) out of the monorepo and into two new repositories, as outlined in the proposal document [1].

Assembling April Arrow board report

hi folks, It's time for our quarterly board report — I started a Google document where we can fill in the information (please request edit permissions if you'd like to help): https://docs.google.com/document/d/12IX5hlzTpZrv03PfZJWyryyUfsjw7vO2Eof0UNMlrLA/edit We obviously have a lot to cover in

Re: CI feedback time

Hi Krisztian, Thanks for bringing this up. This is definitely becoming a high-priority topic for Arrow development. I don't believe there is much opportunity for reducing the number of builds or their runtime. We simply have a lot of development going on, and the number of different CI

CI feedback time

Hi, The Apache Github Actions agent pool seems to be oversubscribed as more Apache projects migrate their CI setup to GHA. We experienced pretty solid feedback times (~20-30m) when we originally moved to GHA but now we are roughly 5hrs behind [1]. Based on other projects' complaints and

Re: Arrow sync call April 14 at 12:00 US/Eastern, 16:00 UTC

Thanks everyone who attended. Meeting notes: Attendees: Colin Alworth Nate Bauernfeind Ian Cook Nic Crane Andy Grove Jonathan Keane Micah Kornfield David Li Kirill Lykov Roc Mihevc Alessandro Molina Weston Pace Antoine Pitrou Neal Richardson Krisztián Szűcs Naman Udasi Discussion: - Arrow

Re: [DISCUSS] [Rust] Move Rust components to new repos and process

I think we are ready for a vote On Tue, Apr 13, 2021, 20:44 Andy Grove wrote: > There has been a lot of discussion both in this email thread and in > comments in the Google document and all the comment threads in the document > have been resolved. > > Is there more work that needs to happen in

Re: [JIRA Permissions] Requesting change to "Contributor"

Done! Neal On Wed, Apr 14, 2021 at 9:36 AM Sarah Gilmore wrote: > Hi all, > > I just created a Jira issue > and I would like to be > added as a Jira contributor so that I can assign the issue to myself. My > Jira username is sgilmore. If this

Re: [Java] Source control of generated flatbuffers code

It would also be nice to upgrade that java flatbuffer version from 1.9 to 1.12. Is anyone planning on doing this work (as listed in ARROW-12111)? If I did this work today, might it be possible to get it included in the 4.0.0 release? On Fri, Mar 26, 2021 at 3:25 PM bobtins wrote: > OK,

[JIRA Permissions] Requesting change to "Contributor"

Hi all, I just created a Jira issue and I would like to be added as a Jira contributor so that I can assign the issue to myself. My Jira username is sgilmore. If this is possible, that would be great! Best, Sarah

Re: Status of Arrow Julia implementation?

Thank you kou! I appreciate the help. I'm happy to do whatever is required to facilitate the moving/donating process from JuliaData/Arrow.jl to apache/arrow-julia. -Jacob On Mon, Apr 12, 2021 at 7:53 PM Sutou Kouhei wrote: > Hi Jacob, > > I, a PMC member, talked to Kenta Murata, a commiter and

[NIGHTLY] Arrow Build Report for Job nightly-2021-04-14-0

Arrow Build Report for Job nightly-2021-04-14-0 All tasks: https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-04-14-0 Failed Tasks: - conda-linux-gcc-py36-arm64: URL: