Antoine, I need to correct your assertion
> we develop on the side every day when we submit PRs from forks; > it's just a matter of how much complexity is being submitted at once Intuitively, there seems to be a continuum between a PR developed within a project to a major feature/codebase developed outside of it. But the ASF treats these contributions differently, and requires the latter kind have to go through the IP clearance process. You might wonder where the line lies. The policy [1] defines it as follows: > a substantial contribution that was not developed within the > ASF's source control system and on our public mailing lists I have no opinion whether arrow2 and parquet2 cross this line. Julian [1] https://incubator.apache.org/ip-clearance/ > On Apr 7, 2021, at 11:39 PM, Antoine Pitrou <anto...@python.org> wrote: > > > Hi Jorge, > > I don't think you have done anything inappropriately here. I'm not able to > give a qualified advice on the arrow2 and parquet2 projects (after all, we > develop on the side every day when we submit PRs from forks; it's just a > matter of how much complexity is being submitted at once). > > There's a sizable Rust Arrow development community by now, so I'd be ok with > leaving the Rust team decide the best way to move forward with those > refactorings. > > Regards > > Antoine. > > > Le 08/04/2021 à 08:29, Jorge Cardoso Leitão a écrit : >> Hi, >> As a PMC member, I am of course very disappointed with myself for not being >> able to express some of these concerns from both Rust and other (e.g. >> Julia) implementations. I do think that I was vocal enough. At some point >> the interactions here started to affect my wellbeing and I thus decided to >> scale down by efforts. >> * If you think that there is a conflict of interests that I have not been >> able to manage, I am of course willing to resign from PMC membership >> * If you think that I should have acted differently, I am also very open to >> feedback. >> Best, >> Jorge >> On Thu, Apr 8, 2021 at 8:16 AM Jorge Cardoso Leitão < >> jorgecarlei...@gmail.com> wrote: >>> Hi Wes, >>> >>>> I will say additionally: it is important to have discussions on the >>> mailing list to explain / draw attention to major initiatives so >>> others aren't left wondering what people's plans are. >>> >>> As an open source contributor and developer of arrow2 and parquet2, given >>> how recent threads over repos, github issues, JIRA, Julia, Ballista have >>> been handled, I admit I feel intimidated to bring anything here. Arrow2 >>> has an FAQ <https://github.com/jorgecarleitao/arrow2#faq> and an open >>> issue <https://github.com/jorgecarleitao/arrow2/issues/31> discussing >>> these. >>> >>> Best, >>> Jorge >>> >>> >>> On Wed, Apr 7, 2021 at 1:35 PM Wes McKinney <wesmck...@gmail.com> wrote: >>> >>>> I will say additionally: it is important to have discussions on the >>>> mailing list to explain / draw attention to major initiatives so >>>> others aren't left wondering what people's plans are. >>>> >>>> I see from the 3/10 sync call notes >>>> >>>> "We talked about Jorge’s work on “Arrow2”. There is a desire to implement >>>> this new design in Arrow and we talked about creating a branch in the >>>> Arrow >>>> repo to continue this work." >>>> >>>> So there has been discussion about this, but only in video calls. It's >>>> OK to discuss these things in video calls, but please keep in mind >>>> that not everyone will be able to participate in the call (because of >>>> time zones or English fluency) and so it's important to have written >>>> discussions to explain. >>>> >>>> On Wed, Apr 7, 2021 at 6:27 AM Wes McKinney <wesmck...@gmail.com> wrote: >>>>> >>>>> I'm sorry to be the PMC worry wart around here, but I'm curious what >>>>> is the plan (if any) with these repositories >>>>> >>>>> https://github.com/jorgecarleitao/arrow2 >>>>> https://github.com/jorgecarleitao/parquet2 >>>>> >>>>> I understand that large new projects like this are sometimes >>>>> necessary, but what some Apache projects have done is set up a project >>>>> branch where the work can take place without bothering the master >>>>> branch. We can of course also create new standalone git repositories >>>>> under the apache/ namespace for experimental work if you aren't sure >>>>> it's going to get merged into master. What we want to avoid is having >>>>> significant work happening outside the community. >>>>> >>>>> On Wed, Apr 7, 2021 at 6:19 AM Mike Seddon <seddo...@gmail.com> wrote: >>>>>> >>>>>> Hi, >>>>>> Sorry I am unable to attend today's (tomorrow's?) call but would like >>>> to >>>>>> raise the idea of temporarily suspending major PRs against Rust >>>>>> Arrow/DataFusion until the work to incorporate the two big changes for >>>>>> Rust/DataFusion: >>>>>> >>>>>> 1. Jorge's major refactor/rewrite of the core Rust Arrow code. >>>>>> 2. Andy's Ballista donation (I am not sure how much this will affect >>>> the >>>>>> core Arrow/DataFusion code). >>>>>> >>>>>> I am able to help do some of the grunt work involved with merging >>>> these >>>>>> pieces if I can be of assistance - but I feel the time has come to at >>>> least >>>>>> face the major Rust Arrow work for all the reasons Jorge has >>>> previously put >>>>>> forward. >>>>>> >>>>>> Cheers, >>>>>> Mike >>>>>> >>>>>> On Thu, Mar 25, 2021 at 10:41 AM Andy Grove <andygrov...@gmail.com> >>>> wrote: >>>>>> >>>>>>> Hi Mike, >>>>>>> >>>>>>> I recently added the call details in the Arrow Rust README, here: >>>>>>> >>>> https://github.com/apache/arrow/tree/master/rust#arrow-rust-community >>>>>>> >>>>>>> I've added you to the guest list so it should sync with your >>>> calendar now. >>>>>>> I'm happy to do this for anyone else that wants me to add them. >>>>>>> >>>>>>> Unfortunately, I couldn't make the call today and it looks like >>>> there were >>>>>>> issues with letting people into the call. I've just been looking at >>>> the >>>>>>> settings and I'm not sure how I can change that. >>>>>>> >>>>>>> Regarding the timing of the call, I am open to moving it if we can >>>> find a >>>>>>> time that accommodates everyone reasonably well. I think we have >>>> regular >>>>>>> attendance from the US, UK, Europe, South Africa, and Australia so >>>> far. >>>>>>> >>>>>>> Thanks, >>>>>>> >>>>>>> Andy. >>>>>>> >>>>>>> >>>>>>> >>>>>>> On Wed, Mar 24, 2021 at 5:24 PM Mike Seddon <seddo...@gmail.com> >>>> wrote: >>>>>>> >>>>>>>> Hi Jorge, >>>>>>>> Can you please confirm the starting time (and timezone) and >>>> correct >>>>>>> Google >>>>>>>> Meet link of the Rust and DataFusion sync calls? >>>>>>>> >>>>>>>> I missed today's due to daylight saving time changes - which is >>>> going to >>>>>>>> make Sydney time even harder. >>>>>>>> >>>>>>>> Thanks >>>>>>>> Mike >>>>>>>> >>>>>>>> On Thu, Mar 25, 2021 at 3:15 AM Jorge Cardoso Leitão < >>>>>>>> jorgecarlei...@gmail.com> wrote: >>>>>>>> >>>>>>>>> Hi, >>>>>>>>> >>>>>>>>> If someone is trying to join the meeting, please try this link: >>>>>>>>> https://meet.google.com/pgx-xycf-zuf >>>>>>>>> >>>>>>>>> Best, >>>>>>>>> Jorge >>>>>>>>> >>>>>>>> >>>>>>> >>>> >>>
