potiuk commented on PR #228: URL: https://github.com/apache/airflow-steward/pull/228#issuecomment-4528095434
Yeah. I very much see @choo121600 "measure becomes a goal" - and framing the output as "guide" is super important. Few things that could make the skill also way more useful - taking into account that we have LLM / Models to do a lot more * Explicit searching for and looking for contributor's guidelines in the project. This will make it less "generic" and more "project autonomously defined" - and linking particular activities to those criteria defined by the project will make those results less "dry/external" and more "ours". While we should aim the criteria being more "objective" - they should always be filtered with "subjective" PMC criteria - which will be different project-by-project * I think that activity would be ***much** more useful if t summarized activitiy of people from various sources -> not only GH - which I see as potentially biggest value here. This is what we usually use when we are looking for contributor's involvment - and we could include (of course) devlist discussions, users discussion but also potentiallly slack/discord/other community activitty sources (different in each projects) + web search for actitivity connected to the project. * I honestly do not think fixed thresholds is the best idea. I would say way better would be comparative assesment of activity - especially regarding the current active committers, PMC members but also comparing to other contributors who could be candidates. This will - almost automatically - adjust to the state of the project, which "lifecycle" part the project is in and even things like focusing on upcoming release. LLMs are good in analysing trends and comparing things without giving the specific thresholds - and I think - contrary to typical deterministic approaches - the more we depart from deterministic assesment and numbers, and use the LLM power to make some "relative comparisions" - the better we use the Agentic/LLM / non-deterministic power -> and to be honest, this is exactly what I think in case of new committers / PMC members - it's not the sheer number of interactions - it's also quality of those. * which leads me to next point - I think part of such assessment should be assesment of "tone", "way of communicating", "cooperativeness" but also "impact of the changes" and similar assessments - I think LLMs are very good in assessing those. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
