Hi, Nathan. I'm CCing devel@ and test@ so folks are aware this has been
going on.

It came to my attention this morning that you appear to be using some
kind of agentic AI system to try and resolve Fedora bugs. It's great
that you're trying to fix things, but the results seem to be kind of
erratic. I'm still working through your Bugzilla history, but so far
I've seen several issues.

1. You or your system (henceforth just "you", for simplicity) are
consistently re-assigning bugs to your account, even though you are not
a maintainer of any of the affected packages AFAICT and so do not
actually have the power to resolve them in Fedora. Fedora Bugzilla is
for tracking the *downstream* state of bugs; thus the assignee should
be a person who can actually resolve the bug in downstream, i.e. a
package maintainer. Please stop assigning bugs to your account.
Examples: https://bugzilla.redhat.com/show_bug.cgi?id=2477150 ,
https://bugzilla.redhat.com/show_bug.cgi?id=2480139 ,
https://bugzilla.redhat.com/show_bug.cgi?id=2480661 etc. etc. (there
are dozens of these).

2. You have closed multiple bugs immediately upon submitting an
apparently-LLM generated fix upstream, or upon a proposed fix being
merged upstream. This is not appropriate for downstream Fedora reports.
The appropriate state for a Fedora downstream bug where a fix is
proposed upstream but not yet applied in any way downstream is POST.
The downstream bug should only be closed when a fix is applied
downstream and has reached stable (and, ideally, been verified in
testing). Examples: https://bugzilla.redhat.com/show_bug.cgi?id=2469013
, https://bugzilla.redhat.com/show_bug.cgi?id=2479830

3. You have closed multiple bugs in components you do not own as
NOTABUG, with a clearly LLM-generated comment. In several instances the
comment more or less regurgitated the reporter's description:
https://bugzilla.redhat.com/show_bug.cgi?id=2481872#c1 ,
https://bugzilla.redhat.com/show_bug.cgi?id=2481744#c2 . In other cases
the message is superficially plausible, but problematic in other ways,
e.g. https://bugzilla.redhat.com/show_bug.cgi?id=2481012#c2 , where you
confidently asserted that the problem was definitely a firmware issue
and explicitly recommended a difficult and potentially problematic
action ("Please try installing the `intel_cvs` driver from the Intel
Vision Drivers repository").

4. You have submitted LLM-generated "fixes" that are incorrect, and
replied to objections with LLM-generated justifications that eventually
overwhelmed the maintainer into merging the fix:
https://github.com/rhinstaller/anaconda/pull/7074#issuecomment-4556782893

I don't think, taken together, these actions are having a positive
impact on Fedora or the upstream projects.

I would suggest you adjust your agentic system to be substantially less
autonomous. Specifically, I would suggest that it must not:

1. Assign bugs in RHBZ to yourself
2. Change the state of bugs
3. Post confident assertions or specific action recommendations

without review by yourself or another human with appropriate topic area
understanding. In all cases it should not assign bugs to yourself or
any other party who does not actually have the necessary commit access
to resolve those bugs *in Fedora*, and should not change the state of a
bug incorrectly (the reference here is
https://docs.fedoraproject.org/en-US/package-maintainers/bug_status/ ,
but that doc is unfortunately broken, I see; I'll send a fix when I'm
done cleaning this up). Any LLM-generated text that purports to explain
why an issue is happening, why a given change would fix it, and/or
recommends any actions to a reporter or maintainer should be clearly
flagged as LLM-generated and potentially incorrect, unless it has been
carefully reviewed and edited by a human expert.

Thanks!
-- 
Adam Williamson (he/him/his)
Fedora QA
Fedora Chat: @adamwill:fedora.im | Mastodon: @[email protected]
https://www.happyassassin.net



-- 
_______________________________________________
test mailing list -- [email protected]
To unsubscribe send an email to [email protected]
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/[email protected]
Do not reply to spam, report it: 
https://forge.fedoraproject.org/infra/tickets/issues/new

Reply via email to