On Fri, 6 Feb 2026 at 19:59, Charles R Harris <[email protected]> wrote: > > On Fri, Feb 6, 2026 at 12:29 PM Oscar Benjamin via NumPy-Discussion > <[email protected]> wrote: >> >> I think that accepting AI generated PRs requires greater >> human-to-human trust like the reviewer needs to have much more trust >> in the author that they did check things carefully themselves. >> Otherwise the effort ratio between author and reviewer is moving >> massively in the wrong direction. > > This is a common problem, so I expect there will be a lot of work on using > AI to review AI in the next year or two.
It may well be good to have AI review PRs whether those PRs are written by humans or AI but I don't think that AI review is a solution to the trust problem here. Let's put it a different way. Suppose a human can prompt an AI to produce a PR and then another AI can review that PR so that the two AIs get into a feedback loop (I've heard about this going badly wrong in some places). Let's suppose that the end result of that AI feedback loop was good code that you trust because your reviewing AI is very trustworthy and has approved the PR. Now the question is what value did the human who opened the PR bring in that situation? If it was possible for the AIs to review each other and produce something good then the human here is really just a liability that you would be better off without. Likewise their AI is a liability and it would be better if you controlled both AIs yourself. I think that the real answer is that it isn't (and may never be) possible for the AIs to produce something trustworthy without careful human oversight. The value that the human brings in the AI PR (if any) is that the human is overseeing the AI to produce something that is more trustworthy than you could get just from the AI. This only works if you can trust the human though: if you trust the human less than your AI then you are better off without the human. -- Oscar _______________________________________________ NumPy-Discussion mailing list -- [email protected] To unsubscribe send an email to [email protected] https://mail.python.org/mailman3//lists/numpy-discussion.python.org Member address: [email protected]
