A more in depth discussion on ACX.
https://open.substack.com/pub/astralcodexten/p/the-pentagon-threatens-anthropic

About 3/4 of Americans oppose mass surveillance and autonomous weapons, but
these are coming anyway, at least until we do away with borders and war in
the next century. But surveillance is here to stay, because it is required
for AI to work. AI controlled by tech billionaires already knows more about
you than you know yourself. I don't know all my passwords or where I was on
some day 5 years ago, but Google does.

It would be nice if we could use AIT to resolve political questions if the
signal to compress wasn't overwhelmed by noise. What data would you
compress to solve the immigration issue? What would you compress to answer
the question of at what point after conception does life begin?

We have political division because it is profitable to media companies.
Rationally, the expected value of your vote is so small as to not make it
worthwhile to bother. But emotions override logic. Inducing fear and
outrage holds your attention until it seem worthwhile to donate to
political causes.

-- Matt Mahoney, [email protected]

On Wed, Feb 25, 2026, 12:47 PM James Bowery <[email protected]> wrote:

>
>
> On Wed, Feb 25, 2026 at 10:47 AM Matt Mahoney <[email protected]>
> wrote:
>
>> ... quash unproductive political division.
>>
>
> How can one know the difference between productive and unproductive
> political division when the utility function of AIXI's SDT isn't known, let
> alone the AIXI-AIT approximation of the macrosocial dynamics?
>
> Indeed, if there is one thing we can say for certain, it is that those who
> hold financial power and yet do not support incentives like Hume's
> Guillotine <https://github.com/jabowery/HumesGuillotine> are in
> not well-founded to weild ANY power.
>
> The least they can do under these circumstances is abdicate their power in
> favor of Sortocracy <https://sortocracy.org/> so people can escape their
> quasi-theocracy while providing much needed experimental controls.
> *Artificial General Intelligence List <https://agi.topicbox.com/latest>*
> / AGI / see discussions <https://agi.topicbox.com/groups/agi> +
> participants <https://agi.topicbox.com/groups/agi/members> +
> delivery options <https://agi.topicbox.com/groups/agi/subscription>
> Permalink
> <https://agi.topicbox.com/groups/agi/Tb9c1aaff01c2b823-M741c17ee9b1fc4ca23900bc1>
>

------------------------------------------
Artificial General Intelligence List: AGI
Permalink: 
https://agi.topicbox.com/groups/agi/Tb9c1aaff01c2b823-M7721fce12ac324c1394c9b21
Delivery options: https://agi.topicbox.com/groups/agi/subscription

Reply via email to