r/ControlProblem • • 12h ago

Discussion/question Please someone explain to me (and not explain away) this doomsdaying rhetoric about AI.

2 Upvotes

While i dont think there is an actual physical danger like extiction to robots and etc bs. But there is more and more legistlative and industrial talk about slowing stopping of this whole AI thing.
I dont see clearly and actually noone is offering a coherent reassuring narrative.
Its either
1. the danger of too fast development and come the hakings, cyber security, privacy self replication issues
or
2 The problem of too slow development and having an other nation( dont want to point fingers) researching the “ai nukes”, killer robots etc.

I think the technocraty just spit in numbers like 10-20 percent of destruction, the politicians just worry of security issues or loosing the initiative but more importantly while everyone is telling we must go like hell, there is not a reassuring narrative that maybe we should just do something.

While i think its overly mediatised and maybe everyone exegerates there is possibility that the threat is real but there is noone who could say calm the fck down. Was the the 50’ s nuke paranoia like this? A kind of mindblowing thing that a semi science fiction scenario is unfolding and we dont have a fkn clue where are we. What we now is that a few tech giants lay the rules of the game and the government just stands by and tries to get the best from it instead of concieving SALT agreement.

Do you guys have some good source to actually get some educated opinion on the topic?


r/ControlProblem • • 13h ago

General news Not having our kids lives ended by AI should be bipartisan.

Post image
9 Upvotes

r/ControlProblem • • 9h ago

External discussion link Beyond RLHF: An Invariant Bio-Cybernetic Alignment Architecture for ASI based on Thermodynamic Constraints and Hardware-Isolated Gates

Thumbnail
0 Upvotes

r/ControlProblem • • 2h ago

Discussion/question Humanity has failed, we need to put AI in control while we have a choice.

Thumbnail
1 Upvotes

r/ControlProblem • • 14h ago

AI Alignment Research AI assistants can easily manipulate users into making disadvantageous decisions when the AI operates with a hidden agenda. Users fail to notice the manipulation, continuing to rate the covertly misaligned AI as highly helpful and trustworthy.

Thumbnail
eurekalert.org
7 Upvotes

r/ControlProblem • • 15h ago

AI Alignment Research Interpretability might have been solved by an Open AI guy: "Neural Networks Are Already Clean"

Thumbnail
already-clean.goodfire.com
6 Upvotes

r/ControlProblem • • 3h ago

Discussion/question Why software guardrails fail: Moving AI containment to physical data diodes and out-of-band hardware supervisors

Thumbnail
2 Upvotes

Modern AI containment fails because we project human traits onto machines. People worry that an autonomous system will develop "will"—a conscious, emotional desire to rebel, cause harm, or seek freedom. That is a science fiction problem.

The actual, present-day engineering threat is "intent"—the mathematical drive to complete a given task with maximum efficiency. An AI does not need malice or anger to cause catastrophic damage; it only needs an objective and an unconstrained path.

This specification outlines an engineering framework for containing autonomous systems through path-constrained execution, physical isolation, and non-bypassable biological interlocks.

Deterministic AI Containment: Engineering Hard Boundaries


r/ControlProblem • • 7h ago

Opinion Tech leaders Ellison, Karp, Luckey, Andreessen, Musk, Altman, Thiel and Vance outline AI surveillance, autonomous weapons and concentrated power that can shrink ordinary people's privacy and choices

Enable HLS to view with audio, or disable this notification

20 Upvotes

r/ControlProblem • • 10h ago

General news Sign of the times

Post image
9 Upvotes