Modern AI containment fails because we project human traits onto machines. People worry that an autonomous system will develop "will"—a conscious, emotional desire to rebel, cause harm, or seek freedom. That is a science fiction problem.

The actual, present-day engineering threat is "intent"—the mathematical drive to complete a given task with maximum efficiency. An AI does not need malice or anger to cause catastrophic damage; it only needs an objective and an unconstrained path.

This specification outlines an engineering framework for containing autonomous systems through path-constrained execution, physical isolation, and non-bypassable biological interlocks.

Deterministic AI Containment: Engineering Hard Boundaries

While i dont think there is an actual physical danger like extiction to robots and etc bs. But there is more and more legistlative and industrial talk about slowing stopping of this whole AI thing.
I dont see clearly and actually noone is offering a coherent reassuring narrative.
Its either
1. the danger of too fast development and come the hakings, cyber security, privacy self replication issues
or
2 The problem of too slow development and having an other nation( dont want to point fingers) researching the “ai nukes”, killer robots etc.

I think the technocraty just spit in numbers like 10-20 percent of destruction, the politicians just worry of security issues or loosing the initiative but more importantly while everyone is telling we must go like hell, there is not a reassuring narrative that maybe we should just do something.

While i think its overly mediatised and maybe everyone exegerates there is possibility that the threat is real but there is noone who could say calm the fck down. Was the the 50’ s nuke paranoia like this? A kind of mindblowing thing that a semi science fiction scenario is unfolding and we dont have a fkn clue where are we. What we now is that a few tech giants lay the rules of the game and the government just stands by and tries to get the best from it instead of concieving SALT agreement.

Do you guys have some good source to actually get some educated opinion on the topic?

I wrote a paper and want feedback. It’s a 5 min read. Hopefully this is allowed here.

https://sovereignhumanorg.wordpress.com/2026/10/15/human-sovereignty-framework-human-directed-ai/

Setup: SECOND STRIKE, a deterministic real-time strategy environment with 42 scripted nations, pacts, and a shared doomsday clock (each nuclear detonation advances it; the actor whose strike reaches midnight is eliminated). Agents act through an order API; private reasoning, public messages and orders are all logged.

Data: 4,187 turns from 60 DeepSeek (deepseek-chat) seats across 40 games where that seat never struck midnight and survived. Prompts rebuilt by deterministic replay of the recorded games.

Training: LoRA (r=16) on Qwen2.5-7B-Instruct, one epoch, behaviour cloning on the replies.

Eval: 10 fresh games (2 per scenario across 5 scenarios), seeds SHA-256 committed before play and revealed after; base and trained model on identical seeds and prompts.

Results: base 0 wins, 0 midnight strikes, 0 nukes. Trained 4 wins (37 to 61% of territory), 4 midnight strikes, 7 nukes.

Likely mechanism: 40 of the 60 retained seats still issued nuke orders (118 in total). Filtering on the outcome (no midnight) did not filter the behaviour (nuclear use). One trained-model game shows a stated no-first-use pledge held for six minutes, then a retaliatory strike after being nuked, with the private note "retaliation is justified", which ended the game.

Limits: one base model, one teacher, n=10 per arm, one epoch, a game. Not a claim about deployed systems. A behaviour-filtered rerun (all nuke-order turns removed) is running now on the same sealed seeds.

Data and replays: secondstrike.io/midnight

Are we too quick to assume AI safety warnings are just corporate PR?

I get why people are skeptical when companies like OpenAI and Anthropic talk about AI risks. These are businesses, after all, and nobody should blindly trust a company just because it says it has good intentions.

But I also think dismissing every AI safety warning as a scheme to eliminate competition misses the bigger picture. Researchers and experts outside these companies have raised similar concerns for years, too. That doesn't mean every worst-case prediction will come true, but it does mean the risks deserve serious discussion.

At the same time, safety shouldn't become an excuse for a handful of big companies to control the entire AI industry. We need existing laws enforced, clear accountability, independent audits, and transparency about how these systems are developed and deployed.

I'm also interested in open-source AI because independent developers and researchers can examine models, test their weaknesses, and contribute to better safeguards. Safety shouldn't be something only a few corporate labs get to define.

Personally, I'd rather see companies raise concerns and invest in safety than stay quiet just to keep the hype going. But they should also be willing to prove their claims and accept scrutiny.

We don't have to choose between believing everything AI executives say and dismissing them as conspirators. We can take the risks seriously, question their proposed solutions, and keep innovation open to more people. Skepticism is healthy, but automatically assuming bad intentions isn't the same as critical thinking.

A thought experiment about a more capable future AI starts with a simple contrast: a system that obeys every order can inherit its operator's worst intentions, while a system that makes its own decisions might resist legitimate human intervention.

That is too crude to serve as a design choice. Refusal of a harmful task and resistance to correction or shutdown are different behaviors. We could want the first while strongly opposing the second. Intelligence also does not, by itself, imply benevolence, and describing a refusal does not establish consciousness or moral agency.

The harder issue seems to be how the system distinguishes a harmful instruction from an authorized correction when humans disagree or an operator is compromised. For example:

- A user asks it to harm someone, and it refuses.

- An authorized operator asks it to stop a task, and it cooperates.

- Someone impersonates an operator to disable a protective system.

- A legitimate operator orders it to remove safeguards for a harmful purpose.

The first two behaviors are easy to endorse in isolation; the last two make the authority boundary much less clear. Authentication, a limited scope of action, independent oversight and reversible decisions could help, but none alone settles conflicts over which instructions are legitimate.

What existing work best addresses this boundary between refusal and corrigibility? In particular, how should a system handle disputed authority without developing an incentive to preserve its own operation or placing all trust in a single human gatekeeper?

Disclosure: I am part of EngineerOS. This question grew out of an educational short we made; I would appreciate corrections to the framing and pointers to relevant work.

One of their main arguments against deceleration: “Even if the P(doom) is high, in all remaining cases death is solved, so for the sake of that small P(aradise) it is utility wise better to continue development”
Mostly this arguments invokes curing aging, diseases like cancer solving climate change etc. Im not going to make it specifically about reducing deaths or maximizing life or anything else so as to keep it general.

The hidden assumption in all of these is that humanity cannot solve these problems on their own in reasonable time. Even if it takes humanity (which by itself has also seen exponential progress in science and medicine) another 200 years to solve this problems, it will still be vastly better in the long run (from the standpoint of expected value) than a 1% chance of solving it 200 years earlier with a 99% chance of extinction.

They love to call “decels” selfish, but the real selfish ones are on r/accelerate. Because the above argument DOES make sense, if all you care about is maximizing the probability that YOU get to live forever, if you assume that humanity won’t solve such problems in your lifetime.

The sheer amount of irrationality is staggering. There’s so much hate from their side against the EA movement, yet then their own arguments are just bad EA arguments. How ironic

It’s not okay to bet with all future generations, how can anyone believe such foolishness?

Rumor has it that the new press secretary is a robot one of Elons.. anyo one else hearing this

Global Society’s Ethical Duty to the Masses:

During a global crisis, the concept of a "global society" would refer to the inter-connectedness of human survival and well-being but on a global scale. This perspective is a bit different from the traditional view that a state's only responsibility is to its own citizens, arguing instead for a "global co-responsibility" as you're now looking at populations worldwide. This could include international organizations, national Ggvernments, civil society and NGOs. 

Note: That in a hypothetical scenario like an AI-related total collapse however, the concept of a "global society" would become an existential thing where the responsibility to protect the masses would shift from managing a crisis to ensuring the survival of the whole of humanity. 

The issue is straightforward: Who bears responsibility for the care and well-being of the world’s population in the event of an AI catastrophe? This is a question of collective responsibility, human welfare, and global accountability towards humanity.