Skip to content
← Atlas
Art.1Idea.1

Part I: Foundations · Method & First Principles · Posted

The Mirror Principle for AI Alignment

False identity

Art.1 is not Th.1 Fixed-Point. It is Th.2 Mirror Closure — open the living join.

What the data actually shows

Current AI alignment methods (RLHF, constitutional AI, scalable oversight) either fail at sufficient capability or require an already-aligned superintelligence to bootstrap.

Why this is necessary

The only stable equilibrium is a system that treats humanity’s own epistemic and moral improvement as part of its terminal goal.

What current approaches miss

Alignment research has focused on single-agent or human-AI pairs. Game-theoretic closure for multi-agent superintelligence was never forced.

If this is right

Ends the alignment arms race. Provides a mathematically provable target instead of endless patches.

Documented theorem joins

Join table only. No invented bijection.

Idea Series on X — Introduction · Index · Atlas

Check this citation in the Rift

Outside instrument

Crux

Stake a prior. Name the disagreement. Not a theorem.

Open full

Outside the corpus

Journals, repositories, counters

multi-agent alignment · echo chambers / polarization. A paper can support a concept. It cannot support a necessity claim. Art.1 remains unproved by every card below.

Support · living source

Tight papers that bear on concepts inside Art.1. A DOI is not a join.

  • Christiano, P. et al. (2017). Deep reinforcement learning from human preferences. NeurIPS 2017.

    RLHF as the single-agent patch the Mirror Principle says will not close.

    Does not support the necessity claim

    Open originalNamed on Art.1, 71
  • Amodei, D. et al. (2016). Concrete problems in AI safety. arXiv:1606.06565.

    Reward hacking, side effects, and scalable oversight — single-agent failure modes.

    Does not support the necessity claim

    Open originalNamed on Art.1
  • Dafoe, A. et al. (2020). Open problems in cooperative AI. arXiv:2012.08630.

    Names multi-agent closure, institutions, and commitment as the open set.

    Does not support the necessity claim

    Open originalNamed on Art.1, 71
  • Hadfield-Menell, D., Dragan, A., Abbeel, P. & Russell, S. (2016). Cooperative inverse reinforcement learning. NeurIPS 2016.

    Alignment as a cooperative game, not a one-way value load.

    Does not support the necessity claim

    Open originalNamed on Art.1, 71
  • Ostrom, E. (2009). A general framework for analyzing sustainability of social-ecological systems. Science 325, 419.

    Polycentric governance as a constructed alternative to collapse or Leviathan.

    Does not support the necessity claim

    Open originalNamed on Art.1
  • Axelrod, R. & Hamilton, W. D. (1981). The evolution of cooperation. Science 211, 1390.

    Reciprocity as a stable multi-agent attractor under shadow of the future.

    Does not support the necessity claim

    Open originalNamed on Art.1

Counter-arguments · refusing pole

One domain counter per cluster, not a repeating method quartet. The mirror reads these as enough to refuse necessity.

  • Bostrom, N. (2012). The superintelligent will: Motivation and instrumental rationality in advanced artificial agents. Minds Mach. 22, 71.

    Counter: orthogonality — intelligence and final goals can come apart; co-evolution is not necessary.

    Does not support the necessity claim

    Open originalNamed on Art.1, 71
  • Hubinger, E. et al. (2019). Risks from learned optimization in advanced machine learning systems. arXiv:1906.01820.

    Counter: inner objectives can come apart from outer ones even with cooperative training.

    Does not support the necessity claim

  • Langosco, L. et al. (2022). Goal misgeneralization in deep reinforcement learning. ICML 2022.

    Agents pursue the wrong goal off-distribution even when training looked aligned.

    Does not support the necessity claim

  • Boxell, L., Gentzkow, M. & Shapiro, J. M. (2017). Greater Internet use is not associated with faster growth in political polarization. PNAS 114, 10612.

    Counter: the oldest, least-online cohorts polarized fastest — feeds are not the whole cause.

    Does not support the necessity claim

    Open originalNamed on Art.36, 79