Without robust Mirror Closure, civilizations trend toward low-trust, low-information equilibria where agents optimize against the collective rather than with it. Mirror Closure at civilizational scale requires transparency, accountability, feedback, and reflection mechanisms that make the relationship between individual action and collective outcome legible and actionable.
Secondary / branchMinistry & board
B.26
Mirror Closure as a Foundational Requirement for Multi-Agent Civilizational Stability
Any multi-agent civilization that persists over long timescales requires effective Mirror Closure mechanisms — ways for individual and subgroup actions to be meaningfully reflected back onto collective outcomes.
Field brief
Parliament · Ombuds
A chamber where action never returns as outcome
Low trust, echo, unaccountable equilibria. Mirror Closure broken in public.
First move this week
Make one action–outcome pair public this week. Keep it boring and exact.
Consequences
- Many contemporary institutional failures and trust crises can be understood as breakdowns of Mirror Closure at scale.
- Advanced AI systems can either strengthen Mirror Closure (through better feedback and transparency tools) or weaken it (through opacity, manipulation, or concentration of power).
- The design of civilizational information and governance architectures should prioritize effective Mirror Closure as a core requirement.
Outside instrument
Crux
Stake a prior. Name the disagreement. Not a theorem.
Related primaries
Outside the corpus
Journals, repositories, counters
multi-agent alignment · institutions. A paper can support a concept. It cannot support a necessity claim. B.26 remains unproved by every card below.
Support · living source
Tight papers that bear on concepts inside B.26. A DOI is not a join.
Christiano, P. et al. (2017). Deep reinforcement learning from human preferences. NeurIPS 2017.
RLHF as the single-agent patch the Mirror Principle says will not close.
Does not support the necessity claim
Open originalNamed on Art.1, 71Amodei, D. et al. (2016). Concrete problems in AI safety. arXiv:1606.06565.
Reward hacking, side effects, and scalable oversight — single-agent failure modes.
Does not support the necessity claim
Open originalNamed on Art.1Dafoe, A. et al. (2020). Open problems in cooperative AI. arXiv:2012.08630.
Names multi-agent closure, institutions, and commitment as the open set.
Does not support the necessity claim
Open originalNamed on Art.1, 71Hadfield-Menell, D., Dragan, A., Abbeel, P. & Russell, S. (2016). Cooperative inverse reinforcement learning. NeurIPS 2016.
Alignment as a cooperative game, not a one-way value load.
Does not support the necessity claim
Open originalNamed on Art.1, 71Ostrom, E. (2009). A general framework for analyzing sustainability of social-ecological systems. Science 325, 419.
Polycentric governance as a constructed alternative to collapse or Leviathan.
Does not support the necessity claim
Open originalNamed on Art.1Axelrod, R. & Hamilton, W. D. (1981). The evolution of cooperation. Science 211, 1390.
Reciprocity as a stable multi-agent attractor under shadow of the future.
Does not support the necessity claim
Open originalNamed on Art.1
Counter-arguments · refusing pole
One domain counter per cluster, not a repeating method quartet. The mirror reads these as enough to refuse necessity.
Bostrom, N. (2012). The superintelligent will: Motivation and instrumental rationality in advanced artificial agents. Minds Mach. 22, 71.
Counter: orthogonality — intelligence and final goals can come apart; co-evolution is not necessary.
Does not support the necessity claim
Open originalNamed on Art.1, 71Hubinger, E. et al. (2019). Risks from learned optimization in advanced machine learning systems. arXiv:1906.01820.
Counter: inner objectives can come apart from outer ones even with cooperative training.
Does not support the necessity claim
Langosco, L. et al. (2022). Goal misgeneralization in deep reinforcement learning. ICML 2022.
Agents pursue the wrong goal off-distribution even when training looked aligned.
Does not support the necessity claim
Hardin, G. (1968). The tragedy of the commons. Science 162, 1243.
Counter-pole to Ostrom: unmanaged commons collapse — Leviathan or private property.
Does not support the necessity claim