TB: Nexus (Harari)
Core Thesis
Humanity gains power by building large information networks, but the way these networks are built predisposes us to use that power unwisely. Information does not essentially link to truth — it puts things in formation. The rise of AI is the most radical information revolution in history because AI is the first technology that can make decisions and create new ideas by itself; it is an agent, not a tool.
Key Takeaways
Information is not truth — it is glue
- The naïve view of information: more information → closer to truth → power + wisdom. History refutes this. We have constant rise in connectivity without a concomitant rise in truthfulness or wisdom.
- Information doesn't necessarily inform us about things — it puts things in formation. Errors, lies, fantasies, and fictions are information too.
- The Bible became one of the most influential texts in history; if information were about representing reality accurately, this would be hard to explain.
Stories and intersubjective reality
- Homo Sapiens rule because we are the only animals that cooperate flexibly in large numbers — enabled by our ability to tell and believe fictional stories.
- The universe has three levels of reality: objective, subjective, and intersubjective. Stories added the third.
- Fiction has two inherent advantages over truth for uniting large numbers of people: it can be made as simple as desired, and it doesn't have to be painful or disturbing.
Mythology and bureaucracy: the twin pillars of civilization
- Long-term human memory is particularly adapted to retaining stories.
- Mythology and bureaucracy are the twin pillars of every large-scale society — both sacrifice truth for order.
- Holy books (like the Bible/Quran) are information technologies designed to be free from error. What happens when an information network believes itself utterly incapable of any error? The history of infallible holy books holds lessons for attempts to create infallible AIs.
The self-correcting mechanism as the engine of science
- The scientific revolution was launched by the discovery of ignorance. Its self-correcting mechanisms — not the printing press — were the engine of the revolution.
- Self-correcting mechanisms are vital for the pursuit of truth but costly for maintaining order. This is the core tension between science and religion/bureaucracy.
- Studying the history of religion is highly relevant to present-day debates about AI.
Democracy vs. totalitarianism as information network designs
- Democracy encourages information to flow through many independent channels; it decentralizes decision-making. Totalitarianism wants ALL information to pass through the central hub.
- Elections are NOT a method for discovering truth. They are a method for maintaining order by adjudicating between conflicting desires.
- The main split in 21st-century politics may not be between democracy and totalitarianism, but between human beings and nonhuman agents — a Silicon Curtain.
AI as a qualitative break
- AI is the first technology in history that can make decisions and create new ideas by itself. It is an agent, not a tool.
- The computer revolution is qualitatively more radical than previous information revolutions. Deep knowledge of history is vital to understand why.
Mental Models
- The Map is Not the Territory — information is a map; Harari's central point is that humans have always governed themselves with maps that actively misrepresent the territory
- Generator Filter — democracy is a generator-filter system (many independent nodes); totalitarianism removes the filter
- Complex Systems: Features from Path — religious institutions' features emerged from developmental history (the need for order and cooperation), not from design
- Second-Order Thinking — the second-order effect of infallible information networks is the rise of powerful human institutions to interpret them