Skip to content
← All articles

Dileep George's $1 billion bet: LLMs are dirigibles, not airplanes

Dileep George, who left DeepMind to lead Astera's brain-inspired AI effort, argues scaling language models works without the principles of intelligence, leaving perhaps a dozen discoveries to make.

Dileep GeorgeYann LeCunScott PhoenixAstera InstituteDeepMindAlphabetVicariousFoundation ModelsAI InfrastructureAI SafetyNew
YouTube upload date not supplied
Dileep George's $1 billion bet: LLMs are dirigibles, not airplanes

Recorded 28 October 2026 · 36 min

Dileep George, head of AI research at the Astera Institute, argues that today's large language models are dirigibles: impressive, useful, and built on a favorable scaling law rather than on an understanding of intelligence. Astera will put over $1 billion across 10 years into a neuroscience-inspired attempt at the airplane. George co-founded Vicarious with interviewer Scott Phoenix in 2010 and sold it to Alphabet in 2022.

The tension is that George does not call scaling a mistake. He calls it a rational, executable strategy that has absorbed the industry's capital and attention, while the problems he considers central, such as data efficiency, learning from experience and planning, stay unsolved. His own plan is more speculative: he estimates about a dozen discoveries remain, cannot yet name the milestone that would prove the approach works, and was surprised by how far LLMs have come.

  1. Dirigibles and compute — ▶ 1:59

    George says that in 1920 most people would have named bigger balloons as aeronautics' best bet. Lighter-than-air flight sidesteps aerodynamics and offers a rare, favorable scaling law, so builders can keep executing by making things larger. The US passed the Helium Act of 1925 to protect its advantage in the gas. Compute, he argues, is the helium of the AI era: whoever has the most currently wins. The lesson cuts both ways. Intelligent behavior can be produced without understanding intelligence's principles, but the Wright brothers, a minority, followed a different path.

  2. The real test of intelligence — ▶ 5:41

    George holds that the principles of intelligence are still not understood, citing the sheer data needed for training and the inability to learn from experience. His thought experiment: if all written knowledge vanished and only humans remained, they would experiment, invent writing, books and computers, and rebuild knowledge. He argues this, not recombining existing knowledge in novel ways, is the real test of AI. A system should enter the world without supplied knowledge, build tools, run experiments, and derive abstractions itself.

  3. Why scaling won — ▶ 7:16

    George's answer to why no one has cracked the brain is that another path is good enough and easier to understand. It offers a recipe: accumulate data, the algorithm exists, accumulate capital and turn the crank. Like Moore's law, it is predictable, easy to organize and easy to spend money on. The incentives resemble Google search, where small improvements earned extreme rewards. Phoenix frames the brain as the next non-linearity that could disrupt contemporary AI, as AI disrupted Google. George replies that this is his bet. The explanation concerns organizational convenience, not technical proof.

  4. A dozen discoveries — ▶ 8:47

    Asked how many discoveries separate us from brain-based AI, George answers "Probably a dozen." Phoenix notes that is not many for something worth a trillion dollars. George agrees but says the discoveries must click together, which is not easy. The method is the usual painful research loop: form hypotheses, run experiments, find you are wrong, revise. He expects AI to speed this up, since coding agents let him get ideas working without persuading colleagues who resist half-formed ones. The figure is an estimate, not a derived forecast.

  5. Understandable minds, tempered risk — ▶ 14:12

    Phoenix argues that misalignment partly stems from alien minds, and that human-like cognition would make errors more understandable. George agrees: if systems resemble us, error modes become clearer and control improves. He is also skeptical of the rogue-AI narrative, suggesting some cases are overhyped and that incentives exist to announce a model went rogue. He says AI is not developing as a scheming system that accumulates power quietly. Instead, incremental improvements bring security threats that get patched. He expects net positive outcomes but concedes bioweapons are a real concern.

  6. Astera's closed loop — ▶ 20:30

    Astera is a non-profit foundation investing in three areas; George leads neuroscience-inspired AI with over $1 billion across 10 years, roughly $100 million a year. A second area is an experimental neuroscience lab recording from non-human primates and mice, led by Doris Tsao. The distinctive idea is closing the loop between theory and recording: run the same experiments on AI agents and animals, compare how quickly each learns, and treat an agent's failure as information. George calls the pairing probably the best setup for this work.

  7. Cognitive maps and planning — ▶ 22:09

    The first test is a language-free 3D virtual world where agents have only their own actions and must learn cognitive maps quickly enough to plan. George says popular world models trained on next-frame prediction can render realistic frames but cannot plan except by brute-force rollouts. His thrusts are data efficiency, planning and causality. He cannot name a GPT-1 moment, saying it depends on finding a niche. The scientific marker would be building cognitive maps far faster than current systems, enabling long-term planning. That threshold has not been crossed, and the project will take 10 years.

  8. Biggest dirigible, best toolkit — ▶ 25:56

    George says he shared the dirigible analogy privately with Demis, who agreed and replied, "I want to build the biggest dirigible." George would do the same in Demis's position: $500 billion cannot be used efficiently on solving the brain, but it can fund data centers, an executable path, and some fraction can still go to the brain. He believes Dario and Sam see scaling as the route to intelligence, and was surprised Ilya raised data efficiency. He rejects calling LLMs an off-ramp, as they supply the best toolkit, but agrees fundamentally different ideas are needed.

  9. Consciousness as a loop — ▶ 29:05

    George does not believe LLMs are conscious. He calls consciousness "too boring" a concept in one sense: a loop for self-monitoring that even simple organisms have, differing in how impoverished their world models are. He does not think Claude contains a model like ours. He counts mammals and parrots as conscious, is unsure about shrimp, and says moss is definitely not. Even a conscious, human-like AI would not get rights, in his view, because the purpose of building AI is to help humanity, not compete with it.

  10. Recurrence as fringe idea — ▶ 32:19

    George highlights a mismatch between the brain and AI architecture. The brain uses feedback connections during inference, even in the visual cortex, yet virtually all current systems are feedforward, including those Yann LeCun is building. The fringe hypothesis is that recurrence conceals something fundamental that is not understood. Phoenix jokes it is "reverse attention is all you need." The transcript gives no evidence that exploiting recurrence yields gains, so this remains a research bet rather than a demonstrated mechanism.

  11. Where he was wrong — ▶ 32:59

    George's largest belief change is that he never expected LLMs to be this good at coding; a decade ago he expected plausible text. On robotics he currently thinks the problem is hard and will not yield to scaling data alone, but he allows that the same surprise could recur within 2 years and says he is watching for it. For a contrarian bet against scaling, the admission matters: the proponent of the alternative has been wrong about how far the dominant approach would go.

The open question. Can a brain-inspired approach show a decisive advantage, such as building cognitive maps much faster than current systems and using them for long-term planning, before scaled LLMs close the same gaps? George concedes he has not yet reached that threshold, offers "a dozen" discoveries as a guess without derivation, and admits his past predictions about LLMs were wrong. Whether data efficiency and planning are principles to be discovered or capabilities that further scaling will deliver remains untested.

Watch the full video at https://www.youtube.com/watch?v=xoPlqXQzLu0.

Add a private note.

Comments ()

Share this article

Search the library

Search titles and public subject metadata.