Skip to content
← All articles

Fine-tuned in-house models cost 97% less, Pompliano claims

Silvia CEO Anthony Pompliano argues businesses will migrate from rented frontier models to owned, specialized intelligence, but his evidence comes from one personal finance product and one cost comparison.

Anthony PomplianoSilviaFintechFoundation ModelsInferenceConsumer AI
YouTube upload date not supplied
Fine-tuned in-house models cost 97% less, Pompliano claims

Recorded 7 October 2026 · 24 min

Anthony Pompliano, chairman and CEO of Silvia, says processing 500 million tokens costs about $5,000 on a frontier model and about 97% less on fine-tuned models running on a company's own hardware. He claims the cheaper option is also faster and more accurate, and he expects businesses to move from renting intelligence to owning it. Sophia, host of MTS, interviews him on the day his second book launches.

The claim rests on Silvia's own results rather than a broad body of evidence. Pompliano concedes that many companies lack the engineers, time or appetite for liability to follow. The conversation also covers his book on personal agency and his macro views on interest rates and Bitcoin, where he reads resilience against headwinds as a signal of strength.

  1. Outcomes as receipts — ▶ 2:48

    Pompliano's book rests on the premise of agency: the state of your life is largely the direct outcome of past decisions, much like fitness, and good habits stack in both directions. Once people see it that way, they ask what to change. His example is that success means being excited to go to work and also to go home; if not, change the job, the team or perhaps the relationship. He says none of the 50 ideas are original, and suggests implementing three at a time.

  2. Silvia's proprietary AI stack — ▶ 14:20

    Silvia removed the majority of frontier models and built its own harness, a file system and memory, a model router and data pipelines. Pompliano says the system is more accurate than every frontier model on tax, mortgage and credit card questions, and the company open-sourced its eval rubrics. He reports over 20,000 users, an average of $2.5 million or more attached per account, and over $60 billion in connected assets in about 18 months.

  3. The wealthy independent investor — ▶ 17:58

    Budgeting apps proliferate, Pompliano argues, because they target the largest addressable market and are built by early-career engineers solving a problem they understand: saving money. Silvia targets a different cohort: wealthy independent investors with complex finances who distrust large financial firms, do not care about saving $5 at Starbucks, and want to retain control over decisions on taxes and estate planning. His lesson is to pick the most valuable group, not the biggest number of users.

  4. The 97% token discount — ▶ 19:05

    Processing 500 million tokens through a frontier model costs about $5,000, Pompliano says. The same volume on Silvia's fine-tuned models on its own hardware is about 97% cheaper. He adds that the owned approach has lower latency and higher accuracy, so cost and quality stop trading off in specialized workflows. The transcript does not say whether the figure includes hardware, fine-tuning or engineering costs. He calls it the most eye-opening lesson from a 6-to-9-month crash course in specialized versus general AI.

  5. Interest is not adoption — ▶ 19:54

    Pompliano concedes that many businesses will not switch even if the economics are compelling. They may not understand the approach, want the time or liability, or have the engineers. His forecast is a migration path: companies start with the large model labs, then move toward owning their intelligence. He calls it a shift of tectonic plates that investors should watch. He gives no timeline. Editorially, the barriers he lists are ones Silvia addressed by building its stack itself.

  6. Rates stopped biting — ▶ 20:40

    Interest rates rose 25 basis points while US stocks hit all-time highs, which Pompliano says violates economics 101. His conclusion is that the economy is less sensitive to interest rates than assumed. He declines to call this good or bad and urges people to revisit prior assumptions. The evidence offered is the single recent episode, and the discussion proposes no mechanism for the reduced sensitivity.

  7. Bitcoin strength despite headwinds — ▶ 21:16

    Pompliano argues a new Bitcoin bull market is underway because the price rose despite rising 10-year yields, oil around $100, general fear of an AI bubble and the Clarity Act failing to pass. If those headwinds eased, he reasons, Bitcoin would be significantly higher. He expects net new demand from Wall Street FOMO, a theme he attributes to Jordy Visser, and from AI agents expanding the addressable market. This is a forecast, and the demand claims are unquantified.

The open question. Does the 97% cost advantage survive full cost accounting, and does it hold outside narrow domains like tax and mortgage questions? Pompliano gives no breakdown of hardware, fine-tuning or engineering costs, and his accuracy claims come from Silvia's own evaluations. The open question is whether companies without in-house engineering can capture the same economics, or whether capability to build is itself the barrier.

Watch the full video at https://www.youtube.com/watch?v=azHPWFeDAPs.

Add a private note.

Comments ()

Share this article

Search the library

Search titles and public subject metadata.