> ## Content Index
> Fetch the complete content index at: https://nnutshell.com/llms.txt
> Use this file to discover other available public pages before exploring further.

# Fine-tuned in-house models cost 97% less, Pompliano claims
- URL: https://nnutshell.com/fine-tuned-in-house-models-cost-97-less-pompliano-claims/
- Published: 2026-10-26T04:44:21.000Z
- Updated: 2026-10-26T04:44:21.000Z
- Description: Silvia CEO Anthony Pompliano argues businesses will migrate from rented frontier models to owned, specialized intelligence, but his evidence comes from one personal finance product and one cost comparison.
- Author: Admin
- Tags: Anthony Pompliano, Silvia, Fintech, Foundation Models, Inference, Consumer AI, #rec-2026-10-07

*Recorded 7 October 2026 · 24 min*

Anthony Pompliano, chairman and CEO of Silvia, says processing 500 million tokens costs about $5,000 on a frontier model and about 97% less on fine-tuned models running on a company's own hardware. He claims the cheaper option is also faster and more accurate, and he expects businesses to move from renting intelligence to owning it. Sophia, host of MTS, interviews him on the day his second book launches.

The claim rests on Silvia's own results rather than a broad body of evidence. Pompliano concedes that many companies lack the engineers, time or appetite for liability to follow. The conversation also covers his book on personal agency and his macro views on interest rates and Bitcoin, where he reads resilience against headwinds as a signal of strength.

1. **Outcomes as receipts** — [▶ 2:48](https://www.youtube.com/watch?v=azHPWFeDAPs&t=168s&ref=nnutshell.com)  
Pompliano's book rests on the premise of agency: the state of your life is largely the direct outcome of past decisions, much like fitness, and good habits stack in both directions. Once people see it that way, they ask what to change. His example is that success means being excited to go to work and also to go home; if not, change the job, the team or perhaps the relationship. He says none of the 50 ideas are original, and suggests implementing three at a time.
2. **Silvia's proprietary AI stack** — [▶ 14:20](https://www.youtube.com/watch?v=azHPWFeDAPs&t=860s&ref=nnutshell.com)  
Silvia removed the majority of frontier models and built its own harness, a file system and memory, a model router and data pipelines. Pompliano says the system is more accurate than every frontier model on tax, mortgage and credit card questions, and the company open-sourced its eval rubrics. He reports over 20,000 users, an average of $2.5 million or more attached per account, and over $60 billion in connected assets in about 18 months.
3. **The wealthy independent investor** — [▶ 17:58](https://www.youtube.com/watch?v=azHPWFeDAPs&t=1078s&ref=nnutshell.com)  
Budgeting apps proliferate, Pompliano argues, because they target the largest addressable market and are built by early-career engineers solving a problem they understand: saving money. Silvia targets a different cohort: wealthy independent investors with complex finances who distrust large financial firms, do not care about saving $5 at Starbucks, and want to retain control over decisions on taxes and estate planning. His lesson is to pick the most valuable group, not the biggest number of users.
4. **The 97% token discount** — [▶ 19:05](https://www.youtube.com/watch?v=azHPWFeDAPs&t=1145s&ref=nnutshell.com)  
Processing 500 million tokens through a frontier model costs about $5,000, Pompliano says. The same volume on Silvia's fine-tuned models on its own hardware is about 97% cheaper. He adds that the owned approach has lower latency and higher accuracy, so cost and quality stop trading off in specialized workflows. The transcript does not say whether the figure includes hardware, fine-tuning or engineering costs. He calls it the most eye-opening lesson from a 6-to-9-month crash course in specialized versus general AI.
5. **Interest is not adoption** — [▶ 19:54](https://www.youtube.com/watch?v=azHPWFeDAPs&t=1194s&ref=nnutshell.com)  
Pompliano concedes that many businesses will not switch even if the economics are compelling. They may not understand the approach, want the time or liability, or have the engineers. His forecast is a migration path: companies start with the large model labs, then move toward owning their intelligence. He calls it a shift of tectonic plates that investors should watch. He gives no timeline. Editorially, the barriers he lists are ones Silvia addressed by building its stack itself.
6. **Rates stopped biting** — [▶ 20:40](https://www.youtube.com/watch?v=azHPWFeDAPs&t=1240s&ref=nnutshell.com)  
Interest rates rose 25 basis points while US stocks hit all-time highs, which Pompliano says violates economics 101\. His conclusion is that the economy is less sensitive to interest rates than assumed. He declines to call this good or bad and urges people to revisit prior assumptions. The evidence offered is the single recent episode, and the discussion proposes no mechanism for the reduced sensitivity.
7. **Bitcoin strength despite headwinds** — [▶ 21:16](https://www.youtube.com/watch?v=azHPWFeDAPs&t=1276s&ref=nnutshell.com)  
Pompliano argues a new Bitcoin bull market is underway because the price rose despite rising 10-year yields, oil around $100, general fear of an AI bubble and the Clarity Act failing to pass. If those headwinds eased, he reasons, Bitcoin would be significantly higher. He expects net new demand from Wall Street FOMO, a theme he attributes to Jordy Visser, and from AI agents expanding the addressable market. This is a forecast, and the demand claims are unquantified.

Pompliano's central claim is that once a workload is specific enough, the economics of AI favor owning intelligence over renting it. His example is stark. Processing 500 million tokens through a frontier model costs about $5,000\. On Silvia's fine-tuned models running on its own hardware, he says, it costs about 97% less. He adds that latency is lower and answers are more accurate. If all three hold, the familiar tradeoff between cost and quality disappears. A business would not be weighing savings against capability. It would be choosing between a slower, pricier, less accurate option and a better one.

Why would a specialized system beat frontier models? Pompliano offers no technical theory beyond what Silvia built. The company removed the majority of frontier models and replaced them with its own harness, a file system and memory, a model router and data pipelines. That list suggests, though he does not say so, that the advantage lies in the whole system rather than any single model. Routing, memory and data can all be tuned to a narrow domain. His evidence is that the system outperforms every frontier model on tax, mortgage and credit card questions, with eval rubrics open-sourced so the method can be inspected.

The choice of market shapes this result. Pompliano argues that consumer finance products skew toward budgeting because the addressable market is largest and because early-career engineers build what they understand. Silvia targets wealthy independent investors with complex finances, who want control over decisions on taxes and estate planning. He reports over 20,000 users, an average of $2.5 million or more attached per account, and over $60 billion in connected assets in about 18 months. Editorially, tax and mortgage questions are also domains where answers can be checked, which is where specialization is easiest to demonstrate.

Pompliano is candid that interest does not equal adoption. Many businesses will not switch because they do not understand the approach, do not want the time or liability, or lack engineers. His forecast is a migration: companies start with the large model labs and then move toward owning their intelligence. He calls this a shift of tectonic plates that investors should track. The forecast comes without a timeline. The barriers he lists are also telling. Silvia cleared them by building in-house, which suggests the ability to build may matter as much as the model itself.

The evidence also has limits. The headline figure is a single comparison from the CEO of a company that benefits from the conclusion. The transcript does not say whether the 97% accounts for hardware, fine-tuning or engineering, or whether the two sides were measured on identical tasks. The accuracy claims rest on Silvia's own evaluations, even if the rubrics are public. None of this makes the thesis wrong. It means the number works better as an illustration of what specialization can achieve in one domain than as a general model of AI costs.

The same habit of reasoning runs through Pompliano's macro views. He starts from observations that contradict the textbook. Interest rates rose 25 basis points and stocks reached all-time highs, so he concludes the economy is less sensitive to rates and tells people to revisit their prior assumptions. Bitcoin rose despite higher 10-year yields, oil around $100, fear of an AI bubble and the failure of the Clarity Act. If those headwinds had eased, he reasons, it would be significantly higher. Demand, he expects, will come from Wall Street FOMO and from AI agents expanding the addressable market. This is forecasting, and the counterfactual cannot be tested.

The thread connecting the book, the product and the market calls is a preference for evidence over inherited assumptions, and for acting on it. Pompliano's book argues that people's circumstances are largely the receipt of their decisions. His AI argument applies that logic to companies: capability goes to those who build it rather than rent it. The harder question is whether the build-versus-rent calculus remains stable. His case depends on a gap between frontier and specialized systems in narrow domains, and the discussion does not examine how long that gap would last.

**The open question.** Does the 97% cost advantage survive full cost accounting, and does it hold outside narrow domains like tax and mortgage questions? Pompliano gives no breakdown of hardware, fine-tuning or engineering costs, and his accuracy claims come from Silvia's own evaluations. The open question is whether companies without in-house engineering can capture the same economics, or whether capability to build is itself the barrier.

Watch the full video at [https://www.youtube.com/watch?v=azHPWFeDAPs](https://www.youtube.com/watch?v=azHPWFeDAPs&ref=nnutshell.com).