Join the waitlist
MCP · Benchmark

I put a small model between Claude and my design system. It sped up nothing.

We put a small, fast model between Claude and Axolo's MCP server and measured 56 generated screens. The verdict: no gain in time, no gain in tokens, same quality.

·

When Claude designs a screen from a design system, it starts by reading: the list of components, the tokens, the house rules. That takes a few seconds and several thousand tokens.

One question kept nagging me: what if a small, very fast model answered the simple questions instead of Claude? Less reading for Claude should mean fewer tokens and less waiting. I wanted to measure it rather than believe it.

The idea: a fast lane between Claude and the MCP

Claude talks to Axolo through an MCP server, a set of tools it can call. I added a small decision model between the two: Laya. It weighs about 1.6 GB, runs on an ordinary computer, answers in under a second, and for a closed question returns an answer with a probability.

Where should Laya sit?The idea: a small, fast model between Claude and Axolo's MCP serverA · TodayClaudereads and decidesraw toolsAxolo MCPcomponents, tokens, rulesB · The fast laneClaudeasks the questionLayaanswers in 0.9 sAxolo MCPsame content as in Aconfident: an answer and its probability, straight to Claudeunsure: “uncertain”, so Claude reads it directlyThe hope: fewer tokens read, less time, same quality.
In A, Claude reads everything. In B, it can ask Laya a question. If Laya is confident it answers; otherwise it says “uncertain” and Claude reads for itself.

I exposed four fast-lane tools: find a token's value, find the closest component, pick the rules that matter for a screen, and say who a property is for (designer or developer). Each returns an answer and a confidence level. Below a threshold I set by hand, the answer becomes “uncertain” and Claude keeps control.

The test

The test, in three steps1 · Generate14 screen requests(login, checkout,settings, navigation…)2 passes × 2 conditions= 56 screensClaude Opus 5.52 · ScoreScreens shuffled A / B,judge doesn't know which is whichfixed scoring grid+ automatic checkClaude Opus 5.5 (blind judge)3 · Comparetime per screentool callstokens readjudge scoreA versus BA = Claude + raw tools · B = A + the 4 fast-lane tools (Laya)
14 screen requests, 2 passes, 2 conditions: 56 screens.

The result

Result: A and B tie, B is a little slowerMedian time per screenA · 13.1 sB · 15.4 sInput tokensA · 12,219B · 14,542Blind judge scoreA · 93 %B · 93 %14 requests × 2 passes × 2 conditions = 56 screens, all valid
The fast lane improves none of the numbers.
56 screensA · raw toolsB · raw tools + Laya
Median time per screen13.1 s15.4 s
Tool calls (average)3.23.4
Input tokens12,21914,542 (+19%)
Blind judge93%93%
Automatic check98%99%

No faster, no cheaper in tokens, same quality. Laya itself adds about 0.9 seconds to each screen.

Why it doesn't work

1. Claude prefers to read for itself. In condition B it calls the rules tool on every screen, but keeps reading the full component list and the tokens. It uses the token lookup 13 times in total across 28 screens, and never the component lookup or the property-audience tool. Reading a whole design system costs it a few seconds; a summary from a small model whose reliability it doesn't know isn't worth the detour.

2. Laya is wrong too often when it says it's confident.

When Laya says “confident”, it is wrong almost 4 times in 10Picking which design rules apply to a screen (325 “confident” answers)123 wrong (38%)202 rightTokens (colors, spacing)always answers “uncertain”(shadcn has no spacing token)Prop audienceright 44 times in 100never clears the confidence barComponent choiceClaude never calls it9 right out of 15 during tuning
A confidence score that doesn't tell the truth is worse than no answer.

What I take away

Decision: I'm not plugging Laya into Axolo's MCP. The small model stays reserved for importing design systems, where it does real work with no external API. Next I'll test the most modest option: answers computed by script.

Limits

Read next

All articles on design systems and AI