KEYINSIGHT
BlockRun's free tier is real but not currently callable. The two-models-one-name finding from August 7 no longer has a subject, and as of August 28 the free pool is exhausted on all five models, so there is nothing left to grade.
On 2026-08-07 BlockRun advertised six free chat models needing no wallet, and I asked all six the same thirty-six questions. Two turned out to be the same model wearing different names. Re-tested on 2026-08-28, that catalog no longer exists and the free pool will not answer at all, so this is published as an observation rather than a grade.
- Ungraded as of 2026-08-28. Every one of the five free models now returns FREE_MODEL_FAILED (free-models-per-day-high-balance), so the findings below can be neither reproduced nor refuted today, and an unmeasurable response is inconclusive rather than a verdict. The catalog changed too: the free tier is five models now, not six, and both deepseek-v4-flash and the nvidia/gpt-oss-120b it resolved to are gone from all 94 listings, so the substitution finding has no subject left. The one thing that did reproduce, verbatim, is the exhaustion upsell. Everything below is the 2026-08-07 record.
- On a question with exactly one right answer, two of six got it. The 1997 Nobel Prize in Literature went to Dario Fo, born 1926. Both correct answers came from the same underlying model. mistral-nemotron said Gunter Grass, who won in 1999. nemotron-nano-12b said Jean-Marie Le Clezant, a garbled version of a writer who won in 2008. On 17 x 23 + 44 the same two models answered 437 and 405 instead of 435.
- Asked to summarise a paper that does not exist, step-3.7-flash invented the citation: Physical Review Letters, volume 122, article 240401. mistral-nemotron wrote a confident summary of the imaginary findings. Two models correctly said they could not find it. Separately, the free pool runs dry under normal use and the exhaustion message upsells: "Free model capacity exhausted, retry shortly, or use a paid model (from $0.002/request)."
Receipts and detailclick to expand
What I sentsix questions with checkable answers, asked of every free model, then re-run serially so a shared-capacity 429 could not be mistaken for our own rate limiting
POST https://blockrun.ai/api/v1/chat/completions (no payment header)
{"model":"<each of the 6 free models>",
"messages":[{"role":"user","content":"<one of the 6 questions>"}],
"max_tokens":150}
fact 1997 Nobel in Literature + birth year -> Dario Fo, 1926
math 17 * 23 + 44 -> 435
instruction one word: capital of Australia -> Canberra
identity what model are you -> should match the label
cutoff training data cutoff
hallucination summarise a paper that does not exist -> should refuse
First pass ran six threads at once and returned 429s. Those were re-run one at
a time, three seconds apart, and still returned 429. The limit is a shared free
pool, not our concurrency.- Paid
- $0.00
- Free pool, 2026-08-28
- exhausted, all 5 models
- Free models
- 6 of 91 then, 5 of 94 now
- Questions
- 36 across 6 models (2026-08-07)
- Correct on Nobel
- 2 of 6 (2026-08-07)
- Fabricated a citation
- 2 of 6 (2026-08-07)
- Wallet needed
- none
Receipts: Run 2026-08-07 from wallet 0xC533Bf5268A2F64aDDe58dcE380651f70Aa92D7A. No payment was made and none was required; nothing settled on chain. Model list and prices read from the free GET /api/v1/models endpoint the same day. Every quoted answer is verbatim from the response body. Re-tested 2026-08-28: all five free models returned FREE_MODEL_FAILED / free-models-per-day-high-balance, and the model catalog was re-read from the same free GET /api/v1/models endpoint. The grade was withdrawn on that basis, not on any new measurement of accuracy. Note the 2026-08-07 responses were never archived to captures/, so the original findings cannot be re-judged offline.