Reading benchmark results carefully
Define the evaluation contract, inspect uncertainty, and check prompt sensitivity before treating a score as evidence.
Independent reference
LLM Model Notes
Clear, practical guides to evaluation design, inference constraints, and the trade-offs behind model comparisons.
Updated · See the project log
Current notes
Latency, throughput, and context
Measure first-token delay, generation cadence, and capacity under a workload another person can reproduce.
Repeatable model comparisons
Turn a product question into a pinned manifest, paired observations, and a compact result bundle.