Server tuning barely moved the bill. The GPU and the number format did: how Docket-3B got to about a cent per million tokens, and why I'd still run it in FP8.
THE NOTEBOOK
Writing.
Notes on engineering, AI, productivity, and things
I couldn’t stop thinking about.
2026
4 postsDocket started as an attempt to build a self-hosted, Jev-style decision model. What worked, what didn't, and how a 3B model went from 54% to beating the hosted reference on enterprise decisions.
Building a personal AI assistant exposed a harder problem than reasoning: letting a browser agent authenticate safely.
I had ideas. I just never published them. So I built a workflow that gets out of the way.
2025
4 postsA short Uber ride became a lesson in the trade-offs we make in the name of efficiency.
Thinking through the costs of compromise and the clarity that comes from choosing a direction.
Notes from judging an Open Source AI Hackathon at Microsoft Reactor in Seattle.
Following a Microsoft API defect through integration layers reveals the hidden cost of abstractions.
2024
1 postComparing real-time options data APIs through the lens of a hobbyist’s requirements and budget.