
What next-token prediction does and does not explain
Trace a small probability table to understand autoregressive language models, sequence likelihood, decoding, and why fluent text still needs evidence.
The journal / Ideas in progress
Engineering & everyday learningSoftware, systems, and the things I’m learning along the way. From first principles to AI in production.
Find something to readA little theory. A lot of practice.

Trace a small probability table to understand autoregressive language models, sequence likelihood, decoding, and why fluent text still needs evidence.

Map MCP hosts, clients, and servers to discovery and tool calls, understand the protocol boundary, and keep authorization outside generated text.

Turn a vague CSV export fix into a bounded task with a failing example, data checks and clear handoff, while separating serialization from delivery and import.

Write the same twelve trips in two orders, inspect actual date statistics, and distinguish column projection, candidate row groups and measured query results.

A postal-address export demonstrates why line counts are not row counts. A worked analytical example with explicit assumptions and checked results.

Use stable merge sort to preserve registration order among equal scores, trace the tie decision, and explain what stability does and does not guarantee.

Choose a simple task-specific baseline, freeze the evaluation set, and interpret an LLM result against correctness, abstention, and operating cost.

Replay committed assignments, reject an unfinished tail, and expose the ordering failures that lose atomicity when home data or log deletion happens too soon.

Use RFC 9457 Problem Details for stable API errors, with field-level validation data, safe diagnostics and client behavior that survives wording changes.

Choose a programming project with fictional data and a repeatable reset, then add real-world constraints deliberately.

Repair AVL imbalance with rotations that preserve in-order keys, follow the transferred middle subtree, and update stored heights in the right order.

Follow a weather lookup through tool selection, argument validation, execution, and response correlation while keeping application authority explicit.