AI Engineering

Notes on making probabilistic systems shippable: evaluation harnesses, LLM judges, context engineering, agents, and the GCP estate underneath them. Everything here comes from production systems — method extracted from work, written to be reused.

2026-08-05 · evals · harness · agents

Can You Trust an AI to Grade Your AI?

Many teams use one AI model to grade another one's answers, and then let that grade decide what ships. Almost nobody checks whether the grader itself can be trusted. This is what it took, on a real production system, to make the grader reliable enough that a failing score is allowed to stop a release.

Read →

Related: the case study on evaluation gates for a 700,000-student agent system, the GCP dossier, and the working papers on agent harnesses and structural waste.