Principal AI Engineer, contractor · Laureate International Universities (contract engagement)
Contract engagement on the GenAI program of Laureate International Universities: conversational agents on Google Cloud serving a student population of 700,000+ across two university brands, handling admissions, enrollment, scheduling, routing, and student support.
- Dominant author of the production agent (150 of 191 commits): prompts, tools, business rules as code, appointment and routing logic, with every change landing as versioned prompt, golden cases, and an ADR.
- Built and own the evaluation harness — 80+ test modules, 55 golden case files — with online and offline evaluation, calibration tooling, session harvesting, and A/B rigs for context budgets.
- Calibrated the LLM judge until its verdict could block a release: case-by-case calibration against hand-labeled turns, majority voting, mock-aware temporal anchoring, and a deterministic-only mode for checks a judge should never score.
- Made evaluation a deploy gate with per-environment depth — smoke on integration, full regression on QA — under trunk-based promotion on Azure DevOps, over a Terraform-managed GCP estate: Vertex AI, Google ADK, Cloud Run, IAM, Secret Manager, Cloud Monitoring.
- Shipped beyond the agent: the QA bug-tracking app used by testers, and the costs service with recorded parity fixtures so pricing answers stay verifiably correct.