AI Engineering Lab

Project Catalog

A project-based path through AI systems engineering. Every concept is introduced because it solves a real engineering problem — you read, build, break, evaluate, and reflect.

How each project works

  1. Read the lessonUnderstand the concept and why it exists
  2. Explain it in your own wordsWrite it down before any code
  3. Build the projectImplement the core yourself
  4. Test your understandingBreak it on purpose; measure it
  5. Write a reflectionWhat surprised you? What would you change?

Two formats, one source of truth. .md files (e.g. source/lesson.agent.md) are the canonical, dense versions written for LLM / agent consumption. .html files (e.g. rendered/lesson.html) are the progressive, visual versions for human learners. When they differ, the Markdown agent version wins. Browse the rendered Source Map for every source note.

Available now

01

AI Chatbot

A multi-turn conversational AI with streaming, a persistent system prompt, configurable context windows, and real-time token/cost tracking — you build the conversation loop yourself, not a wrapper around a chat UI.

Foundational Available ~4–8 hrs Requires: start here
LLM APIsstreamingsystem promptcontext windowtoken costprovider abstraction
05

Personal Memory System

A persistent memory system that gives an AI assistant memory across conversations — scoring memories on relevance, recency (exponential decay), and importance, across episodic (what happened), semantic (what is true), and procedural (how to do things) kinds.

Intermediate Available ~10–15 hrs Requires: Project 02
memory streamretrieval scoringrecency decayimportanceepisodic/semantic/procedural
06

AI Coding Copilot

A context-aware coding copilot that reads your codebase through tools — file read, directory listing, code search — and answers grounded in the real files, not a guess. The learning target is tool use and the agentic loop (ReAct): the model requests a tool, you execute it, feed the result back, and repeat until it answers.

Intermediate Available ~10–14 hrs Requires: Project 01, Project 03
tool useagentic loopReActcontext injectionsandboxing
07

AI Evaluation Framework

A reusable evaluation harness for measuring AI system quality: LLM-as-a-judge scoring, a pass-rate decision, and regression testing — re-score a frozen dataset after a prompt/model change and catch what got worse. The learning target is the judge (prompt + robust parse) and turning scores into decisions, with its biases (position, verbosity, self-enhancement) reproduced as failure analysis.

Intermediate Available ~8–12 hrs Requires: Project 01, Project 04
LLM-as-judgejudge biasespass-rateregression testingfaithfulness
08

AI Agent

An autonomous, multi-step agent built by making Project 06's tool loop reliable: loop/stuck detection, a steps-and-tokens budget, tool-error recovery, and run evaluation (completion, efficiency, cost) — plus the judgment of when not to use an agent at all. The tool layer is provided; the learning target is the reliability layer that keeps an autonomous loop from going wrong.

Intermediate Available ~12–16 hrs Requires: Project 06
autonomous agentstuck detectiontoken budgetfailure recoveryagent evaluation
09

Personal Learning OS

The capstone: a personal AI operating system that orchestrates memory, retrieval, the agent, and evaluation behind one routing front door for personal knowledge management. The direct prototype for StarcallOS patterns.

Intermediate Available ~15–20 hrs Requires: Projects 0508
system designorchestrationquery routingknowledge graphs

Electives

Optional, off-spine labs that go deeper on a focused topic. Not part of the numbered 1–9 sequence and they gate nothing — take them after the prerequisites listed on each card.

E1

MCP Interface Layer

Stop hand-wiring tools into one app loop. Wrap Project 05's memory system as a Model Context Protocol server — tools, resources, and a prompt — then consume that one server from two different hosts. The learning target is the provider/consumer split (M×N → M+N): turning a subsystem into a reusable protocol surface, with a real trust boundary. The backend and transport wiring are provided.

Advanced Available ~10–14 hrs Requires: 05, 06, 08
MCPprovider/consumer splittools/resources/promptsstdio vs HTTPtrust boundary