Skip to content
jonathanhodak.com

AI systems / engineering leadership

AI systems I build, run, and improve.

I build and operate software and AI systems daily, from architecture and infrastructure to tools and products. My personal lab compresses the engineering feedback loop; firsthand results sharpen the judgment I bring to enterprise platforms.

Current platform workMission Control
  • AI engineering strategy
  • Platform architecture
  • Engineering enablement
  • Agent systems
  • Model strategy
  • Evaluation and evidence
  • Infrastructure
  • Technical execution
Operating systemFIG. 01
StrategyArchitectureEvidence
A stylized view of work moving through an AI engineering system.

Mission Control / system behavior

Watch work move through the system.

Simplified views of systems I design, build, operate, or apply in my engineering work. Most come from my own workshop; the enterprise view describes my professional architecture work across systems owned by many teams.

Selected system view: Evidence and learning

Active system view

BUILDING NOW · PERSONAL EXPERIMENT

Every run can improve the next system decision.

06 / 06
System view
I am building evidence capture into my own agent workflows to record task context, tool activity, candidate results, validation, independent review, and outcomes from agent work.
Engineering value
Validated execution records can support reliability measurement, model comparison, failure analysis, and future specialist datasets; model training remains experimental.
Evidence and learning — conceptual system topologyAn architectural illustration, not live telemetry. Structured execution history supports evaluation now and offers a future path to specialist-model datasets. Execution mode: continuous. Components: Task definition (Goal · constraints); Context used (Sources · provenance); Tool activity (Calls · outputs); Candidate result (Proposed change); Validation (Tests · deterministic checks); Independent review (Findings · confidence); Human decision (Escalation · acceptance); Final outcome (Verified · stopped · revised); Durable evidence (Structured execution history); Workflow evaluation (Reliability · failure analysis); Model routing (Quality · cost · latency); Future specialization (Future training · optional). Ordered stages: Task definition; Context used; Tool activity; Candidate result; Validation; Independent review; Final outcome; Durable evidence. Feedback loop: Durable evidence; Workflow evaluation; Model routing; the next continuous pass explicitly revisits Context used; Tool activity; Candidate result; Validation; Independent review; Final outcome; Durable evidence. Connections: Task definition to Context used; Context used to Tool activity; Tool activity to Candidate result; Candidate result to Validation; Validation to Independent review; Independent review to Human decision (when review escalates) (conditional); Human decision to Final outcome (conditional); Independent review to Final outcome; Final outcome to Durable evidence; Durable evidence to Workflow evaluation (feedback); Workflow evaluation to Model routing (feedback); Durable evidence to Future specialization (conditional); Model routing to Context used (feedback). Optional conditional paths are shown but do not run in the illustrated sequence.Task definitionGoal · constraintsContext usedSources · provenanceTool activityCalls · outputsCandidate resultProposed changeValidationTests · deterministicchecksIndependent reviewFindings · confidenceHuman decisionEscalation · acceptanceFinal outcomeVerified · stopped ·revisedDurable evidenceStructured executionhistoryWorkflow evaluationReliability · failureanalysisModel routingQuality · cost · latencyFuture specializationFuture training · optional
  • idle
  • incoming
  • active
  • outgoing
  • settled

Conceptual sequence · not live telemetry.

Execution sequence

  1. 01
    Task definitionTask definition → Context used
  2. 02
    Context usedContext used → Tool activity
  3. 03
    Tool activityTool activity → Candidate result
  4. 04
    Candidate resultCandidate result → Validation
  5. 05
    ValidationValidation → Independent review
  6. 06
    Independent reviewIndependent review → Final outcome
  7. 07
    Final outcomeFinal outcome → Durable evidence
  8. 08
    Durable evidence

Ongoing learning loop

  1. 01
    Durable evidenceDurable evidence → Workflow evaluation
  2. 02
    Workflow evaluationWorkflow evaluation → Model routing
  3. 03
    Model routingModel routing → Context used

The next pass explicitly revisits Context used → Tool activity → Candidate result → Validation → Independent review → Final outcome → Durable evidence for another pass.

Conditional paths

  • Independent review → Human decision · Escalation · acceptance · when review escalates
  • Human decision → Final outcome
  • Durable evidence → Future specialization · Future training · optional
Conceptual execution · explicit dependencies · not live telemetry
Illustrative architecture / grounded in engineering workExplore system

Current work / enterprise AI platform

Architecture spanning six or more engineering teams.

In my current contractor engagement in a large enterprise retail environment, I contribute architecture to an internal AI platform initiative. I help connect capabilities built by separate teams into a coherent platform and shared employee experience; those teams remain responsible for their systems.

How the scope grew

I contribute cross-team architecture and technical direction. The participating teams build and remain responsible for their systems.

Architecture focus

Connect independent capabilities into a usable platform.

  • Cross-team architectureService boundaries · Integration patterns · Common architecture
  • Application and workflow architectureApplication architecture · Navigation · Workflows
  • Shared AI platform capabilitiesPlatform consolidation · Reusable patterns · Deployment and runtime
  • Engineering enablementStandards · Developer enablement · AI-assisted practice
Explore the platform architecture

AI leadership / operating model

Enterprise AI is an engineering system.

Enterprise AI adoption depends on coordinated engineering across people, platform, models, governance, and product delivery. Model strategy sits inside that wider operating system.

  1. DOMAIN 01

    People

    Build capability and shared practice across engineering teams.

    • Training
    • Adoption
    • Engineering practices
    • Standards
  2. DOMAIN 02

    Platform

    Make useful AI capabilities available through a coherent system.

    • Context
    • Tools
    • Orchestration
    • Evaluation
    • Observability
  3. DOMAIN 03

    Models

    Match model capability to the task and its operating constraints.

    • Routing
    • Cost
    • Latency
    • Capability
    • Local and hosted
  4. DOMAIN 04

    Governance

    Make authorization, validation, and review proportional to risk.

    • Authorization
    • Validation
    • Proportional review
    • Evidence
  5. DOMAIN 05

    Product delivery

    Connect the engineering system to product work and business outcomes.

    • Build
    • Operate
    • Deliver outcomes
Evidence from delivery should shape governance, platform architecture, and model choices as the operating system evolves.

Engineering principles

Direction, expressed as practice.

A system-level approach to making AI useful, affordable, observable, and safe inside real engineering work.

  • 01

    Increase engineering leverage

    AI should increase engineering leverage without removing engineering discipline.

  • 02

    Prefer deterministic systems first

    Use a small, deterministic tool when it can do the job; reserve model reasoning, including frontier models, for work that benefits from it.

  • 03

    Match intelligence to the task

    Use the least expensive model that reliably solves the task, considering latency, privacy, and the cost of failure.

  • 04

    Share platform capabilities; keep domain ownership clear

    Centralize reusable AI capabilities while product teams continue to own their domain behavior and data.

See all eight engineering principles

Career / increasing scope

A progression from operations to AI platform architecture.

My work has moved from training and operational process through engineering, architecture, management, and founding roles to enterprise AI platform architecture.

  1. 01

    Early leadership

    Operational leadership, training, and process

  2. 02

    Engineering foundation

    Web engineering, experimentation, and systems

  3. 03

    Technical leadership

    Mentorship, standards, and platform modernization

  4. 04

    Enterprise architecture

    Front-End Architect

  5. 05

    Engineering management

    Engineering Manager

  6. 06

    Founding engineering

    Founding Engineer

  7. 07

    Current

    Architecture spanning an enterprise AI initiative

See selected leadership evidence

AI Lab / systems and experiments

Working systems and experiments.

Built work, benchmarks, active tests, and future investigations each have their own stage. Results from real use inform the next iteration and my professional judgment.

  • TOPIC 01
    Benchmarking

    Local model performance and routing

    I benchmark local inference on my AMD Strix Halo machine with 128 GB unified memory, comparing context, quantization, runtimes, latency, and task quality before changing routing.

  • TOPIC 02
    Built and used

    Deterministic code exploration

    I built and use indexes, syntax-aware analysis, repository graphs, and targeted retrieval to find relevant code before model reasoning.

  • TOPIC 03
    Testing

    Context-size experiments

    I am testing how context selection and size affect task quality, completeness, latency, and cost.

View the full AI Lab

Technical depth / supporting detail

Hands-on depth, in context.

I stay hands-on across the systems I architect. The tools matter as part of the broader engineering work, not as a list on their own.

I still build and operate across applications, APIs, data, models, and infrastructure. That firsthand work informs my architecture and leadership decisions.

Applications and services

  • TypeScript
  • React
  • React Router
  • Node.js
  • APIs
  • OAuth

Data and retrieval

  • PostgreSQL
  • Supabase
  • Vector search
  • RAG

AI systems

  • MCP
  • Local inference
  • Model orchestration
  • Agent systems
  • Evaluation
  • Observability

Platform and infrastructure

  • Linux
  • Docker
  • Vercel
  • Deployment systems

Contact

Compare notes on what’s working.

I’m glad to compare notes on AI engineering, enterprise platform architecture, or the practical work of bringing AI into engineering teams.

Contact information