Beyond Text Streams: Building Interactive Micro-Frontends with MCP Apps
Why conversational AI needs rich visual components, and how to embed sandboxed interactive widgets into agent chat using MCP.
AI Architect · Distinguished Engineer, AI at Trimble
I set the technical direction for how AI is built into enterprise products, and I lead the platform that makes it possible.
15+ years in production systems taught me where AI breaks. I find it before your users do.
For more than 15 years I have built the shared systems many products depend on. On our AI platform I built the model gateway and the MCP gateway from the ground up, and they carry the platform's model and tool traffic. Today I work on the hard parts of enterprise AI: one architecture for many teams, safe use of models and company data, and a clear bar for what is ready to ship.
Approximate, rounded figures that show the scale of my work.
A retrospective on carrying 130B+ tokens, architecting multi-cloud gateways, scaling Kubernetes with Spot compute, and leading through code.
Focus
One platform shape that many product teams can build on. I design the shared foundation so each team ships AI features without rebuilding the hard parts.
Safe use of models and company data, by design. Access, data boundaries, and guardrails are part of the architecture from day one.
How teams decide an AI feature is good enough to ship. I push for measurement before scale, so quality is a number and not an opinion.
The standards, reviews, and people around the platform. I write decisions down, review designs early, and grow engineers into owners.
Track record
One governed entry point to 60+ models from four providers. It has served 130B+ tokens in production with cross-cloud failover, circuit breakers, and latency telemetry.
Secure, audited access from agents to 120+ MCP servers. Handled 110K+ tool calls with dynamic OpenAPI translation, schema dereferencing, and Token Vault identity.
Migrated compute to Amazon EKS with Karpenter Spot provisioning, cutting batch processing costs by 70–90% while scaling to thousands of concurrent worker pods.
Built IssueOps and GitOps automation where engineers and AI agents safely ship services. Achieved ISO/IEC 27001, SOC 2, and ISO/IEC 42001 compliance as code.
Built company-wide identity serving 30M+ users and an authorization service adopted by 40+ applications. The same foundations now sit under the AI platform.
Writing
Why conversational AI needs rich visual components, and how to embed sandboxed interactive widgets into agent chat using MCP.
How to design a production model gateway that handles provider outages, rate limits, and latency spikes across multiple cloud providers.
How streaming tokens, minute-long connections, and token-based rate limits break standard enterprise API proxies.