Section 1: The dataset and the problem
The hidden distribution, the dataset I actually get, and why generative modeling starts there.
Writing
Notes on AI platforms, agent quality, and how software engineering is changing.
Series
I am working through Mathematical Foundations of Generative AI and writing a deeper note for each section, with the visual and the detours that make the formula hold.
The hidden distribution, the dataset I actually get, and why generative modeling starts there.
Pick a parametric family, define a divergence, and minimise it using only samples.
One convex function f turns a density ratio into a divergence. Forward KL, reverse KL, Jensen–Shannon, and total variation are four choices of f.
Rewrite D_f using only sample averages. The convex conjugate turns the density ratio into a critic game — the GAN objective in disguise.
Turn Week 1's abstract sup over functions T into a neural-network critic T_w, creating the two-player saddle-point game J(theta, w).
One engineer’s journey through faster code, rising AI bills, and the work that still needs a human.
AI will not make software engineers obsolete. It moves the value of the work from writing code toward judgment, trust, and people.
Turn Week 1's abstract sup over functions T into a neural-network critic T_w, creating the two-player saddle-point game J(theta, w).
Rewrite D_f using only sample averages. The convex conjugate turns the density ratio into a critic game — the GAN objective in disguise.
One convex function f turns a density ratio into a divergence. Forward KL, reverse KL, Jensen–Shannon, and total variation are four choices of f.
Pick a parametric family, define a divergence, and minimise it using only samples.
The hidden distribution, the dataset I actually get, and why generative modeling starts there.
Why conversational AI needs rich visual components, and how to embed sandboxed interactive widgets into agent chat using MCP.
What the ISO/IEC 42001 standard means when systems move from passive text generation to autonomous, tool-using agents.
How platform engineering eliminates infrastructure bottlenecks while automating enterprise security, compliance, and cloud onboarding through issue-driven GitOps.
Why platform engineers building agentic AI systems choose Amazon EKS Auto Mode over Fargate and ECS, and the real-world trade-offs to watch out for.
How to handle high-cardinality GenAI traces by ingesting once with OpenTelemetry and forking into APM, billing, and ClickHouse.
How to eliminate audit spreadsheets by automating branch protections, code ownership validation, and continuous audit evidence collection.
Why AI agents need their own first-class cryptographic identity alongside user delegation, and how a Token Vault enables secure tool execution.
How to design a production model gateway that handles provider outages, rate limits, and latency spikes across multiple cloud providers.
Why flat virtual networks are dangerous for AI systems, and how to design isolated network zones to prevent SSRF and data exfiltration.
How streaming tokens, minute-long connections, and token-based rate limits break standard enterprise API proxies.
Why safety frameworks must shift from regulating text output to constraining real-world actions when agents use tools.
How to connect AI agents to hundreds of existing internal APIs dynamically using the Model Context Protocol.
Tackling underdetermined and overdetermined linear systems in data science with practical Python code, rank analysis, and least squares solutions.
How to formulate and solve systems of linear equations in data science using matrix representations and the fundamental AX = B formulation.
A practical guide to linear algebra fundamentals for data science, covering matrices, data organization, and finding linear relationships.
An in-depth analysis of evaluation frameworks for AI agents, covering conversational, autonomous, and multi-agent systems with practical insights and methodologies.
An exploration of how AI is transforming coding, with a focus on Cursor IDE and the changing landscape of software development.
A technical deep dive into the four core platform modules: LLM gateways, MCP tool brokers, secure execution sandboxes, and unified telemetry.
An in-depth exploration of architectural patterns and best practices for building enterprise-grade AI platforms that scale.