// Topics / Reliability
Reliability
34 entries tagged “Reliability”
- Reliability Is the Autonomy Ceiling
· 4 min
Capability earns the demo; measured reliability earns the autonomy. Budget autonomy by failure cost times failure rate.
ai
reliability
operations
Agent Identity Is the New Control Plane
· 4 min
An agent that acts needs an identity—scoped, short-lived, attributable, revocable—not a shared API key.
ai
reliability
security
The Benchmark You Didn't Build
· 4 min
Public benchmarks are contaminated and gamed. The only eval that matters runs on your traffic, your failure modes, your bar—and you own it.
ai
reliability
metrics
Agentic Systems at Scale: The New Reliability Contract
· 4 min
Agentic systems need SRE-style reliability contracts with explicit blast-radius limits, fallback paths, and kill switches.
ai
reliability
operations
The Anti-Fragile AI Organization
· 4 min
The best AI organizations do not merely survive model churn and vendor shocks; they convert each one into a capability they keep.
teams
ai
reliability
Designing the AI Leadership Bench: Roles, Interfaces, and Failure Boundaries
Canon post —
· 2 min
AI scaling needs explicit leadership interfaces between product, platform, reliability, and governance.
leadership
teams
ai
How to Run an AI Incident Review That Changes Architecture, Not Slides
· 2 min
Incident reviews should produce architecture deltas and control updates, not narrative theater.
reliability
ai
governance
AI Production Governance: A Maturity Model
· 4 min
The gap between stable AI features and shipping chaos isn't tools—it's production governance. How mature teams evaluate, deploy, and roll back.
governance
ai
reliability
Why Most Enterprise AI Architecture Fails in Year One
· 3 min
In 2026, enterprise AI isn't failing because models are bad. It is failing because organizations are building brittle demos instead of bounded, operable systems.
architecture
ai
reliability
De-Risking the Black Swan: Red-Teaming Distributed Databases Before Production
· 8 min
Red-teaming distributed databases before production: most catastrophic failures are compound scenarios nobody practiced, not black swans.
distributed-systems
databases
reliability
Building Reliable AI Agents in Go
· 6 min
Reliable agents are engineered, not prompted: bounded tools, validation at every step, explicit recovery paths. Here's how I build them in Go.
agents
reliability
ai
AI Incidents Don't Look Like Outages. That's the Problem.
· 4 min
AI systems can return 200 OK while confidently wrong. How to detect, contain, and learn from AI incidents using proven incident response principles.
incident-management
ai
reliability
Agentic Workflows: From Demo Magic to Production Reality
· 6 min
AI agents that can take actions are fundamentally different from chatbots. The engineering bar must match the blast radius.
agents
ai
production
Why I Run Multiple Models in Production
· 4 min
Betting on a single model provider is like having a single database with no failover. Here is why multi-model is the only sane production strategy.
ai
architecture
llm
Resilient Teams Are Boring Teams
· 4 min
The engineering teams that survived 2022 best were not the ones with the most talent. They were the ones with the least drama.
teams
leadership
reliability
Watching Layoffs From the Inside
· 5 min
What I saw during the 2022 layoff wave, and what actually helps engineering teams survive contraction without burning out.
leadership
teams
hiring
The AWS us-east-1 Outage Was Predictable. Your Architecture Was Not Ready.
· 4 min
December 7 reminded everyone that us-east-1 is a single point of failure for half the internet. Again. I am annoyed.
cloud
incident-management
reliability
What a 3 AM Outage Taught Me About Incident Management
· 6 min
Good incident response is not about preventing failure. It is about failing well. Lessons from a decade of on-call, including national cyber-defense and telecom-scale operations.
incident-management
reliability
Stop Renaming Your Ops Team to SRE
· 5 min
Opinionated take on SRE team models from someone who has seen them all fail in interesting ways.
reliability
teams
leadership
Database Reliability Engineering: What I've Learned the Hard Way
· 7 min
Practical database reliability from running Postgres in production: configs, safe migration patterns, and the operational habits that prevent outages.
databases
reliability
infrastructure
Observability-Driven Development Is Just Instrumenting Your Code
· 4 min
ODD sounds fancy. It's not. It means writing logs, metrics, and traces before you ship, not after your first outage.
observability
development
reliability
Most Chaos Engineering Is Theater
· 3 min
Teams love saying they do chaos engineering. Few actually have hypotheses. Even fewer fix what they find.
reliability
opinion
Your Business Continuity Plan Is Corporate Theater
· 6 min
Most BCP documents are shelf-ware written by consultants. Here's what actually keeps engineering teams running when everything breaks.
reliability
engineering
remote-work
Zero Downtime Deploys Are a Team Habit, Not a Tool
· 5 min
Every team says they want zero downtime. Few want to do the boring work that actually gets them there. Here's what that boring work looks like.
ci-cd
devops
kubernetes
Your Load Tests Are Lying to You
· 3 min
Most load tests produce comforting numbers instead of useful answers. Here's what I learned the hard way about getting honest results.
testing
performance
reliability
Your SLOs Are Probably Useless (Here's How to Fix Them)
· 6 min
Most SLOs are dashboards nobody acts on. Pick indicators that reflect real users, set targets from data, and make error budgets change how your team ships.
reliability
observability
engineering
Design for Failure or It Will Design Your Weekend
· 3 min
Failure is not an edge case but the default state you hold off with good engineering. Hard-won rules for systems that bend instead of shatter.
reliability
architecture
distributed-systems
Async Job Processing: Patterns That Saved Us at a Fintech Startup
· 7 min
Hard-won patterns for reliable background job processing -- queues, retries, idempotency, and the failures that taught me to care about all three.
backend
architecture
reliability
What Building Distributed Systems at a Fintech Startup Taught Me About Failure
· 6 min
Hard-won lessons from designing distributed systems that survive real failures -- timeouts, retries, bulkheads, and the habits that keep things running.
distributed-systems
reliability
architecture
SRE Principles Are Great. The Cargo-Culting Is Not.
· 5 min
The SRE hype train has everyone copying Google's playbook without asking whether it fits. What actually matters when you're not running at planet scale.
reliability
devops
operations
Your Incident Process Will Break at 15 People. Here's What to Do.
· 5 min
What I learned building incident management at the fintech startup — from five people shouting across a room to actual structured response.
incident-management
devops
reliability
You Don't Need to Be Netflix to Break Things on Purpose
· 4 min
Chaos engineering isn't just for the big players. Here's how a small team can start breaking things deliberately and actually learn from it.
reliability
testing
devops
How I Build Data Pipelines That Actually Survive Production
· 6 min
Every pipeline I've built at the fintech startup broke at some point. Here's the design approach that made them recoverable instead of catastrophic.
data
reliability
architecture
Building Resilient Systems: Lessons from Production Failures
· 7 min
Production incidents show where architecture bends and breaks. Lessons on designing for failure, limiting blast radius, and making recovery routine.
reliability
architecture
engineering