All posts/tagged
#post-mortem
4 posts
- kubernetes9
- guide7
- containers4
- docker4
- post-mortem4
- ci-cd3
- jenkins3
- freelens2
- gpu2
- networking2
- nvidia2
- open-source2
- scaling2
- airgap1
- architecture1
- certification1
- dns1
- ebpf1
- finops1
- git1
- gke1
- history1
- kernel1
- linux1
- messaging1
- meta1
- mig1
- nextjs1
- observability1
- performance1
- personal1
- prometheus1
- python1
- rabbitmq1
- security1
- tls1
MIG vs MPS in Kubernetes: Re-Carving a GPU Is Not a Pod Restart
What MIG and MPS actually give you on A100/H100, why the GPU Operator won't let you mix them on one node, how I ran one service on MPS anyway — and the three ways a MIG change took GPUs (and once, the whole node) down.
·9 min read
The Physics of Kubernetes: What Happens When You Force a Live Cluster Into Isolation
A deep dive into the cascade failures that occur when you simulate air-gapped environments on live infrastructure, and the physics of Kubernetes state management
·10 min read
How DNS Resolution Became Our CI/CD Bottleneck at 600+ Daily Builds
When Jenkins scaled from 50 to 600+ builds per day, DNS resolution failures brought everything down. Here's how Linux networking knowledge saved us.
·11 min read
How a Single-Node Kubernetes Cluster Accidentally Grew to 550 Pods
A cautionary tale about scope creep, resource management, and the slippery slope of infrastructure growth that nobody planned for
·9 min read