A company building GPU infrastructure for machine learning models describes their five-year evolution from naive ECS containers to Kubernetes-based systems. They detail persistent challenges with cold starts, image loading, and autoscaling, discovering that Knative's design optimized for web traffic couldn't handle their GPU-intensive inference workloads.