AI firm Anthropic slashed its AWS bill 40% by using Karpenter

"If spot instances weren’t available, we had no way to tell Cluster Autoscaler to fall back to on-demand Instances, and we ended up stuck in a few loops…" others note.