AI Gateway introduces per-user and per-key budgets for coding tokens

According to AI Gateway's recent announcement, the company is introducing per-key and now per-user budgets for managing coding tokens to prevent uncontrolled infrastructure costs. The issue is illustrated by the price range of an AWS machine, from t3.nano at $3.80/month up to p5.48xlarge at as much as $40,000/month, so oversight and cost optimization are important.