Day 11. Both AWS and LLM bills surprise people every month. Doing this once properly so we know the levers in advance and can build cost-conscious systems from day one.
Topics to cover:
- AWS cost basics — Cost Explorer, Budgets, tagging strategy that actually works
- Compute levers — Savings Plans, Spot, ARM/Graviton, right-sizing Lambdas
- Data levers — S3 storage classes + Intelligent-Tiering, RDS reserved, CloudWatch retention
- LLM cost levers — prompt caching, model routing (haiku → sonnet), batch APIs
- Semantic caching, response caching, and rule-based pre-checks before the model runs
Plan: Chandana on the AWS cost levers (Cost Explorer, Savings Plans, S3 tiers), me on the LLM cost levers (caching, routing, budgets), both writing up the actual bill numbers we hit.
Day 11. Both AWS and LLM bills surprise people every month. Doing this once properly so we know the levers in advance and can build cost-conscious systems from day one.
Topics to cover:
Plan: Chandana on the AWS cost levers (Cost Explorer, Savings Plans, S3 tiers), me on the LLM cost levers (caching, routing, budgets), both writing up the actual bill numbers we hit.