- Lab
-
Libraries: If you want this lab, consider one of these libraries.
- Cloud
Diagnose a Cost-per-Workflow Regression on AWS
In this lab, you'll investigate an unexpected increase in the cost of completed Amazon Bedrock workflows using pre-seeded workflow telemetry that you query with Amazon Athena. You'll: - Calculate cost per completed workflow before and after a deployment - Identify the routing regression that raised the unit cost - Restore a cost-efficient model route for standard requests - Run a live evaluation to confirm the lower-cost model meets both the unit-cost and answer-quality requirements
Lab Info
Table of Contents
-
Challenge
Find the cause of the cost increase
- Calculate the cost per completed workflow for the baseline and post-deployment periods.
- Compare traffic, token use, completion rate, workload type, and model routing across both periods.
- Submit your diagnosis and the values that support it.
-
Challenge
Correct the model route
- Compare the available models against the lab's unit-cost requirement.
- Return standard requests to Amazon Nova Micro while keeping complex requests on Amazon Nova Pro.
- Confirm that the corrected route meets the cost requirement.
-
Challenge
Verify cost and answer quality
- Run a live evaluation of the corrected route against 16 support-ticket test cases.
- Compare classification accuracy and unit cost with the Nova Pro baseline and the lab's requirements.
- Submit a short summary of what changed, what it fixed, and the evidence behind it.
Real skill practice before real-world application
Hands-on Labs are real environments created by industry experts to help you learn. These environments help you gain knowledge and experience, practice without compromising your system, test without risk, destroy without fear, and let you learn from your mistakes. Hands-on Labs: practice your skills before delivering in the real world.
Learn by doing
Engage hands-on with the tools and technologies you’re learning. You pick the skill, we provide the credentials and environment.
Follow your guide
All labs have detailed instructions and objectives, guiding you through the learning process and ensuring you understand every step.
Turn time into mastery
On average, you retain 75% more of your learning if you take time to practice. Hands-on labs set you up for success to make those skills stick.