AIToday
AI Coding AssistantsAmazon AI BlogPublished: Oct 24, 2026, 04:00 JST

AWS CDK construct fixes SageMaker AI auto scaling updates

Send on LINE
AWS CDK construct fixes SageMaker AI auto scaling updates

3 Key Points

  1. What happened

    AWS released a reusable AWS CDK construct that replaces native auto scaling resources with three CloudFormation custom resources, so SageMaker AI endpoint updates and scaling changes deploy together without manual steps.

  2. Why it matters

    Teams running SageMaker AI endpoints through CloudFormation or AWS CDK no longer need to manually deregister auto scaling before updates, and they avoid broken stacks that previously required manual recovery.

WHO IT HITSMachine learning platform engineers and DevOps teams who manage SageMaker AI endpoints with AWS CDK or CloudFormation are the most direct users, since they can now update instance types, counts, or environment variables without separately handling auto scaling registration.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

The problem AWS addresses here is a structural mismatch between SageMaker AI's requirement to deregister a scalable target before changing an endpoint and CloudFormation's inability to track Application Auto Scaling resources once they are deregistered. The post lays out three distinct failure modes: an immediate rejection when auto scaling is still registered, a silent loss of scaling when only the endpoint configuration changes, and a broken stack with a failed rollback when both endpoint and scaling parameters change.

The construct's design reflects those failure modes. It splits the work into three custom resources with explicit dependency ordering: Deregister runs first, the endpoint update proceeds normally, then Register Scalable Target waits for InService status before re-registering, and Attach Scaling Policy waits for the target to become queryable before applying the policy. A ConfigHash property on each resource forces re-invocation whenever either the endpoint or auto scaling configuration changes.

The post also details the resource footprint: the deployed stack contains three custom resources, two Step Functions state machines, and twelve Lambda functions, of which five hold the construct's own handler code and seven are generated by the CDK provider framework. For teams already managing SageMaker AI endpoints through CDK, the construct can be copied into an existing project and added alongside current endpoint resources.

FAQ
Why do SageMaker AI endpoint updates fail when auto scaling is enabled?
SageMaker AI rejects the update because the variant must be deregistered as a scalable target with Application Auto Scaling before the instance type can be changed. CloudFormation tries to update the endpoint while the scalable target is still registered, causing the deployment to fail.
What happens if I manually deregister auto scaling before redeploying?
If only the endpoint configuration changes, the deployment succeeds but CloudFormation does not re-register auto scaling, leaving the endpoint running without scaling. If auto scaling parameters also change, the update fails because the scalable target no longer exists, and the rollback also fails, leaving the stack broken.
How many Lambda functions does the construct add to my stack?
The deployed stack contains three custom resources, two Step Functions state machines, and twelve Lambda functions. Five of those functions hold the construct's own handler code, while the remaining seven are generated by the CDK provider framework.
How long does the construct wait for the endpoint to become ready?
Register Scalable Target has a total timeout of 1 hour, and Attach Scaling Policy has a total timeout of 15 minutes. Both use an asynchronous completion pattern that checks readiness every 30 seconds.
Amazon AI BlogRead Original Article
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleOpenAI's Habitat cuts read latency to 10 ms for 1B users