CertNote/ Commute Study Notes
Roadmap
KOEN
CLF-C02 · FoundationalCloud Practitioner - Foundational
DVA-C02 · AssociateDeveloper - Associate
SAA-C03 · AssociateSolutions Architect - Associate
SOA-C02 · AssociateCloudOps Engineer - Associate
SAP-C02 · ProfessionalSolutions Architect - Professional
DOP-C02 · ProfessionalDevOps Engineer - Professional
Linux Master 2 · 2급KAIT Linux Master - Level 2
SCS-C03 · SpecialtySecurity - Specialty
Linux Master 1 · 1급KAIT Linux Master - Level 1
MLA-C01 · AssociateMachine Learning Engineer - Associate
  • Week 1
    • 1.The ML Lifecycle and the Role of the ML Engineer
    • 2.ML Problem Types and Evaluation Metric Basics
    • 3.AWS ML Stack at a Glance
    • 4.SageMaker Overview: Studio, Training/Inference, Built-in Algorithms
    • 5.Week 1 Comprehensive Review — ML Fundamentals & AWS Stack
  • Week 2
  • Week 3
  • Week 4
  • Week 5
  • Week 6
  • Week 7
    • 1.SageMaker Pipelines: Steps, DAG, Parameters, Condition Steps
    • 2.Model Registry & Model Governance: Model Package Groups, Approval Workflows, Version Management
    • 3.CI/CD for ML: SageMaker Projects, CodePipeline/CodeBuild Integration, Automated Deployment
    • 4.IaC & Workflow Orchestration: CloudFormation/CDK, Step Functions, EventBridge, Airflow (MWAA)
    • 5.Week 7 Synthesis: MLOps Review
  • Week 8
  • Week 9
  • Week 10
AIF-C01 · FoundationalAI Practitioner - Foundational
DEA-C01 · AssociateData Engineer - Associate
MLS-C01 · SpecialtyMachine Learning - Specialty
SQLD · 개발자SQL Developer (SQLD)

© CertNote · 주간랩스

  • About
  • Changelog
  • Contact
  • Terms
  • Privacy
← MLA-C01/Week 7/Day 5

Based on the MLA-C01 exam guide·Report an error

MLA-C01· AssociateWeek 7 · Day 5~29 min read

Day 5 - Week 7 Synthesis: MLOps Review

📌 Key Takeaways

  • This week implemented the three MLOps principles of automation, reproducibility, and governance with SageMaker ecosystem tools.
  • The full chain: code push → Build → quality gate → register → approve → EventBridge → Deploy → staging → manual approval → production.
  • Orchestrator selection rests on three criteria: scope covered + existing assets + trigger type.
  • Two axes are easy to confuse: Pipelines vs Step Functions vs MWAA (workflows) and EventBridge (a trigger is not a workflow).
  • The exam does not ask for tool names; it asks for a scenario keyword → tool mapping. It is worth memorizing the keywords.

MLOps End-to-End Flow at a Glance

We coded workflows with Pipelines (Day 1), managed versions and approvals with the Registry (Day 2), automated everything from commit to deployment with CI/CD (Day 3), and standardized it with IaC and orchestrators (Day 4). Now we connect it all into one chain.

[Code push] → CodePipeline(Build) → CodeBuild → SageMaker Pipeline
   (preprocess → train → evaluate → ConditionStep[accuracy gate] → RegisterModel)
        ↓ Model is registered in the Registry as PendingManualApproval
[Reviewer approves: Approved]
        ↓ EventBridge detects the approval event
   CodePipeline(Deploy) → deploy to staging with CloudFormation → automated tests
        ↓ Manual approval gate
   Deploy to production endpoint

This one diagram is the whole week. If you can name the service that implements each arrow, you are prepared for the exam.

Link in the chainService responsibleWithout this link
Detecting code changesCodePipeline source stageA person has to run it by hand every time
Running commandsCodeBuild (buildspec.yml)No compute to start the pipeline
Training/evaluation orderSageMaker Pipelines (DAG)Order and dependencies exist only in someone's head
Quality verdictConditionStepA model that misses the bar is registered anyway
Versions and approvalModel RegistryCannot prove what was deployed
Approval detectionEventBridgeApproving triggers nothing
Deployment executionCodePipeline + CloudFormationEndpoints are updated by hand
Production controlManualApproval actionDefects reach users immediately

💡 Related theory: The three core principles of MLOps are automation, reproducibility, and governance. Automation replaces manual intervention with triggers and pipelines; reproducibility guarantees the same result by version-controlling code, data, and infrastructure; governance tracks and controls who approved and deployed what. Every service this week is a tool that implements at least one of these three.

MLOps principleImplementing toolsWhere this week
AutomationEventBridge, CodePipeline, CodeBuild, SageMaker ProjectsDays 3-4
ReproducibilitySageMaker Pipelines (parameters, DAG), CloudFormation/CDKDays 1, 4
GovernanceModel Registry (approval status, Lineage), ManualApproval actionDays 2-3

Core Review by Day

Day 1 - SageMaker Pipelines

  • A SageMaker-native service that orchestrates an ML workflow as a DAG defined in code.
  • Step types: ProcessingStep, TrainingStep, TuningStep, RegisterModel, ConditionStep, TransformStep, LambdaStep, CallbackStep, FailStep, and more.
  • Parameters inject values at execution time → the same definition is reused across environments.
  • Condition steps build quality gates such as an accuracy threshold, automatically blocking poor models.
  • When one step's output is referenced as the next step's input, the dependency automatically becomes a DAG edge. Without a reference, steps run in parallel.

Day 2 - Model Registry & Governance

  • Registering into a Model Package Group (a purpose-based bundle) automatically increments the version.
  • Each version holds the artifact, inference image, evaluation metrics, and approval status.
  • Approval status: PendingManualApproval → Approved / Rejected.
  • An approval status change fires an EventBridge event → wired to a deployment trigger.
  • Linked with SageMaker Lineage to provide data → training → model → deployment traceability (auditing). Rollback means redeploying the previous approved version.

Day 3 - CI/CD for ML

  • SageMaker Projects: A Service Catalog template provisions the repository, CodePipeline, CodeBuild, Registry, and EventBridge in one go.
  • Build pipeline (triggered by code push) vs Deploy pipeline (triggered by model approval).
  • Service roles: CodeCommit (source), CodeBuild (build, buildspec.yml), CodePipeline (orchestration), CloudFormation (deployment), EventBridge (trigger).
  • Staging → manual approval gate → production deployment minimizes the blast radius.
  • Approval happens twice. Approved in the Registry and the ManualApproval in CodePipeline are different decisions.

Day 4 - IaC & Orchestration

  • CloudFormation/CDK: Infrastructure as code (IaC) - idempotency, reproducibility, environment consistency. CDK, once synthesized, becomes CloudFormation.
  • Step Functions: A state machine that connects multiple AWS services (Choice, Parallel, Retry, Catch). SageMaker is awaited to completion with .sync.
  • EventBridge: Schedule (cron) or event-based triggers - the signal that starts a workflow.
  • MWAA: Managed Airflow - existing Airflow assets, hybrid setups, complex DAGs.

Decision Criteria for Choosing Tools on the Exam

The easily confused comparisons, pinned down in tables.

Scenario keywordCorrect tool
SageMaker-job-centric, lineage/Registry integrationSageMaker Pipelines
Orchestrating multiple AWS services (Lambda/Glue/SNS, etc.)Step Functions
Reproduce and version-control infrastructure as codeCloudFormation / CDK
Start a workflow at a set time or on an eventEventBridge
Existing Airflow assets, hybrid, multi-cloudMWAA
Quickly stand up MLOps CI/CD infrastructure from a templateSageMaker Projects
Model version tracking, approval, auditingModel Registry
Register only when the accuracy bar is metConditionStep in Pipelines
Automatic deployment on model approvalRegistry approval → EventBridge → CodePipeline
Human control right before production releaseCodePipeline ManualApproval action
Mark a below-threshold result as a failure and notifyelse_steps=[FailStep] in ConditionStep
Run the same definition differently for dev/staging/prodPipeline Parameter

The three workflow tools appear side by side especially often, so memorize them axis by axis.

Comparison axisSageMaker PipelinesStep FunctionsMWAA (Airflow)
Scope coveredCentered on SageMaker jobsAWS services broadlyAWS plus on-premises and external
Lineage/Registry integrationNatively strongWeak (wire it yourself)Weak
Operating modelManaged (billed per job)ServerlessAlways-on environment (idle cost)
Definition styleSageMaker Python SDKState machine (JSON/ASL)Python DAG + operators
Deciding factor"SageMaker alone is enough""Many steps live outside SageMaker""We already use Airflow"
# Synthesis concept code: at the end of the pipeline, register if the condition passes → approval triggers deployment
# 1) Pipelines: ConditionStep(if_steps=[RegisterModel])  → quality gate
# 2) Registry: ModelApprovalStatus = "Approved"          → governance
# 3) EventBridge: ModelApprovalStatus=["Approved"] pattern   → CD trigger
# 4) CodePipeline + CloudFormation: staging→approval→production → safe deployment

Tracing the Chain Backwards

The exam does not only ask front to back. It also asks the reverse question: "prove where the model now running in production came from."

Production endpoint
     │  EndpointConfig → Model
     ▼
Model Package (version N)       ← Model Registry
     │  approval status · approver · ApprovalDescription
     │  ModelMetrics (evaluation metrics)
     ▼
Training Job                    ← with which Estimator and hyperparameters
     │  ModelArtifacts.S3ModelArtifacts
     ▼
Processing Job (preprocessing)  ← with which input data
     ▼
Raw S3 dataset · Git commit hash
  • The point where this chain breaks is usually manual intervention. A model built by hand in the console or an artifact uploaded from a laptop has no lineage.
  • So when "auditable" is required, the answer is always registration through the pipeline + Registry + Lineage, not log searching or S3 versioning.
Audit questionWhere the answer lives
Which version is deployed right nowEndpointConfig → Model → Model Package ARN
What was that version's performanceModelMetrics on the Model Package
Who approved it and whenApproval status change history, ApprovalDescription
What data was it trained onLineage → Training Job → input channel S3 path
Why did this model passConditionStep result of the pipeline execution

Common Pitfalls Summary

  • Pipelines vs Step Functions: "SageMaker only" means Pipelines; "many services broadly" means Step Functions. Both are DAGs, but the integration scope differs.
  • EventBridge is not a workflow: It is only a start signal (trigger); the workflow itself is carried out by Pipelines/Step Functions/CodePipeline.
  • MWAA is the answer for "when you already use Airflow": If you are starting a new project inside SageMaker, Pipelines comes first. MWAA shows up alongside existing-asset or hybrid keywords.
  • Approval status change = CD trigger: "Automatic deployment on model approval" is almost always the chain Registry approval → EventBridge → CodePipeline.
  • ConditionStep = quality gate: "Register/deploy only when accuracy is at or above the threshold" points to ConditionStep.
  • CDK is not a replacement for CloudFormation: Its synthesized output is a CloudFormation template. The question is not "which is more powerful" but how you author.
  • Keep parameters as objects: Pulling out default_value kills runtime injection.
  • Approval shows up twice: Approved in the Registry (the decision to put it on the deployment flow) and ManualApproval in CodePipeline (the decision to release to production) are different gates.
  • Do not mix up CodeBuild and CodePipeline: The compute that actually runs commands is CodeBuild; CodePipeline only manages the order.

Final Check: Situation → What to Choose

SituationAnswer
Retraining must run automatically every day at dawnEventBridge schedule rule → pipeline execution
You approved, but deployment does not startCheck the EventBridge rule pattern and target connection
Steps run simultaneously with no orderAdd dependencies through output references or depends_on
You must submit the deployed model's provenance for an auditModel Registry + SageMaker Lineage
The new model is bad and must be reverted immediatelyRedeploy with the previous approved version's ARN (rollback)
dev/prod endpoint configurations differ from each otherUnify them with a CloudFormation/CDK template
A Glue ETL and a Lambda notification must be tied into one flowStep Functions
A below-threshold run ended as a success and nobody noticedExplicit failure with else_steps=[FailStep]
Preprocessing reruns on every execution and costs too muchCacheConfig on the steps that do not change
On-premises jobs must be tied into one DAGMWAA
You must build the repository, pipeline, and Registry from scratchSageMaker Projects template
Approval is automatic, but a human checks only the production releaseAutomatic approval + CodePipeline ManualApproval

💡 Concept: The fastest way to solve this week's questions is to decide the layer first. Decide which of four layers is being asked: "what exists (IaC) / what runs in what order (workflow) / when it starts (trigger) / who is accountable (governance)". Usually two of the four answer choices are tools from other layers and are eliminated immediately.

Next week we move on to monitoring and observability for deployed models.

📖 Glossary

  • MLOps: A way of building, deploying, and watching models through automated pipelines rather than by hand.
  • Automation, reproducibility, governance: The three MLOps principles. Reduce human intervention / guarantee the same result / leave a record of who approved.
  • Quality gate: An automated checkpoint that passes only models that clear a performance bar to the next stage. In Pipelines, ConditionStep plays this role.
  • CI/CD chain: The entire automated path from code push to production deployment.
  • Build pipeline / Deploy pipeline: The former runs through training and registration when code changes; the latter runs through deployment when a model is approved.
  • Trigger: A signal that starts a workflow. It is either a schedule or an event. It is different from the workflow itself.
  • Orchestrator: A tool that manages the execution order, branching, and retries of multiple tasks. Pipelines, Step Functions, and MWAA belong here.
  • Lineage: A connection record that lets you trace back which data, code, and jobs produced this model.
  • ManualApproval gate: A human checkpoint placed in the middle of an automated deployment flow. A device for reducing the blast radius.
  • Rollback: Returning to the last good version when a new deployment is wrong. Possible because versions remain in the Registry.

📝 Practice Questions

Click a choice to reveal the answer and explanation.

Question 1

Which of the following is the LEAST appropriate pairing of the three MLOps principles (automation, reproducibility, governance) and the tool that implements them?

Question 2

One ML workflow passes through multiple services as Glue ETL → SageMaker training → Lambda post-processing → SNS notification, and another workflow consists only of SageMaker preprocessing → training → evaluation → registration. What is the most suitable orchestrator for each?

Question 3

You want to block registration if the model evaluation accuracy is below the threshold and, after approval, automatically deploy all the way to production. What is the correct connection of components?

Question 4

An organization already runs complex dependencies, including on-premises ones, as Apache Airflow DAGs. Which option correctly pairs the recommended tool for continuing them on AWS as a managed service with the recommended tool for starting a completely new project inside SageMaker?

Question 5

In standard MLOps using SageMaker Projects, which is correct about what a "code push" and a "model Approved" each trigger?

PreviousIaC & Workflow Orchestration: CloudFormation/CDK, Step Functions, EventBridge, Airflow (MWAA)Week 7 · Day 4Next SageMaker Model Monitor: Data Quality and Model Quality DriftWeek 8 · Day 1

Official references

  • MLA-C01 official exam page(opens in a new tab)
  • Amazon SageMaker AI documentation(opens in a new tab)
  • Amazon EventBridge documentation(opens in a new tab)
  • AWS CodePipeline documentation(opens in a new tab)
  • AWS Step Functions documentation(opens in a new tab)
  • AWS CloudFormation documentation(opens in a new tab)

On this page

  • Key Takeaways
  • MLOps End-to-End Flow at a Glance
  • Core Review by Day
  • Day 1 - SageMaker Pipelines
  • Day 2 - Model Registry & Governance
  • Day 3 - CI/CD for ML
  • Day 4 - IaC & Orchestration
  • Decision Criteria for Choosing Tools on the Exam
  • Tracing the Chain Backwards
  • Common Pitfalls Summary
  • Final Check: Situation → What to Choose
  • Glossary
  • Practice Questions