Domain IV · Manage AI Model Development and Evaluation · 16% of the exam
IV.3 Manage AI/ML model training
Task 3 of Manage AI Model Development and Evaluation
May 9: Mid Sept 6: Low Study Hall misses: 2 Logged: 0
Enablers (verbatim, ECO)
PMI, ECO p. 5: enablers are "illustrative examples of the work associated with the task" and "not meant to be an exhaustive list but rather offer a few examples to help demonstrate what the task encompasses."
Ours: PMI's stems paraphrase one of these as a symptom; the right option is that enabler in PMI's words; the distractors are its siblings or a neighbouring task's enablers.
- Plan training schedules and resource allocation for model development
- Monitor training progress and computational resource utilization
- Coordinate hyperparameter tuning and optimization activities
- Oversee cross-validation and model selection processes
- Manage training data versioning and experiment tracking
The rule
After initial training, tune hyperparameters on the validation set. Generalization testing on unseen data comes after that. Insufficient compute is fixed by provisioning, not by reviews.
Study Hall misses on this task (2)
- Full-length Q101 · confidence High · 38sScenario: Repeated training failures from insufficient computeDecided by: Assess requirements and provision infrastructure before trainingChose: More stakeholder reviews (PM-sounding, does not fix the cause)
- Full-length Q57 · confidence High · 66sScenario: Initial training done; NEXT (Phase IV sequence)Decided by: Tune hyperparameters on the validation set; unseen-data testing comes afterChose: Jumping to generalisation testing (two steps ahead)
Logged misses on this task
Log a missNothing logged yet.
What to read
- Workbook p. 78-80 — Model Training/Model Building; Hyperparameter Optimization
- Module 04 Lesson 7: What Is AI Model Development?; Lesson 13: Introduction to Model Validation; Lesson 14: Generalizing to New Data
- Module 03 Lesson 24: Splitting Data Sets
- Study guide Lesson 14: ECO Task IV.3 — Manage AI/ML Model Training
Glossary terms in the enablers: training data