Domain IV · Manage AI Model Development and Evaluation · 16% of the exam
IV.2 Oversee AI/ML model QA/QC (e.g., configuration management, model performance)
Task 2 of Manage AI Model Development and Evaluation
May 9: not tested Sept 6: High Study Hall misses: 1 Logged: 0
Enablers (verbatim, ECO)
PMI, ECO p. 5: enablers are "illustrative examples of the work associated with the task" and "not meant to be an exhaustive list but rather offer a few examples to help demonstrate what the task encompasses."
Ours: PMI's stems paraphrase one of these as a symptom; the right option is that enabler in PMI's words; the distractors are its siblings or a neighbouring task's enablers.
- Establish model testing protocols and quality assurance procedures
- Implement configuration management for model versions and parameters
- Monitor model performance metrics during development and testing
- Coordinate peer reviews and technical validation of model designs
- Ensure adherence to coding standards and best practices
The rule
Match the symptom to the specific enabler: unrecorded changes mean configuration management for versions and parameters, not generic QA procedures.
Study Hall misses on this task (1)
- Practice IV #19 · confidence High · 35sScenario: Model changes were not recorded, so results across variants cannot be comparedDecided by: Match the symptom to the specific enabler: configuration management for versions and parametersChose: The generic 'establish QA procedures' enabler
Logged misses on this task
Log a missNothing logged yet.
What to read
- Workbook p. 77, 85 — Generate Model Test Design; Review Process
- Module 05 Lessons 19-21: AI Audit Trails; Auditability and Traceability; Integrating With DevSecOps
- Module 06 Lesson 33: What Is Model Governance?
- Study guide Lesson 21: ECO Task IV.2 — Oversee AI/ML model QA/QC (e.g., configuration management, model performance)