Domain IV · Manage AI Model Development and Evaluation · 16% of the exam

IV.3 Manage AI/ML model training

Task 3 of Manage AI Model Development and Evaluation
May 9: Mid Sept 6: Low Study Hall misses: 2 Logged: 0

Enablers (verbatim, ECO)

PMI, ECO p. 5: enablers are "illustrative examples of the work associated with the task" and "not meant to be an exhaustive list but rather offer a few examples to help demonstrate what the task encompasses."

Ours: PMI's stems paraphrase one of these as a symptom; the right option is that enabler in PMI's words; the distractors are its siblings or a neighbouring task's enablers.

  1. Plan training schedules and resource allocation for model development
  2. Monitor training progress and computational resource utilization
  3. Coordinate hyperparameter tuning and optimization activities
  4. Oversee cross-validation and model selection processes
  5. Manage training data versioning and experiment tracking

The rule

After initial training, tune hyperparameters on the validation set. Generalization testing on unseen data comes after that. Insufficient compute is fixed by provisioning, not by reviews.

Study Hall misses on this task (2)

Logged misses on this task

Log a miss

Nothing logged yet.

What to read

Glossary terms in the enablers: training data