Domain V · Operationalize AI Solution · 17% of the exam
V.4 Oversee AI solution metrics (e.g., KPI, model performance)
Task 4 of Operationalize AI Solution
May 9: Mid Sept 6: High Study Hall misses: 1 Logged: 0
Enablers (verbatim, ECO)
PMI, ECO p. 5: enablers are "illustrative examples of the work associated with the task" and "not meant to be an exhaustive list but rather offer a few examples to help demonstrate what the task encompasses."
Ours: PMI's stems paraphrase one of these as a symptom; the right option is that enabler in PMI's words; the distractors are its siblings or a neighbouring task's enablers.
- Implement monitoring dashboards for business and technical metrics
- Track key performance indicators and success measures
- Analyze model performance trends and degradation patterns
- Generate regular performance reports for stakeholders
- Establish alerting systems for performance threshold breaches
The rule
Evidence of value after go-live comes from live KPI dashboards and current reports, not from re-reading the original success criteria.
Study Hall misses on this task (1)
- Mini 4 #4 · confidence High · 32sScenario: Leadership wants evidence of value three months after go-liveDecided by: Live KPI dashboards and reporting (current data)Chose: Re-reading the original success criteria (historical document)
Logged misses on this task
Log a missNothing logged yet.
What to read
- Workbook p. 83, 90 — KPI Measurement; Monitoring and Maintenance Plan
- Module 06 Lesson 35: What Is Model Monitoring?
- Module 05 Lessons 12-16: Data Drift; Model Drift; Responding, Measuring and Ongoing Oversight; KPIs Overview
- Leading and Managing AI Projects p. 35 — Technical and Business Performance
- Study guide Lesson 23: ECO Task V.4 — Oversee AI solution metrics (e.g., KPI, model performance)