Measurement, Analysis, and Knowledge Management (Category 4)
Module 4 · Students, Stakeholders, and Knowledge

Measurement, Analysis, and Knowledge Management (Category 4)

Build STC's scorecard of leading and lagging measures with comparisons, run a review cadence that leads to action, project future performance, and manage data quality, security, and knowledge, from shared measure definitions to master course shells and governed AI tools.

The Foundation of the System

Category 4 (90 points) sits under everything else in the framework diagram. Without reliable measures, analysis, and knowledge, management by fact isn’t possible.

  • 4.1 Measurement, Analysis, Review, and Improvement of Organizational Performance (45): which measures you track, where your comparative data comes from, how you keep measures agile, how leaders review performance, how you project future performance, and how reviews lead to improvement.
  • 4.2 Information and Knowledge Management (45): how you manage knowledge and share best practices, ensure data quality, availability, and security (including cybersecurity), and pursue innovation.

From Data to Decisions

SOURCESStudent info systemLMS activityAdmissions CRMSurveysHR and adjunct dataFinanceGoverned dataShared definitionsQuality checksFERPA access rulesSecurity controlsSTC scorecardLeading andlagging measuresTargets andcomparisonsREVIEW CADENCEWeekly huddleMonthly leadershipQuarterly strategyAnnual reviewAlerts, enrollment, ticketsAction-plan progressObjectives vs. projectionsMeasures and systemActions: improve, reallocate, innovateChange what you measure

Choosing Measures

STC tracks about 20 key measures. A few from its scorecard:

MeasureTypeFrequencyComparisonLinked to
Week-2 LMS login for new studentsLeadingWeeklyOwn trendSO2
Gateway course DFW rateLeadingQuarterlyPeer institutions via a shared consortiumSO2
First-year persistence, onlineLaggingQuarterly / annualNational Student ClearinghouseSO2
Six-year completion, part-time transfer studentsLaggingAnnualIPEDS Outcome Measures7.1
Graduate employment in field within six monthsLaggingAnnualLabor-market data; peer programs7.1, SO1
Adjunct onboarding completionLeadingQuarterlyOwn targetSO4
Adjunct engagement indexLaggingAnnualPulse benchmark from survey vendorSO4
Cost per credit hourLaggingQuarterlyOther schools in the university; instructional-cost benchmarking studiesSO5

Leading measures give early warning that you can act on this quarter. Lagging measures confirm whether outcomes improved. A scorecard with only lagging measures tells you what went wrong a year too late.

Timing is what separates them. For a new student, the measures arrive in this order:

Window to help this studentConfirms whether it workedLMSloginMissingworkCourseDFWRe-enrollmentFirst-yearpersistenceSix-yearcompletionWeek 2Week 5Week 10Next quarterYear 1Year 6LEADINGAct here: coach outreach, tutoring, instructor contactLAGGINGUse these to judge the strategyNot to scale

Measurement agility means you can add or change measures quickly. When STC launched AI tutoring, it added “tutor sessions per student” and “help-desk tickets on AI tools” in the same quarter.


Reviews That Lead to Action

4.1b asks how senior leaders review performance and capabilities, and 4.1c asks how reviews lead to improvement and how you project future performance.

At STC’s monthly leadership review, each action-plan owner reports status against projection in one slide: on track, at risk, or off track. Only at-risk and off-track items get discussion time. Each review ends with a list of decisions: what changes, who owns it, and when it’ll be checked.

Projections connect measurement to strategy. In the quarterly review, the team compares actual persistence with the projection in the SO2 action plan. If the gap is growing, it adjusts the plan (2.2b) or reallocates resources.


Managing Knowledge

Knowledge at a school is easily lost, because so much lives in individual instructors’ heads and course sections. STC manages it deliberately:

  • Master course shells. Every section is built from a shared master. Improvements made in one section are reviewed and added to the master, so the next 15 sections benefit.
  • Teaching circles. Full-time and adjunct faculty meet each quarter by course cluster to share what worked.
  • Retirement handoffs. Retiring faculty co-teach with their successor for a quarter and record walkthroughs of key labs.
  • Best-practice transfer. When one program’s early-alert follow-up rate hit 95%, its process was documented and adopted by the other programs.

Data Quality, Security, and AI Tools

  • One definition per measure. “Persistence” means the same thing in the dean’s dashboard, the program review, and the NWCCU report. The definitions live in a shared data dictionary.
  • Access by role, following FERPA: instructors see their own sections, advisors see their caseload, and leaders see aggregates.
  • Cybersecurity of student and research data is managed with the university’s IT security office and tested through regular phishing exercises and access reviews.
  • AI tools are reviewed before adoption: what data they use, where it’s stored, whether vendors can train on it, and whether outputs are checked for bias across student segments.
⚠️ Common Pitfall: Dashboards Nobody Acts On

Common mistake: STC builds an impressive dashboard with 70 charts. Leaders look at it in meetings and say “interesting,” and nothing changes.

Measures earn their place by driving decisions. For each measure, ask: Who reviews it, how often, against what target and comparison, and what do they do when it’s off? If no one can answer, drop the measure or fix the review.


Key Takeaway

Category 4 is the foundation. Choose a small set of leading and lagging measures linked to objectives, each with a comparison. Review them on a defined cadence that ends in decisions, and project future performance. Manage knowledge through master shells, teaching circles, and handoffs. Keep data accurate, consistently defined, secure, and governed, including any AI tools that use student data.

🧪 Try It: Build a Ten-Measure Scorecard

For your school, list ten key measures. For each, fill in:

MeasureLeading or laggingFrequencyComparison sourceWho reviews itLinked objective

Check the result:

  • Do you have at least three leading measures?
  • Does every measure have a comparison other than your own past performance?
  • Does every strategic objective have at least one measure?
🧠 Knowledge Check

1. Which is a leading measure for first-year persistence?

2. What does 'measurement agility' mean?

3. Why do master course shells support knowledge management?

4. STC has a 70-chart dashboard that leads to no changes. What is the core fix?