Tag: teaching excellence

  • Why Employability Metrics Are Failing Universities

    Why Employability Metrics Are Failing Universities

    Universities are under increasing pressure to demonstrate that their graduates secure meaningful employment. In response, governments and regulators have embedded employability metrics into performance frameworks, funding models, and league tables. In the UK, for example, graduate outcomes (B3) data has become a central feature of regulatory oversight and institutional strategy.

    On the surface, this seems entirely reasonable. Students invest significant time and money into higher education, and they expect a return in the form of improved career prospects. Policymakers, in turn, want assurance that universities are delivering value.

    Yet, despite this growing emphasis, a fundamental problem persists:

    Employability metrics, as currently designed, are failing universities—and more importantly, they are failing students.


    The Illusion of Measurement

    At the heart of the issue lies a simple but powerful question: what exactly are we measuring?

    Most employability metrics rely on narrow indicators such as:

    • Graduate employment rates
    • Salaries after 15 months
    • Job classification (e.g. “professional” roles)(Don’t ask me about Models)

    While these measures provide a snapshot, they do not capture the complexity of graduate outcomes.

    Employment is not a binary state. Nor is it a static endpoint. Careers evolve over time, often through nonlinear and unpredictable pathways. By reducing employability to short-term outcomes, metrics create an illusion of precision while obscuring the reality of graduate transitions.


    The Timing Problem

    One of the most widely used measures in the UK is based on graduate destinations approximately 15 months after completion. This timeframe is deeply problematic.

    Many graduates:

    • Pursue further study
    • Start businesses (which at 15 months is traveling through the valley of death)
    • Take interim roles while exploring career options
    • Enter industries with longer entry pathways

    For these individuals, early outcomes may appear weak, even though their long-term trajectories are strong.

    The result is a systematic distortion: universities are judged on when outcomes occur, rather than how meaningful those outcomes ultimately become.


    Penalising the Wrong Institutions

    Employability metrics often fail to account for differences in student demographics and institutional missions.

    Universities that:

    • Serve widening participation students
    • Operate in economically disadvantaged regions
    • Recruit non-traditional learners

    are frequently penalised.

    These institutions play a critical role in social mobility, yet their graduates may face structural barriers in the labour market. Lower short-term employment outcomes do not necessarily reflect poor educational quality—they often reflect inequality in opportunity.

    By ignoring context, current metrics risk reinforcing the very inequalities they are meant to address.


    The Narrow Definition of Success

    Another major limitation is the narrow definition of what constitutes “success.”

    Metrics typically prioritise:

    • Full-time employment
    • High salaries
    • Traditional career pathways (Occupation codes last changed on 4 April 2024)

    However, this excludes a wide range of valuable outcomes, including:

    • Entrepreneurship and self-employment
    • Portfolio careers
    • Social impact work
    • Creative and cultural industries

    In an economy increasingly characterised by flexibility and diversity, these pathways are not marginal—they are central.

    Yet, because they do not fit neatly into existing metrics, they are often undervalued or ignored.


    Behavioural Distortions

    Perhaps the most concerning consequence of current employability metrics is how they shape institutional behaviour.

    When universities are measured on specific indicators, they naturally optimise for those indicators.

    This can lead to:

    • Overemphasis on short-term job outcomes
    • Strategic steering of students towards “safe” careers
    • Reduced support for entrepreneurship or risk-taking
    • Gaming of data through selective reporting or classification

    In extreme cases, employability becomes less about empowering students and more about managing metrics.

    This is a classic example of Goodhart’s Law:
    When a measure becomes a target, it ceases to be a good measure.


    The Missing Middle: Capability Development

    One of the most significant gaps in current frameworks is the absence of capability-based measures.

    Employability is not just about outcomes; it is about:

    • Skills development
    • Confidence and agency
    • Networks and social capital
    • The ability to navigate uncertainty

    These capabilities are developed over time and are often invisible in traditional metrics.

    For example, a student who:

    • Builds strong professional networks
    • Develops entrepreneurial skills
    • Gains meaningful project experience

    may be highly employable, even if their first job is not immediately “high status.”

    By focusing only on outcomes, metrics ignore the underlying processes that drive long-term success.


    Regional and Structural Blind Spots

    Employability metrics also fail to account for regional economic conditions.

    Graduates in areas with:

    • Limited job opportunities
    • Lower average wages
    • Sectoral decline

    are inherently disadvantaged in outcome-based measures.

    Universities cannot control local labour markets, yet they are judged as if they can.

    This creates a disconnect between:

    • Institutional performance
    • Regional economic realities

    and further disadvantages institutions located outside major economic hubs.


    Data Without Insight

    Another challenge is the overreliance on quantitative data without sufficient qualitative insight.

    Large-scale surveys provide valuable information, but they often lack depth. They do not capture:

    • Graduate experiences
    • Career aspirations
    • Barriers faced
    • Non-linear pathways

    Without this context, data can be misleading.

    For example, a graduate in a “non-professional” role may be:

    • Building experience in a chosen field
    • Transitioning between careers
    • Prioritising personal circumstances

    Yet, the metric records this simply as a negative outcome.


    Towards Better Employability Measures

    If current metrics are failing, what should replace them?

    A more effective approach would involve a shift from outcomes-only measurement to a multi-dimensional framework.

    1. Longitudinal Tracking

    Instead of focusing on short-term outcomes, metrics should track graduates over time:

    • 3 years
    • 5 years
    • 10 years

    This would provide a more accurate picture of career development.

    2. Contextualisation

    Metrics must account for:

    • Student demographics
    • Regional economic conditions
    • Institutional mission

    This would create fairer comparisons and more meaningful insights.

    3. Inclusion of Diverse Pathways

    Entrepreneurship, self-employment, and portfolio careers should be fully recognised and valued.

    This requires:

    • New classification systems
    • Better data collection methods

    4. Capability-Based Indicators

    Universities should be assessed on their ability to develop:

    • Skills
    • Networks
    • Confidence
    • Career management capabilities

    These are the foundations of employability.

    5. Integration with Skills Frameworks

    Linking outcomes to frameworks such as ESCO (European Skills, Competences, Qualifications and Occupations) would enable:

    • Better alignment with labour market needs
    • More granular analysis of skills development

    Reframing the Purpose of Employability

    Ultimately, the issue is not just technical—it is philosophical.

    What is the purpose of higher education?

    If employability is reduced to:

    • Immediate job outcomes
    • Salary levels

    then universities become training providers for the labour market.

    But higher education has a broader role:

    • Developing critical thinkers
    • Enabling social mobility
    • Fostering innovation and entrepreneurship
    • Contributing to society

    Employability should be understood as the capacity to create value over a lifetime, not just secure a job in the short term.


    Conclusion

    Employability metrics were introduced with good intentions: to ensure accountability, improve outcomes, and provide transparency.

    However, in their current form, they fall short.

    They:

    • Oversimplify complex realities
    • Ignore context
    • Distort behaviour
    • Undervalue diverse pathways

    Most importantly, they fail to capture what truly matters: the long-term ability of graduates to navigate, contribute to, and shape an ever-changing world.

    If universities are to fulfil their role in society, we must move beyond narrow metrics and embrace a richer, more nuanced understanding of employability.

    Because the goal is not just to produce graduates who get jobs.

    It is to develop individuals who can build careers, create opportunities, and drive the future of our economies.

  • Improving Quality Systems in University–Subcontractual Provider Relationships

    Improving Quality Systems in University–Subcontractual Provider Relationships

    Effective quality management in higher education is increasingly complex when universities work with subcontractual or partner providers. Ensuring consistency, compliance, and continuous improvement across multiple delivery sites requires robust systems that balance accountability with enhancement. Traditional quality control and assurance processes must evolve into dynamic frameworks that embed shared responsibility, data-driven oversight, and collaborative development. This review outlines practical strategies to strengthen institutional quality systems, drawing on UK QAA standards, the PDCA improvement model, and Total Quality Management principles. It highlights how universities can maintain academic integrity, enhance student outcomes, and build sustainable partnerships through structured subcontractual oversight.

    1. Strengthen Governance and Oversight Structures

    1.1. Establish a Unified Partnership Quality Framework

    Develop a Partnership Quality Framework that clearly defines:

    • Roles and responsibilities of both the university and subcontractual provider.
    • Reporting lines to central academic quality and registry functions.
    • Minimum academic, operational, and compliance standards aligned with the UK Quality Code.

    This framework should integrate QA (process assurance) and QE (continuous improvement) mechanisms to ensure all partners meet equivalent standards to on-campus delivery.

    1.2. Introduce a Partnership Oversight Board

    Create a Subcontractual Oversight Board reporting to the Academic Board or Senate, responsible for:

    • Reviewing academic performance metrics across providers.
    • Approving new partnerships and dynamically monitoring risks.
    • Overseeing annual self-evaluations, site visits, and re-approval cycles.

    The board should include representation from academic quality, registry, finance, compliance, and student experience, ensuring a holistic governance approach.


    2. Embed the PDCA (Plan–Do–Check–Act) Cycle in Partnership Management

    2.1. Plan

    • Co-develop Programme Delivery Plans with each provider, specifying staffing, learning resources, assessment timelines, and student support.
    • Ensure alignment with Subject Benchmark Statements and the Framework for Higher Education Qualifications (FHEQ).

    2.2. Do

    • Deliver teaching and learning using approved teaching staff and validated module specifications, which detail session learning outcomes.
    • Require staff induction into the university’s academic policies, assessment regulations, and pedagogic philosophy.

    2.3. Check

    • Conduct joint moderation of assessments and external examiner reviews.
    • Implement mid-academic year quality reviews using student session attendance, module performance, retention, and satisfaction data.
    • Use risk-based audits for providers showing volatility in outcomes.

    2.4. Act

    • Require Corrective Action Plans (CAPs) for underperforming areas.
    • Integrate lessons learned into the Annual Programme Monitoring (APM) process.
    • Share improvement outcomes across the provider network for collective learning.

    3. Enhance Data-Driven Quality Control and Benchmarking

    3.1. Develop a Partnership Data Dashboard

    Create a real-time data dashboard tracking:

    • Student enrolment and retention rates.
    • Session Attendance and Engagement.
    • Assessment completion and grade distribution.
    • Module feedback from Students.
    • External examiner feedback and academic misconduct cases.
    • Continuation and Completion rates.
    • NSS-equivalent satisfaction scores.

    This evidence-based approach supports proactive quality interventions and transparent accountability.

    3.2. Implement Cross-Provider Benchmarking

    Benchmark subcontractual providers against:

    • Internal university programmes.
    • External sector norms (using data such as HESA, TEF outcomes, or Graduate Outcomes Survey).
    • Comparable franchise or validation partners.

    Use this benchmarking to drive competitive quality improvement and share best practice across providers and sites.


    4. Reinforce Quality Assurance through Continuous Professional Development (CPD)

    4.1. Standardise Staff Development

    Mandate joint staff development programmes for university and subcontractual teaching staff:

    • Annual Teaching and Assessment Symposium to share best practices.
    • Digital pedagogy and student engagement workshops.
    • Support for HEA Fellowship or equivalent professional recognition.

    4.2. Peer Review and Mentoring

    Implement peer observation schemes that cross partner boundaries:

    • University academics mentor subcontractual teaching staff.
    • Reciprocal classroom visits and reflection sessions.

    This approach transforms quality assurance from a compliance mechanism into a shared culture of learning, reflection, and continuous improvement, fostering trust, capability, and consistency across the entire partnership network.


    5. Strengthen Quality Enhancement through Student Partnership

    5.1. Student Voice Integration

    Ensure student representation from each subcontractual provider within the university’s:

    • Academic Board or Learning & Teaching Committee.
    • Programme review and revalidation panels.
    • Student experience forums.

    Establish consistent mechanisms for module feedback, focus groups, and student–staff liaison committees across all partners and sites, with standardised templates and analysis which drive the data dashboard.

    5.2. Feedback-to-Action Transparency

    Create a monthly Student Feedback Impact Report for each provider that shows:

    • Key issues raised.
    • Actions taken and responsible parties.
    • Timelines and measurable outcomes.

    This demonstrates responsiveness and supports a culture of continuous enhancement.


    6. Institutionalise Total Quality Management (TQM) Principles

    6.1. Develop a Culture of Shared Responsibility

    Move beyond compliance by embedding TQM principles:

    • Leadership commitment to shared goals.
    • Stakeholder-driven quality (students, employers, staff).
    • Continuous improvement mindset.

    Encourage providers to see quality as everyone’s responsibility, not merely the QA office’s function.

    6.2. Establish Continuous Improvement Reviews

    Introduce biannual Continuous Improvement Reviews (CIRs) where each provider:

    • Presents progress on academic and operational KPIs.
    • Shares innovations in pedagogy and student support.
    • Reflects on improvement actions implemented since the last review.

    This shifts the focus from inspection to collaboration and learning.


    7. Manage Risk and Compliance Proactively

    7.1. Adopt a Risk-Based Quality Oversight Model

    Categorise providers as Low, Medium, or High Risk based on:

    • Past performance.
    • Staff turnover.
    • Student outcomes.
    • Financial stability.

    Tailor monitoring intensity accordingly:

    • Low risk: light-touch annual review.
    • Medium risk: mid-year check plus full annual review.
    • High risk: enhanced scrutiny, extra visits, and conditional continuation.

    7.2. Maintain Clear Contractual Quality Clauses

    Contracts should specify:

    • Quality expectations linked to QAA and OfS standards.
    • Sanctions for non-compliance or misrepresentation.
    • Obligations for real-time data reporting, assessment moderation, and staff approval.

    Contracts should integrate quality indicators and improvement triggers—making QE a contractual expectation, not an optional enhancement.


    8. Foster Transparency and External Credibility

    8.1. External Examiner Network

    Create a shared pool of external examiners across subcontractual sites to ensure consistency in:

    • Marking and assessment standards.
    • Feedback quality and moderation.
    • Award recommendations.

    8.2. Public Reporting and Communication

    Publish a Partnership Quality Annual Report summarising:

    • Provider performance.
    • Enhancements achieved.
    • Future improvement goals.

    This reinforces institutional transparency and strengthens trust with stakeholders and regulators.


    9. Promote Innovation and Digital Oversight

    9.1. Digital Monitoring Systems

    Use secure digital platforms for:

    • Engagement throughout module teaching.
    • Continuously track student learning development.
    • Online moderation and assessment tracking.
    • Automated alerts for underperformance.

    9.2. AI-Driven Quality Insights

    Apply learning analytics and AI tools to identify early warning signals such as:

    • Declining attendance or engagement.
    • Assessment bottlenecks.
    • Variance in feedback turnaround times.

    Such data-driven intelligence enhances preventive quality management rather than reactive response. All digital platforms should be linked through a central data warehouse or dashboard, enabling the quality team to conduct integrated analyses that combine academic results, engagement data, and feedback insights. This holistic approach strengthens both accountability (through Quality Assurance) and innovation (through Quality Enhancement).


    10. Align Subcontractual Oversight with Institutional Enhancement Strategy

    Finally, integrate subcontractual quality oversight into the university’s broader enhancement agenda, ensuring it supports institutional ambitions in:

    • Teaching excellence (TEF alignment).
    • Graduate employability.
    • International reputation.
    • Inclusive student success.

    When partners are embedded within a shared mission of continuous enhancement, the subcontractual relationship becomes not just a compliance requirement but a collaborative driver of educational excellence.


    Summary: Key Recommendations

    AreaKey ActionModel Applied
    GovernanceCreate unified Partnership Quality Framework & Oversight BoardQA
    Continuous ImprovementApply PDCA cycle and CAPsQC → QE
    Data & AnalyticsBuild live dashboards and benchmarking systemsData-driven QA
    Staff CapabilityJoint CPD, peer mentoringQE
    Student PartnershipStandardised feedback + representationTQM / Transformational
    Risk ManagementRisk-based oversight modelQA / Compliance
    TransparencyAnnual partnership quality reportsQE

    Summary

    This article explores how universities can strengthen quality management when working with subcontractual or partner providers. It argues that traditional quality control and assurance models must evolve into integrated systems combining accountability, collaboration, and continuous enhancement.

    A robust governance structure—anchored by a unified Partnership Quality Framework and Oversight Board—ensures consistent academic standards and transparent reporting. The PDCA (Plan–Do–Check–Act) cycle supports iterative improvement across all providers, while data-driven dashboards enable real-time monitoring of student outcomes, attendance, and satisfaction.

    Staff capability is reinforced through joint CPD, cross-partnership peer review, and mentoring, creating a shared academic culture that values reflection and improvement. Students play a central role through standardised feedback mechanisms and representation on key committees.

    The article promotes Total Quality Management (TQM) principles and risk-based oversight, balancing trust with accountability. Digital systems—including learning analytics, AI-driven dashboards, and experiential tools such as SimVenture—enhance transparency and consistency across teaching and assessment.

    Ultimately, aligning subcontractual oversight with the university’s wider enhancement strategy ensures that all partners contribute to teaching excellence, employability, and inclusive student success. Quality thus becomes a collective, data-informed, and enhancement-led endeavour that unites the entire university network.

    Other blogs in this series:

    OfS Subcontractual Oversight: Helping Universities Strengthen Assurance

    Bridging Subcontracting Oversight and Business Simulation: How Can Universities Meet OfS Expectations?

    Call to Action:

    If you are interested in learning more or discussing the points in this blog, then please either:
    Connect on Linkedin: https://www.linkedin.com/in/bozward/
    Book an Appointment: https://calendar.app.google/hCA49pWHJ2TtteL76