Перейти к основной навигации Перейти к поиску Перейти к основному содержанию

Evidence-Grounded LLM Summarization for Actionable Student Feedback Analysis

    • Nazarbayev University
    • Nazarbayev University Graduate School of Public Policy

    Результат исследованийрецензирование

    Аннотация

    Analyzing large-scale student feedback is critical for higher education quality assurance, yet manual analysis is inefficient and subjective. This paper proposes an integrated framework that unifies supervised classification, unsupervised clustering, and retrieval-augmented generation (RAG) to produce evidence-grounded and actionable insights. Ensemble-based supervised models perform thematic classification, while multi-encoder embedding fusion enables unsupervised discovery of coherent feedback clusters. A multi-stage RAG module integrates category predictions and cluster structure to retrieve representative evidence and generate transparent summaries with citation traceability. The framework is evaluated on student feedback collected from a Central Asian university and two public benchmarks, EduRABSA and Coursera course reviews, covering seven thematic categories. The supervised ensemble achieves 83.0% accuracy and 0.829 Macro-F1 on the primary dataset, while unsupervised clustering attains a silhouette score of 0.271 under the best fusion strategy. Independent evaluation on external benchmarks yields ensemble accuracy of 81.1% on EduRABSA and 49.8% on Coursera, confirming the framework’s adaptability across diverse educational contexts. By leveraging supervised labels and unsupervised structure, the proposed framework enables evidence-grounded, category-aware LLM-based summaries that faithfully reflect the diversity and distribution of student feedback and support actionable educational decision-making.

    Язык оригиналаEnglish
    Номер статьи351
    ЖурналInformation (Switzerland)
    Том17
    Номер выпуска4
    DOI
    СостояниеPublished - апр. 2026

    ЦУР ООН

    Работа этого автора способствует достижению следующих Целей устойчивого развития

    1. Quality education
      Quality education

    ASJC Scopus subject areas

    • Information Systems

    Fingerprint

    Подробные сведения о темах исследования «Evidence-Grounded LLM Summarization for Actionable Student Feedback Analysis». Вместе они формируют уникальный семантический отпечаток (fingerprint).

    Цитировать