ERIC Number: ED627628
Record Type: Non-Journal
Publication Date: 2023
Pages: 27
Abstractor: ERIC
ISBN: 978-1-922801-11-1
ISSN: N/A
EISSN: N/A
Evaluating Machine Learning for Projecting Completion Rates for VET Programs. Technical Paper
Hall, Michelle; Lees, Melinda; Serich, Cameron; Hunt, Richard
National Centre for Vocational Education Research (NCVER)
This paper summarises exploratory analysis undertaken to evaluate the effectiveness of using machine learning approaches to calculate projected completion rates for vocational education and training (VET) programs, and compares this with the current approach used at the National Centre for Vocational Education Research (NCVER) -- Markov chains methodology. While the Markov chains methodology currently used by NCVER has demonstrated that it is reliable, with predictions aligning well with the actual rates of completion for historical estimates, it has not been reviewed for some time and it does have some limitations. The evaluation of machine learning techniques for predicting VET program completion rates was undertaken to overcome some of these limitations and with a view to improving our current predictions. This report includes: (1) an overview of the methodologies: Markov chains and two machine learning algorithms that were applied to predict completion rates for VET programs (XGBoost and CatBoost); (2) a comparison of the accuracy of the predictions generated by both methodologies; and (3) an evaluation of the relative strengths and limitations of both methodologies.
Descriptors: Vocational Education, Graduation Rate, Artificial Intelligence, Prediction, Algorithms, Methods, Accuracy, Evaluation
National Centre for Vocational Education Research Ltd. P.O. Box 8288, Stational Arcade, Adelaide, SA 5000, Australia. Tel: +61-8-230-8400; Fax: +61-8-212-3436; e-mail: ncver@ncver.edu.au; Web site: http://www.ncver.edu.au
Publication Type: Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: Australian Government Department of Employment and Workplace Relations
Authoring Institution: National Centre for Vocational Education Research (NCVER) (Australia)
Grant or Contract Numbers: N/A