ERIC Number: EJ1428134
Record Type: Journal
Publication Date: 2024
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1548-1093
EISSN: EISSN-1548-1107
Feature Extraction of Dialogue Text Based on Big Data and Machine Learning
Xuelin Liu; Hua Zhang; Yue Cheng
International Journal of Web-Based Learning and Teaching Technologies, v19 n1 2024
In this article, a dialogue text feature extraction model based on big data and machine learning is constructed, which transforms the high-dimensional space of text features into the low-dimensional space that is easy to process, so that the best feature words can be selected to represent the document set. Tests show that in most cases, the classification accuracy of this model is higher than 88%, and the recall rate is higher than 85%, thus achieving the goal of higher classification accuracy with less computation. When extracting the features of dialogue texts, there is no need for preprocessing, just count the data such as lexical composition, sentence length and sentence-to-sentence relationship of the target text, and make linear analysis to obtain key indicators and weights. Based on this, the classification model can achieve good results, thus effectively reducing the workload and computation of text classification.
Descriptors: Artificial Intelligence, Data, Text Structure, Classification, Word Processing, Computation, Natural Language Processing, Discussion, Information Technology
IGI Global. 701 East Chocolate Avenue, Hershey, PA 17033. Tel: 866-342-6657; Tel: 717-533-8845; Fax: 717-533-8661; Fax: 717-533-7115; e-mail: journals@igi-global.com; Web site: https://www.igi-global.com/journals/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A