Publikace UTB
Repozitář publikační činnosti UTB

Automatic short answer grading (ASAG) using attention-based deep learning MODEL

Repozitář DSpace/Manakin

Zobrazit minimální záznam


dc.title Automatic short answer grading (ASAG) using attention-based deep learning MODEL en
dc.contributor.author Amur, Zaira Hassan
dc.contributor.author Hooi, Yew Kwang
dc.contributor.author Soomro, Gul Muhammad
dc.relation.ispartof 2022 International Conference on Digital Transformation and Intelligence, ICDI 2022 - Proceedings
dc.identifier.isbn 979-8-3503-9700-0
dc.identifier.isbn 979-8-3503-9698-0
dc.date.issued 2022
dc.citation.spage 1
dc.citation.epage 7
dc.event.title 2022 International Conference on Digital Transformation and Intelligence, ICDI 2022
dc.event.location Kuching, Sarawak
utb.event.state-en Malaysia
utb.event.state-cs Malajsie
dc.event.sdate 2022-12-01
dc.event.edate 2022-12-02
dc.type conferenceObject
dc.language.iso en
dc.publisher Institute of Electrical and Electronics Engineers Inc.
dc.identifier.doi 10.1109/ICDI57181.2022.10007187
dc.relation.uri https://ieeexplore.ieee.org/document/10007187
dc.relation.uri https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10007187
dc.subject ASAGS en
dc.subject automatic grading en
dc.subject BERT en
dc.subject short text en
dc.description.abstract In artificial intelligence, automatic short answer grading (ASAG) sparked the interest of many researchers. These Systems are used to evaluate the student's performance based on their intellectual and cognitive skills. Unfortunately, short answer grading poses various challenges to assess individual abilities. The first challenge, short sentences can be 10 to 20 words long. These short sentences include primary and secondary keywords, identifying such keywords is a challenge for syntactic processing. Furthermore, the order and relationship among the words affect the actual meaning of the answers. Answers provided by students may not be syntactically correct. The second challenge is different question types included in the short text:-factoid, descriptive, short, and long questions. Different question types influence the intent of the answer which affects the precision of grading accuracy. As a result, strategies for overcoming these problems in the assessment are required. In this study, we have proposed the attention-based deep learning model known as bidirectional encoder representation from a transformer (BERT) for the evaluation of short subjective answers. The measurement findings indicate that the BERT model is effective for automatic short answer grading. © 2022 IEEE. en
utb.faculty Faculty of Applied Informatics
dc.identifier.uri http://hdl.handle.net/10563/1011370
utb.identifier.scopus 2-s2.0-85147022679
utb.source d-scopus
dc.date.accessioned 2023-02-17T00:08:30Z
dc.date.available 2023-02-17T00:08:30Z
utb.contributor.internalauthor Soomro, Gul Muhammad
utb.fulltext.affiliation Zaira Hassan Department of computer and information sciences University teknologi Petronas Zaira_20001009@utp.edu.my Amur Yew Kwang Hooi department of computer and information sciences Universiti teknologi Petronas yewkwanghooi@utp.edu.my Gul Muhammad Soomro Tomas Bata University, Czech Republic gulmuhammadsoomro@yahoo.com
utb.fulltext.references [1] S. Das, N. Deb, A. Cortesi, and N. J. S. C. S. Chaki, "Sentence embedding models for similarity detection of software requirements," vol. 2, no. 2, pp. 1-11, 2021. [2] L. B. Galhardi and J. D. Brancher, "Machine learning approach for automatic short answer grading: A systematic review," in Ibero-american conference on artificial intelligence, 2018, pp. 380-391: Springer. [3] M. Han et al., "A survey on the techniques, applications, and performance of short text semantic similarity," vol. 33, no. 5, p. e5971, 2021. [4] P.-S. Huang, P.-S. Chiu, J.-W. Chang, Y.-M. Huang, and M.-C. J. J. o. I. T. Lee, "A study of using syntactic cues in short-text similarity measure," vol. 20, no. 3, pp. 839-850, 2019. [5] B. Agarwal, H. Ramampiaro, H. Langseth, M. J. I. P. Ruocco, and Management, "A deep network model for paraphrase detection in short text messages," vol. 54, no. 6, pp. 922-937, 2018. [6] H. Al-Bataineh, W. Farhan, A. Mustafa, H. Seelawi, and H. T. Al-Natsheh, "Deep contextualized pairwise semantic similarity for arabic language questions," in 2019 IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI), 2019, pp. 1586-1591: IEEE. [7] W. Huang, Q. Qu, M. J. N. C. Yang, and Applications, "Interactive knowledge-enhanced attention network for answer selection," vol. 32, no. 15, pp. 11343-11359, 2020. [8] L. Zhang, Y. Huang, X. Yang, S. Yu, and F. J. I. l. e. Zhuang, "An automatic short-answer grading model for semi-open-ended questions," vol. 30, no. 1, pp. 177-190, 2022. [9] H. Khorashadizadeh, R. Monsefi, and S. Foolad, "Attention-based Convolutional Neural Network for Answer Selection using BERT," in 2020 8th Iranian Joint Congress on Fuzzy and intelligent Systems (CFIS), 2020, pp. 121-126: IEEE. [10] A. A. Shah, S. D. Ravana, S. Hamid, M. A. J. K. Ismail, and I. Systems, "Accuracy evaluation of methods and techniques in Web-based question answering systems: a survey," vol. 58, no. 3, pp. 611-650, 2019. [11] P. Ranjan and R. C. Balabantaray, "Question answering system for factoid based question," in 2016 2nd International Conference on Contemporary Computing and Informatics (IC3I), 2016, pp. 221-224: IEEE. [12] J. Mozafari, A. Fatemi, and M. A. J. a. p. a. Nematbakhsh, "BAS: an answer selection method using BERT language model," 2019. [13] !!! INVALID CITATION !!! . [14] M. Lewis et al., "Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension," 2019. [15] M. Mansoor, Z. ur Rehman, M. Shaheen, M. A. Khan, M. J. I. T. Habib, and Control, "Deep learning based semantic similarity detection using text data," vol. 49, no. 4, pp. 495-510, 2020. [16] M. H. Nguyen and D. Q. J. J. I. S. E. Tran, "Estimation in Semantic Similarity of Texts," vol. 37, no. 3, pp. 617-633, 2021. [17] J. Schneider, R. Richner, and M. J. a. p. a. Riser, "Towards Trustworthy AutoGrading of Short, Multilingual, Multi-type Answers," 2022. [18] X. Song, Y. J. Min, L. Da-Xiong, W. Z. Feng, and C. J. P. C. S. Shu, "Research on text error detection and repair method based on online learning community," vol. 154, pp. 13-19, 2019. [19] S. J. H. S. Sun and O. R. Methodology, "Meta-analysis of Cohen’s kappa," vol. 11, no. 3, pp. 145-163, 2011.
utb.fulltext.sponsorship -
utb.scopus.affiliation University Teknologi Petronas, Department of Computer and Information Sciences, Malaysia; Tomas Bata University, Czech Republic
utb.fulltext.projects -
utb.fulltext.faculty -
utb.fulltext.ou -
Find Full text

Soubory tohoto záznamu

Zobrazit minimální záznam