TY - GEN
T1 - Analysis of Student Facial Reactions during Classroom Instruction
AU - Endang, Andi Hutami
AU - Ilham, Amil Ahmad
AU - Achmad, Andani
AU - Yusri, Amiqatun Nasyati
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - This study seeks to construct a model that is capable of categorizing students' facial expressions during classroom instructional sessions. Facial expressions serve as pivotal non-verbal indicators, offering valuable insights into students' emotional and cognitive conditions. Leveraging Convolutional Neural Network (CNN) technology, this research integrates image models with facial geometry feature models to identify a range of facial expressions including happiness, sadness, neutrality, surprise, anger, and fatigue. The dataset utilized in this investigation comprises 2,069 facial images sorted into six distinct categories of facial expressions. Data collection was carried out through the recording of primary school educational sessions and monitoring of classroom footage sourced from YouTube. Subsequent to preliminary processing steps, encompassing facial landmark recognition, geometry feature extraction, normalization, and data enhancement, the dataset was partitioned into training, validation, and testing sets utilizing an 80:10:10 ratio. The constructed CNN model incorporates six convolutional layers for facial images and four fully connected layers for facial geometry features. Model assessment was conducted utilizing metrics including accuracy, precision, recall, and F1-score. Results from testing reveal that the proposed model exhibits considerable accuracy in recognizing students' facial expressions, with a validation accuracy rate of 92% and a testing accuracy rate of 95%. This research makes a notable contribution to the fields of education and psychology by furnishing valuable feedback on students' emotional and cognitive involvement, thereby supporting educators in pinpointing learning impediments and enhancing instructional methods.
AB - This study seeks to construct a model that is capable of categorizing students' facial expressions during classroom instructional sessions. Facial expressions serve as pivotal non-verbal indicators, offering valuable insights into students' emotional and cognitive conditions. Leveraging Convolutional Neural Network (CNN) technology, this research integrates image models with facial geometry feature models to identify a range of facial expressions including happiness, sadness, neutrality, surprise, anger, and fatigue. The dataset utilized in this investigation comprises 2,069 facial images sorted into six distinct categories of facial expressions. Data collection was carried out through the recording of primary school educational sessions and monitoring of classroom footage sourced from YouTube. Subsequent to preliminary processing steps, encompassing facial landmark recognition, geometry feature extraction, normalization, and data enhancement, the dataset was partitioned into training, validation, and testing sets utilizing an 80:10:10 ratio. The constructed CNN model incorporates six convolutional layers for facial images and four fully connected layers for facial geometry features. Model assessment was conducted utilizing metrics including accuracy, precision, recall, and F1-score. Results from testing reveal that the proposed model exhibits considerable accuracy in recognizing students' facial expressions, with a validation accuracy rate of 92% and a testing accuracy rate of 95%. This research makes a notable contribution to the fields of education and psychology by furnishing valuable feedback on students' emotional and cognitive involvement, thereby supporting educators in pinpointing learning impediments and enhancing instructional methods.
KW - Classification
KW - CNN
KW - Facial Expression
KW - Geometric Features
KW - Learning
UR - https://www.scopus.com/pages/publications/85216551765
U2 - 10.1109/ICACIT62963.2024.10788644
DO - 10.1109/ICACIT62963.2024.10788644
M3 - Conference contribution
AN - SCOPUS:85216551765
T3 - Proceedings - 10th International Symposium on Accreditation of Engineering and Computing Education, ICACIT 2024
BT - Proceedings - 10th International Symposium on Accreditation of Engineering and Computing Education, ICACIT 2024
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 10th International Symposium on Accreditation of Engineering and Computing Education, ICACIT 2024
Y2 - 3 October 2024 through 4 October 2024
ER -