A Novel CNN-RNN Model for E-Cheating Detection Based on Video Surveillance
Keywords:Detect Suspicious Activities, Person Detection, Person Tracking, YOLOv7, CNN-RNN, Physical Exam, DeepSort, Face Recognition, Smart Attendance
Nowadays, everything needs to be digitized, and scientific knowledge is constantly bringing comfort and change to everyday life. Autonomous systems have become a prominent technology in recent years, with a variety of applications in different fields. Though our proposed system is designed to maintain academic integrity in exams. The system uses computer vision techniques to monitor the behavior of students during the exam and detect any suspicious activities, such as looking at someone else's paper or using unauthorized materials. The proposed E-Cheating Detection consists of four core steps: 1) Student/Person Detection and Tracking, 2) Detect suspicious activities, 3) Generating alerts, and 4) Mark attendance. Student detection from videos is performed by using YOLOv7 and DeepSort tracker is used to track the detected persons that are being detected by the YOLOv7 algorithm. To classify suspicious activities (such as the exchange of paper, and giving codes to one another, etc.) the system uses CNN-RNN architecture in which the inceptionV3 model is used for feature extraction. The system will generate real-time alerts for suspicious behavior by sending an email via SMTP to the exam administration /invigilator. The system marks the student's attendance by recognizing and matching student faces that are stored in the database. The performance of the system will be evaluated by conducting a series of experiments using simulated scenarios, and the results will demonstrate the effectiveness of the proposed system in detecting suspicious activities during physical exams. The proposed system has the potential to promote exam integrity and create a fair environment for all students, ultimately improving the education system's quality.
Academic dishonesty definition and types: Academic integrity tutorial. Northern Illinois University. Available at: https://www.niu.edu/academic-integrity/faculty/types/index.shtml (Accessed: March 30, 2023).
26, dgsM. and 23, M.F. (2020) Online exam vs. traditional pen paper exams: Conductexam, Conduct Exam Technologies LLP. Available at: https://www.conductexam.com/blog/online-exams-vs-traditional-pen-paper-exams (Accessed: March 30, 2023).
C. A. Drake, "Why Students Cheat," The Journal of Higher Education, vol. 12, pp. 418-420, 1941/11/01 1941.
3 benefits of an online invigilator (2023) EDExams Blog. Available at: https://blog.edexams.com/3-benefits of-an-online-invigilator/ (Accessed: March 30, 2023).
J. Nishchal, S. Reddy, and P. N. Navya, "Automated cheating detection in exams using posture and emotion analysis," in 2020 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT), 2020, pp. 1-6.
F. Ozdamli, A. Aljarrah, D. Karagozlu, and M. Ababneh, "Facial Recognition System to Detect Student Emotions and Cheating in Distance Learning," Sustainability, vol. 14, p. 13230, 2022.
R. a. M. Al_airaji, I. A. Aljazaery, H. T. S. Alrikabi, and A. H. M. Alaidi, "Automated Cheating Detection based on Video Surveillance in the Examination Classes," International Journal of Interactive Mobile Technologies (iJIM), vol. 16, pp. pp. 124-137, 04/26 2022.
X. G. Yu, J. Y. Sun, B. He, J. J. Zhuang, and Z. C. Dai, "Design and Implementation of Automatic Invigilation Functions Using the Embedded Technology," Procedia Computer Science, vol. 166, pp. 41-45, 2020/01/01/ 2020.
M. Adil, R. Simon, and S. K. Khatri, "Automated Invigilation System for Detection of Suspicious Activities during Examination," 2019 Amity International Conference on Artificial Intelligence (AICAI), pp. 361-366, 2019.
A. Arinaldi and M. I. Fanany, "Cheating video description based on sequences of gestures," in 2017 5th International Conference on Information and Communication Technology (ICoIC7), 2017, pp. 1-6.
M. Asadullah and S. Nisar, "An automated technique for cheating detection," in 2016 Sixth International Conference on Innovative Computing Technology (INTECH), 2016, pp. 251-255.
F. Kamalov, H. Sulieman, and D. Santandreu Calonge, "Machine learning based approach to exam cheating detection," Plos one, vol. 16, p. e0254340, 2021.
Y. Atoum, L. Chen, A. X. Liu, S. D. Hsu, and X. Liu, "Automated online exam proctoring," IEEE Transactions on Multimedia, vol. 19, pp. 1609-1624, 2017.
K. Jiang, T. Xie, R. Yan, X. Wen, D. Li, H. Jiang, et al., "An Attention Mechanism-Improved YOLOv7 Object Detection Algorithm for Hemp Duck Count Estimation," Agriculture, vol. 12, p. 1659, 2022.
C.-Y. Wang, A. Bochkovskiy, and H.-Y. M. Liao, "YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors," arXiv preprint arXiv:2207.02696, 2022.
N. Wojke, A. Bewley, and D. Paulus, "Simple online and realtime tracking with a deep association metric," in 2017 IEEE International Conference on Image Processing (ICIP), 2017, pp. 3645-3649.
Team, K. Keras Documentation: Video Classification with a CNN-RNN architecture, Keras. Available at: https://keras.io/examples/vision/video_classification/ (Accessed: April 2, 2023).
Three ways to send emails using python with code tutorials (no date) Courier. Available at: https://www.courier.com/blog/three-ways-to-send-emails-using-python-with-code-tutorials/ (Accessed: February 30, 2023).
J. Mahajan and A. Paithane, "Face detection on distorted images by using quality HOG features," in 2017 International Conference on Inventive Communication and Computational Technologies (ICICCT), 2017, pp. 439-444.
Syed Danish Ahmad Sharifi, Muhammand Usman, and Eman Gul, “An Intelligent Health Control Security Robotic System”, University of Wah Journal of Computer Science, vol. 4, no. 1, pp. 17–30, Jan. 2023
A. Liang, W. Liu, L. Li, M. R. Farid, and V. Le, "Accurate facial landmarks detection for frontal faces with extended tree-structured models," in 2014 22nd International Conference on Pattern Recognition, 2014, pp. 538-543.
Jessica Li (https://www.kaggle.com/jessicali9530), Accessed by 7/9/2022.