Background: The global COVID-19 pandemic turned the adoption of on-line assessment in the institutions for higher education from possibility to necessity. Thus, in the end of Fall 20/21 semester Tel Aviv University (TAU)—the largest university in Israel—designed and implemented a scalable procedure for administering proctored remote examinations. This procedure is applicable to different kinds of examinations in diverse disciplines and to disparate degree levels. Objectives: This study aims to deepen the knowledge with respect to the design and adoption of remote proctoring at an institutional level. Methods: First, based on lessons learned from the first semester of COVID-19, we describe the development and implementation of an institution-wide protocol for conducting on-line proctored assessment. We show the large-scale applicability of the protocol for administering examinations via Moodle with remote proctoring via Zoom. The accurately designed procedures that included careful consideration of all parties involved—academic staff members, students, administrative staff and proctors—enabled TAU to successfully assess the learning outcomes of its 25,000 students, while maintaining validity, compatibility and reliability of the assessment. Second, we report combined data from surveys of 4380 students and 188 faculty-members (18% and 12% response rate respectively), conducted at TAU following these examinations. Results and Conclusions: With over 90% of the students experiencing at least one, and 80% of faculty-members administering at least one proctored remote examination, these heterogeneous sources of data allow us to investigate a unique and complementary perspective of the process. Some of the significant findings consist of the over-all perception of the students' integrity by both groups surveyed; the discrepancy in the groups' perspectives of the adequate form of learning-assessment—with the instructors preferring proctored examinations and the students—formative-assessment; and the influence of the pedagogical challenges on the perception of validity that outweighed other factors, for example, the pandemic-related stress, the on-line assessment challenges and other.
Bibliographical noteFunding Information:
We thank the administrative staff and the IT department of TAU for helping with organizing and implementing the novel remote proctoring design during the full campus closure at the peak of COVID-19 pandemic in the end of Fall 20/21 semester.
© 2022 The Authors. Journal of Computer Assisted Learning published by John Wiley & Sons Ltd.
- Higher education
- On-line proctored assessment
- Remote proctoring