Construction of a Standardized Questionnaire to measure the Culture of evaluation in the Higher Education System: A mixed research of instrument development model

Document Type : Research Article

Authors

1 Faculty of Psychology and Education, University of Tehran, Tehran, Iran.

2 Associate professor, faculty of psychology and education, University of Tehran, Tehran, Iran.

3 Associate professor, Faculty of Psychology and Education, University of Tehran, Tehran, Iran.

10.22059/jomc.2024.371651.1008636

Abstract

Objective: In this research, the conceptualization and construction of a scaled tool for measuring quality of culture and evaluation was discussed.

Methods: This research was based on the exploratory mixed method of the instrument development model. In the phenomenology stage, with the aim of analyzing the lived experiences of Beneficiaries and stakeholders, after interviewing 61 participants, data saturation was achieved. In the quantitative part, which was based on the correlation method, 510 university activists, including faculty members, teaching and executive staff, and university students, participated in the study in an accessible way. In the construction of the tool, the psychometric characteristics were examined based on the (CTT) and (IRT).

Results: At first, content and construct validity were examined and confirmed using factor analysis; In the following, the Reliability using McDonald's omega method in evaluation of culture was obtained as 0.869 in general and above 0.7 in all subscales. In the analysis of the items based on the Item Response Theory, the findings showed that the partial score model (PCM) has a better fit with the data of the evaluation of cultural questionnaire.

Conclusion: Based on the obtained results, this questionnaire can be used to measure the levels of evaluation of culture in the academic environment.

Keywords

Main Subjects