Objective: Assessing nursing students' competence requires valid, reliable, and objective tools. The Objective Structured Clinical Examination (OSCE) evaluates cognitive and behavioral dimensions of learning. This study aimed to identify common errors made by nursing students during OSCE exams and examine the relationship between their theoretical and clinical practice grades with OSCE performance. Material and Methods: The study was conducted retrospectively. The study sample consisted of 443 students who took the fundamentals of nursing course during the 2018-2019 and 2019-2020 academic years. Data were collected retrospectively from student OSCE records and student information system between 2nd and 30th November 2020. The Students' Descriptive Characteristics Form, Categorised Steps of Care-oriented Skills Form, and Care-oriented Skills Checklists, which were developed by the researchers, were used for data collection. Results: In care-oriented OSCE, students commonly performed well in providing patient information, selecting appropriate materials, removing used materials properly, and recording procedures. However, frequent mistakes included poor skill execution and non-compliance with infection control principles. A significant positive correlation was found between OSCE grades and theoretical (r=0.812), practice (r=0.263), and final grades (r=0.265) (p<0.001 for all). Conclusion: OSCE was a valid and reliable method for skill assessment. Increasing the number of skill stations could enhance its representativeness. Future studies could explore factors behind students' low OSCE grades.
Keywords: Clinical competence; examination questions; psychomotor skill; students; nursing
Amaç: Hemşirelik öğrencilerinin yeterliklerini değerlendirmek için geçerli, güvenilir ve objektif araçlar gereklidir. Objektif Yapılandırılmış Klinik Sınav (OYKS), öğrenmenin bilişsel ve davranışsal boyutlarını değerlendirir. Bu çalışma, hemşirelik öğrencilerinin OYKS sınavlarında sık yaptığı hataları belirlemeyi ve teorik ile klinik uygulama notları ile OYKS performansları arasındaki ilişkiyi incelemeyi amaçlamıştır. Gereç ve Yöntemler: Çalışma, retrospektif olarak yürütülmüştür. Örneklem, 2018-2019 ve 2019- 2020 akademik yıllarında hemşirelik esasları dersini alan 443 öğrenciden oluşmaktadır. Veriler, 2-30 Kasım 2020 tarihleri arasında öğrenci OYKS kayıtları ve not giriş sisteminden retrospektif olarak toplanmıştır. Verilerin toplanmasında araştırmacılar tarafından oluşturulan Öğrenci Tanıtım Özellikleri Formu, Bakım Odaklı Becerilere Yönelik Kategorize Edilmiş Adımlar Formu ve Bakım Odaklı Beceriler Kontrol Listeleri kullanılmıştır. Bulgular: Bakım odaklı OYKS'de öğrenciler, hasta bilgilendirme, uygun malzeme seçimi, kullanılan malzemeleri uygun şekilde uzaklaştırma ve işlemi doğru kaydetme adımlarında genellikle başarılı olmuştur. Ancak, sık yapılan hatalar arasında beceri uygulamalarında yetersizlik ve enfeksiyon kontrol ilkelerine uyulmaması yer almıştır. OYKS notları ile teorik (r=0.812), uygulama (r=0.263) ve final notları (r=0.265) arasında anlamlı pozitif yönde bir ilişki bulunmuştur (hepsi için, p<0.001). Sonuç: OYKS, beceri değerlendirmede geçerli ve güvenilir bir yöntemdir. Beceri istasyonlarının artırılması, sınavın tüm becerileri temsil etme gücünü artırabilir. Gelecekteki çalışmalarda, öğrencilerin düşük OYKS notlarının nedenleri incelenebilir.
Anahtar Kelimeler: Klinik yeterlilik; sınav soruları; psikomotor beceri; öğrenciler; hemşirelik
- Özden D, Gürol Arslan G, Ertuğrul B, Adanır A. Hemşirelik öğrencilerinin objektif yapilandirilmiş klinik sinav becerisinin teorik ve uygulama başarisi ile ilişkisi [The relationship of nursing students? objective structured clinical exam skills with theoretical and practical success. Dokuz Eylül Üniversitesi Hemşirelik Fakültesi Elektronik Dergisi. 2022;15(4):487-506. [Crossref]
- Solà-Pola M, Morin-Fraile V, Fabrellas-Padrés N, Raurell-Torreda M, Guanter-Peris L, Guix-Comellas E, et al. The usefulness and acceptance of the OSCE in nursing schools. Nurse Educ Pract. 2020;43:102736. [PubMed]
- Ismail SM, Rahul DR, Patra I, Rezvani E. Formative vs. summative assessment: impacts on academic motivation, attitude toward learning, test anxiety, and self-regulation skill. Lang Test Asia. 2022;12(1):40. [Crossref] [PMC]
- Epstein RM. Assessment in medical education. N Engl J Med. 2007;356(4):387-96. [Crossref] [PubMed]
- Harden RMG, Downie WW, Stevenson M, Wilson GM. Assessment of clinical competence using objective structured examination. Br Med J. 1975;1:447-51. [Crossref] [PubMed] [PMC]
- Demirağ H, Göktaş Ş, Yıldırım E, Tamgül M, Gökçe M, Akkaya T. Objektif yapılandırılmış klinik sınavı (OYKS) kullanılarak paramedik öğrencilerin mesleki becerilerinin değerlendirilmesi [Evaluation of professional skills of paramedic students by using objective structured clinical exam (OSCE)]. Gümüşhane Univ Sağlık Bilim Derg. 2018;7(4):65-73. [Link]
- Lee KC, Ho CH, Yu CC, Chao YF. The development of a six-station OSCE for evaluating the clinical competency of the student nurses before graduation: a validity and reliability analysis. Nurse Educ Today. 2020;84:104247. [Crossref] [PubMed]
- Madenoğlu Kıvanç M, Türen S, Gül A, Miral M, Atakoğlu R, Kara Özçalık C. Hemşirelik eğitiminde öğrenci değerlendirme stratejisi: objektif yapılandırılmış klinik sınavı [Student assessment strategy in nursing education: objective structured clinical examination]. Sağlık ve Yaşam Bil Derg. 2023;5(2):80-6. [Crossref]
- Malakooti N, Bahadoran P, Ehsanpoor S. Assessment of the midwifery students' clinical competency before internship program in the field based on the objective structured clinical examination. Iran J Nurs Midwifery Res. 2018;23(1):31-5. [PubMed] [PMC]
- Couto LB, Durand MT, Wolff ACD, Restini CBA, Faria M Jr, Romão GS, et al. Formative assessment scores in tutorial sessions correlates with OSCE and progress testing scores in a PBL medical curriculum. Med Educ Online. 2019;24(1):1560862. [Crossref] [PubMed] [PMC]
- Terry R, Hing W, Orr R, Milne N. Relationships between pre-clinical summative assessment scores and the clinical performance of physiotherapy students. J Allied Health. 2020;49(1):e13-e19. [PubMed]
- Albannaa R, Almela T. Evaluation of objective structured clinical examination-assessed competence and perceived confidence in oral surgery among final-year undergraduate student. J Dent Educ. 2025. [Crossref] [PubMed]
- Akın Korhan E, Tokem Y, Uzelli Yılmaz D, Dilemek H. Hemşirelikte psikomotor beceri eğitiminde video destekli öğretim ve OSCE uygulaması: bir deneyim paylaşımı [Video-based teaching and OSCE implementation in nursing psychomotor skills education: sharing of an experience]. İzmir Kâtip Çelebi Üniversitesi Sağlık Bilimleri Fakültesi Dergisi. 2016;1(1):35-7. [Link]
- Miller GE. The assessment of clinical skills/competence/performance. Acad Med. 1990;65(9 Suppl):S63-7. [PubMed]
- Adams NE. Bloom's taxonomy of cognitive learning objectives. J Med Libr Assoc. 2015;103(3):152-3. [PubMed] [PMC]
- Brown J. Preparation for objective structured clinical examination: a student perspective. J Perioper Pract. 2019;29(6):179-84. [Crossref] [PubMed]
- Mortsiefer A, Karger A, Rotthoff T, Raski B, Pentzek M. Examiner characteristics and interrater reliability in a communication OSCE. Patient Educ Couns. 2017;100(6):1230-4. [Crossref] [PubMed]
- Goh HS, Ng E, Tang ML, Zhang H, Liaw SY. Psychometric testing and cost of a five-station OSCE for newly graduated nurses. Nurse Educ Today. 2022;112:105326. [Crossref] [PubMed]
- D'Aoust R, Slone SE, Russell N, Budhathoki C, Ling C. PRIME-nurse practitioner competency model validation and criterion based OSCE rubric interrater reliability. BMC Med Educ. 2024;24(1):124. [Crossref] [PubMed] [PMC]
- Chabrera C, Diago E, Curell L. Development, validity and reliability of objective structured clinical examination in nursing students. SAGE Open Nurs. 2023;9. [Crossref] [PubMed] [PMC]
- Huang HP, Chao LF, Wang YH, Liu YM, Ni LF, Jane SW. The establishment and examination of the reliability, validity, discrimination, and difficulty of nursing Objective Structured Clinical Examination (OSCE). Hu Li Za Zhi. 2017;64(6):67-76. Chinese. [Crossref] [PubMed]
- Bagnasco A, Tolotti A, Pagnucci N, Torre G, Timmins F, Aleo G, et al. How to maintain equity and objectivity in assessing the communication skills in a large group of student nurses during a long examination session, using the Objective Structured Clinical Examination (OSCE). Nurse Educ Today. 2016;38:54-60. [Crossref] [PubMed]
- Akın Korhan E, Uzelli Yılmaz D, Ceylan B, Akbıyık A, Tokem Y. Hemşirelikte psikomotor becerilerin öğretiminde senaryo temelli öğrenme: bir deneyim paylaşımı [Scenario based teaching in nursing psychomotor skills education: sharing of an experience]. İzmir Kâtip Çelebi Üniversitesi Sağlık Bilimleri Fakültesi Dergisi. 2018;3(3):11-6. [Link]
- Bani-Issa W, Al Tamimi M, Fakhry R, Tawil HA. Experiences of nursing students and examiners with the Objective Structured Clinical Examination method in physical assessment education: a mixed methods study. Nurse Educ Pract. 2019;35:83-9. [Crossref] [PubMed]
- Taber KS. The use of Cronbach?s alpha when developing and reporting research instruments in science education. Res Sci Educ. 2018;48(6):1273-96. [Crossref] [PubMed]
- Aronowitz T, Aronowitz S, Mardin-Small J, Kim B. Using Objective Structured Clinical Examination (OSCE) as education in advanced practice registered nursing education. J Prof Nurs. 2017;33(2):119-25. [Crossref] [PubMed]
- Chongloi N, Thomas P, Hansaram, Ara M, Deepak KK. Attitudes of undergraduate nursing students toward Objective Structure Practical Examination: an Exploratory study. Int J Nurs Sci. 2016;4(1):68-72. [PubMed] [PMC]
- Daniels VJ, Pugh D. Twelve tips for developing an OSCE that measures what you want. Med Teach. 2018;40(12):1208-13. [PubMed]
- East L, Peters K, Halcomb E, ve ark. Evaluating objective structured clinical assessment (OSCA) in undergraduate nursing. Nurse Educ Pract. 2014;14(5):461-7. [Crossref] [PubMed]
- Graham R, Zubiaurre Bitzer LA, Anderson OR. Reliability and predictive validity of a comprehensive preclinical OSCE in dental education. J Dent Educ. 2013;77(2):161-7. [PubMed]
- Bektaş M, Akdeniz Kudubeş A. Bir ölçme ve değerlendirme aracı olarak: yazılı sınavlar [As a measurement and evaluation tool: written exams]. DEU Hemş Yüksekok Elektron Derg. 2014;7(4):330-6. [Link]
- Hengameh H, Afsaneh R, Morteza K, Hosein M, Marjan SM, Abbas E. The effect of applying direct Observation of Procedural Skills (DOPS) on nursing students' clinical skills: a randomized clinical trial. Glob J Health Sci. 2015;7(7 Spec No):17-21. [Crossref] [PubMed] [PMC]
- Aldridge MD, Hummel F. Nursing students' perceptions of skills learning: a phenomenological study. Nurse Educ. 2019;44(3):170-4. [Crossref] [PubMed]
- Gürol Arslan G, Özden D, Alan N, Yilmaz İ, Ayik C, Göktuna G. Examination of nursing drug administration practices via central venous catheter: An observational study. J Vasc Access. 2020;21(4):426-33. [Crossref] [PubMed]
.: Process List