|Year : 2020 | Volume
| Issue : 4 | Page : 233-240
The effect of portfolio training and clinical evaluation method on the clinical competence of nursing students
Maryam Sadat Katebi1
, Ali Arab Ahmadi2
, Hassan Jahani2, Fatemeh Mohalli3, Masood Rahimi3, Fateme Jafari4
1 Department of Midwifery, Qaen School of Nursing and Midwifery, Birjand University of Medical Sciences, Birjand, Iran
2 Department of Public Health, Qaen School of Nursing and Midwifery, Birjand University of Medical Sciences, Birjand, Iran
3 Department of Nursing, Qaen School of Nursing and Midwifery, Birjand University of Medical Sciences, Birjand, Iran
4 Midwifery, Mazandaran University of Medical Sciences, Mazandaran, Iran
|Date of Submission||27-Jan-2020|
|Date of Acceptance||11-Jun-2020|
|Date of Web Publication||15-Oct-2020|
Mr. Ali Arab Ahmadi
Department of Public Health, Qaen School of Nursing and Midwifery, Birjand University of Medical Sciences, Birjand
Source of Support: None, Conflict of Interest: None
Context: Nowadays, nurses in addition to acquiring knowledge should have sufficient clinical skills. One of the methods that have recently been taken into consideration in nursing students' clinical education is the method of portfolio.
Aims: The purpose of this study was to affect the portfolio training and clinical evaluation method on the clinical competence of nursing students.
Settings and Design: This semi-experimental study was carried out at the Faculty of Nursing and Midwifery of Qaen.
Material and Methods: The research population was all senior nursing students who were randomly divided into control groups and intervention to available sampling method. Education and clinical evaluation in the field of clinical competency in the internal and surgical departments were conducted in the intervention group of students with portfolio method and in the control group of students with conventional method from the viewpoint of professors and students.
Statistical Analysis Used: The data were analyzed by SPSS 24 and paired and independent t-test.
Results: According to the students' viewpoint in all aspects of clinical competence (except individual management) and clinical competency, the portfolio group had a higher mean, but there was no significant difference between the two groups (P > 0.05). However, according to the professor's view, there was a significant difference between the two groups in all aspects of clinical competency and total clinical competency.
Conclusions: Portfolio training and clinical evaluation can improve students' clinical competence. Therefore method can be used to create either motivation or interest to participate in learning and improve the level of clinical competence. Therefore, those interested and those in charge of educational affairs can benefit from this new educational method for the purpose of training and clinical evaluation of trainee students in the field.
Keywords: Clinical competency, Clinical Evaluation, Nursing Student, Portfolio, Training
|How to cite this article:|
Katebi MS, Arab Ahmadi A, Jahani H, Mohalli F, Rahimi M, Jafari F. The effect of portfolio training and clinical evaluation method on the clinical competence of nursing students. J Nurs Midwifery Sci 2020;7:233-40
|How to cite this URL:|
Katebi MS, Arab Ahmadi A, Jahani H, Mohalli F, Rahimi M, Jafari F. The effect of portfolio training and clinical evaluation method on the clinical competence of nursing students. J Nurs Midwifery Sci [serial online] 2020 [cited 2021 Jan 15];7:233-40. Available from: https://www.jnmsjournal.org/text.asp?2020/7/4/233/298233
| Introduction|| |
Assessing the clinical competence of nursing students is important not only to ensure the safety of care but also to identify areas that need to be upgraded and to determine educational needs. Evaluation of clinical performance is one of the important and sensitive components in the teaching and learning process; therefore, the category of evaluation in the fields of medical sciences is of special importance. In this regard, clinical education provides an opportunity for the student to interact with their environment and their instructor to apply their theoretical knowledge to patient care in the field of practice. Evaluating student learning is one of the most important elements of educational planning. The limited results in the country indicate that clinical assessment is not appropriate for students. In a study, Delaram et al. showed that 75% of nursing students believe that their teachers' clinical evaluation is not appropriate. 73.6% of students and 75.9% of professors found and disagreed with the conventional method of clinical evaluation, according to Imanipour's study, and it does not show the actual clinician of a student. Nasiriani et al. reported that most nursing students believe that they have not been able to learn the skills necessary for employment in nursing, which indicates that the value of ideal clinical education in personal and professional development, as well as clinical nursing skills, is undeniable.
In Carol research, based on the students' responses in year 6, the student-developed portfolio of guidelines in clinical skills was accepted and found useful. Other than being used as a tool for competency development, it also seems possible that the portfolio could be used as a tool for reflection in clinical skills, even in the early years. Since learners of medical sciences must be students with the ability to learn self-regulation, meaningful learning, and a combination of theoretical and clinical learning, it is necessary to train them as rethinking learners, which requires the use of new teaching methods.,
There have been many innovations in the theory and practice of education in the last decade, and the teachings have shifted from a teacher-centered to student-centered approach. In addition, encouraging learners to rethink, identifying learning needs by the learner, and encouraging them to learn more are other benefits of this cover-up. It should be noted that this method has disadvantages that require a lot of time to gather evidence and cause anxiety in learners.
The process of preparing a job involves collecting, organizing, and analyzing the best evidence that it shows how much the learning objectives have been approached , and also indicates the success and progress of the individual. In addition, the portfolio improves one's self-assessment ability and demonstrates their clinical competence. Numerous studies have also shown that this method promotes learning. In a study by Buckley et al., which looked at the best evidence of portfolio's impact on undergraduate education in the UK, the study found that the level of compatibility and compatibility of the portfolio method with students' clinical experience was higher than the conventional method.
On the other hand, student evaluation should be consistent with educational goals and evaluate student performance in relation to educational goals and to provide feedback to the student on a regular basis while at the university teaching and evaluation of students in the traditional way. All the semesters are done equally in theory and internship and therefore do not match with the clinical experience of the students. Furthermore, in this method, the student at the end of the semester is only informed from the score of the final examination and does not find their strengths and weaknesses point. Numerous studies have also suggested that, unlike the conventional teaching method, the portfolio has helped students develop self-awareness and learning independently, and they have achieved more success in the final examination. Furthermore, in Zahraei's study, from the perspective of faculty members and students, the most effective in improving clinical education, individual characteristics of students and the least impact have been evaluated.
From point of educational books, the lack of sufficient information in the field of their validity is considered as one of the weaknesses of the common method and they have introduced the portfolio method as an effective method in the field. Although the need for review in clinical practice management has been emphasized in many studies, due to the complexity of training in the clinical environment, only limited research on training, learning, and evaluation in this environment and how to improve it have been condemned. Therefore, considering the results of different studies, further research is needed on how to use the covert approach in clinical education and evaluation of nursing students. The aim of this research was to affect the portfolio training and clinical evaluation method on the clinical competence of nursing students.
| Material and Methods|| |
This clinical trial study was an empirical study that aimed to determine the effect of education and clinical evaluation in both conventional and portfolio methods on clinical competency of students and faculty members, point of views.
Based on the above sampling formula and taking into account the test power (1-B) equal to 90% and 95% reliability, as well as the mean values and standard deviation from the study, the same number of samples was determined for each group of 27 people.
It was assumed that 10% of samples do not fill out the questionnaires. Thereby, the sample size for each group was 30 people (60 samples for both groups). We included 30 nursing students in the seventh semester and 30 nursing students in the eighth semester. Participants were randomly divided into two groups of common and routine according to the planning of the nursing and education group manager. Then, each group was divided into two groups of 15 individuals for internship and surgery. The 2-week 5-day (10-day) training period was equivalent to one training unit for each of the internal and surgical departments. Students were supervised and evaluated by two instructors: one instructor in the internal department and the other instructor in the surgical department who led the two working groups. There were two groups, but there was no significant ability between the two groups. Entry criteria included: tendency to participate in research, lack of work experience such as independent student internship, and participation in the first day of preexamination, and the most important criterion was the failure to complete the internship for some reason, including the absence of more than one day.
In the portfolio group, the internship course plan was presented to the students and the portfolio description booklet. According to the lesson plan and the educational goals of the traineeship unit, the students wrote their needs and goals in order of priority in theory and practical skills in terms of defining behaviors and ways to achieve them.
Then, the students then the initial report of the portfolio was delivered to the instructor by the students and they received the necessary feedbacks. In the second week of the internship they performed the relevant practical activities and wrote a work report using the help of the instructor, and they again received the necessary feedback. At the end, all the materials were delivered in a coherent format to the instructor for scoring and evaluation. In the conventional education group, after setting educational goals and assignments and presenting the topics to the students, a 1-h conference and group discussion was held. Students were also instructed by the instructor to provide nursing care and treatment methods in the ward, and finally, evaluation was done based on common forms of the faculty. At the end of nursing students' clinical competency training, a clinical competency questionnaire was administered to students by self-evaluation and then by an instructor. Data collection tools included demographic information questionnaires of the research units including questions about age, gender, marital status, shift work, interest in nursing, satisfaction with internship, marriage satisfaction, traineeship site, internal and surgical course score in the previous year, place of internship, and pre- and posttest score and validity and reliability of clinical competency questionnaire. The validity of this tool was calculated by Content Mastery Method by several professors and specialists of this course and its reliability was calculated by internal consistency method using Cronbach's alpha correlation coefficient, which was 0.95.
In this study, the clinical competency of nursing students was a score that the respondents gave to 44-item questionnaires of clinical competency of nursing students. The questionnaire was completed by students and others by the instructor. The questionnaire is based on a five-point Likert scale (never – 1, rarely – 2, sometimes – 3, often – 4, and always – 5). The range of scores obtained from the questionnaire is between 44 and 220.
Rating between 44 and 73: The level of clinical competence of nursing students is low. Rating between 73 and 147: The clinical qualification of nursing students is moderate. Score above 147: The level of clinical competence of nursing students is high. This study was conducted by researchers in the internal medicine and surgery department of Qaen's Shohada Hospital after the approval of the ethics committee of Birjand University of Medical Sciences and obtaining a letter of introduction from Qaen's School of Nursing and Midwifery. Written consent was obtained from eligible participants in the study. At the end of data collection, data were entered into IBM SPSS Statistical version 23 software and analyzed by descriptive and inferential statistics including independent t-test, one-way analysis of variance, Chi-square, and Fisher's exact test at P < 0.05.
| Results|| |
In this study, 60 nursing students participated in the control group (30 students) and the intervention group (30 students). The majority of participants were male (58.3%). Their mean age was 22.91 (SD = 1.38).
Results of primary tests with Chi-square and independent t-tests showed that there was not a significant difference between the two groups in terms of gender distribution (P = 0.19, df = 1, χ2 = 1.71), work shift (P = 1, df = 1, χ2 = 0), internship satisfaction (P = 0.67, Fisher's exact = 1.22), marriage satisfaction (P = 0.47, df = 1, χ2 = 1/71), and pretest score status (P = 0.55, df = 2, χ2 = 1/16). However, there was no statistically significant difference in occupational interest (P = 0.46, df = 2, χ2 = 1.92) and mean age (P = 0.64, df = 58, t = 0.46). There was a significant difference between the two groups in terms of marital status (P=0.004, df =1, χ2 = 8.52), accommodation (P= 0.02, df=1, χ2 = 5.40), internal course score status (P<0.001, df =2, χ2 =21.21), Surgery course score (P=0.007, df =2, χ2 =10), traineeship site (P=1, df=1, χ2 = 0), and post-test score status (P<0.001, df=2, χ2 = 15.82). Considering that the level of clinical competence of students in both groups was measured both by self-expression and by the instructor, it was revealed that based on self-expression, in all dimensions of clinical competence (except individual management) and overall clinical competence, people in the portfolio group had a higher mean score; however, there was no statistically significant difference between the means of these two groups (P>0.05) [Table 1]. The review of students' clinical competence by the instructor also showed that there is a significant difference between the two groups in both all dimensions of clinical competence and total clinical competence. Moreover, it was revealed that portfolio group had a higher mean score. (P<0.05) [Table 2].
|Table 1: Comparison of scores of clinical competence domains in the two groups under study from the students' perspective|
Click here to view
|Table 2: Comparison of scores of clinical competence domains in the two groups under study from the instructor's perspective|
Click here to view
The results showed that, from the students' point of view, there is no significant relationship between demographic characteristics of individuals such as gender, marital status, interest in the profession, satisfaction with the internship environment, marriage satisfaction, housing status, pretest scores, posttest scores, internal course score, surgical course score status and areas of clinical competence, total clinical competence (P > 0.05). However, in assessment of the relationship between work shift and traineeship site with scores of clinical competence and total clinical competence from the students' point of view, there was a significant relationship only in the domain of clinical competency care management, so that in relation to work shift, people in night shift had a higher average score in comparison to people in afternoon shift (P = 0/025). Furthermore, regarding the place of internship, students in surgery ward had a higher average score in this area than the students in internal ward (P = 0.040). It was revealed that, from the instructor's point of view, there is no significant relationship between demographic characteristics of individuals such as gender, shift, interest in the profession, satisfaction with the internship environment, marriage satisfaction, pretest scores, internship place and areas of clinical competence, total clinical competence (P>0.05). However, the relationship between marital status, housing status, posttest scores, internal lesson scores, and students' surgery course scores was significantly correlated with the score of clinical competency and their overall clinical competence from the instructor's point of view [Table 3].
|Table 3: Comparison of mean total score and score of different domains of clinical competence with individual variables of research units from the trainer's point of view|
Click here to view
| Discussion|| |
This study aimed to affect the portfolio training and clinical evaluation method on the clinical competence of nursing students.
It has been shown that, from the educator's point of view, there is a significant difference between the areas of clinical competence such as care management, scientific competence, individual management, patient centeredness and scholarship, as well as general competence in the two groups under study. The dimensions mentioned were higher than the average group members as well as the overall competence of them, and people in the portfolio group had a higher average score in all dimensions than the conventional group. Valizadeh et al., in a study examining the impact of portfolio teaching and assessment on students' cognitive learning in clinical settings, also found that the study significantly enhanced the cognitive learning of nursing students, consistent with the results of this study. Various studies have shown that the portfolio can be used as a tool for clinical education and evaluation of students. Furthermore, Tiwari and Tang in their study show that using the portfolio method in clinical education of students improves their clinical learning level. Numerous studies have also believed that nursing students have somehow been able to play a role in enhancing their cognitive learning in the clinical setting., It was consistent with the results of the Mofrad and Karami study on the learning rate and ability of nursing students to self-evaluate in the portfolio method. However, it is more common than the usual method. However, in Zahraei's research, students mentioned the greatest impact on improving the clinical education of individual student characteristics and considered the least impact in the field of evaluation.
However, in a study, Latifi et al. Showed that clinical evaluation by portfolio method was less than the usual method to increase the ability of critical thinking in nursing students.
A study of Azadi et al., which was conducted as a study of the effect of education training and evaluation in the field of community health nursing by portfolio on the satisfaction of nursing students of Ilam University of Medical Sciences, showed that the average of all previous semesters in the two portfolio and conventional groups did not differ significantly. Also, Hekmatpour's study entitled “The effect of portfolio evaluation on the accuracy of clinical evaluation of internship students in nursing at Arak University of Medical Sciences showed that there were no significant differences between the two groups in the self-assessment of students in both the conventional and portfolio of clinical competence in this study”. Kariman et al. showed in their own study that clinical evaluation by portfolio method increases students' participation in the learning process. It also was revealed that applying the principles and concepts of theory in clinical education increases their learning compared to the group with routine training the results of this study are contrary to the results of the present study. This may be because in our self-assessment study, it may be perceived in the conventional group that responding to the questionnaire may affect their final score, or that the conventional group may have self-predicted. However, both the groups were required to explain this before the study. Hakimzadeh et al. also reported this issue in their study. It should be noted that the difference in the facilities of educational and clinical environments and the performance of clinical educators and their relationship with students can be effective in the difference in the results of studies.
In assessment of the relationship between shift work and trainee placement with the score of clinical competence and total clinical competence from the students' point of view, there was a significant relationship only in the domain of clinical competency care management. Furthermore, Toubaei and Sahraeian showed that the day workers had a higher mean score than nighttime workers in this area. Nighttime work in comparing the evening or the morning can lead to fatigue and depersonalization in nurses. Furthermore, regarding the place of internship, surgeons had a higher average score in the field of care management than the interns. Mosavianasl et al., in a study, showed that nurses in the internal ward had less personal performance than nurses in the surgical ward, which is consistent with the results of the present study. Investigating the relationship between students' demographic characteristics such as gender, shift, interest in the profession, satisfaction with the internship, marriage satisfaction (excluding care management), pretest scores, and student placement with scores of clinical competency and their portfolio clinical competence was not significantly correlated from the instructor's point of view. In Latifi et al.'s study, there was no significant relationship between gender and nursing students' evaluation scores with critical thinking skills evaluated by the employer, which is consistent with the present study. Asadi and et al.found that there is no significant relationship between interest in the work profession and the level of satisfaction of nursing students in both the portfolio and conventional groups. The results are consistent with ours. The relationship between marital status, housing status, posttest scores, internal course scores, and students' surgery course scores was significantly correlated with the score of clinical competency and their overall clinical competence from the instructor's point of view. In a study, Baba Mohammadi et al. found a positive and significant relationship between the average score of students half a year ago and the critical thinking skills test that enables nurses to deal with patient problems, reasoning, and judgment, which is consistent with the present results. However, contrary to the results of our study, Abutalebi et al. did not find a significant relationship between marital status and clinical education evaluation, which may be due to the different structures of these two studies.
| Conclusions|| |
The results of the present study showed that students who had been trained in clinical practice and clinical evaluation in regard to portfolio methods had higher scores in all fields of clinical competence and overall clinical competence than the conventional method, which indicates its importance, considering that the existing issues in the evaluation of the portfolio in a holistic way with the educational goals motivate and interest the student to participate in learning. Improving the level of their clinical competence can benefit from new educational methods such as portfolio. Therefore, educational stakeholders and beneficiaries can benefit from this new educational method to train and evaluate clinical students in the field.
Application of findings
Training and evaluation as a portfolio is more effective than the usual method on the clinical competence of nursing students. Therefore, it is suggested to use modern methods of student-centered teaching, including the portfolio method, to improve the level of scientific competence of nursing students.
It was difficult to get students' satisfaction to do a 10-day course, and many students said that it was too much.
Conflicts of interest
There are no conflicts of interest.
All authors contributed equally to the writing of the scientific proposal, data collection, and manuscript drafting. The final manuscript was reviewed and approved by all the authors.
Financial support and sponsorship
The project is sponsored by the Student Research Committee of Birjand University of Medical Sciences.
All nursing students and educational instructors participating in the present research project, as well as the research committee of Birjand University of Medical Sciences, are appreciated and thanked.
The present study, dated 7.2.2019 was approved by the Ethics Committee of Birjand University of Medical Sciences with the code of ethics IR.BUMS.REC.1397.335.
| References|| |
Arfaie K. Priorities of clinical education evaluation from nursing and midwifery students' perspective. Iran J Nurs 2012;25:71-7.
Yazdanpanah Nozari A, Jalahi H. The effective method for postering thinking dispositions of learners. J Mazandaran Univ Med Sci 2006;16:152-60.
Shakurnia A, Jouhanmardi A, Komaili Sani H. Students' opinion on factors affecting faculty evaluation in Jondishapoor Medical University. Iranian Journal of Medical Education 2005;5:101-10.
Fakhari A, Karegarmaher M. The opinion of medical interns about test methods in the clinical wards. Jornal of Medical Education 2005;5.
Imanipour M, Jalili M. Nursing students clinical evaluation in students and teachers views. Iran J Nurs Res 2012;7:17-26.
Delaram M, Reisi Z, Alidusti M. Strengths and weaknesses of clinical education from the viewpoints of nursing and midwifery students in Shahrekord University of medical sciences, Shahrekord, Iran. Qom Univ Med Sci J 2012;6:76-81.
Nasiriani K, Farnia F, Nasiriani F, Purdah Hambood A, Barzegari S. Evaluating the effectiveness of internal-surgical clinical education from the perspective of new nursing graduates. Iranian Journal of Medical Education 2005;5.
Khaw C, Raw L, Tonkin A, Kildea H. Evaluation of student-prepared portfolio of guidelines in undergraduate clinical skills using a mixed methods study. International Journal of Medical Education 2012;3:183-9.
Dearnley CA, Meddings FS. Student self-assessment and its impact on learning-a pilot study. Nurse Educ Today 2007;27:333-40.
Markani AK, Markani MK. Midwifery. Portfolio-based learning in nursing education. Advances in Nursing & Midwifery 2009;19:43-9.
McMullan M. Using portfolios for clinical practice learning and assessment: The pre-registration nursing student's perspective. Nurse Educ Today 2008;28:873-9.
Brown J Jr. Assessment Matters in Higher Education. Philadelphia: McGraw-Hill Education (UK); 1999.
Taşdemır M, Taşdemır A, Yildirim K. Influence of portfolio evaluation in coopeative learning on student success. J Theory Practice Educ 2009;5:53-66.
Brown S, Knight P. Assessing Learners in Higher Education. London: Routledge; 2012.
Ebadi A, Tabanejad Z, Pazokian MJ. Clinical competence among MSc students of critical care nursing. Iranian Journal of Medical Education. 2015;14:1036-46.
Valizadeh S, Rahmani A, Davoodi A, Aminiaee NJ. Comparison of the effect of clinical education and assessment using portfolio and blended methods on cognitive learning of nursing students in clinical settings. Iranian Journal of Medical Education 2011;11:245-53.
Nairn S, O'Brien E, Traynor V, Williams G, Chapple M, Johnson S. Student nurses' knowledge, skills and attitudes towards the use of portfolios in a school of nursing. J Clin Nurs 2006;15:1509-20.
Ryan M. Evaluating portfolio use as a tool for assessment and professional development in graduate nursing education. J Prof Nurs 2011;27:84-91.
Karsten K. Using ePortfolio to demonstrate competence in associate degree nursing students. Teaching Learning Nurs 2012;7:23-6.
Mollahadi M, Khademolhoseini SM, Mokhtari-Nouri J, Khaghanizadeh M. The portfolio as a tool for mentoring in nursing students: A scoping review. Iran J Nurs Midwifery Res 2018;23:241-7.
Zahraei H. Comparing the factors related to the effective clinical teaching from faculty members' and students' points of view. Iran J Med Educ 2008;7:249-56.
Garrett BM, MacPhee M, Jackson C. Evaluation of an eportfolio for the assessment of clinical competence in a baccalaureate nursing program. Nurse Educ Today 2013;33:1207-13.
Tiwari A, Tang C. From process to outcome: The effect of portfolio assessment on student learning. Nurse Educ Today 2003;23:269-77.
Mofrad MN, Karami M. The effects of portfolio method on self-directed learning (SDL) of nursing students. Biosci Biotechnol Res Asia 2013;10:817-21.
Latifi M, Shaban M, Nikbakht Nasrabadi A, Mehran A, Parsa Yekta ZJ. Effect of clinical evaluation with portfolio on critical thinking skills of nursing students. Iranian Journal of Medical Education 2011;11:368-81.
Azadi A, Bastami M, Bastami MR. The effect of clinical learning and assessment of community health nursing apprenticeship using portfolio method on nursing students' satisfaction. Iran J Nurs Res 2017;11:1-6.
Hekmatpour D. Effect of portfolio based evaluation on accuracy of clinical evaluation of nursing students during internship in Arak University of medical sciences, Iran. Strides Develop Med Educ 2013;10:60-9.
Kariman N, Heidari T. The effect of Portfolio's evaluation on learning and satisfaction of midwifery students. J Arak Univ Med Sci 2010;12:81-8.
Hakimzadeh R, Karamdost N, Memarian R, Ghodrati A, Mirmosavi JJ. Assessing nursing students' clinical competency: Self-assessment. Nursing Management 2012;1:17-25.
Toubaei S, Sahraeian AJ. Burnout and job satisfaction of nurses working in internal, surgery, psychiatry burn and burn wards. The Horizon of Medical Sciences 2007;12:40-5.
Mosavianasl Z, Babaeipouya A, Karimi A. The relationship between shift work and occupational burnout among nurses in a teaching hospital in Ahvaz. Occupational Hygiene and Health Promot J 2017;1:118-28.
Asadi S, Latifi SM, Sheini-Jaberi P. Effects of clinical education and evaluation with portfolio method on nursing students' satisfaction: a clinical trial. Journal of Clinical Nursing and Midwifery 2014;3:70-9.
Baba mohammadi H, Khalili H. Critical Thinking Skills of Nursing Students in Semnan University of Medical Sciences. Iran J Med Educ 2004;4:23-31.
Abotalebi G, Vosoghi N, Sajadi A, Akbary M. Evaluation of clinical education from the perspective of nursing students of Ardabil University of Medical Science in 2009. J Health 2010;1:31-7.
[Table 1], [Table 2], [Table 3]