Systematic Review and Evaluation
Systematic Review and Evaluation
Our program evaluation includes information and data from the following sources:
- Practicum and internship evaluations by site supervisors
- Clinical mental health counselor trainees (CT) are observed by their site supervisor at the 50 and 100 hour points during their practicum experience to evaluate intervention/counseling, cognitive/case conceptualization, and self-awareness skills as well as professional behavior. They are also evaluated and at the 100, 300, and 500 hour points in their internship experience to provide (CT) with feedback on the effective use of counseling skills and their progress toward mastery of these skills, They are further evaluated by their site supervisors at the 200, 400, and 600 hour points during their internship experience to assess CT counseling, case conceptualization, self-awareness skills, as well as measure their professional behavior.
- School counseling practicum students are evaluated by their site supervisors to gauge their knowledge, skills, and dispositions related to problem solving, consultation, and professionalism. They are then evaluated for problem-solving consultation at the 200, 400, and final 80 hours of the 600 hour points of internship. Each assessment is formative in nature with a goal of enhancing growth as a professional school counselor. In addition, students have live skills evaluations in the areas of individual counseling, small group counseling, and classroom guidance as all of these areas are required by the American School Counselor Association (ASCA). Finally, each student must complete a personal self-evaluation and reflection form for each live skills evaluation
- Student evaluation of site and site supervisors
- At the end of internship, each student is invited to complete an evaluation of their internship sites and the site supervisor. Specific information about the responsiveness, opportunities for appropriate cases, direct and indirect hour opportunities, and access to site supervision are all collected as a way to evaluate appropriateness and effectiveness of internship sites and site supervision. This information is used to determine if a site will continue to be part of the vetted list provided for student consideration.
- Clinical Mental Health students are required to obtain status as a Counselor Trainee (CT) through the state of Ohio, prior to beginning practicum. All School Counseling students must register for a Pre Service Teacher Permit through the Ohio Department of Education and Workforce prior to the beginning of practicum. Both require completion of a FBI/BCI fingerprint and criminal records check and application through the appropriate licensing body.
- Passing of licensure exam
- Clinical counseling students must take and pass the National Counselor Examination (NCE). School counseling students must take and pass the Ohio Assessments for Educators, School Counselor Exam (040). The 4-year average first time pass rate for theClinical Counseling (NCE) licensure exam is 94%. The 5-year average first time pass rate for the School Counseling Licensure (OAE) exam is 89%.
- Input from our advisory board
- The school counseling and clinical mental health programs have separate advisory boards which meet at least annually to provide feedback and insight about the programs, their performance, and future directions. The advisory board members include program alumni, site supervisors, adjunct instructors, and other currently practicing professionals from each program.
- Advisory board members are asked about new ideas, best practices, course and delivery improvement ideas and information. Data collected from these meetings are included, in aggregate, in our annual CACREP vital statistics reports, and to drive improvements and changes within our programs.
- Surveys of employers and alumni
- Employers and alumni are sent an online survey designed to collect information about current employment, outcomes, and general satisfaction with alignment of program preparation and current job status. These surveys are generated and sent by the university with access provided via Salesforce.
- Evaluation of Faculty and Supervisors by students
- In each course, students are invited to evaluate their class experiences through the online Student Feedback Tool (SFT) previously known as the Student Evaluation of Teaching (SET). Students are asked to provide anonymous, candid, respectful opinions and constructive suggestions. Results of each SFT are provided to faculty after the end of each semester. The scores are reported as relative frequency distributions and each year, faculty will be asked to complete a concise SFT reflection form each year which is designed to help them integrate student feedback, evaluate new pedagogical approaches, connect with course learning outcomes, and enhance teaching effectiveness. Academic units and departments will develop and maintain these reflection forms. Student comments are saved and included with faculty scores; both are included as data for annual reviews. Time is provided in class for students to complete the SFT and language to that effect is required on each course syllabus.
- Placement of our graduates into counseling/counselor education positions
- Graduates are asked to provide information about their first counseling positions post-graduation. For the past 10 years, all students who have sought counseling positions have been hired in their respective fields, including at agencies, health care facilities, K-12 public, private, charter, and parochial schools, and colleges. Our master’s students are highly sought after and we consistently receive positive feedback about how well prepared, professional, conscientious, and open minded our students are. Many employers seek our students as potential employees.
- All Ohio Counselors Conference attendance and presentations
- Each year, current students and alumni present at the All Ohio Counselors Conference as well as at other conferences in the state of Ohio and beyond.
- UD hosts an annual reception at the All Ohio Counselors Conference each year as an opportunity for students and alumni to reconnect and network with each other.
Curriculum quality
Input |
Modification |
---|---|
Licensure Exam Pass Rate |
The culminating seminar CMH course includes NCE test preparation. OAE test preparation is embedded in EDC 546, School Counseling Program Development |
Advisory Board Meeting Input |
Content was adjusted in several courses to reflect feedback about current best practices. |
Student Input |
More intentional advising practices were implemented for school counseling students to help them select from elective options
|
Student Performance |
Adjustments are made continuously ton insure student Recent example: Multicultural counseling was amended to include more flexibility in the immersion experience |
Student SET/SFT Feedback |
Instructors use student feedback from the SET/SFT tools to evaluate the effectiveness of course content and assignments. Adjustments are made to ensure student |
Program Quality
Selection and Retention Supervisors and Adjunct Instructors
Input |
Modification |
---|---|
Student Input |
Student feedback via SFT and ad hoc conversations are used to determine whether there should be a conversation with or whether the person should not be invited to return as an adjunct instructor or to serve as a supervisor Recent examples: An adjunct instructor with extremely positive feedback has been offered a course for the spring semester. Another adjunct was terminated after poor student SET feedback and general dissatisfaction with teaching performance |
SFT results |
SFT reports on adjunct instructors are sent to the department chair who collaborates with program coordinators to make decisions about future employment |
Student Quality
Academic and Dispositional Potential of Students
Input |
Modification |
---|---|
Student interview performance |
If a student is inappropriate at the interview stage, questions about their ability to successfully complete the program are explored and a subsequent follow up interview may be scheduled |
Student Performance in Class |
If a student is not engaging appropriately in class, the instructor may schedule an informal conversation to discuss expectations and discern opportunities for improvement. If agreements cannot be found, the program coordinator can be brought into the conversation. If there is no resolution after that, the department chair may be brought into the conversation. |
Knowledge, Skills, and Dispositions (KSD) Assessments |
Core and adjunct faculty complete KSD assessments at the end of each semester. Each student is evaluated on their attainment and demonstration of course-related knowledge based on performance of a final course assignment, acquisition and demonstration of course specific skills, and their professional dispositions. The data from each student is reviewed by the core CMH and SC faculty. Students are provided with written feedback about their progression in the program with assigned advisors completing follow up conversations as necessary. If needed, formal review and retention processes are initiated per the program, department, and university guidelines. |