Program Goals and Outcomes
Program Goals and Outcomes
The UM-Flint PA Program’s mission is expressed through four fundamental goals that emphasize clinical excellence, professionalism, leadership and advocacy. Through rigorous academic preparation and experiential learning opportunities, the program strives to graduate PAs who will make meaningful contributions to healthcare delivery and advance the profession. The PA Program at the University of Michigan-Flint strives to achieve the following:
Goal #1: Prepare PA students with the knowledge and skills necessary to enter clinical practice
Rationale: The program implements a comprehensive curriculum with measurable benchmarks to verify students’ readiness for clinical practice. Through systematic assessment of medical knowledge via standardized national examinations (PANCE and PAEA End of Curriculum Exam) and evaluation of clinical competencies through Entrustable Professional Activities, the program ensures graduates demonstrate both the foundational knowledge and practical skills essential for entry-level clinical practice. Clinical preceptors’ assessments of students’ performance on EPAs provide direct evidence of students’ ability to apply their medical knowledge in authentic clinical settings
Outcome Measures:
a) Medical knowledge – PANCE performance
This standardized exam serves as a validated, comprehensive assessment tool that objectively measures students’ medical knowledge across key clinical domains, reflecting the acquisition of fundamental scientific understanding required for PA practice. Additionally, using this exam as an outcome measure allows the UM-Flint PA program to benchmark students’ performance against national standards, providing data to evaluate the effectiveness of their curriculum in preparing graduates for clinical practice.
Benchmark: The program’s first-time PANCE pass rate meets or exceeds the national average.
Strength Benchmark: 100% of students in the cohort achieve pass PANCE on the first attempt
Overall Strength Benchmark: 100% of students in the cohort achieve pass PANCE on the first attempt for three or more consecutive years.
Rationale: the national mean is representative of all new graduates, and the program is committed to exceeding the national average. Overall program performance below the national average for first time taker pass rate will be considered an area in need of improvement, action planning and subsequent measurement. The program aspires to academic excellence, hence the strength benchmark of 100% first time pass rate.
b) Medical knowledge – PAEA End of Curriculum Exam (EOCE) performance
The program has adopted the PAEA EOCE as a summative evaluation tool to assess medical knowledge at the conclusion of the program. This decision is based on several factors that support its effectiveness in measuring students’ comprehensive understanding of medical concepts at the conclusion of their studies. The exam serves as a standardized method to evaluate the depth and breadth of medical knowledge acquired throughout the curriculum and as an outcome measure to allow the UM-Flint PA program to benchmark students’ performance against national standards.
Benchmark: 90% of students will obtain a score higher than the program-determined benchmark on the PAEA End of Curriculum Exam on the first attempt.
Strength Benchmark: 100% of students in the cohort achieve a score higher than the program-determined benchmark on the first attempt.
Overall Strength Benchmark: 100% of students in the cohort achieve a score higher than the program-determined benchmark on the first attempt for three or more consecutive years.
Rationale: The benchmark 0f 1475 EOCE score for Classes of 2024 and 2025 is based upon existing research analysis of a robust sample size conducted by a program consultant. Program data was analyzed both descriptively and parametrically to determine an appropriate benchmark for passing the EOCE (based on End of Rotation Exam scores, PACKRAT 1 and II scores, and the End of Curriculum exam scores of previous cohorts and a national sample of PA students) that will be predictive of PANCE performance. The benchmark of 90% first time pass is based on the program’s rationale that >10% of remediations of any one assessment would be grounds for concern and an area in need of improvement, action planning, and subsequent measurement.
c) Assessment of program competencies – Entrustable Professional Activities (EPAs) performance
The UM-Flint PA program has integrated Entrustable Professional Activities (EPAs) throughout the clinical phase as the framework for assessment of program competencies. During the clinical phase, students apply accumulated knowledge and skills obtained during the didactic phase to clinical phase learning to achieve program competencies as evidenced by successful completion of the EPA’s. Entrustable Professional Activities is one method the program uses to determine that the student has achieved program competencies and is ready for clinical practice as a new PA graduate.
Benchmark: 100% of the students will obtain a “competent” or higher grade, as assessed by clinical preceptors, on all required EPAs.
Rationale: All students must demonstrate knowledge, skills, and attitudes obtained during the program that reflect the student achievement of program competencies. Completion of the EPA (Entrustable Professional Activities) assessment is mandatory for graduation, as it demonstrates that students have achieved the required program competencies to the level required at PA Program graduation.
Actual Outcomes:
a) First-time PANCE pass rate table (2023 and 2024 cohorts) compared to the national average
Physician Assistant National Certifying Examination – Exam Performance Summary Report
Program Name: University of Michigan-Flint
Program Number: 6119
Test Taker Status: All Test Takers
| Class | Class Graduation Year | Group | Number of Candidates Who Took PANCE | Number of Exam Attempts | Number of Exams Passed | Program Exam Pass Rate | National Exam Pass Rate for the Class Graduation Year | % of Candidates Who Ultimately Passed PANCE |
|---|---|---|---|---|---|---|---|---|
| Class of 2023 | 2023 | All Takers | 38 | 47 | 36 | 77% | 89% | 95% |
| First Time Takers | 38 | 38 | 31 | 82% | 92% | 95% | ||
| Class of 2024 | 2024 | All Takers | 43 | 45 | 42 | 93% | 90% | 98% |
| First Time Takers | 43 | 43 | 40 | 93% | 93% | 98% |
The program’s pass rates showed varying performance against national benchmarks. The 2023 cohort achieved an 82% first-time pass rate, falling short of the 92% national benchmark with 89% of the benchmark met. In contrast, the 2024 cohort demonstrated significant improvement, achieving a 93% first-time pass rate (43/45 students have taken the PANCE), meeting the national benchmark with 100% success. Overall, the program reflected strong performance in 2024, highlighting its ability to meet and exceed national standards after addressing prior underperformance in 2023.
b) PAEA End of Curriculum exam student report table (2023 and 2024 cohorts)
University of Michigan-Flint Performance Report by Class – End of Curriculum Exam
| All Programs | Number of Exams | Mean Score | Standard Deviation |
|---|---|---|---|
| Reference Population | 4756 | 1519 | 52 |
| CLASS – Cohort 2023 | |||
| Class Average | 36 | 1510 | 29 |
| Reference Population | 14164 | 1516 | 46 |
| CLASS – Cohort 2024 | |||
| Class Average | 49 | 1533 | 44 |
| Performance Levels | CLASS – Cohort 2023 Percent | All Programs Percent |
|---|---|---|
| Limited Medical Knowledge (1200-1399) | 0% | 1% |
| Satisfactory Medical Knowledge (1400-1554) | 97% | 75.40% |
| Advanced Medical Knowledge (1555-1800) | 3% | 23.60% |
| Performance Levels | CLASS – Cohort 2024 Percent | All Programs Percent |
|---|---|---|
| Limited Medical Knowledge (1200-1399) | 0% | 1% |
| Satisfactory Medical Knowledge (1400-1554) | 73% | 75.40% |
| Advanced Medical Knowledge (1555-1800) | 26% | 23.60% |
Class of 2023 End of Curriculum Exam benchmark score was 1400. 38/38 students earned a score >1400 on the first attempt.
Class of 2024 End of Curriculum Exam benchmark score was 1475. 41/45 students earned a score of > 1475 on the first attempt.
Both cohorts demonstrated strong performance. The 2023 cohort achieved a perfect outcome, with 100% of students scoring above the benchmark of 1400, exceeding the standard. The 2024 cohort had 91.1% of students scoring above the higher benchmark of 1475, meeting the standard but with a slightly lower success rate compared to the 2023 cohort. Overall, the results reflect solid program preparation and a high level of achievement across both years.
c) Clinical preceptor completed EPA grades for the graduating 2023 and 2024 student cohorts
| EPAs | Description | % Grade “Competent” or higher – 2023 Cohort (n=38) | % Grade “Competent” or higher – 2024 Cohort (n=45) |
|---|---|---|---|
| EPA 1: | Gather a history and perform a physical examination | 100% | 100% |
| EPA 2: | Prioritize a differential diagnosis following a clinical encounter | 100% | 100% |
| EPA 3: | Recommend and interpret common diagnostic and screening tests | 100% | 100% |
| EPA 4: | Develop and implement patient orders and management plans | 100% | 100% |
| EPA 5: | Document a clinical encounter in the patient record | 100% | 100% |
| EPA 6: | Provide an oral presentation of a clinical encounter | 100% | 100% |
| EPA 7: | Form clinical questions and retrieve evidence to advance care | 100% | 100% |
| EPA 8: | Give or receive a patient handover to transition care responsibility | 100% | 100% |
| EPA 9: | Collaborate as a member of an interprofessional team | 100% | 100% |
| EPA 10: | Recognize a patient requiring urgent or emergent care and initiate evaluation and management | 100% | 100% |
| EPA 11: | Obtain informed consent for tests and/or procedures | 100% | 100% |
The clinical preceptor-completed EPA grades for the graduating 2023 and 2024 student cohorts show that the program consistently achieved a 100% success rate. Both cohorts met the benchmark, with all students receiving competency grades of 100%. This demonstrates the program’s consistent and exceptional performance in ensuring all students achieve the required clinical competency standards.
Goal #2: Cultivate student professionalism within the PA program
Rationale: The PA program is dedicated to cultivating student professionalism as it is fundamental to delivering high-quality patient care and upholding the standards of the PA profession. This is assessed through regular monitoring of professional conduct, student self-assessment of their professional development, and faculty evaluation of demonstrated professional behaviors.
Outcome Measures:
a) Monitoring student professional conduct within the program
Benchmark: The program will review each student’s professionalism at least twice per semester.
Rationale: Formative assessment of student professional conduct is essential as it allows early identification and intervention for behavioral concerns that could impact patient care and professional practice for each student enrolled in the program.
b) Student Exit Survey
Graduating student perspective of the program’s cultivation of student professionalism.
Benchmark: Graduating students score at or above the program’s benchmark of 3.5 on a 5-point Likert scale on the Student Exit Survey on related items.
Rationale: scores 3.5 / 5.0 to 4.49 / 5.0 indicate a generally positive satisfactory response. Using this as a benchmark ties the definition to commonly understood academic norms and creates a manageable list of priority issues for faculty to discuss. This indicates performance meaningfully above neutral and denotes adequate and passable performance. No intervention required.
Strength benchmark: ratings ≥4.5/5.0 on the Likert scale
Rationale: ratings ≥4.5/5.0 reflects outstanding service or experience. No intervention required.
Overall Strength Benchmark: The average student rating of each of the related items is equal to or greater than 4.5 on a 5-point Likert scale for three or more consecutive years.
Student Exit Survey items:
- “Prepare students to act with the professionalism expected of a practicing PA,”
- “The program has prepared me to demonstrate a commitment to carrying out professional responsibilities and an adherence to ethical principles,” and
- “The program has prepared me to demonstrate the qualities required to sustain lifelong personal and professional growth”
c) Faculty Evaluation of the Program Survey
Program faculty rating of the student professionalism.
Benchmark: Faculty ratings at or above the program’s benchmark of 3.5 on a 5-point Likert scale on the Student Exit Survey on related items.
Rationale: scores 3.5 / 5.0 to 4.49 / 5.0 indicate a generally positive satisfactory response. Using this as a benchmark ties the definition to commonly understood academic norms and creates a manageable list of priority issues for faculty to discuss. This indicates performance meaningfully above neutral and denotes adequate and passable performance. No intervention required.
Strength benchmark: ratings ≥4.5/5.0 on the Likert scale
Rationale: ratings ≥4.5/5.0 reflects outstanding service or experience. No intervention required.
Overall Strength Benchmark: The average faculty rating of each of the related items is equal to or greater than 4.5 on a 5-point Likert scale for three or more consecutive years.
Faculty Evaluation of the Program Survey items:
Students in the program “meet the program goals for professionalism”
Actual Outcomes:
a) Semester-wise UM-Flint PA program review of student professional conduct for the program duration
| Semester | UM-Flint PA Student Cohort % of students whose professional conduct was review the program at least twice per semester | |||
|---|---|---|---|---|
| 2023 | 2024 | 2025 | 2026 | |
| 1 | 100% | 100% | 100% | 100% |
| 2 | 100% | 100% | 100% | 100% |
| 3 | 100% | 100% | 100% | N/A |
| 4 | 100% | 100% | 100% | N/A |
| 5 | 100% | 100% | 100% | N/A |
| 6 | 100% | 100% | N/A | N/A |
| 7 | 100% | 100% | N/A | N/A |
The program consistently met the benchmark of reviewing each student’s professionalism at least twice per semester. For the 2023 and 2024 cohorts, all semesters (1 through 7) achieved 100% compliance, confirming that the benchmark was met throughout the program duration. For the 2025 cohort, semesters 1 through 5 also achieved 100% compliance, with no data available for semesters 6 and 7. Similarly, the 2026 cohort achieved 100% compliance for semesters 1 through 3, with no data available for subsequent semesters. Overall, the program demonstrated a strong commitment to cultivating student professionalism by consistently meeting the benchmark wherever data was available. Student Professional Conduct Review: 100% compliance for all cohorts, meeting the benchmark.
b) Student Exit Survey results for its ability to prepare students to act with professionalism
| Student Exit Survey | Cohort 2023 | Cohort 2024 |
|---|---|---|
| Survey Response Rate | 36/38=95% | 40/45=89% |
| i. The program has prepared me to act with the professionalism expected of a practicing PA | 4.38* | 4.43 |
| ii. The program has prepared me to demonstrate a commitment to carrying out professional responsibilities and an adherence to ethical principles | 4.38* | 4.46 |
| iii. The program has prepared me to demonstrate the qualities required to sustain lifelong personal and professional growth. | 4.34* | 4.48 |
* mean value was converted from a 4-point to a 5-point Likert scale
Student Exit Survey demonstrates consistent success in meeting the standard benchmark of 3.5, which is the initial goal for assessing program outcomes related to professionalism preparation. Students rated “Preparedness to act with professionalism” at 4.42, “Preparedness to demonstrate ethical principles” at 4.5, and “Commitment to lifelong personal and professional growth” at 4.43. All three areas exceeded the standard benchmark of 3.5, with one meeting the strength benchmark of 4.5.
While the program consistently achieved strong results, narrowly missing the strength benchmark in two areas highlights an opportunity for further enhancement. This reflects the program’s commitment to continuous improvement in preparing students to meet the highest standards of professionalism.
c) Faculty Evaluation of Program Survey
| Faculty Evaluation of Program Survey | 2023 | 2024 |
|---|---|---|
| Survey Response Rate | 8/8=100% | 7/7=100% |
| Students meet program goals for professionalism | 4.25 | 4.43 |
The faculty survey results show that the program met the general benchmark of 3.5 for professionalism for both 2023 and 2024, with scores of 4.25 and 4.43, respectively. However, the program did not meet the strength benchmark of 4.5 for either year. While the scores indicate strong performance, ranging from 4.25 to 4.43, they fall slightly short of the strength benchmark, highlighting areas for potential improvement in fully achieving the program’s goals for cultivating student professionalism.
Goal #3: Prepare students as leaders and advocates for the PA profession
The program embeds leadership and advocacy projects within the curriculum, providing students with real-world opportunities to develop as healthcare leaders. It is through these structured experiences and professional development activities that the program prepares graduates to emerge prepared to champion the PA profession and influence positive change in healthcare systems.
Outcome Measures:
a) Student Exit Survey
Graduating student perception on program preparation of student leaders
Benchmark: Graduating students score at or above the program’s benchmark of 3.5 on a 5-point Likert scale on the Student Exit Survey on related items.
Rationale: scores 3.5 / 5.0 to 4.49 / 5.0 indicate a generally positive satisfactory response. Using this as a benchmark ties the definition to commonly understood academic norms and creates a manageable list of priority issues for faculty to discuss. This indicates performance meaningfully above neutral and denotes adequate and passable performance. No intervention required.
Strength benchmark: ratings ≥4.5/5.0 on the Likert scale
Rationale: ratings ≥4.5/5.0 reflects outstanding service or experience. No intervention required.
Overall Strength Benchmark: The average student rating of each of the related items is equal to or greater than 4.5 on a 5-point Likert scale for three or more consecutive years.
Student Exit Survey item:
Graduating students rating of program’s ability to “prepare me as a PA leader”
b) Faculty Evaluation of the Program Survey
Program faculty rating of students practicing the mission and goals of the program. The mission of the UM-Flint PA program is to prepare students to become exemplary physician assistant practitioners, leaders, and advocates.
Benchmark: Faculty ratings at or above the program’s benchmark of 3.5 on a 5-point Likert scale on the Faculty Evaluation of the Program Survey on related items.
Rationale: scores 3.5 / 5.0 to 4.49 / 5.0 indicate a generally positive satisfactory response. Using this as a benchmark ties the definition to commonly understood academic norms and creates a manageable list of priority issues for faculty to discuss. This indicates performance meaningfully above neutral and denotes adequate and passable performance. No intervention required.
Strength benchmark: ratings ≥4.5/5.0 on the Likert scale
Rationale: ratings ≥4.5/5.0 reflects outstanding service or experience. No intervention required.
Overall Strength Benchmark: The average faculty rating of each of the related item is equal to or greater than 4.5 on a 5-point Likert scale for three or more consecutive years.
Faculty Evaluation of the Program Survey item:
Program faculty rating of the students in the program meeting the goal of “practicing the mission and goals set by the program”
Actual Outcomes:
a) Student Exit Survey results for its ability to prepare students as PA leaders
| Student Exit Survey | Cohort 2023 | Cohort 2024 |
|---|---|---|
| Survey Response Rate | 40/45=89% | 36/38=95% |
| The program has prepared me as a PA leader | 4.3* | 4.48 |
* mean value was converted from a 4-point to a 5-point Likert scale
The Student Exit Survey results indicate that the program successfully exceeded the program benchmark of 3.5 for preparing students as PA leaders. The 2023 cohort achieved an average score of 4.30, and the 2024 cohort improved further with a score of 4.48. However, neither cohort met the strength benchmark of 4.5. These results reflect strong preparation of students as leaders, with notable progress from 2023 to 2024.
b) Faculty Evaluation of the Program Survey
| Faculty Evaluation of the Program Survey | Cohort 2023 | Cohort 2024 |
|---|---|---|
| Survey Response Rate | 8/8=100% | 7/7=100% |
| Students meet program goals: Practice the mission and goals set by the program | 4.5 | 4.57 |
The Faculty Evaluation of the Program Survey results show that the program exceeded both the benchmark of 3.5 and the strength benchmark of 4.5 for practicing the program’s mission and goals. The 2023 cohort received a score of 4.50, and the 2024 cohort further improved to 4.57. These outcomes highlight consistent excellence in faculty assessments of the program’s success in meeting its mission and goals.
December 2024
Updated May 2025