PAEA (Physician Assistant Education Association) Monitoring Suite Data Files

PAEA Suite of Dashboards for Physician Assistant Programs: What files do I need to send?

---

PANCE

PACKRAT

EoC - End of Curriculum

EoR - End of Rotation

---

PANCE: Physician Assistant National Certifying Examination

• Please use the following matrices to guide the upload of files to the PANCE folder in your Enflux BOX folder. 

• Enflux must receive the Roster spreadsheet and the ‘Program Performance Report by Class’ spreadsheet for each class year.

• For these files, each class will have one Score Report, and one Program Performance Report by Class.

Refer to pages 20-23 in this link from the NCCPA for a detailed explanation of how to download these reports. https://www.nccpa.net/wp-content/uploads/2021/06/Program-Portal-User-Manual.pdf 

Below is an example of what the file output should look like:
Performance Report 2020.xlsx

This report will have two tabs.  

Sheet 1 contains this summary table containing the Class Overview

Sheet 2 contains three parts.

First the program identification information.

The program summary Table

and the PANCE Content Area Feedback

Score Report 2020.xlsx

This report will have 1 tab.

The report header will include:

• Print date
• Page count
• Program Name (your university)
• Program Number (your id number)
• Class Name
• Students (All Students)

Listed fields in the Score Report:

• Class
• Type, which may include First-Time Takers and Repeat Takers
• Name
• Exam Date
• Result
• Score
• Organ System (14 areas)
• Knowledge and Skills (8 areas)

Things we notice about the files

When sending PANCE files, please be sure of the following:

• The Program Performance Report is by class. It will have four rows in the heading, the second of which will clearly state “Program Performance by Class.”
• The Program Performance Report by Class has Sheet1 and Sheet2. Sheet1 contains descriptive text and the Class Overview table. Sheet2 contains the Program Summary Table and PANCE Content Area Feedback.
  • • We have seen a couple of 2022 reports that have changes to this format. We’re not sure if they’re standard reports. Differences we’ve noticed include:
    • All three tables showing up on one worksheet
    • The label #NOT_SUPPORTED# between the text and the tables
    • No labels identifying First Time Exams and All Exams mean and s.d. Columns in the PANCE Content Area Feedback table. The columns exist but are not labeled properly. 
• Select All Students when sending the score report if you want to see the results for repeat takers as well as first time takers.
• For both the Program Performance Report and the Score Report, you may send us updated files if you have students who need to repeat the exam. Upon receipt of the updates, we will update the dashboards to reflect the additional attempts.

Back to top of page

---

PACKRAT: Physician Assistant Clinical Knowledge Rating and Assessment Tool

 

Enflux must receive the PACKRAT Composite Score Report spreadsheet for each "class of" or "cohort."  Additionally, we must receive a Performance Report by Class report in the form of a PDF file.

If you have a new class where only partial data (first test) is available, go ahead and send us both of the initial files.  Then send us subsequent files as they become available.

Below is a list of example files for a single year:

2024 Composite Score Report PACKRAT.CSV

The listing will be by student name and provide:

• Exam Date

• Score Released (True/False)

• Raw Score

• % Correct

• % for each Specialty Area

• % for each Task Area

2024 Performance Report by Class (PACKRAT).PDF

The .PDF file will contain two sections:

1. Summary with comparison to National Scores

2. Content Area Feedback

   1. Task Areas

   2. Specialties 

Please send us the files as they are generated directly from the PAEA portal. Do not make changes to the files prior to sending them.

Matrix to help you know that you have submitted all of your files in .xls and .html format.  You should be sending all types of files for each year

Back to top of page

---

PA EoC: End of Curriculum

Enflux must receive the Composite Score Report in a spreadsheet (.xlsx or .csv) and the Performance Report by Class in PDF format.

Below is a list of example files for a single year:

Composite Score Report EOC2020.xlsx or .csv - one row for each student in the cohort/class

The listing will be by student name and provide:

• Exam Date

• Score Released (True/False)

• Student Score

• Scale Score for each

  • Content Category,

  • Task Area,

  • EPA,

  • Setting,

  • Life Course,

  • Bloom’s Taxonomy

Performance Report by Class EOC 2023.PDF - summary data for the "class" and "all programs"

The .PDF file will contain three sections:

1. Summary with comparison to National Scores

2. Class of Performance Levels

3. Class of Summaries for

   1. Content Categories

   2. Tasks

   3. Entrustable Professional Activity

   4. Key Dimension: Setting

   5. Key Dimension: Life Course

   6. Key Dimension: Bloom’s Taxonomy

Back to top of page

---

PA EoR: End of Rotation

Enflux must receive one Composite Score Report spreadsheet file per rotation. Additionally, we must receive one Performance Report PDF file per rotation.

Below is a list of example files for a single year:

Excel files have one row for each student in the cohort/class

• 2021 CompositeScoreReport Emergency Medicine EOR.xlsx

• 2021 CompositeScoreReport Family Medicine EOR.xlsx

• 2021 CompositeScoreReport General Surgery EOR.xls

• 2021 CompositeScoreReport Internal Medicine EOR.xlsx

• 2021 CompositeScoreReport Pediatrics EOR.xls

• 2021 CompositeScoreReport Psychiatry EOR.xlsx

• 2021 CompositeScoreReport Women’s Health EOR.xlsx

PDF:

• 2021 Performance Emergency Medicine EOR.pdf

• 2021 Performance Family Medicine EOR.pdf

• 2021 Performance General Surgery EOR.pdf

• 2021 Performance Internal Medicine EOR.pdf

• 2021 Performance Pediatrics EOR.pdf

• 2021 Performance Psychiatry EOR.pdf

• 2021 Performance Women’s Health.pdf

These .pdf files will have two sections:

1. Summary of scores

2. Class of scores for:

   1. Content Categories

   2. Tasks

Please generate the files directly from the PAEA portal. Do not make any changes to the exported files.

Matrix to help you know that you have submitted all of your files in .xlsx/.csv and .pdf format.  You should be sending both types of files for all areas for each year

Composite Score Report.xlsx or .csv (depending on whether the exams were taken prior to the new hub existing):