In today’s technology-driven workflow, maintaining paper records of technologist performance proves to be inefficient. We implemented an online issue submission process integrated into the radiologist workstation picture archiving and communication system (PACS) to simplify submission. We also implemented a technologist peer review process to ensure ongoing continuity of quality focus. With these quality databases, we constructed an online graphical technologist report card with the goal of enabling management to make effective performance appraisals for technologists and to set effective quality improvement goals.

Technologist Report Card enables supervisors to keep records of radiologist-submitted quality control (QC) issues, as well as peer-reviewed statistics. Storing these records in a database and representing data in a Web-based graphical format allows supervisors to easily review performance at both departmental and technologist levels. Supervisors can track performance month to month, by 6-month period, and year to year. Technologist Report Card has been incorporated into each technologist’s yearly performance review. It is also incorporated into the department’s performance improvement plan.

Technologist Report Card was built in-house using the Ruby on Rails Web development platform. Data are collected in two ways: (1) From issues radiologists submit via a PACS-integrated Web tool. This tool allows the radiologist to submit QC issues at the time of discovery and notify the supervisor. Supervisors investigate issues submitted by the radiologist and assign each issue to the responsible technologist. Supervisors also assign error codes to each issue. This allows the supervisor to keep track of the number of specific error codes, as well as the frequency of errors per technologist. (2) Data is also mined from our Technologist Peer Review database, which allows technologists to rate each others’ work based on specific criteria. Supervisors then review the work of the reviewers. In addition to providing a computer-based training tool, these data help supervisors recognize leadership qualities in staff.

Technologist Report Card shows several performance datasets at a glance, including (Figs. 1–3):

Fig. 1 Number of QC issues assigned to a technologist.

Fig. 2 Submitted QC issue trends for a technologist.

Fig. 3 Image quality averages based on peer review statistics.

Technologist Report Card is incorporated into performance reviews. Performance review objectives vary based on tech experience level. Our department has three technologist experience levels. Technologists at levels one, two, and three are reviewed based on 12, 15, and 17 objectives, respectively. Each level is held to its own standard. Grades are assigned based on how well standards are met. Supervisors set standards based on department averages. Technologists receive pay increases based on this grading system.

Supervisors review technologists’ report cards on a monthly basis. Because data is represented in visual graphs, supervisors are able to identify technologists who are not meeting departmental standards. Flagged technologists are then initiated into a performance improvement plan. Supervisors are able to track improvement, because report cards represent a 6-12–month period. During the performance improvement period, technologists must meet or exceed the department average and are given as much time as needed to improve their yearly average as long as they meet or exceed department monthly averages. If the technologist repeatedly fails to meet the department average during the performance improvement period, he or she is subject to possible termination.

Radiologists can improve the department's performance by submitting QC issues. Having this data in a form that is useful to the supervisor ensures that issues are resolved efficiently and gives supervisors the ability to increase and maintain department standards.

Technologists get constructive feedback and are able to focus on areas that need improvement.

Technologist Report Card represents a paperless form of technologist performance review. By collecting data submitted by radiologists and technologist peers, supervisors are able to visually represent department and individual performance. The entire department benefits by this tool that provides management support, quality control, drill-down data for process analysis, and valuable professional development support for technologist staff.