This position is primarily involved in research and development activities, designed to enhance the psychometric quality and integrity of our clients computer-based performance assessment products. This position provides expertise in development of new performance assessments and enhancements to current products such as the addition of multimedia. A core value is to assure that new or enhanced assessments maintain the highest possible validity. The position reports to the Director of Psychometric Operations Research.
PRINCIPLE DUTIES AND RESPONSIBILITIES:
Lead projects developing new assessment products that may include multimedia, medical case simulation, and high-fidelity simulations Coordinate work with expert physicians and staff from other departments to design new assessments Provide mentoring support to staff on psychometric issues, particularly new assessment methodology Maintain currency with developments in the psychometric field, especially other large scale testing programs. Collaborate on research and development projects within and across departments as well as with external organizations Prepare internal technical reports and background/discussion papers related to assigned projects Author manuscripts in peer-reviewed journals; present scholarly research at professional meetings and to those outside the testing community
KNOWLEDGE, SKILLS, AND ABILITIES:
Strong foundation in psychometrics, including latent trait models Understanding of test development, including cognitive aspects Strong background in research design, methodologies, and analytical procedures/statistical analysis High level of proficiency with statistical software packages (e.g., SAS) Strong understanding of innovative assessments (e.g., simulations, multimedia) Strong understanding of classification testing Excellent verbal and written communication, planning, analytical, and problem-solving skills Ability to prioritize tasks, meet deadlines and work both independently and as part of a team. Ability to lead group processes Excellent interpersonal skills Willing to travel as needed to perform job functions
TRAINING AND EXPERIENCE: Ph.D. in measurement or a related field Two years professional experience in performance assessment