Jacobs Sr. Instructional Testing Expert (TS/SCI with Poly) in Hanover, Maryland
Sr. Instructional Testing Expert (TS/SCI with Poly)
Jacobs is seeking a Sr. Instructional Testing Expert candidate at our Hanover, MD location.
The Senior Instructional Testing Expert designs, develops, and revises tests and/or assessments for highly-technical evaluation programs. A qualified candidate must be fully cleared and possess an extensive range of experience including developing complex technical testing for eLearning, distance learning, instructor-led courses, and blended learning solutions.
The Testing Expert must have extensive knowledge of test design and exam item analysis methodologies to effectively support customers with rapidly evolving requirements.The Testing Expert should be familiar with tools such as Excel, SPSS Statistics software, and applications used to deliver testing solutions.
The Testing Expert ensures integrity of task analysis training requirements, training hierarchies, instructional materials and evaluation plans. The Testing Expert develops test blueprints for effectively designing and developing tests tied to learning objectives. The Testing Expert manages the test development activities of an item development team as lead test developer.
The Testing Expert creates job-knowledge tests and performance-oriented assessments. The Testing Expert conducts Cut Score Workshops to determine appropriate cut scores for individual items and aggregate cut scores for exams.
The Testing Expert writes Level 1 Survey forms to collect student feedback in courses. The Testing Expert works with Team Members to create Statistical Analysis Reports for exam analysis and customer reporting. The Testing Expert develops reports to satisfy contractual reporting requirements.
The Testing Expert will work closely with content developers and subject matter experts (SMEs) to design and develop rigorous formative and summative assessments to gauge the learner’s mastery of key concepts presented in learning materials.
The Testing Expert conducts thorough data gathering and needs analyses to ensure learning objectives; Knowledge, Skills, and Abilities (KSA); and/or Job Qualification Standards (JQS) are mapped to test questions and case studies.
Must have an active TS/SCI with Poly and be willing to upgrade upon acceptance of this position within 1 year.
Ph.D. in Industrial/Organizational Psychology or Instructional Design and Human Performance Improvement (or similar degree) with eight years of experience in workplace job performance assessments and/or evaluations. MS Degree in Industrial/Organizational Psychology or Instructional Design and Human Performance Improvement (or similar degree) with ten years of experience in workplace job performance assessments and/or evaluations.
Preferred Qualifications (but not required):
Selects and develops the appropriate assessment and/or testing methods for learning solutions (virtual, face-to-face)Applies validity and reliability standards to ensure test and/or assessments are psychometrically sound
Revises tests and/or assessments based on beta and pilot offerings of learning programs
Conducts research and provides recommendations to the Team and Customer on business processes and procedures for test creation and administration to ensure high exam validity and consistent student experience; these processes and procedures will also maximize test security, minimize test item exposure, reduce student potential for cheating, etc.
Writes contract documentation to support all aspects of testing on the program to include Testing Packages, Proctoring Guides and documentation for High Stakes Exams, Training Evaluation documentation, Item Analysis Reports and documentation, etc.
Collaborates with content developers, subject matter experts, and instructional designers/developers to integrate formative and summative tests and/or assessments into the course content of learning programs
Designs and develops job simulation exercises with behaviorally-based rating scales based on job competencies
Develops and utilizes paper or electronic assessment instruments, such as multiple-choice selected responses, open ended, essay, case studies, performance-based tasks, role-play, pre-and post-tests, and simulations
Conducts Cut Score Workshops to determine the appropriate passing score for individual exam items and case studies and aggregates the cut score raters’ inputs to calculate the overall passing score for a specific exam.
Applies psychometric formulas and theory to construct valid and reliable tests and measures of knowledge and/or performance-based assessments of learning and behavioral objectives
Effective communication, writing, documentation, and requirements gatherings skills are needed to be effective in this role for working with other members of the Team and with the Customer to meet the requirements of the contract
Maintains detailed records of the exams for the program regarding updates to exams and rationale for changes over time. Submits tickets in the Change Management System for tracking purposes and maintains detailed spreadsheets and reports for tracking purposes.
Works with exam item statistics to conduct item analysis including, but not limited to, evaluation of distractor patterns, item difficulty, and item point bi-serial/corrected item total correlations, etc.
Develops behaviorally-related rating scales that emphasize job relevant competencies
Knowledgeable and/or skilled at applying Kirkpatrick’s levels of evaluation in order to develop appropriate strategies for measuring learning outcomes
Works with subject matter experts and instructional designers/developers to develop/ensure learning objectives are measurable and translate those objectives into the appropriate testing and/or assessment strategy
Most work will be done at a desk or computer.
General Office environment. The work environment is fast-paced and sometimes involves extreme deadline pressures. The nature of the work requires a high degree of teamwork and cooperation with other members of the staff as well as individuals across the Company and Customers.
Equipment & Machines:
General office equipment including PC/laptop, Fax, Copiers, Shredder, Printers, Telephone, and other miscellaneous office equipment.
Attendance is critical at all times. Must be able to work a 40-hour workweek, normally Monday through Friday. However, times and days may vary depending on business requirements. Needs to be available to work overtime during critical peaks and be available to meet last minute requests for overtime should the situation occur.
Other Essential Functions:
Must be able to communicate effectively both verbally and in writing
Grooming and dress must be appropriate for the position and must not impose a safety risk/hazard to the employee or others. Must put forward a professional behavior that enhances productivity and promotes teamwork and cooperation.
Must be able to interface with individuals at all levels of the organization both verbally and in writing. Must be well-organized with the ability to coordinate and prioritize multiple tasks simultaneously. Must work well under pressure to meet deadline requirements. Must be willing to travel as needed. Must take and pass a drug test and background check as well as a motor vehicle records check. Must be a US citizen.
Jacobs is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, religion, creed, color, national origin, ancestry, sex (including pregnancy, childbirth, breastfeeding, or medical conditions related to pregnancy, childbirth, or breastfeeding), age, medical condition, marital or domestic partner status, sexual orientation, gender, gender identity, gender expression and transgender status, mental disability or physical disability, genetic information, military or veteran status, citizenship, low-income status or any other status or characteristic protected by applicable law. Learn more about your rights under Federal EEO laws and supplemental language.
Job Information Technology
Primary Location United States-Maryland-Hanover-20361-MIL3
Job Type Experienced
Req ID: CYB0000AL