Jacobs Sr. Instructional Testing Expert in Hanover, Maryland
Challenging Today. Reinventing Tomorrow.
We're invested in you and your success. Everything we do is more than just a project. It's our challenge as human beings, too. That's why we bring a thoughtful and collaborative approach to every one of our partnerships.
At Jacobs, we challenge the status quo and redefine how to solve the world's greatest challenges, transforming big ideas into intelligent solutions for a more connected, sustainable world.
Design your career with a company that inspires and empowers you to deliver your best work so you can evolve, grow and succeed – today and into tomorrow
Duties and Responsiblities
If you want to be part of a dynamic Instructor Team delivering engaging and cutting-edge training solutions, this is the place for you!
The Senior Instructional Testing Expert designs, develops, and revises tests and/or assessments for highly-technical evaluation programs. A qualified candidate must be fully cleared and possess an extensive range of experience including developing complex technical testing for eLearning, distance learning, instructor-led courses, and blended learning solutions.
The Testing Expert must have extensive knowledge of test design and exam item analysis methodologies to effectively support customers with rapidly evolving requirements. The Testing Expert will work closely with content developers and subject matter experts (SMEs) to design and develop rigorous formative and summative assessments to gauge the learner’s mastery of key concepts presented in learning materials. The Testing Expert conducts thorough data gathering and needs analyses to ensure learning objectives; Knowledge, Skills, and Abilities (KSA); and/or Job Qualification Standards (JQS) are mapped to test questions and case studies.
The Testing Expert ensures integrity of task analysis training requirements, training hierarchies, instructional materials and evaluation plans. The Testing Expert develops test blueprints for effectively designing and developing tests tied to learning objectives. The Testing Expert manages the test development activities of an item development team as lead test developer. The Testing Expert creates job-knowledge tests and performance-oriented assessments. The Testing Expert conducts Cut Score Workshops to determine appropriate cut scores for individual items and aggregate cut scores for exams. The Testing Expert writes Level 1 Survey forms to collect student feedback in courses. The Testing Expert works with Team Members to create Statistical Analysis Reports for exam analysis and customer reporting. The Testing Expert develops reports to satisfy contractual reporting requirements.
The Testing Expert should be familiar with tools such as Excel, SPSS Statistics software, and applications used to deliver testing solutions.
Here’s What You’ll Need:
Ph.D. in Industrial/Organizational Psychology or Instructional Design and Human Performance Improvement (or similar degree) with eight years of experience in workplace job performance assessments and/or evaluations. MS Degree in Industrial/Organizational Psychology or Instructional Design and Human Performance Improvement (or similar degree) with ten years of experience in workplace job performance assessments and/or evaluations.
Minimum Years of Experience:
Eight years of relevant work experience in workplace job performance assessments and/or evaluations (with a Ph.D. in I/O Psychology or Instructional Design and Human Performance Improvement or similar degree).
Ten years of relevant work experience in workplace job performance assessments and/or evaluations (with an MS Degree in I/O Psychology or Instructional Design and Human Performance Improvement or similar degree).
Desired Requirements ( nice to have but not required ):
Selects and develops the appropriate assessment and/or testing methods for learning solutions (virtual, face-to-face)
Applies validity and reliability standards to ensure test and/or assessments are psychometrically sound
Revises tests and/or assessments based on beta and pilot offerings of learning programs
Writes contract documentation to support all aspects of testing on the program to include Testing Packages, Proctoring Guides and documentation for High Stakes Exams, Training Evaluation documentation, Item Analysis Reports and documentation, etc.
Conducts research and provides recommendations to the Team and Customer on business processes and procedures for test creation and administration to ensure high exam validity and consistent student experience; these processes and procedures will also maximize test security, minimize test item exposure, reduce student potential for cheating, etc.
Collaborates with content developers, subject matter experts, and instructional designers/developers to integrate formative and summative tests and/or assessments into the course content of learning programs
Works with subject matter experts and instructional designers/developers to develop/ensure learning objectives are measurable and translate those objectives into the appropriate testing and/or assessment strategy
Knowledgeable and/or skilled at applying Kirkpatrick’s levels of evaluation in order to develop appropriate strategies for measuring learning outcomes
Develops behaviorally-related rating scales that emphasize job relevant competencies
Designs and develops job simulation exercises with behaviorally-based rating scales based on job competencies
Develops and utilizes paper or electronic assessment instruments, such as multiple-choice selected responses, open ended, essay, case studies, performance-based tasks, role-play, pre-and post-tests, and simulations
Conducts Cut Score Workshops to determine the appropriate passing score for individual exam items and case studies and aggregates the cut score raters’ inputs to calculate the overall passing score for a specific exam.
Applies psychometric formulas and theory to construct valid and reliable tests and measures of knowledge and/or performance-based assessments of learning and behavioral objectives
Works with exam item statistics to conduct item analysis including, but not limited to, evaluation of distractor patterns, item difficulty, and item point bi-serial/corrected item total correlations, etc.
Maintains detailed records of the exams for the program regarding updates to exams and rationale for changes over time. Submits tickets in the Change Management System for tracking purposes and maintains detailed spreadsheets and reports for tracking purposes. Effective communication, writing, documentation, and requirements gatherings skills are needed to be effective in this role for working with other members of the Team and with the Customer to meet the requirements of the contract
Jacobs is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, religion, creed, color, national origin, ancestry, sex (including pregnancy, childbirth, breastfeeding, or medical conditions related to pregnancy, childbirth, or breastfeeding), age, medical condition, marital or domestic partner status, sexual orientation, gender, gender identity, gender expression and transgender status, mental disability or physical disability, genetic information, military or veteran status, citizenship, low-income status or any other status or characteristic protected by applicable law. Learn more about your rights under Federal EEO laws (https://www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf) and supplemental language (https://www.eeoc.gov/sites/default/files/migrated_files/employers/eeoc_gina_supplement.pdf) .