Senior Psychometrician

  • Wonderlic
  • Remote (Chicago, IL, USA)
  • Aug 16, 2021
Full time Human Resources Information Technology Other Research Science

Job Description

At Wonderlic, we combine our science-based assessment background with the best talent to innovate the way modern pre-employment screening is used by the recruiting industry. Our mission is to expertly combine I/O psychology, machine learning, and artificial intelligence to ensure applicants are able to find their best jobs. Wonderlic provides the most trusted, scientifically validated assessments for sophisticated HR teams looking to identify top applicants and accurately predict on-the-job performance potential.

As a people-first company, we’re constantly on the lookout for the best and brightest minds to propel Wonderlic forward. Do you strive for excellence? Are you driven by the desire to make positive changes in the world you live in? Are you passionate about your craft? Join Wonderlic in shaping the future of our organization. We’d be happy to have you.


Wonderlic is seeking a Senior Psychometrician to work as part of our Research and Development department. Senior Psychometricians contribute substantially to all aspects of the assessment development cycle from initial design through implementation to continuous maintenance and improvement. They will lead projects pertaining to model calibration, maintenance and improvement of item pools, improvement of our computer adaptive testing engine, technical documentation, and research into new methods of assessment in employee development and selection contexts. They will work closely with our Consulting, Product, Machine Learning, and Software Development teams in order to perform a wide range of tasks. Individuals in this role are expected to work independently, take the initiative to learn what they need to in order to perform their tasks, and contribute informed, well thought-out opinions to the team.

In this role, you’ll be responsible for:

  • Independently leading development of new assessments including research, design, data collection, and implementation of scoring
  • Researching the feasibility of and applying modern Item Response Theory approaches (e.g., multidimensional IRT, IRT models for forced-choice, etc.…) to our assessments
  • Performing maintenance, improvement, and continuing study on existing assessments
  • Designing and performing research studies, the results of which will be included in internal resources and client-facing white papers
  • Contributing meaningfully to the body of scientific research on matters pertaining to assessment and/or our core construct offering via conference submissions and academic publications
  • Designing and implementing core systems (e.g., scoring engines) in concert with our Product and Software Development teams
  • Assisting with the development and refinement of core assessment practices pertaining to matters like item pool maintenance, content localization, and parameter drift analysis
  • Contributing to Wonderlic’ s point of view on matters pertaining to the design of selection systems and employee development
  • Acting as a high-level escalation resource for clients with questions or concerns about technical aspects of our assessments
  • Advising internal teams on matters relating to best practice and science
  • Training other Wonderlic employees (e.g., Research Scientists, Consultants) on matters pertaining to I/O Psychology, measurement and psychometrics, and methodology as needed
  • Collaborate with our Machine Learning department on a variety of applied projects, contributing an I/O and psychometric perspective to the decisions made and results obtained.
  • Performing other duties as assigned



  • Educational Requirements
    • Ph.D. in Industrial/Organizational Psychology
    • 5 years applied experience creating modern assessments for business use
  • Required Knowledge & Skills
    • Expert level knowledge and skills regarding psychometric analysis, with a focus on modern IRT methods and computer adaptive testing
    • Experience implementing IRT-driven assessments into production environments
    • Expert level skills in R statistical software (additional applied experience with Python preferred)
    • Knowledge of I/O psychology principles and issues
    • Knowledge and skill in assessment design and development
    • Knowledge and skill regarding research design
    • Demonstrated skill in managing research and development projects
    • Written and oral communication skills
    • Self-management and organizational skills
    • Very strong problem-solving skills
    • Strong attention to detail


  • The Research and Development team is fully remote and this position is as well
  • If desired, space in our Vernon Hills, IL office will be provided
  • If the remote option is utilized, travel to our Vernon Hills, IL office on a quarterly basis may be required

Supervisory Environment:

  • Reports to Manager of R&D
  • Works largely independently on large, often ambiguous, projects that require a high degree of decision quality and have substantial short- and long-term business implications

Other Requirements:

  • Must be authorized to work in the United States and not require a visa sponsorship now or in the future

What We Offer:

  • Competitive compensation and benefits
  • PTO starting at 21 days plus 2 floating holidays
  • Paid company shutdown from 12/26 to 12/31
  • Medical, dental, and vision group insurance
  • Company-paid life and long-term disability insurance
  • Paid Parental and Primary Caregiver Leave after 1 year of employment
  • Remote work options and flexible work arrangements

Affirmative Action Plan/Equal Employer Opportunity (AAP/EEO) Statement:

Wonderlic is proud to be an equal employment opportunity/affirmative action employer. Here, diversity is valued and celebrated, and is what makes us such a successful team. Wonderlic does not discriminate in employment on the basis of race, color, religion, gender, gender identity, pregnancy status, national origin, sexual orientation, marital status, disability, genetic information, age, parental status, military/veteran status, or any other factor protected by law.