• Wonderlic
  • Remote (Chicago, IL, USA)
  • Aug 16, 2021
Full time Human Resources Information Technology Other Research Science

Job Description

At Wonderlic, we combine our science-based assessment background with the best talent to innovate the way modern pre-employment screening is used by the recruiting industry. Our mission is to expertly combine I/O psychology, machine learning, and artificial intelligence to ensure applicants are able to find their best jobs. Wonderlic provides the most trusted, scientifically validated assessments for sophisticated HR teams looking to identify top applicants and accurately predict on-the-job performance potential.

As a people-first company, we’re constantly on the lookout for the best and brightest minds to propel Wonderlic forward. Do you strive for excellence? Are you driven by the desire to make positive changes in the world you live in? Are you passionate about your craft? Join Wonderlic in shaping the future of our organization. We’d be happy to have you.


Job Title:



Wonderlic is seeking a Psychometrician to work as part of our Research and Development department. Psychometricians contribute substantially to all aspects of the assessment development cycle from initial design through implementation to continuous maintenance and improvement. They will contribute to projects pertaining to model calibration, maintenance and improvement of item pools, improvement of our computer adaptive testing engine, technical documentation, and research into new methods of assessment in employee development and selection contexts. They will work closely with our Consulting, Product, Machine Learning, and Software Development teams in order to perform a wide range of tasks. Individuals in this role are expected to work independently, take the initiative to learn what they need to in order to perform their tasks, and contribute informed, well thought-out opinions to the team.

In this role, you’ll be responsible for:

  • Contributing to all aspects of new assessment development including research, design, data collection, and implementation of scoring
  • Conducting research on and specification of test scoring methods that utilize Item Response Theory for use in our assessments
  • Performing maintenance, improvement, and continuing study on existing assessments including item analysis, bias analysis, and test equivalence
  • Designing and performing research studies, the results of which will be included in internal resources and client-facing white papers
  • Contributing meaningfully to the body of scientific research on matters pertaining to assessment and/or our core construct offering via conference submissions and academic publications
  • Performing a wide range of ad hoc analysis tasks involving data collection, obtaining data from databases, statistical analysis, and report writeup
  • Conducting literature reviews on a wide variety of topics and maintaining a library of resources
  • Assisting with the development and refinement of core assessment practices pertaining to matters like item pool maintenance, content localization, and parameter drift analysis
  • Acting as an escalation resource for clients with questions or concerns about technical aspects of our assessments
  • Advising internal teams on matters relating to best practice and science
  • Performing other duties as assigned



  • Educational Requirements
    • Ph.D. in Industrial/Organizational Psychology
    • 3 years applied experience creating modern assessments for business use
  • Required Knowledge & Skills
    • High level knowledge and skills regarding psychometric analysis, with a focus on Item Response Theory
    • Experience applying IRT methods to assessments, whether in a research or applied setting
    • High level skills in R statistical software (additional applied experience with Python preferred)
    • Knowledge of I/O psychology principles and issues
    • Knowledge and skill in assessment design and development
    • Knowledge and skill regarding research design
    • Demonstrated skill in managing research and development projects
    • Written and oral communication skills
    • Self-management and organizational skills
    • Very strong problem-solving skills
    • Strong attention to detail




  • The Research and Development team is fully remote and this position is as well
  • If desired, space in our Vernon Hills, IL office will be provided
  • If the remote option is utilized, travel to our Vernon Hills, IL office on a quarterly basis may be required

Supervisory Environment:

  • Reports to Manager of R&D
  • Works largely independently on large, often ambiguous, projects that require a high degree of decision quality and have substantial short- and long-term business implications

Other Requirements:

  • Must be authorized to work in the United States and not require a visa sponsorship now or in the future

What We Offer:

  • Competitive compensation and benefits
  • PTO starting at 21 days plus 2 floating holidays
  • Paid company shutdown from 12/26 to 12/31
  • Medical, dental, and vision group insurance
  • Company-paid life and long-term disability insurance
  • Paid Parental and Primary Caregiver Leave after 1 year of employment
  • Remote work options and flexible work arrangements

Affirmative Action Plan/Equal Employer Opportunity (AAP/EEO) Statement:

Wonderlic is proud to be an equal employment opportunity/affirmative action employer. Here, diversity is valued and celebrated, and is what makes us such a successful team. Wonderlic does not discriminate in employment on the basis of race, color, religion, gender, gender identity, pregnancy status, national origin, sexual orientation, marital status, disability, genetic information, age, parental status, military/veteran status, or any other factor protected by law.