Senior Research Specialist, Psychometrics and Machine Learning Applications

Boston College Introduction

Founded in 1863, Boston College is a Jesuit, Catholic university located six miles from downtown Boston with an enrollment of 9,654 full-time undergraduates and 5,072 graduate and professional students. Ranked 37 among national universities, Boston College has 923 full-time and 1,336 FTE faculty, 2,822 non-faculty employees, an operating budget of $1.4 billion, and an endowment in excess of $3.9 billion.

Job Description

The TIMSS & PIRLS International Study Center has anopening for a Senior Research Specialist, Psychometrics and Machine LearningApplications. The TIMSS & PIRLS International Study Center is home to twomajor international research programs that monitor student achievement inmathematics, science, and reading in more than 60 countries. TIMSS (the Trendsin International Mathematics and Science Study) is conducted on a four-yearcycle and measures mathematics and science achievement at the fourth and eighthgrades. It has regularly reported results for more than 28 years. PIRLS(the Progress in International Reading Literacy Study) assesses fourth-grade student achievement in reading literacy on afive-year cycle. Both TIMSS and PIRLS completed transitioning to a fullydigital assessment in their most recent cycle.

TIMSS and PIRLS are sponsored by the IEA (International Association forthe Evaluation of Educational Achievement), an independent internationalcooperative of national research institutes and governmental research agenciesheadquartered in Amsterdam, the Netherlands.

The Senior Research Specialist, Psychometrics and Machine LearningApplications, supports the Assistant Research Director, Advanced Psychometricsand Machine Learning Applications, in conducting specialized analysis forinsights reports, contributes to special research projects, and support QCprocedures at the TIMSS & PIRLS InternationalStudy Center. Under the general supervision of the Executive Director and theassistant director, the successful candidate willdesign and execute statistical analyses, develop and document reproducibleworkflows, and contribute to supporting the analyses needs of thecenter. This role requires strong quantitative skills and familiarity withstatistical models used for large-scale assessment data including extensiveknowledge of approaches such as hierarchical linear modes, latent variablemodeling, multiple-group IRT frameworks, and the use of specializedpsychometric software. The ability to work autonomously and an interest in theemerging AI and ML approaches are preferred.

Responsibilitiesinclude:

• preparing and executing analysis plans for TIMSS and PIRLS Insights reports
• support writing Insights reports focusing on data analysis and methods sections
• support activities of the analysis team and systems verification team as needed
• support systems verification team by actively participating in verifications
• assisting in examining applications of ML and AI capabilities for data analyses and systems verification

Title and salary commensurate withrelevant experience based on the following titles and full-time equivalenthiring ranges:

Senior ResearchSpecialist, Psychometrics & Machine Learning Applications:
$79,950 - $99,900; Master's in field ofexpertise + 3 yrs. of experience in field or PhD in field ofexpertise + 0-2 yrs. of experience in field

Research Specialist,Psychometrics & Machine Learning Applications:
$67,150 - $83,900;Master's in field of expertise + 2 yrs. of experience in field

Requirements

• Strong quantitative skills and experience in automated scoring, deep learning and NLP methodologies, complex data analysis, modeling, and statistical programming targeting analyses of large-scale assessment and/or survey data
• Advanced proficiency in Python for data analysis, machine learning, and NLP tools
• Experience with relevant statistical programming and analysis tools. Experience in either R or Python, and the ability to work with both, is desired.
• Knowledge of AI/ML applications in psychometrics, including classical and modern measurement models, embedding-based representations, automated scoring methods, and quality-control automation
• Willingness to pick up new methodological skills and learn new tools as necessitated by current and future responsibilities is required.
• Ability to persevere, maintain focus in reviewing technical material, pay close attention to detail under tight deadlines
• Ability to work independently with minimal supervision, managing analysis tasks, timelines, and deliverables in a self-directed manner
• Master's degree required; PhD preferred
• Research Specialist: Master's + 2 years of related experience
• Senior Research Specialist: Master's in field of expertise + 3 yrs. of experience in field; or PhD in field of expertise + 0-2 yrs. of experience in field

Possible travel to international meetings.
This is a grant funded position.

Closing Statement

Boston College offers a broad and competitive range of benefits depending on your job classification eligibility:

• Tuition remission for Employees
• Tuition remission for Spouses and Children who meet eligibility requirements
• Generous Medical, Dental, and Vision Insurance
• Low-Cost Life Insurance
• Eligibility for both University-Funded 401k and Employer-Sponsored 403b Retirement Plans
• Paid Holidays Annually
• Generous Sick and Vacation Pay
• Additional benefits can be found on

Boston College conducts pre-employment background checks as part of the hiring process.

Boston College is an Equal Opportunity Employer and does not discriminate on the basis of any legally protected category, including disability and protected veteran status. Boston College's Notice of Nondiscrimination can be viewed at