Executive Director, Natural Language Measurement

Executive Director, Natural Language Measurement

100% Remote (anticipated 25% travel, usually 2-3 days at a time)

The Psychometrics Team supports College Board in serving more than seven million students a year as they prepare for a successful transition to college through programs and services in college readiness and college success. We provide our partners with measurement solutions that set the standard for quality, efficiency, and innovation through operational excellence and research leadership that advances the field of psychometrics and supports College Board's mission of access and equity in education. Our team of Psychometricians and Research Statisticians collaborates deeply with other departments and divisions including, but not limited to Assessment Design & Development, College Readiness Assessments, Advanced Placement & Instruction, State & District Partnerships, and Technology.

As our Executive Director, Natural Language Measurement, you are a strategic measurement leader at the forefront of responsible AI in education. Energized by our mission to enhance educational and career opportunities for millions of students, you will shape the future of automated scoring and use of AI-powered feedback in large-scale assessments. You will set the vision and multi-year roadmap for natural language measurement across SAT, AP, CLEP, Accuplacer and future products, ensuring all applications are grounded in validity, fairness, and reliability. You will expand the College Board's innovation agenda in AI-enabled approaches that power personalized learning and feedback, reinforcing our leadership in responsible and equitable assessment. You bring experience shaping national or international best practices in responsible AI / NL for large-scale assessment and have a proven record of scaling applications from research to operational use in high-stakes contexts, making a transformative impact on both students and the field.

Strategic Leadership and Roadmap (35%)

• Shape and implement the multi-year strategy and roadmap for automated scoring and intelligent learning approaches across current flagship programs, such as SAT and AP, and emerging future products.
• Advance College Board's innovation agenda by expanding from automated scoring to broader AI-enabled solutions that support personalized learning and actionable feedback.
• Establish model-readiness criteria and guide release decisions for senior leadership to ensure high-quality, scalable deployment of natural language-driven solutions.
• Partner closely with Technology to shape development of guided scoring products and other intelligent learning innovations, advancing next-generation assessment capabilities.

Operational and Implementation Work (35%)

Lead and Manage the Natural Language Measurement Team (20%)

Internal and External Collaboration and Communication (10%)

To qualify for this role, you must have :

All roles at College Board require :

Application review will begin immediately and will continue until the position is filled. This role is expected to accept applications for a minimum of 5 business days.

While the hiring process may vary, it generally includes : resume and application submission, recruiter phone / video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks.

At College Board, we offer more than just a paycheckwe provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive. We're a self-sustaining nonprofit that believes in fair and competitive compensation, grounded in your qualifications, experience, impact, and the market.

The hiring range for this role is $148,000 $225,000. Your exact salary will depend on your location, experience, and how your background compares to others in similar roles at the College Board.

You'll have open, transparent conversations about compensation, benefits, and what it's like to work at College Board throughout your hiring process. Check out our careers page for more.