MENU
  • Remote Jobs
  • Companies
  • Go Premium
  • Job Alerts
  • Post a Job
  • Log in
  • Sign up
Working Nomads logo Working Nomads
  • Remote Jobs
  • Companies
  • Post Jobs
  • Go Premium
  • Get Free Job Alerts
  • Log in

Principal Psychometrician - Assessments

Khan Academy

Full-time
USA, Canada
$153k-$191k per year
python
insurance
medical
math
director
The job listing has expired. Unfortunately, the hiring company is no longer accepting new applications.

To see similar active jobs please follow this link: Remote Development jobs

ABOUT KHAN ACADEMY

Khan Academy is a nonprofit with the mission to deliver a free, world-class education to anyone, anywhere. Our proven learning platform offers free, high-quality supplemental learning content and practice that cover Pre-K - 12th grade and early college core academic subjects, focusing on math and science. We have over 155 million registered learners globally and are committed to improving learning outcomes for students worldwide, focusing on learners in historically under-resourced communities.

OUR COMMUNITY 

Our students, teachers, and parents come from all walks of life, and so do we. Our team includes people from academia, traditional/non-traditional education, big tech companies, and tiny startups. We hire great people from diverse backgrounds and experiences because it makes our company stronger. We value diversity, equity, inclusion, and belonging as necessary to achieve our mission and impact the communities we serve. We know that transforming education starts in-house with learning about ourselves and our colleagues. We strive to be world-class in investing in our people and commit to developing you as a professional.

THE ROLE

We’re seeking a highly experienced Principal Psychometrician to join our Assessments team. As a key contributor, this person will play a critical role in the development of innovative K-12 assessments. The ideal candidate will possess deep expertise in psychometrics, particularly in K-12 settings, and will have demonstrated experience with the adoption of AI in the context of complex items and automated scoring. This person will play a pivotal role in leveraging measurement and AI technologies. 

WHAT YOU'LL DO:

  • Collaborate with the Director of Assessment, content creators, and other team members in developing assessments

  • Own psychometric efforts including planning for psychometric analyses in collaboration with our field testing coordinator, as well as automated scoring, scaling, calibration, and bank maintenance

  • Coordinate the collection of psychometric validity evidence

  • Work with the team to build a robust computerized adaptive assessment, leveraging measurement science and AI

  • Apply measurement expertise and collaborate with product and engineering teams in creating and scoring more complex, interactive assessments for our students

  • Drive innovation of measurement and AI industry advancements, especially generative AI advancements, as well as improvements in the assessment experience

  • Help guide other psychometricians

WHAT YOU BRING:

  • You are motivated by the Khan Academy mission “to provide a free world-class education for anyone, anywhere.”

  • You have 7+ years of applied experience in psychometrics - including computerized adaptive assessment and automated scoring - ideally in K-12 assessment development.

  • Track record of leading other psychometricians and collaborating with cross-functional teams, including engineering, product, content, and design. 

  • Strong quantitative technical proficiency with common statistical software (e.g., Python, R).

  • Proven cross-cultural competency skills demonstrating self-awareness, awareness of other, and the ability to adopt inclusive perspectives, attitudes, and behaviors to drive inclusion and belonging throughout the organization.

  • Ability to balance the rigor of psychometrics with the promise of innovation.

  • A positive growth mindset that is innately curious and passionate about staying on top of the latest in assessment and AI technologies, and that wants to innovate the assessment experience. 

  • A bias to action and an ability to plan and provide structure in ambiguous situations. 

PERKS AND BENEFITS

We may be a non-profit, but we reward our talented team extremely well! We offer:

  • Competitive salaries

  • Ample paid time off as needed – Your well-being is a priority.

  • Remote-first culture - that caters to your time zone, with open flexibility as needed, at times

  • Generous parental leave

  • An exceptional team that trusts you and gives you the freedom to do your best

  • The chance to put your talents towards a deeply meaningful mission and the opportunity to work on high-impact products that are already defining the future of education

  • Opportunities to connect through affinity, ally, and social groups

  • And we offer all those other typical benefits as well: 401(k) + 4% matching & comprehensive insurance, including medical, dental, vision, and life

At Khan Academy we are committed to fair and equitable compensation practices, the well-being of our employees, and our Khan community. This belief is why we have built out a robust Total Rewards package that includes competitive base salaries, and extensive benefits and perks to support physical, mental, and financial well-being.

The target salary range for this position is $152,908 - $191,135 USD. The pay range for this position is a general guideline only. The salary offered will depend on internal pay equity and the candidate’s relevant skills, experience, qualifications, and job market data. Exceptional performers in this role who make an outsized contribution can make well in excess of this range.  Additional incentives are provided as part of the complete total rewards package in addition to comprehensive medical and other benefits.

MORE ABOUT US

  • Sal’s TED talk from 2011

  • Sal’s TED talk from 2015

  • Sal's TED talk from 2023

  • Our team:  http://www.khanacademy.org/about/the-team

OUR COMPANY VALUES

Live & breathe learners

We deeply understand and empathize with our users. We leverage user insights, research, and experience to build content, products, services, and experiences that our users trust and love. Our success is defined by the success of our learners and educators.

Take a stand

As a company, we have conviction in our aspirational point of view of how education will evolve. The work we do is in service to moving towards that point of view. However, we also listen, learn and flex in the face of new data, and commit to evolving this point of view as the industry and our users evolve.

Embrace diverse perspectives

We are a diverse community. We seek out and embrace a diversity of voices, perspectives and life experiences leading to stronger, more inclusive teams and better outcomes. As individuals, we are committed to bringing up tough topics and leaning into different points of view with curiosity. We actively listen, learn and collaborate to gain a shared understanding. When a decision is made, we commit to moving forward as a united team.

Work responsibly and sustainably

We understand that achieving our audacious mission is a marathon, so we set realistic timelines and we focus on delivery that also links to the bigger picture. As a non-profit, we are supported by the generosity of donors as well as strategic partners, and understand our responsibility to our finite resources. We spend every dollar as though it were our own. We are responsible for the impact we have on the world and to each other. We ensure our team and company stay healthy and financially sustainable.

Bring out the joy

We are committed to making learning a joyful process. This informs what we build for our users and the culture we co-create with our teammates, partners and donors.

Cultivate learning mindset

We believe in the power of growth for learners and for ourselves. We constantly learn and teach to improve our offerings, ourselves, and our organization. We learn from our mistakes and aren’t afraid to fail. We don't let past failures or successes stop us from taking future bold action and achieving our goals.

Deliver wow

We insist on high standards and deliver delightful, effective end-to-end experiences that our users can rely on. We choose to focus on fewer things — each of which aligns to our ambitious vision — so we can deliver high-quality experiences that accelerate positive measurable learning with our strategic partners.

We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, gender, gender identity or expression, national origin, sexual orientation, age, citizenship, marital status, disability, or Veteran status. We value diversity, equity, and inclusion, and we encourage candidates from historically underrepresented groups to apply.

About the job

Full-time
USA, Canada
$153k-$191k per year
6 Applicants
Posted 9 months ago
python
insurance
medical
math
director
Enhancv advertisement

30,000+
REMOTE JOBS

Unlock access to our database and
kickstart your remote career
Join Premium

Principal Psychometrician - Assessments

Khan Academy
The job listing has expired. Unfortunately, the hiring company is no longer accepting new applications.

To see similar active jobs please follow this link: Remote Development jobs

ABOUT KHAN ACADEMY

Khan Academy is a nonprofit with the mission to deliver a free, world-class education to anyone, anywhere. Our proven learning platform offers free, high-quality supplemental learning content and practice that cover Pre-K - 12th grade and early college core academic subjects, focusing on math and science. We have over 155 million registered learners globally and are committed to improving learning outcomes for students worldwide, focusing on learners in historically under-resourced communities.

OUR COMMUNITY 

Our students, teachers, and parents come from all walks of life, and so do we. Our team includes people from academia, traditional/non-traditional education, big tech companies, and tiny startups. We hire great people from diverse backgrounds and experiences because it makes our company stronger. We value diversity, equity, inclusion, and belonging as necessary to achieve our mission and impact the communities we serve. We know that transforming education starts in-house with learning about ourselves and our colleagues. We strive to be world-class in investing in our people and commit to developing you as a professional.

THE ROLE

We’re seeking a highly experienced Principal Psychometrician to join our Assessments team. As a key contributor, this person will play a critical role in the development of innovative K-12 assessments. The ideal candidate will possess deep expertise in psychometrics, particularly in K-12 settings, and will have demonstrated experience with the adoption of AI in the context of complex items and automated scoring. This person will play a pivotal role in leveraging measurement and AI technologies. 

WHAT YOU'LL DO:

  • Collaborate with the Director of Assessment, content creators, and other team members in developing assessments

  • Own psychometric efforts including planning for psychometric analyses in collaboration with our field testing coordinator, as well as automated scoring, scaling, calibration, and bank maintenance

  • Coordinate the collection of psychometric validity evidence

  • Work with the team to build a robust computerized adaptive assessment, leveraging measurement science and AI

  • Apply measurement expertise and collaborate with product and engineering teams in creating and scoring more complex, interactive assessments for our students

  • Drive innovation of measurement and AI industry advancements, especially generative AI advancements, as well as improvements in the assessment experience

  • Help guide other psychometricians

WHAT YOU BRING:

  • You are motivated by the Khan Academy mission “to provide a free world-class education for anyone, anywhere.”

  • You have 7+ years of applied experience in psychometrics - including computerized adaptive assessment and automated scoring - ideally in K-12 assessment development.

  • Track record of leading other psychometricians and collaborating with cross-functional teams, including engineering, product, content, and design. 

  • Strong quantitative technical proficiency with common statistical software (e.g., Python, R).

  • Proven cross-cultural competency skills demonstrating self-awareness, awareness of other, and the ability to adopt inclusive perspectives, attitudes, and behaviors to drive inclusion and belonging throughout the organization.

  • Ability to balance the rigor of psychometrics with the promise of innovation.

  • A positive growth mindset that is innately curious and passionate about staying on top of the latest in assessment and AI technologies, and that wants to innovate the assessment experience. 

  • A bias to action and an ability to plan and provide structure in ambiguous situations. 

PERKS AND BENEFITS

We may be a non-profit, but we reward our talented team extremely well! We offer:

  • Competitive salaries

  • Ample paid time off as needed – Your well-being is a priority.

  • Remote-first culture - that caters to your time zone, with open flexibility as needed, at times

  • Generous parental leave

  • An exceptional team that trusts you and gives you the freedom to do your best

  • The chance to put your talents towards a deeply meaningful mission and the opportunity to work on high-impact products that are already defining the future of education

  • Opportunities to connect through affinity, ally, and social groups

  • And we offer all those other typical benefits as well: 401(k) + 4% matching & comprehensive insurance, including medical, dental, vision, and life

At Khan Academy we are committed to fair and equitable compensation practices, the well-being of our employees, and our Khan community. This belief is why we have built out a robust Total Rewards package that includes competitive base salaries, and extensive benefits and perks to support physical, mental, and financial well-being.

The target salary range for this position is $152,908 - $191,135 USD. The pay range for this position is a general guideline only. The salary offered will depend on internal pay equity and the candidate’s relevant skills, experience, qualifications, and job market data. Exceptional performers in this role who make an outsized contribution can make well in excess of this range.  Additional incentives are provided as part of the complete total rewards package in addition to comprehensive medical and other benefits.

MORE ABOUT US

  • Sal’s TED talk from 2011

  • Sal’s TED talk from 2015

  • Sal's TED talk from 2023

  • Our team:  http://www.khanacademy.org/about/the-team

OUR COMPANY VALUES

Live & breathe learners

We deeply understand and empathize with our users. We leverage user insights, research, and experience to build content, products, services, and experiences that our users trust and love. Our success is defined by the success of our learners and educators.

Take a stand

As a company, we have conviction in our aspirational point of view of how education will evolve. The work we do is in service to moving towards that point of view. However, we also listen, learn and flex in the face of new data, and commit to evolving this point of view as the industry and our users evolve.

Embrace diverse perspectives

We are a diverse community. We seek out and embrace a diversity of voices, perspectives and life experiences leading to stronger, more inclusive teams and better outcomes. As individuals, we are committed to bringing up tough topics and leaning into different points of view with curiosity. We actively listen, learn and collaborate to gain a shared understanding. When a decision is made, we commit to moving forward as a united team.

Work responsibly and sustainably

We understand that achieving our audacious mission is a marathon, so we set realistic timelines and we focus on delivery that also links to the bigger picture. As a non-profit, we are supported by the generosity of donors as well as strategic partners, and understand our responsibility to our finite resources. We spend every dollar as though it were our own. We are responsible for the impact we have on the world and to each other. We ensure our team and company stay healthy and financially sustainable.

Bring out the joy

We are committed to making learning a joyful process. This informs what we build for our users and the culture we co-create with our teammates, partners and donors.

Cultivate learning mindset

We believe in the power of growth for learners and for ourselves. We constantly learn and teach to improve our offerings, ourselves, and our organization. We learn from our mistakes and aren’t afraid to fail. We don't let past failures or successes stop us from taking future bold action and achieving our goals.

Deliver wow

We insist on high standards and deliver delightful, effective end-to-end experiences that our users can rely on. We choose to focus on fewer things — each of which aligns to our ambitious vision — so we can deliver high-quality experiences that accelerate positive measurable learning with our strategic partners.

We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, gender, gender identity or expression, national origin, sexual orientation, age, citizenship, marital status, disability, or Veteran status. We value diversity, equity, and inclusion, and we encourage candidates from historically underrepresented groups to apply.

Working Nomads

Post Jobs
Premium Subscription
Sponsorship
Free Job Alerts

Job Skills
API
FAQ
Privacy policy
Terms and conditions
Contact us
About us

Jobs by Category

Remote Administration jobs
Remote Consulting jobs
Remote Customer Success jobs
Remote Development jobs
Remote Design jobs
Remote Education jobs
Remote Finance jobs
Remote Legal jobs
Remote Healthcare jobs
Remote Human Resources jobs
Remote Management jobs
Remote Marketing jobs
Remote Sales jobs
Remote System Administration jobs
Remote Writing jobs

Jobs by Position Type

Remote Full-time jobs
Remote Part-time jobs
Remote Contract jobs

Jobs by Region

Remote jobs Anywhere
Remote jobs North America
Remote jobs Latin America
Remote jobs Europe
Remote jobs Middle East
Remote jobs Africa
Remote jobs APAC

Jobs by Skill

Remote Accounting jobs
Remote Assistant jobs
Remote Copywriting jobs
Remote Cyber Security jobs
Remote Data Analyst jobs
Remote Data Entry jobs
Remote English jobs
Remote Spanish jobs
Remote Project Management jobs
Remote QA jobs
Remote SEO jobs

Jobs by Country

Remote jobs Australia
Remote jobs Argentina
Remote jobs Brazil
Remote jobs Canada
Remote jobs Colombia
Remote jobs France
Remote jobs Germany
Remote jobs Ireland
Remote jobs India
Remote jobs Japan
Remote jobs Mexico
Remote jobs Netherlands
Remote jobs New Zealand
Remote jobs Philippines
Remote jobs Poland
Remote jobs Portugal
Remote jobs Singapore
Remote jobs Spain
Remote jobs UK
Remote jobs USA


Working Nomads curates remote digital jobs from around the web.

© 2025 Working Nomads.