Senior AI Development Lead

Full-time
USA
$157k-$171k per year
Senior Level
Posted 43 minutes ago
Apply for this position → Go ad-free with Premium ×

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way.

The Community You Will Join

We're the AI & ML Enablement team in Supply Tech. Teams across Airbnb come to us when they want AI to take over a process, or to ship an AI feature they can trust. We're helping business and field teams use AI to take on high volume-low value tasks, and helping product teams understand whether an AI feature works before it reaches our users. Day to day, we move manual review processes to AI and put people where their judgment matters most. We design new workflows so AI does the work from the start. We also build the labeled datasets that show whether the AI is right, and we keep everything running as models and policies change. Our methods and projects change as the models do, and we expect the scope of this role to grow with them.

The Difference You Will Make

You'd work with whichever team has a problem AI could take on, whether that's a business team with a process that's slow, expensive or inconsistent, or a product team getting an AI feature ready to launch. The job looks much the same either way. You start with how the work really gets done, build an AI version of it, and test it until you trust the results. Then you graduate it and use what worked on the next problem. The mix of projects will keep changing as AI takes on more of the work, so we care more about how you work than about a fixed list of projects. This is a hands-on role. You design and build the workflow, prove it works with data, and ship it with engineering and product.

A Typical Day

  • Drive the AI workflows and features we support from design to launch, defining the quality bar and measurement plan with engineering, product and business partners.
  • Prioritize projects by business impact, making trade-offs in partnership with your manager and the business and product leads you support.
  • Sit with the team that owns a problem, map how the work gets done today, and work out how AI can do it and where people step in for the hard cases.
  • Design and build AI workflows: write the prompts when needed, set up the pipeline and tooling, and monitor quality and drift once it's live.
  • Design the evaluation framework: build test sets, define accuracy and agreement metrics, and calibrate LLM judges against human reviewers.
  • Work with engineers on architecture and tooling decisions, and pressure-test estimates and scope.
  • Turn unclear guidelines into criteria a reviewer can apply consistently, working with product, Legal and Policy.
  • Work with subject matter experts to write labeling guidelines and produce human-verified labels on real data.
  • Run labeling at scale with vendor labeling teams, and check their work against agreement metrics and your own spot checks.
  • Work with product teams early to agree on what "good enough to launch" means for an AI feature, and bring the evidence and a recommendation for the go/no-go decision.
  • Build reusable evaluation and workflow components, document what you learn, and get other teams using them so the next team gets to production faster.
  • Keep our methods current as models, tools and policies change, and recommend what to retire when it stops working.

Your Expertise

  • 8+ years in product or program management, analytics, consulting or applied AI, with a proven record of taking technical programs from idea to production and owning results such as backlog, cycle time or launch speed among others.
  • You're strong in SQL and in the statistics of quality: accuracy, precision and recall, sampling and reviewer agreement. You pull and analyze the data yourself instead of waiting for a report.
  • You’ve shipped something built on AI that other people rely on, such as a workflow, an agent or an automation, and you can show the before-and-after numbers. You can tell us where it failed and what you changed.
  • You're technically fluent enough to pressure-test an engineering estimate, understand how prompts, pipelines and evaluations fit together, and know when a workaround is the right call.
  • You're curious about how work actually gets done, including the awkward exceptions, and you've taken a messy process and made it measurable. You state the desired result first and measure success in business outcomes, not features shipped.
  • You have good judgment on quality. You can take messy qualitative feedback, such as reviewer comments or disagreements, and boil it down to what matters and what is worth changing.
  • You write clearly and can work with sales, operations, PMs and engineers in the same week, getting results through people you don't manage.
  • You're fine being the first person on a problem, and you try things yourself instead of waiting for someone to build them.

Nice to have

  • Hands-on Python and API experience, such as scripting data pulls, calling model APIs or building small automations.
  • Experience with LLM evaluation: building test sets, calibrating LLM judges or fine-tuning models.
  • Experience with experimentation and measurement, such as A/B tests, metric design and dashboards.
  • Trust and safety, content moderation, customer support automation, annotation operations or other human-in-the-loop work at scale.
  • Background in a two-sided marketplace, travel, or another operations-heavy business.

Your Location:

This position is US - Remote Eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed to with your manager. While the position is Remote Eligible, you must live in a state where Airbnb, Inc. has a registered entity. Click here for the up-to-date list of excluded states. This list is continuously evolving, so please check back with us if the state you live in is on the exclusion list  If your position is employed by another Airbnb entity, your recruiter will inform you what states you are eligible to work from.

Our Commitment To Inclusion & Belonging:

Airbnb is committed to working with the broadest talent pool possible. We believe diverse ideas foster innovation and engagement, and allow us to attract creatively-led people, and to develop the best products, services and solutions. All qualified individuals are encouraged to apply.

We strive to also provide a disability inclusive application and interview process. If you are a candidate with a disability and require reasonable accommodation in order to submit an application, please contact us at: reasonableaccommodations@airbnb.com. Please include your full name, the role you’re applying for and the accommodation necessary to assist you with the recruiting process. 

We ask that you only reach out to us if you are a candidate whose disability prevents you from being able to complete our online application.

Equal Employment Opportunity:

Airbnb values diversity & belonging and is proud to be an Equal Employment Opportunity employer. All individuals seeking employment at Airbnb are considered without regard to race, color, religion, national origin, age, gender, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, gender expression, sexual orientation, or any other legally protected characteristic. 

How We'll Take Care of You:

Our job titles may span more than one career level. The actual base pay is dependent upon many factors, such as: training, transferable skills, work experience, business needs and market demands. The base pay range is subject to change and may be modified in the future. This role may also be eligible for bonus, equity, benefits, and Employee Travel Credits.  

Pay Range
$157,000—$171,000 USD

Reasonable Accommodations: We are committed to providing reasonable accommodations throughout the recruitment process for applicants with disabilities. If you need assistance, or an accommodation, please let your recruiter know once you are contacted about a role.

A Note on Recruiting Scams: Scammers sometimes pose as Airbnb recruiters to get money or personal information from candidates. A few things that will always be true for Airbnb’s hiring process: our open roles are posted on Airbnb’s Career’s Page at careers.airbnb.com, and our recruiters correspond only from @airbnb.com or @ext.airbnb.com email addresses. Our recruiters will never ask for your Social Security number, bank account details, passport, or payment app information while you are interviewing.  We’ll also never ask you to pay a fee, send money, deposit or cash a check, or purchase work-related equipment (such as a company laptop) during the interview process. We encourage candidates to remain vigilant of these recruiting scams and not share sensitive information if you do not believe an individual is actually affiliated with Airbnb.

Go ad-free with Premium ×
Apply for this position →
About the Job
Full-time
USA
Senior Level
$157k-$171k per year
Posted 43 minutes ago
Check if your resume is a good fit
25/100
Get Full Report
+ 1,284 new jobs added today
50,000+
Remote Jobs

Don't miss out — new listings every hour

Join Premium

Senior AI Development Lead

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way.

The Community You Will Join

We're the AI & ML Enablement team in Supply Tech. Teams across Airbnb come to us when they want AI to take over a process, or to ship an AI feature they can trust. We're helping business and field teams use AI to take on high volume-low value tasks, and helping product teams understand whether an AI feature works before it reaches our users. Day to day, we move manual review processes to AI and put people where their judgment matters most. We design new workflows so AI does the work from the start. We also build the labeled datasets that show whether the AI is right, and we keep everything running as models and policies change. Our methods and projects change as the models do, and we expect the scope of this role to grow with them.

The Difference You Will Make

You'd work with whichever team has a problem AI could take on, whether that's a business team with a process that's slow, expensive or inconsistent, or a product team getting an AI feature ready to launch. The job looks much the same either way. You start with how the work really gets done, build an AI version of it, and test it until you trust the results. Then you graduate it and use what worked on the next problem. The mix of projects will keep changing as AI takes on more of the work, so we care more about how you work than about a fixed list of projects. This is a hands-on role. You design and build the workflow, prove it works with data, and ship it with engineering and product.

A Typical Day

  • Drive the AI workflows and features we support from design to launch, defining the quality bar and measurement plan with engineering, product and business partners.
  • Prioritize projects by business impact, making trade-offs in partnership with your manager and the business and product leads you support.
  • Sit with the team that owns a problem, map how the work gets done today, and work out how AI can do it and where people step in for the hard cases.
  • Design and build AI workflows: write the prompts when needed, set up the pipeline and tooling, and monitor quality and drift once it's live.
  • Design the evaluation framework: build test sets, define accuracy and agreement metrics, and calibrate LLM judges against human reviewers.
  • Work with engineers on architecture and tooling decisions, and pressure-test estimates and scope.
  • Turn unclear guidelines into criteria a reviewer can apply consistently, working with product, Legal and Policy.
  • Work with subject matter experts to write labeling guidelines and produce human-verified labels on real data.
  • Run labeling at scale with vendor labeling teams, and check their work against agreement metrics and your own spot checks.
  • Work with product teams early to agree on what "good enough to launch" means for an AI feature, and bring the evidence and a recommendation for the go/no-go decision.
  • Build reusable evaluation and workflow components, document what you learn, and get other teams using them so the next team gets to production faster.
  • Keep our methods current as models, tools and policies change, and recommend what to retire when it stops working.

Your Expertise

  • 8+ years in product or program management, analytics, consulting or applied AI, with a proven record of taking technical programs from idea to production and owning results such as backlog, cycle time or launch speed among others.
  • You're strong in SQL and in the statistics of quality: accuracy, precision and recall, sampling and reviewer agreement. You pull and analyze the data yourself instead of waiting for a report.
  • You’ve shipped something built on AI that other people rely on, such as a workflow, an agent or an automation, and you can show the before-and-after numbers. You can tell us where it failed and what you changed.
  • You're technically fluent enough to pressure-test an engineering estimate, understand how prompts, pipelines and evaluations fit together, and know when a workaround is the right call.
  • You're curious about how work actually gets done, including the awkward exceptions, and you've taken a messy process and made it measurable. You state the desired result first and measure success in business outcomes, not features shipped.
  • You have good judgment on quality. You can take messy qualitative feedback, such as reviewer comments or disagreements, and boil it down to what matters and what is worth changing.
  • You write clearly and can work with sales, operations, PMs and engineers in the same week, getting results through people you don't manage.
  • You're fine being the first person on a problem, and you try things yourself instead of waiting for someone to build them.

Nice to have

  • Hands-on Python and API experience, such as scripting data pulls, calling model APIs or building small automations.
  • Experience with LLM evaluation: building test sets, calibrating LLM judges or fine-tuning models.
  • Experience with experimentation and measurement, such as A/B tests, metric design and dashboards.
  • Trust and safety, content moderation, customer support automation, annotation operations or other human-in-the-loop work at scale.
  • Background in a two-sided marketplace, travel, or another operations-heavy business.

Your Location:

This position is US - Remote Eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed to with your manager. While the position is Remote Eligible, you must live in a state where Airbnb, Inc. has a registered entity. Click here for the up-to-date list of excluded states. This list is continuously evolving, so please check back with us if the state you live in is on the exclusion list  If your position is employed by another Airbnb entity, your recruiter will inform you what states you are eligible to work from.

Our Commitment To Inclusion & Belonging:

Airbnb is committed to working with the broadest talent pool possible. We believe diverse ideas foster innovation and engagement, and allow us to attract creatively-led people, and to develop the best products, services and solutions. All qualified individuals are encouraged to apply.

We strive to also provide a disability inclusive application and interview process. If you are a candidate with a disability and require reasonable accommodation in order to submit an application, please contact us at: reasonableaccommodations@airbnb.com. Please include your full name, the role you’re applying for and the accommodation necessary to assist you with the recruiting process. 

We ask that you only reach out to us if you are a candidate whose disability prevents you from being able to complete our online application.

Equal Employment Opportunity:

Airbnb values diversity & belonging and is proud to be an Equal Employment Opportunity employer. All individuals seeking employment at Airbnb are considered without regard to race, color, religion, national origin, age, gender, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, gender expression, sexual orientation, or any other legally protected characteristic. 

How We'll Take Care of You:

Our job titles may span more than one career level. The actual base pay is dependent upon many factors, such as: training, transferable skills, work experience, business needs and market demands. The base pay range is subject to change and may be modified in the future. This role may also be eligible for bonus, equity, benefits, and Employee Travel Credits.  

Pay Range
$157,000—$171,000 USD

Reasonable Accommodations: We are committed to providing reasonable accommodations throughout the recruitment process for applicants with disabilities. If you need assistance, or an accommodation, please let your recruiter know once you are contacted about a role.

A Note on Recruiting Scams: Scammers sometimes pose as Airbnb recruiters to get money or personal information from candidates. A few things that will always be true for Airbnb’s hiring process: our open roles are posted on Airbnb’s Career’s Page at careers.airbnb.com, and our recruiters correspond only from @airbnb.com or @ext.airbnb.com email addresses. Our recruiters will never ask for your Social Security number, bank account details, passport, or payment app information while you are interviewing.  We’ll also never ask you to pay a fee, send money, deposit or cash a check, or purchase work-related equipment (such as a company laptop) during the interview process. We encourage candidates to remain vigilant of these recruiting scams and not share sensitive information if you do not believe an individual is actually affiliated with Airbnb.