Senior Product Manager I - AI Agent Quality
Role Summary
Our mission at HubSpot is to help millions of organizations grow better. As a Senior Product Manager on the AI Agent Quality team, you’ll lead strategy and execution for one of HubSpot’s most critical AI investments. You’ll shape how customers measure, improve, and scale the performance of AI agents—helping them confidently use AI to transform marketing, sales, and service. If you’re excited by cutting-edge machine learning and eager to turn innovation into real customer impact, we’d love to meet you.
In this role you’ll get to
Own the Agent Quality strategy across operational, product, and customer-facing layers, defining what “good” means for reliability, ROI, and safety.
Implement evaluation frameworks including golden datasets, canary releases with rollback, and automated quality gates for model updates.
Define and standardize metrics like acceptance criteria, error budgets, SLOs, and latency targets to ensure scalable, trustworthy AI experiences.
Deliver customer-facing tools in Breeze Studio that enable managers to inspect interactions, trace tool actions, and continuously improve agent behavior.
Mature the Agent Quality Dashboard to unify ROI, usage, cost, and quality data for clear insights and decision-making.
Build self-serve evaluation kits—scenario libraries, regression suites, and human-in-the-loop review flows—to empower teams to improve agents safely.
Instrument end-to-end telemetry and define KPIs such as regression rate, time-to-detect, safety incidents, and cost per successful task.
Partner with MLOps and AI Foundations teams to ensure scalable, performant, and cost-efficient operations.
Establish an incident management program with runbooks and post-mortems that raise the bar for reliability and customer trust.
We are looking for people who have
Required Qualifications
Proven experience using AI/ML technologies (GenAI, NLP, Deep Learning) to deliver customer-facing products.
Track record of leading cross-functional teams and driving measurable outcomes in a fast-moving environment.
Strong business acumen with data-driven decision-making and KPI ownership.
Ability to simplify complex ideas and communicate clearly across technical and non-technical audiences.
Comfort navigating ambiguity and defining clear strategies where none exist.
Experience collaborating across product, design, engineering, and research disciplines.
Passion for AI, experimentation, and delivering meaningful, reliable innovation for customers.
Nice-to-Have Qualifications
Experience building or managing agentic AI systems or evaluation pipelines.
Familiarity with large-scale telemetry, observability, or reliability programs.
Exposure to MLOps, prompt engineering, or human-in-the-loop feedback systems.
Previous experience in SaaS product management or AI-powered customer experience tools.
Pay & Benefits
The cash compensation below includes base salary, on-target commission for employees in eligible roles, and annual bonus targets under HubSpot’s bonus plan for eligible roles. In addition to cash compensation, some roles are eligible to participate in HubSpot’s equity plan to receive restricted stock units (RSUs). Some roles may also be eligible for overtime pay. Individual compensation packages are tailored to your skills, experience, qualifications, and other job-related reasons.
This resource will help guide how we recommend thinking about the range you see. Learn more about HubSpot’s compensation philosophy.
Benefits are also an important piece of your total compensation package. Explore the benefits and perks HubSpot offers to help employees grow better.
At HubSpot, fair compensation practices aren’t just about checking off the box for legal compliance. It’s about living out our value of transparency with our employees, candidates, and community.
Annual Cash Compensation Range:
$158,100—$253,000 USD
About the job
Apply for this position
Senior Product Manager I - AI Agent Quality
Role Summary
Our mission at HubSpot is to help millions of organizations grow better. As a Senior Product Manager on the AI Agent Quality team, you’ll lead strategy and execution for one of HubSpot’s most critical AI investments. You’ll shape how customers measure, improve, and scale the performance of AI agents—helping them confidently use AI to transform marketing, sales, and service. If you’re excited by cutting-edge machine learning and eager to turn innovation into real customer impact, we’d love to meet you.
In this role you’ll get to
Own the Agent Quality strategy across operational, product, and customer-facing layers, defining what “good” means for reliability, ROI, and safety.
Implement evaluation frameworks including golden datasets, canary releases with rollback, and automated quality gates for model updates.
Define and standardize metrics like acceptance criteria, error budgets, SLOs, and latency targets to ensure scalable, trustworthy AI experiences.
Deliver customer-facing tools in Breeze Studio that enable managers to inspect interactions, trace tool actions, and continuously improve agent behavior.
Mature the Agent Quality Dashboard to unify ROI, usage, cost, and quality data for clear insights and decision-making.
Build self-serve evaluation kits—scenario libraries, regression suites, and human-in-the-loop review flows—to empower teams to improve agents safely.
Instrument end-to-end telemetry and define KPIs such as regression rate, time-to-detect, safety incidents, and cost per successful task.
Partner with MLOps and AI Foundations teams to ensure scalable, performant, and cost-efficient operations.
Establish an incident management program with runbooks and post-mortems that raise the bar for reliability and customer trust.
We are looking for people who have
Required Qualifications
Proven experience using AI/ML technologies (GenAI, NLP, Deep Learning) to deliver customer-facing products.
Track record of leading cross-functional teams and driving measurable outcomes in a fast-moving environment.
Strong business acumen with data-driven decision-making and KPI ownership.
Ability to simplify complex ideas and communicate clearly across technical and non-technical audiences.
Comfort navigating ambiguity and defining clear strategies where none exist.
Experience collaborating across product, design, engineering, and research disciplines.
Passion for AI, experimentation, and delivering meaningful, reliable innovation for customers.
Nice-to-Have Qualifications
Experience building or managing agentic AI systems or evaluation pipelines.
Familiarity with large-scale telemetry, observability, or reliability programs.
Exposure to MLOps, prompt engineering, or human-in-the-loop feedback systems.
Previous experience in SaaS product management or AI-powered customer experience tools.
Pay & Benefits
The cash compensation below includes base salary, on-target commission for employees in eligible roles, and annual bonus targets under HubSpot’s bonus plan for eligible roles. In addition to cash compensation, some roles are eligible to participate in HubSpot’s equity plan to receive restricted stock units (RSUs). Some roles may also be eligible for overtime pay. Individual compensation packages are tailored to your skills, experience, qualifications, and other job-related reasons.
This resource will help guide how we recommend thinking about the range you see. Learn more about HubSpot’s compensation philosophy.
Benefits are also an important piece of your total compensation package. Explore the benefits and perks HubSpot offers to help employees grow better.
At HubSpot, fair compensation practices aren’t just about checking off the box for legal compliance. It’s about living out our value of transparency with our employees, candidates, and community.
Annual Cash Compensation Range:
$158,100—$253,000 USD