Sr. Engineering Manager - ML Serving Platform
The ML Platform team provides foundational tools and infrastructure used by hundreds of ML engineers across Pinterest, including recommendations, ads, visual search, growth/notifications, trust and safety. We aim to ensure that ML systems are efficient, healthy (production-grade quality) and fast (for modelers to iterate upon).
Pinterest is seeking a Sr. Engineering Manager to lead the team that builds the serving and deployment infrastructure for all ML models at Pinterest. Systems include:
Ultra-high-performance C++ model inference engine for production recommendations and content ranking systems. TorchScript + CUDA Graph models on GPU inference, serving 500+M inferences/second.
Production GenAI & LLM model inference stack for emerging use cases.
Model routing, deployment, monitoring.
Feature fetching, caching, and logging.
What you’ll do:
Lead the team to deliver continual improvements in advanced model architectures, cost-efficient resource utilization, and ML developer productivity.
Set technical direction for the team based on company and org priorities.
Coach and develop talent on the team.
What we’re looking for:
Experience managing platform engineering teams with many cross-organizational customers
Experience building large-scale distributed serving systems
Experience with ML inference technologies for online serving at Web scale
Experience developing engineering platforms: deep customer understanding
Bachelor’s degree in Computer Science, a related field or equivalent experience
In-Office Requirement Statement:
We let the type of work you do guide the collaboration style. That means we're not always working in an office, but we continue to gather for key moments of collaboration and connection.
This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country. Prefer Bay Area as most ML Serving team members are located there.
Relocation Statement:
This position is not eligible for relocation assistance. Visit our PinFlex page to learn more about our working model.
#LI-REMOTE
#LI-JT1
Sr. Engineering Manager - ML Serving Platform
The ML Platform team provides foundational tools and infrastructure used by hundreds of ML engineers across Pinterest, including recommendations, ads, visual search, growth/notifications, trust and safety. We aim to ensure that ML systems are efficient, healthy (production-grade quality) and fast (for modelers to iterate upon).
Pinterest is seeking a Sr. Engineering Manager to lead the team that builds the serving and deployment infrastructure for all ML models at Pinterest. Systems include:
Ultra-high-performance C++ model inference engine for production recommendations and content ranking systems. TorchScript + CUDA Graph models on GPU inference, serving 500+M inferences/second.
Production GenAI & LLM model inference stack for emerging use cases.
Model routing, deployment, monitoring.
Feature fetching, caching, and logging.
What you’ll do:
Lead the team to deliver continual improvements in advanced model architectures, cost-efficient resource utilization, and ML developer productivity.
Set technical direction for the team based on company and org priorities.
Coach and develop talent on the team.
What we’re looking for:
Experience managing platform engineering teams with many cross-organizational customers
Experience building large-scale distributed serving systems
Experience with ML inference technologies for online serving at Web scale
Experience developing engineering platforms: deep customer understanding
Bachelor’s degree in Computer Science, a related field or equivalent experience
In-Office Requirement Statement:
We let the type of work you do guide the collaboration style. That means we're not always working in an office, but we continue to gather for key moments of collaboration and connection.
This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country. Prefer Bay Area as most ML Serving team members are located there.
Relocation Statement:
This position is not eligible for relocation assistance. Visit our PinFlex page to learn more about our working model.
#LI-REMOTE
#LI-JT1