Principal Machine Learning Engineer - Large Scale Embedding
To see similar active jobs please follow this link: Remote Development jobs
The LS Embedding team will focus on building highly expressive multi-entity large scale embeddings exploring architectures beyond standard two-tower approaches to enhance our recommendation systems at Reddit. This entails modelling various compound interactions and relationships between users and entities they interact with using Graphs and exploring Graph neural networks and transformers to encode them.
We are looking for a Principal Machine Learning Engineer to lead the design and architecture of GNN and transformers based multi-entity embedding generation actively participating in end-to-end implementation process including enabling efficient distributed training and serving for such architectures shaping the future of recommendation systems at Reddit.
If applying ML / AI in production to improve Reddit Relevance excites you, then you’ve found the right place.
RESPONSIBILITIES:
Lead the team that architects and designs GNN and transformers based multi-entity embedding generation.
Define the technical roadmap and plan of execution in collaboration with Xfn partners.
Develop and optimize large-scale graph-based machine learning pipelines for recommendation systems.
Architect scalable and efficient GNN and transformers-based recommendation models that can process complex, interconnected data structures.
Collaborate with cross functional business units such as Ads teams leveraging the models for upstream functions and improve relevance metrics.
Collaborate with ML Infrastructure teams to enable distributed GPU based training and online serving architecture
Lead feature engineering efforts to identify and curate expressive raw data to be used for creating embeddings
Be a mentor and cross-functional advocate for the team
Contribute towards team and product strategy, operations and execution at Reddit.
QUALIFICATIONS:
15+ years of Technical Leadership Experience
Proven ability to lead ML initiatives, mentor engineers, and communicate complex concepts to cross-functional teams.
Expertise in Graph Neural Networks, collaborative filtering, knowledge graphs, and deep learning for recommendations.
Understanding of graph theory, network science, and representation learning technique
Strong coding skills in Python and experience with ML frameworks like PyTorch Geometric (PyG), Deep Graph Library (DGL), TensorFlow, and scikit-learn.
Solid understanding of ML infrastructure components and libraries (data parallel, model parallel, pipeline parallel, torch.inductor, model pruning, etc.) enabling efficient distributed training and inference.
Benefits:
Comprehensive Healthcare Benefits and Income Replacement Programs
401k Match
Family Planning Support
Gender-Affirming Care
Mental Health & Coaching Benefits
Flexible Vacation & Reddit Global Days off
Generous paid Parental Leave
Paid Volunteer time off
About the job
Principal Machine Learning Engineer - Large Scale Embedding
To see similar active jobs please follow this link: Remote Development jobs
The LS Embedding team will focus on building highly expressive multi-entity large scale embeddings exploring architectures beyond standard two-tower approaches to enhance our recommendation systems at Reddit. This entails modelling various compound interactions and relationships between users and entities they interact with using Graphs and exploring Graph neural networks and transformers to encode them.
We are looking for a Principal Machine Learning Engineer to lead the design and architecture of GNN and transformers based multi-entity embedding generation actively participating in end-to-end implementation process including enabling efficient distributed training and serving for such architectures shaping the future of recommendation systems at Reddit.
If applying ML / AI in production to improve Reddit Relevance excites you, then you’ve found the right place.
RESPONSIBILITIES:
Lead the team that architects and designs GNN and transformers based multi-entity embedding generation.
Define the technical roadmap and plan of execution in collaboration with Xfn partners.
Develop and optimize large-scale graph-based machine learning pipelines for recommendation systems.
Architect scalable and efficient GNN and transformers-based recommendation models that can process complex, interconnected data structures.
Collaborate with cross functional business units such as Ads teams leveraging the models for upstream functions and improve relevance metrics.
Collaborate with ML Infrastructure teams to enable distributed GPU based training and online serving architecture
Lead feature engineering efforts to identify and curate expressive raw data to be used for creating embeddings
Be a mentor and cross-functional advocate for the team
Contribute towards team and product strategy, operations and execution at Reddit.
QUALIFICATIONS:
15+ years of Technical Leadership Experience
Proven ability to lead ML initiatives, mentor engineers, and communicate complex concepts to cross-functional teams.
Expertise in Graph Neural Networks, collaborative filtering, knowledge graphs, and deep learning for recommendations.
Understanding of graph theory, network science, and representation learning technique
Strong coding skills in Python and experience with ML frameworks like PyTorch Geometric (PyG), Deep Graph Library (DGL), TensorFlow, and scikit-learn.
Solid understanding of ML infrastructure components and libraries (data parallel, model parallel, pipeline parallel, torch.inductor, model pruning, etc.) enabling efficient distributed training and inference.
Benefits:
Comprehensive Healthcare Benefits and Income Replacement Programs
401k Match
Family Planning Support
Gender-Affirming Care
Mental Health & Coaching Benefits
Flexible Vacation & Reddit Global Days off
Generous paid Parental Leave
Paid Volunteer time off