Specialist Engineer - Data
Apply for this position → Go ad-free with PremiumCompany Description
OUR STORY
Let’s be honest: there are lots of people out there doing what we do. We’re just not convinced they’re doing it right. Businesses are hungry for innovation and opportunity, but not at the cost of their independence. At Ollion, we’ve connected companies and capabilities around the world to help ambitious organizations make the most of their transformation and leave the status quo in the dust.
WORKING AT OLLION
Innovation is risky. It demands bold steps and big questions, but that’s the price of making change. We’ve got our head in the cloud and two feet on the ground, channeling tech’s endless potential towards a single goal: making a world of difference. And we’re building a global team to do just that— a team capable of making game-changing breakthroughs without ever losing sight of the people it will impact. This is more than consulting. This is the change you can be.
THE OLLION DIFFERENCE
At Ollion, we’re all in on your independence. Our teams are seasoned. Our solutions are straightforward—sometimes even groundbreaking. And our engagements? Exactly as long as you want them to be. We deliver fresh thinking and hard-earned insight in a way that works for you and your customers, arming your organization with everything you need to make your transformation truly mean something.
WORKING WITH OLLION (our clients’ experiences)
Progress matters more than process. Our global team of cloud-native pros is all about creating new and better ways to work—not just by solving your tech challenges, but by using technology to solve your business challenges. We keep the formulas, frameworks, and ten-point plans to a minimum, tackling your most pressing problems with a proprietary mix of good-old-fashioned ingenuity and refreshing humanity.
DIVERSITY AT OLLION
One of our cultural keystones, ‘Find the angle’ recognizes that every individual has different aspirations, needs and brings a unique perspective.
We value diversity, inclusion, and equity (DE&I) as core to our success. We believe that a diverse workforce brings together unique perspectives, experiences, and ideas, leading to innovation, creativity, and better outcomes for our clients and our organization. We are on a journey and are committed to building a workplace that celebrates and respects individuals from all backgrounds, including but not limited to race, ethnicity, gender, sexual orientation, age, disability, and cultural heritage.
As our commitment to diversity and inclusion is reflected in our:
Awareness and sensitisation programs: to create awareness and sensitisation. We encourage open dialogue, active listening, and mutual respect, creating a safe and supportive environment for everyone to contribute their unique perspectives and ideas.
Dedicated efforts to building diverse teams: that leverage the strength of our differences to tackle complex challenges and drive innovation. By embracing diversity, we broaden our collective knowledge, enhance problem-solving capabilities, and unlock limitless potential for our employees.
Job Description
As a Specialty Engineer - Data, you have the unique opportunity to challenge the status quo, aiding the growth and defining the future of cloud data consumption for Enterprise Organizations.
While cloud technology has accelerated organizational change, the process of operationalizing, governing, and deriving value from data pipelines has been slow to evolve. This is your opportunity to be at the forefront of defining the next chapter of modern Data Engineering—spanning traditional batch workloads to cutting-edge real-time data streaming patterns on Azure and GCP.
The successful candidate will evangelize the benefits of a modern, ELT-first approach, driving continuous, iterative improvement to our data platform. You won't just build pipelines; you will architect data-driven solutions that directly inform executive decision-making and operational excellence.
Job Requirements:
Design and Development: Design, build, and optimize robust and scalable ETL/ELT data pipelines to ingest and process large volumes of data using Azure and GCP services (e.g., Azure Data Factory, Azure Synapse/Databricks, GCP Dataflow, Cloud Data Fusion, or Cloud Functions).
Data Modeling and Warehousing: Develop and maintain optimized data models (e.g., dimensional, vault) within multi-cloud data warehouse solutions (e.g., Google BigQuery or Azure Synapse Analytics) or data lakes to support BI, reporting, and analytical workloads. This includes ensuring data structures are optimized for consumption by tools like Power BI and Looker.
Performance Tuning: Monitor, troubleshoot, and optimize the performance of data warehouse queries and compute resources (e.g., BigQuery slots, Azure Synapse SQL pools, or Databricks/Dataproc clusters) to ensure cost-efficiency and fast data retrieval.
AI Data Foundation:
Feature Engineering: Collaborate with Data Scientists to design and implement feature stores and pipelines to prepare and serve data for ML model training and inference.
Vector Database Integration: Develop and maintain pipelines for transforming unstructured data (text, documents) into embeddings and loading them into vector databases (e.g., Azure Cosmos DB, GCP Vertex AI Vector Search, or dedicated vector stores) to support RAG solutions.
Data Orchestration: Implement workflows (e.g., using Apache Airflow, Google Cloud Composer, or Azure Data Factory/Logic Apps) to automate the end-to-end data lifecycle for AI/ML processes, including data refresh and model retraining.
MLOps and Productionization:
Model Deployment: Work with Data Science teams to containerize, deploy, and manage machine learning models in production environments (e.g., using GCP Vertex AI, Azure Machine Learning, or AKS/GKE).
Monitoring and Logging: Implement robust monitoring and logging solutions for production ML pipelines and models to track performance, data drift, and model decay using Azure Monitor or GCP Cloud Monitoring.
CI/CD for ML: Integrate model training, testing, and deployment into CI/CD pipelines to ensure rapid, reliable, and automated updates to production ML services.
Security and Governance: Implement and manage security best practices across Azure, GCP, and Snowflake, including access controls, role-based security (RBAC), IAM policies, and data encryption.
Coding and Automation: Write complex, efficient SQL queries and develop scripts in Python (or other relevant languages like Scala/Java) for data manipulation, process automation, and pipeline orchestration.
Collaboration: Work closely with data analysts, data scientists, and business stakeholders to understand data requirements and deliver high-quality, actionable data solutions, including setting up data sources and datasets for BI tools like Power BI and Looker.
Documentation: Create and maintain technical documentation for data models, data flows, and ETL/ELT processes.
Qualifications
Expertise You Bring:
Cloud Data Platform Mastery: hands-on experience designing and operating data solutions using major Azure services (Blob Storage, Data Factory, Databricks, Synapse) and/or GCP services (Cloud Storage, BigQuery, Dataflow, Pub/Sub, IAM).
Transformation & Modeling: Expert in SQL and modern ELT methodologies using tools like dbt (Data Build Tool) for version-controlled, production-grade data modeling within a modern cloud data warehouse (e.g., BigQuery, Azure Synapse, or Snowflake).
BI & Reporting: Experience with BI tools, specifically the configuration and optimization of data for use in Power BI or Looker.
Engineering Excellence: Advanced proficiency in Python for complex data transformation, API integrations, and automation scripting. Experience with workflow orchestration tools (Apache Airflow, Google Cloud Composer, or Azure Data Factory).
Machine Learning Engineering & MLOps:
Proven experience working with Data Scientists to build data and feature pipelines for ML.
Familiarity with ML lifecycle tools and frameworks (e.g., GCP Vertex AI, Azure Machine Learning, Kubeflow, MLflow).
Understanding of machine learning model deployment, serving, monitoring, and versioning best practices.
Data Security & Governance: Expertise in applying security controls, including encryption, data masking, and implementing role-based access control (RBAC) models in Azure and GCP data services.
DevOps Capabilities: Familiarity with infrastructure as code (IaC) practices using Terraform (preferred for multi-cloud) or cloud-native tooling (Azure Bicep / GCP Deployment Manager) and experience with version control, CI/CD pipelines, and automation tools for cloud data services.
Education & Experience: Bachelor’s or Master’s degree in Computer Science, Engineering, or a quantitative field. 4+ years of professional experience in a Data Engineering, Software Engineering, or Data Architecture role.
Required Certifications: Must hold professional-level data/AI certifications in at least one of the major platforms, such as:
Azure: Microsoft Certified: Azure Data Engineer Associate, or Azure AI Engineer Associate.
GCP: Google Cloud Certified Professional Data Engineer, or Professional Machine Learning Engineer.
Additional Information
BENEFITS & PERKS FOR WORKING AT OLLION
Our employees multiply their potential because they have opportunities to: Create a lasting Impact, Learn and Grow professionally & personally, Experience great Culture, and Be your Whole Self!
Beyond an amazing, collaborative work environment, great people, and inspiring, innovative work, we have some great benefits and perks:
Benchmarked, competitive, in-market total rewards package including (but not limited to): base salary & short-term incentive for all employees
Fully remote-first, small but Global organization; ‘learn wherever, whenever’ frees our people from a rigid view of learning and growth
Retiral benefits which are as per the local statutory regulations as our company is 100% compliant
Globally, we build benefit plans that offer choices for whatever stage in life our employees are in and allow for flexibility as life happens.
Employees have the benefit of medical insurance which is in line with industry benchmark.
In addition to great healthcare coverage, we also offer all employees mental health resources and additional wellness programs.
Generous time off and compensatory off
And more!
Ollion is an equal opportunity employer. We celebrate diversity and we are committed to creating an inclusive environment for all employees. Ollion does not discriminate in employment on the basis of race, color, religion, sex (including pregnancy and gender identity), national origin, political affiliation, sexual orientation, marital status, disability, genetic information, age, membership in an employee organization, parental status, military service, or other non-merit factor.
Similar Jobs
Principal Machine Learning & Data Engineer
Twilio · USA
Senior Software Engineer
Welkin Health, Inc. · USA
Software Engineer, Ads
Reddit · USA
Staff Software Engineer
Twilio · USA - West
Senior Backend Engineer - Databases Pyroscope
Grafana Labs · USA
Specialist Engineer - Data
Company Description
OUR STORY
Let’s be honest: there are lots of people out there doing what we do. We’re just not convinced they’re doing it right. Businesses are hungry for innovation and opportunity, but not at the cost of their independence. At Ollion, we’ve connected companies and capabilities around the world to help ambitious organizations make the most of their transformation and leave the status quo in the dust.
WORKING AT OLLION
Innovation is risky. It demands bold steps and big questions, but that’s the price of making change. We’ve got our head in the cloud and two feet on the ground, channeling tech’s endless potential towards a single goal: making a world of difference. And we’re building a global team to do just that— a team capable of making game-changing breakthroughs without ever losing sight of the people it will impact. This is more than consulting. This is the change you can be.
THE OLLION DIFFERENCE
At Ollion, we’re all in on your independence. Our teams are seasoned. Our solutions are straightforward—sometimes even groundbreaking. And our engagements? Exactly as long as you want them to be. We deliver fresh thinking and hard-earned insight in a way that works for you and your customers, arming your organization with everything you need to make your transformation truly mean something.
WORKING WITH OLLION (our clients’ experiences)
Progress matters more than process. Our global team of cloud-native pros is all about creating new and better ways to work—not just by solving your tech challenges, but by using technology to solve your business challenges. We keep the formulas, frameworks, and ten-point plans to a minimum, tackling your most pressing problems with a proprietary mix of good-old-fashioned ingenuity and refreshing humanity.
DIVERSITY AT OLLION
One of our cultural keystones, ‘Find the angle’ recognizes that every individual has different aspirations, needs and brings a unique perspective.
We value diversity, inclusion, and equity (DE&I) as core to our success. We believe that a diverse workforce brings together unique perspectives, experiences, and ideas, leading to innovation, creativity, and better outcomes for our clients and our organization. We are on a journey and are committed to building a workplace that celebrates and respects individuals from all backgrounds, including but not limited to race, ethnicity, gender, sexual orientation, age, disability, and cultural heritage.
As our commitment to diversity and inclusion is reflected in our:
Awareness and sensitisation programs: to create awareness and sensitisation. We encourage open dialogue, active listening, and mutual respect, creating a safe and supportive environment for everyone to contribute their unique perspectives and ideas.
Dedicated efforts to building diverse teams: that leverage the strength of our differences to tackle complex challenges and drive innovation. By embracing diversity, we broaden our collective knowledge, enhance problem-solving capabilities, and unlock limitless potential for our employees.
Job Description
As a Specialty Engineer - Data, you have the unique opportunity to challenge the status quo, aiding the growth and defining the future of cloud data consumption for Enterprise Organizations.
While cloud technology has accelerated organizational change, the process of operationalizing, governing, and deriving value from data pipelines has been slow to evolve. This is your opportunity to be at the forefront of defining the next chapter of modern Data Engineering—spanning traditional batch workloads to cutting-edge real-time data streaming patterns on Azure and GCP.
The successful candidate will evangelize the benefits of a modern, ELT-first approach, driving continuous, iterative improvement to our data platform. You won't just build pipelines; you will architect data-driven solutions that directly inform executive decision-making and operational excellence.
Job Requirements:
Design and Development: Design, build, and optimize robust and scalable ETL/ELT data pipelines to ingest and process large volumes of data using Azure and GCP services (e.g., Azure Data Factory, Azure Synapse/Databricks, GCP Dataflow, Cloud Data Fusion, or Cloud Functions).
Data Modeling and Warehousing: Develop and maintain optimized data models (e.g., dimensional, vault) within multi-cloud data warehouse solutions (e.g., Google BigQuery or Azure Synapse Analytics) or data lakes to support BI, reporting, and analytical workloads. This includes ensuring data structures are optimized for consumption by tools like Power BI and Looker.
Performance Tuning: Monitor, troubleshoot, and optimize the performance of data warehouse queries and compute resources (e.g., BigQuery slots, Azure Synapse SQL pools, or Databricks/Dataproc clusters) to ensure cost-efficiency and fast data retrieval.
AI Data Foundation:
Feature Engineering: Collaborate with Data Scientists to design and implement feature stores and pipelines to prepare and serve data for ML model training and inference.
Vector Database Integration: Develop and maintain pipelines for transforming unstructured data (text, documents) into embeddings and loading them into vector databases (e.g., Azure Cosmos DB, GCP Vertex AI Vector Search, or dedicated vector stores) to support RAG solutions.
Data Orchestration: Implement workflows (e.g., using Apache Airflow, Google Cloud Composer, or Azure Data Factory/Logic Apps) to automate the end-to-end data lifecycle for AI/ML processes, including data refresh and model retraining.
MLOps and Productionization:
Model Deployment: Work with Data Science teams to containerize, deploy, and manage machine learning models in production environments (e.g., using GCP Vertex AI, Azure Machine Learning, or AKS/GKE).
Monitoring and Logging: Implement robust monitoring and logging solutions for production ML pipelines and models to track performance, data drift, and model decay using Azure Monitor or GCP Cloud Monitoring.
CI/CD for ML: Integrate model training, testing, and deployment into CI/CD pipelines to ensure rapid, reliable, and automated updates to production ML services.
Security and Governance: Implement and manage security best practices across Azure, GCP, and Snowflake, including access controls, role-based security (RBAC), IAM policies, and data encryption.
Coding and Automation: Write complex, efficient SQL queries and develop scripts in Python (or other relevant languages like Scala/Java) for data manipulation, process automation, and pipeline orchestration.
Collaboration: Work closely with data analysts, data scientists, and business stakeholders to understand data requirements and deliver high-quality, actionable data solutions, including setting up data sources and datasets for BI tools like Power BI and Looker.
Documentation: Create and maintain technical documentation for data models, data flows, and ETL/ELT processes.
Qualifications
Expertise You Bring:
Cloud Data Platform Mastery: hands-on experience designing and operating data solutions using major Azure services (Blob Storage, Data Factory, Databricks, Synapse) and/or GCP services (Cloud Storage, BigQuery, Dataflow, Pub/Sub, IAM).
Transformation & Modeling: Expert in SQL and modern ELT methodologies using tools like dbt (Data Build Tool) for version-controlled, production-grade data modeling within a modern cloud data warehouse (e.g., BigQuery, Azure Synapse, or Snowflake).
BI & Reporting: Experience with BI tools, specifically the configuration and optimization of data for use in Power BI or Looker.
Engineering Excellence: Advanced proficiency in Python for complex data transformation, API integrations, and automation scripting. Experience with workflow orchestration tools (Apache Airflow, Google Cloud Composer, or Azure Data Factory).
Machine Learning Engineering & MLOps:
Proven experience working with Data Scientists to build data and feature pipelines for ML.
Familiarity with ML lifecycle tools and frameworks (e.g., GCP Vertex AI, Azure Machine Learning, Kubeflow, MLflow).
Understanding of machine learning model deployment, serving, monitoring, and versioning best practices.
Data Security & Governance: Expertise in applying security controls, including encryption, data masking, and implementing role-based access control (RBAC) models in Azure and GCP data services.
DevOps Capabilities: Familiarity with infrastructure as code (IaC) practices using Terraform (preferred for multi-cloud) or cloud-native tooling (Azure Bicep / GCP Deployment Manager) and experience with version control, CI/CD pipelines, and automation tools for cloud data services.
Education & Experience: Bachelor’s or Master’s degree in Computer Science, Engineering, or a quantitative field. 4+ years of professional experience in a Data Engineering, Software Engineering, or Data Architecture role.
Required Certifications: Must hold professional-level data/AI certifications in at least one of the major platforms, such as:
Azure: Microsoft Certified: Azure Data Engineer Associate, or Azure AI Engineer Associate.
GCP: Google Cloud Certified Professional Data Engineer, or Professional Machine Learning Engineer.
Additional Information
BENEFITS & PERKS FOR WORKING AT OLLION
Our employees multiply their potential because they have opportunities to: Create a lasting Impact, Learn and Grow professionally & personally, Experience great Culture, and Be your Whole Self!
Beyond an amazing, collaborative work environment, great people, and inspiring, innovative work, we have some great benefits and perks:
Benchmarked, competitive, in-market total rewards package including (but not limited to): base salary & short-term incentive for all employees
Fully remote-first, small but Global organization; ‘learn wherever, whenever’ frees our people from a rigid view of learning and growth
Retiral benefits which are as per the local statutory regulations as our company is 100% compliant
Globally, we build benefit plans that offer choices for whatever stage in life our employees are in and allow for flexibility as life happens.
Employees have the benefit of medical insurance which is in line with industry benchmark.
In addition to great healthcare coverage, we also offer all employees mental health resources and additional wellness programs.
Generous time off and compensatory off
And more!
Ollion is an equal opportunity employer. We celebrate diversity and we are committed to creating an inclusive environment for all employees. Ollion does not discriminate in employment on the basis of race, color, religion, sex (including pregnancy and gender identity), national origin, political affiliation, sexual orientation, marital status, disability, genetic information, age, membership in an employee organization, parental status, military service, or other non-merit factor.
Similar Jobs
Principal Machine Learning & Data Engineer
Twilio · USA
Senior Software Engineer
Welkin Health, Inc. · USA
Software Engineer, Ads
Reddit · USA
Staff Software Engineer
Twilio · USA - West
Senior Backend Engineer - Databases Pyroscope
Grafana Labs · USA