Data Platform Infrastructure Engineer - Software and Data Company
To see similar active jobs please follow this link: Remote Development jobs
Truelogic is a leading provider of nearshore staff augmentation services, located in New York. Our team of 500 tech talents is driving digital disruption from Latin America to the top projects in U.S. companies. Truelogic has been helping companies of all sizes to achieve their digital transformation goals.
Would you like to make innovation happen? Have you ever dreamed of building Products that impact millions of users? Nice! Then we have a seat for you on our team!
What are you going to do?
You will have the opportunity to work in a forward-thinking and growth-oriented environment, at a rapidly growing data-driven Go-To-Market software company, we are accelerating the development of our data platform. Our vision is to be the single source of truth for data and enable the rapid creation of large-scale data solutions and applications.
Occupy a unique position in the market, As a Data Platform Engineer in our team you'll have a key role in the design, implementation, and deployment of our Data Platform. The ideal candidate is an experienced software engineer having built large-scale data pipelines or systems using excellent problem-solving skills and know-how of working in very large scales. Our data platform is a nascent initiative and you’ll have the opportunity to affect its direction. You’ll take the lead in bringing in new ideas, testing and validating them quickly and independently, and incorporating them while socializing them with the team.
Design and build a highly scalable data platform to support data pipelines for diversified and complex data flows.
Track and identify relevant new technologies in the market and push their implementation into our pipelines through research and POC activities.
Deliver scalable, reliable and reusable data solutions.
Leading, building and continuously improving our data gathering, modeling, reporting capabilities and self-service data platforms.
Working closely with Data Engineers, Data Analysts, Data Scientists, Product Owners, and Domain Experts to identify data needs.
Develop processes and tools to monitor, analyze, maintain and improve data operation, performance and usability.
What will help you succeed
Relevant Bachelor degree or other equivalent Software Engineering background.
10+ years of experience as an infrastructure / data platform / big data software engineer.
Experience with AWS/GCP cloud services such as GCS/S3, Lambda/Cloud Function, EMR/Dataproc, Glue/Dataflow, Athena.
IaC design and hands-on experience.
Familiarity designing CI/CD pipelines with Jenkins, Github Actions, or similar tools.
Experience in designing, building and maintaining enterprise systems in a big data environment on public cloud.
Strong SQL abilities and hands-on experience with SQL, performing analysis and performance optimizations.
Hands-on experience in Python or equivalent programming language.
Experience with administering data warehouse solutions (like Bigquery/ Redshift/ Snowflake).
Experience with data modeling, data catalog concepts, data formats, data pipelines/ETL design, implementation and maintenance.
Experience with Airflow and DBT - advantage
Experience with Kubernetes using GKE or EKS - advantage..
Experience with development practices – Agile, TDD - advantage.
About the job
Data Platform Infrastructure Engineer - Software and Data Company
To see similar active jobs please follow this link: Remote Development jobs
Truelogic is a leading provider of nearshore staff augmentation services, located in New York. Our team of 500 tech talents is driving digital disruption from Latin America to the top projects in U.S. companies. Truelogic has been helping companies of all sizes to achieve their digital transformation goals.
Would you like to make innovation happen? Have you ever dreamed of building Products that impact millions of users? Nice! Then we have a seat for you on our team!
What are you going to do?
You will have the opportunity to work in a forward-thinking and growth-oriented environment, at a rapidly growing data-driven Go-To-Market software company, we are accelerating the development of our data platform. Our vision is to be the single source of truth for data and enable the rapid creation of large-scale data solutions and applications.
Occupy a unique position in the market, As a Data Platform Engineer in our team you'll have a key role in the design, implementation, and deployment of our Data Platform. The ideal candidate is an experienced software engineer having built large-scale data pipelines or systems using excellent problem-solving skills and know-how of working in very large scales. Our data platform is a nascent initiative and you’ll have the opportunity to affect its direction. You’ll take the lead in bringing in new ideas, testing and validating them quickly and independently, and incorporating them while socializing them with the team.
Design and build a highly scalable data platform to support data pipelines for diversified and complex data flows.
Track and identify relevant new technologies in the market and push their implementation into our pipelines through research and POC activities.
Deliver scalable, reliable and reusable data solutions.
Leading, building and continuously improving our data gathering, modeling, reporting capabilities and self-service data platforms.
Working closely with Data Engineers, Data Analysts, Data Scientists, Product Owners, and Domain Experts to identify data needs.
Develop processes and tools to monitor, analyze, maintain and improve data operation, performance and usability.
What will help you succeed
Relevant Bachelor degree or other equivalent Software Engineering background.
10+ years of experience as an infrastructure / data platform / big data software engineer.
Experience with AWS/GCP cloud services such as GCS/S3, Lambda/Cloud Function, EMR/Dataproc, Glue/Dataflow, Athena.
IaC design and hands-on experience.
Familiarity designing CI/CD pipelines with Jenkins, Github Actions, or similar tools.
Experience in designing, building and maintaining enterprise systems in a big data environment on public cloud.
Strong SQL abilities and hands-on experience with SQL, performing analysis and performance optimizations.
Hands-on experience in Python or equivalent programming language.
Experience with administering data warehouse solutions (like Bigquery/ Redshift/ Snowflake).
Experience with data modeling, data catalog concepts, data formats, data pipelines/ETL design, implementation and maintenance.
Experience with Airflow and DBT - advantage
Experience with Kubernetes using GKE or EKS - advantage..
Experience with development practices – Agile, TDD - advantage.