Staff Data Engineer - Software and Data Company
To see similar active jobs please follow this link: Remote Development jobs
Truelogic is a leading provider of nearshore staff augmentation services, located in New York. Our team of 500 tech talents is driving digital disruption from Latin America to the top projects in U.S. companies. Truelogic has been helping companies of all sizes to achieve their digital transformation goals.
Would you like to make innovation happen? Have you ever dreamed of building Products that impact millions of users? Nice! Then we have a seat for you on our team!
What are you going to do?
You will have the opportunity to work in a forward-thinking and growth-oriented environment, at a rapidly growing data-driven Go-To-Market software company, we are accelerating the development of our data platform. Our vision is to be the single source of truth for data and enable the rapid creation of large-scale data solutions and applications.
Occupy a unique position in the market, As a Staff Data Engineer in our team you'll have a key role in the design, implementation, and deployment of our Data Platform. The ideal candidate is an experienced software engineer having built large-scale data pipelines or systems using excellent problem-solving skills and know-how of working in very large scales. Our data platform is a nascent initiative and you’ll have the opportunity to affect its direction. You’ll take the lead in bringing in new ideas, testing and validating them quickly and independently, and incorporating them while socializing them with the team.
Design, build and operate highly scalable and flexible systems that can manage and process billions of records a day and support complex and diversified data pipelines
Leverage cloud computing architectures to support development needs
Develop processes and tools to monitor, analyze, maintain, and improve data operation, performance, and usability
Work closely with Data Engineers, Data Analysts, Data Scientists, and Domain Experts to understand their needs for the data platform
Evangelize and educate about new solutions, work across the company to apply the data processing patterns
What will help you succeed
Substantial experience with Java 8+ (preferred), Scala, or Python
Experience with streaming/data processing technologies such as Beam, Spark, Kafka, Airflow, HBase, Presto
Proven experience building enterprise-grade software in a cloud-native environment (GCP or AWS) using cloud services such as GCS/S3, Dataflow/Glue, Dataproc/EMR, Cloud Function/Lambda, BigQuery/Athena, BigTable/Dynamo
Deep technical understanding of software engineering and working with data at scale
Experience in system architecture and design
Experience in stream/data processing technologies like Kafka, Spark, Google BigQuery, Google Dataflow, Presto, HBase
Experience with SQL, particularly performance optimization
Staff Data Engineer - Software and Data Company
To see similar active jobs please follow this link: Remote Development jobs
Truelogic is a leading provider of nearshore staff augmentation services, located in New York. Our team of 500 tech talents is driving digital disruption from Latin America to the top projects in U.S. companies. Truelogic has been helping companies of all sizes to achieve their digital transformation goals.
Would you like to make innovation happen? Have you ever dreamed of building Products that impact millions of users? Nice! Then we have a seat for you on our team!
What are you going to do?
You will have the opportunity to work in a forward-thinking and growth-oriented environment, at a rapidly growing data-driven Go-To-Market software company, we are accelerating the development of our data platform. Our vision is to be the single source of truth for data and enable the rapid creation of large-scale data solutions and applications.
Occupy a unique position in the market, As a Staff Data Engineer in our team you'll have a key role in the design, implementation, and deployment of our Data Platform. The ideal candidate is an experienced software engineer having built large-scale data pipelines or systems using excellent problem-solving skills and know-how of working in very large scales. Our data platform is a nascent initiative and you’ll have the opportunity to affect its direction. You’ll take the lead in bringing in new ideas, testing and validating them quickly and independently, and incorporating them while socializing them with the team.
Design, build and operate highly scalable and flexible systems that can manage and process billions of records a day and support complex and diversified data pipelines
Leverage cloud computing architectures to support development needs
Develop processes and tools to monitor, analyze, maintain, and improve data operation, performance, and usability
Work closely with Data Engineers, Data Analysts, Data Scientists, and Domain Experts to understand their needs for the data platform
Evangelize and educate about new solutions, work across the company to apply the data processing patterns
What will help you succeed
Substantial experience with Java 8+ (preferred), Scala, or Python
Experience with streaming/data processing technologies such as Beam, Spark, Kafka, Airflow, HBase, Presto
Proven experience building enterprise-grade software in a cloud-native environment (GCP or AWS) using cloud services such as GCS/S3, Dataflow/Glue, Dataproc/EMR, Cloud Function/Lambda, BigQuery/Athena, BigTable/Dynamo
Deep technical understanding of software engineering and working with data at scale
Experience in system architecture and design
Experience in stream/data processing technologies like Kafka, Spark, Google BigQuery, Google Dataflow, Presto, HBase
Experience with SQL, particularly performance optimization