Data Engineer III/IV -G
Data Engineer III/ IV - IN (Operation/ Supports)
Work Location - Remote
Shift: Rotation Shifts
Experience: 10 years
Job Description
Summary
The Data engineer is responsible for managing and operating upon Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau. The engineer will work closely with the customer and team to manage and operate cloud data platform.
Job Description
Leads Level 4 operational coverage: Resolving pipeline issues / Proactive monitoring for sensitive batches / RCA and retrospection of issues and documenting defects.
Design, build, test and deploy fixes to non-production environment for Customer testing. Work with Customer to deploy fixes on production upon receiving Customer acceptance of fix.
Cost / Performance optimization and Audit / Security including any associated infrastructure changes
Troubleshooting incident/problem, includes collecting logs, cross-checking against known issues, investigate common root causes (for example failed batches, infra related items such as connectivity to source, network issues etc.)
Knowledge Management: Create/update runbooks as needed .
Governance: Watch all the configuration changes to batches and infrastructure (cloud platform) along with mapping it with proper documentation and aligning resources.
Communication: Lead and act as a POC for customer from off-site, handling communication, escalation, isolating issues and coordinating with off-site resources while level setting expectation across stakeholders
Change Management: Align resources for on-demand changes and coordinate with stakeholders as required
Request Management: Handle user requests – if the request is not runbook-based create a new KB or update runbook accordingly
Incident Management and Problem Management, Root cause Analysis, coming up with preventive measures and recommendations such as enhancing monitoring or systematic changes as needed.
Skill
Good hands-on Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau
Ability to read and write sql and stored procedures.
Good hands-on experience in configuring, managing and troubleshooting along with general analytical and problem-solving skills.
Excellent written and verbal communication skills.
Ability to communicate technical info and ideas so others will understand. Ability to successfully work and promote inclusiveness in small groups.
Experience/Education
Requires a Bachelor’s degree in computer science or other related field plus 10+ years of hands-on experience in configuring and managing AWS/tableau and databricks solutions.
Experience with Databricks and tableau environment is desired.
JOb Complexity
This role requires extensive problem-solving skills and the ability to research an issue, determine the root cause, and implement the resolution;
research of various sources such as databricks/AWS/tableau documentation that may be required to identify and resolve issues.
Must have the ability to prioritize issues and multi-task.
Data Engineer III/IV -G
Data Engineer III/ IV - IN (Operation/ Supports)
Work Location - Remote
Shift: Rotation Shifts
Experience: 10 years
Job Description
Summary
The Data engineer is responsible for managing and operating upon Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau. The engineer will work closely with the customer and team to manage and operate cloud data platform.
Job Description
Leads Level 4 operational coverage: Resolving pipeline issues / Proactive monitoring for sensitive batches / RCA and retrospection of issues and documenting defects.
Design, build, test and deploy fixes to non-production environment for Customer testing. Work with Customer to deploy fixes on production upon receiving Customer acceptance of fix.
Cost / Performance optimization and Audit / Security including any associated infrastructure changes
Troubleshooting incident/problem, includes collecting logs, cross-checking against known issues, investigate common root causes (for example failed batches, infra related items such as connectivity to source, network issues etc.)
Knowledge Management: Create/update runbooks as needed .
Governance: Watch all the configuration changes to batches and infrastructure (cloud platform) along with mapping it with proper documentation and aligning resources.
Communication: Lead and act as a POC for customer from off-site, handling communication, escalation, isolating issues and coordinating with off-site resources while level setting expectation across stakeholders
Change Management: Align resources for on-demand changes and coordinate with stakeholders as required
Request Management: Handle user requests – if the request is not runbook-based create a new KB or update runbook accordingly
Incident Management and Problem Management, Root cause Analysis, coming up with preventive measures and recommendations such as enhancing monitoring or systematic changes as needed.
Skill
Good hands-on Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau
Ability to read and write sql and stored procedures.
Good hands-on experience in configuring, managing and troubleshooting along with general analytical and problem-solving skills.
Excellent written and verbal communication skills.
Ability to communicate technical info and ideas so others will understand. Ability to successfully work and promote inclusiveness in small groups.
Experience/Education
Requires a Bachelor’s degree in computer science or other related field plus 10+ years of hands-on experience in configuring and managing AWS/tableau and databricks solutions.
Experience with Databricks and tableau environment is desired.
JOb Complexity
This role requires extensive problem-solving skills and the ability to research an issue, determine the root cause, and implement the resolution;
research of various sources such as databricks/AWS/tableau documentation that may be required to identify and resolve issues.
Must have the ability to prioritize issues and multi-task.