Senior Data Engineer - Databricks

Zencore is a fast-growing company founded by former Google Cloud leaders, architects, and engineers. We are seeking candidates with significant experience in Google Cloud to join our team. Our engagements aim to eliminate obstacles, reduce risk, and accelerate timelines for customers transitioning to Google and seeking assistance with data and application modernization. We embed within customer teams to provide strategic guidance, facilitate technology decisions, and execute projects in a collaborative, co-development style.

What you will do...

As a member of our Data Engineering team, you will be working with fast paced innovative companies, leveraging Databricks as the key driver of their transformation. They will look at you as their trusted advisor, someone they can rely on and who will be there to help them along their journey on Databricks. You will be expected to cover a large spectrum of technology topics like ETL/ELT, Data Warehousing, Distributed Data Processing, Streaming Data systems, Data Modeling, Data Security & Governance, and BI/AI.

Who we need...

• 5+ years of experience serving in a data engineering capacity

• 2+ years of experience working with DatabricksPreferred candidates will have the Databricks’ Data Engineer Associate or Data Engineer Professional certification

• Familiarity with the Databricks tech stack related to data engineering: notebooks, clusters, jobs, workflows, serverless sql, unity catalog, repos, dashboards, DLT,etc.

• Experience developing production Spark applicationsStrong skills with Python, PySpark and Spark SQL

• Strong understanding of Delta Lake technology and best practices to apply its capabilities during the data pipeline development lifecycle

• Experience with Spark Structured Streaming and Databricks Delta Live Tables (DLT)

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases

Why work here...

• We are professionals you can Trust. Our people have the extensive experience to get the job done 

• We share unbiased opinions and are comfortable with the hard truths. You are the subject matter experts for our customers. 

• We are the Missing Link. You will connect our customers to Google and move quickly when others can’t

• We remove uncertainty and risk by clearly outlining the process of cloud migration for our customers

• We accelerate timelines and do not dwell on a challenge. You’ll move faster and expose “unknown unknowns” for our customers 

• We show empathy. Our customers believe in us because we can relate to their complexities.

How to succeed...

• First rule at Zencore - Be Kind 

• Own the process - own your customer’s success by proactive practices 

• Work hard to reach the destination, but make sure to enjoy the journey 

• Champion a consistent collaborative culture 

• Be receptive to Feedback

• Challenge the Status Quo

We are a fully remote company and offer competitive compensation and benefits.

Zencore is committed to a diverse and inclusive workplace. Zencore is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.