Job Description
We are seeking a passionate handson and experienced Lead Data Engineer to join our Databricks Center of Excellence. You will play a key role in helping customers understand and implement Databricks Lakehouse platform and to achieve their business goals. The candidate will collaborate with client stakeholders on multiple projects in Big Data and business teams. The candidate is expected to lead following workstreams:
- Work with customers to understand their business challenges data needs and accordingly propose data solutions built on Databricks to address them.
- Implement data Lakehouse solutions on the Databricks platform including data pipelines data warehousing and machine learning workflows.
- Work with customers to deploy and manage their Databricks environments using upstream and downstream technologies like Airflow Terraform Tableau etc.
- Provide technical support and guidance to customers during ongoing implementation
- Create and deliver presentations and other materials to educate customers about Databricks.
- Lead and participate in daily standup meetings to continuously assess data needs and deliver those. Hire develop and mentor data engineers and analysts in the team.
Skills:
- Minimum 6 years of experience (6 years a plus) in Data engineering and 2 years of handson experience on Databricks.
- Proficiency in Data modeling and design. Track record in implementing petabyte scale data platforms in Cloud platforms such as AWS/Azure/GCP.
- Handson experience with Modern Data stack tools like Airflow Terraform dbt etc.
- Proficiency in SQL and Data visualization tool like Tableau.
- Professional level Certifications in Databricks and/or AWS/Azure is a plus Skills.
- Strong Problemsolving and conflict resolution ability.
- Strong communication interpersonal and mentoring skills.
- Ability to handle ambiguity and fastpaced environment with ability to lead multiple projects/POCs POCs simultaneously.
- Prior experience in managing Director level stakeholders a plus.
- Ability to understand the technology stack dependencies between applications and how the data flows between them.
- Highly adaptable to change and an excellent team player with the ability to influence and negotiate.
databricks,gcp,data modeling,data engineering,certifications,tableau,interpersonal,stakeholder management,terraform,technology stack understanding,airflow,problem-solving,communication,mentoring,cloud platforms,aws,dbt,project management,sql,azure