Sr Data Engineer - ONSITE

Certification(s) Required : DATABRICKS CERTIFIED PROFESSIONAL DATA ENGINEER AWS CERTIFIED BIG DATA SPECIALTY

Sr. Data Engineer

***5 days onsite in Boston MA

Job summary

Experience : 10to14Yrs

Required Skills : Databricks/Spark/Scala PythonSpark in Scala DatabricksDatabricks Delta LakeDatabricks SQL

Certification(s) Required : DATABRICKS CERTIFIED PROFESSIONAL DATA ENGINEER AWS CERTIFIED BIG DATA SPECIALTY

We are seeking a highly skilled Sr. Data Engineer with 10 to 14 years of experience to join our team as a Business Associate BC.

The ideal candidate will have extensive experience in Databricks Databricks Delta Lake and Databricks SQL with additional skills in Spark in Scala and Python being a plus.

This role will involve designing and implementing data solutions that drive business success and innovation.

Roles & Responsibilities

Lead the design and implementation of data solutions using Databricks ensuring high performance and scalability

Oversee the integration of Databricks Delta Lake to manage and optimize large datasets

Provide expertise in Databricks SQL to develop complex queries and data models

Collaborate with crossfunctional teams to understand business requirements and translate them into technical solutions

Ensure data solutions are aligned with business goals and objectives driving efficiency and innovation

Develop and maintain documentation for data architectures solutions and processes

Monitor and optimize data pipelines to ensure data quality and reliability

Implement best practices for data governance and security ensuring compliance with industry standards

Mentor and guide junior team members fostering a culture of continuous learning and improvement

Conduct regular code reviews to ensure highquality code and adherence to best practices

Stay updated with the latest trends and advancements in data technologies incorporating them into the teams work

Provide technical support and troubleshooting for datarelated issues ensuring minimal downtime

Collaborate with stakeholders to identify opportunities for datadriven improvements and innovations

Qualifications

Possess extensive experience in Databricks Databricks Delta Lake and Databricks SQL

Have a strong understanding of data architecture and data engineering principles

Demonstrate proficiency in developing and optimizing data pipelines

Show expertise in data governance and security best practices

Exhibit strong problemsolving skills and the ability to troubleshoot complex data issues

Have experience in mentoring and guiding junior team members

Display excellent communication skills with the ability to convey technical concepts to nontechnical stakeholders

Be familiar with Spark in Scala and Python with handson experience being a plus

Certification(s) Required : DATABRICKS CERTIFIED PROFESSIONAL DATA ENGINEER, AWS CERTIFIED BIG DATA - SPECIALTY Sr. Data Engineer ***5 days onsite in Boston MA Job summary Experience : 10to14Yrs Required Skills : Databricks/Spark/Scala, Python,Spark in Scala, Databricks,Databricks Delta Lake,Databricks SQL Certification(s) Required : DATABRICKS CERTIFIED PROFESSIONAL DATA ENGINEER, AWS CERTIFIED BIG DATA - SPECIALTY We are seeking a highly skilled Sr. Data Engineer with 10 to 14 years of experience to join our team as a Business Associate - BC. The ideal candidate will have extensive experience in Databricks, Databricks Delta Lake, and Databricks SQL, with additional skills in Spark in Scala and Python being a plus. This role will involve designing and implementing data solutions that drive business success and innovation.