Data Engineer

Expected Experience

6+ Years

Technical Skills

6+ years of working experience in data integration and pipeline development.

6+ years with Python/PySpark/Data Bricks

2+ years of Experience with Azure Cloud on data integration with Apache Spark

Strong experience in python development especially in pySpark

Design, develop test, deploy, maintain and improve data integration pipeline.

Python, PySpark, Hive, Hadoop, Java, Tableau

Experience in Python and common python libraries.

Strong analytical experience with databases in writing complex queries, query optimization, debugging, user-defined functions, views, indexes, etc.

Management Skills

Strong communication skills.

Have experience interacting with business stakeholders and customers directly.

Experience in Agile project development methodologies.

Experience with Scaled Agile Framework is a plus.