Job Title: Python Data Engineer
Location: Irving, TX(Onsite in 2 months)
Key Skill /Skill Specialization: Python
Mandatory Skills: Python, SQL, PySpark
Desired Skills: ADF, Azure Function,Databricks, C#
Job Description:
Minimum 7 years with Python, SQL and PySpark
5+ years of experience with Spark & Pyspark with Big Data ecosystem tools (e.g. Hadoop, Hive) and data processing within the EDL for big data data pipelines, architectures & data sets
Nice to have experience in Azure Cloud technologies like Azure functions, Azure Apps, Azure Storage, ADF, Databricks
3 years experience with Unit testing using Python
Writing well designed, testable, efficient code
Effective communication skills
Any experience on Azure will be an added advantage.
Proven ability to work as an efficient team member in Agile scrum environment