PySpark Developer

JD for Pyspart dev:
• Experience:
• 2 years hands on experience as a PySpark Developer with a strong track record in developing and optimizing PySpark applications.
• Experience with SQL and relational databases including writing and optimizing complex SQL queries.
• Technical Skills:
• Proficiency in PySpark including handson experience with Spark SQL DataFrames RDDs and Spark Streaming.
• Solid understanding of SQL and relational database management.
• Familiarity with big data platforms such as Hadoop Hive or AWS EMR is a plus.
• Soft Skills:
• Strong problemsolving and analytical abilities.
• Excellent communication skills with the ability to convey complex technical information clearly.
• Ability to work independently and collaboratively in a fastpaced environment.