AWS GluePyspark Developer

AWS Glue/Pyspark Developer

Location : Mason/Richmond/Norfolk/Woodland Hills/Thousand Oaks/Atlanta

Need local candidates who can report onsite from Day 1 any of the above locations

Looking for a Strong developer who has :

1. Strong Handson in AWS cloud in S3/ATHENA/GLUE/EMR/VPC.
2. Creating and Managing Data Pipelines and Streamsets in KAFKA
3. 5 yrs of Proven experience as a PySpark Developer or a related role
4. Strong programming skills in Scala Spark or Python
5. Experience in working with AWS cloud and AWS DocuDB
6. Familiarity with big data processing tools and techniques
7. Experience with streaming data platforms.
8. Excellent analytical and problemsolving skills
9. Strong knowledge in Kafka topics and KSQL
10. Extensive Unix/FTP/ File Handling
11. Strong Handson in No SQL databases like Mongo DB
12. Experience with Agile Methodology/JIRA/Confluence
13. Handson in Handling all Processors.

Responsibilities:

1. Extensive knowledge in understanding Data and creating Data Pipelines.
2. Interact with Business to understand the requirement on a daily evolving need and adapt to the needs.
3. Handle streaming data platforms .
4. Able to handle all the database storage and retrieval mechanisms for the Mongo DB on and extensive experience in handling.
5. Able to understand the business requirements tech stack involved and guide the team towards Integral solution approach.
6. Provide extensive development support to the Team in achieving the Project Milestones.
7. Dedicated and committed approach with excellent communication skills.
8. Overall 8 years of IT Development experience
9. 5 years of expereince as a PySpark Developer or a related role
10. Good experience in AWS AWS Glue Hudi & Kafka
11. Experience in working with AWS cloud PostGreSQL and AWS DocuDB
12. Familiarity with big data processing tools and techniques
13. Experience with streaming data platforms
14. Excellent exposure with both relational and nonrelation Databases
15. Experience in Nifi will be a plus
16. Excellent analytical and problemsolving skills