AWS Glue/Pyspark Developer
Location : Mason/Richmond/Norfolk/Woodland Hills/Thousand Oaks/Atlanta
Need local candidates who can report onsite from Day 1 any of the above locations
Looking for a Strong developer who has :
- Strong Handson in AWS cloud in S3/ATHENA/GLUE/EMR/VPC.
- Creating and Managing Data Pipelines and Streamsets in KAFKA
- 5 yrs of Proven experience as a PySpark Developer or a related role
- Strong programming skills in Scala Spark or Python
- Experience in working with AWS cloud and AWS DocuDB
- Familiarity with big data processing tools and techniques
- Experience with streaming data platforms.
- Excellent analytical and problemsolving skills
- Strong knowledge in Kafka topics and KSQL
- Extensive Unix/FTP/ File Handling
- Strong Handson in No SQL databases like Mongo DB
- Experience with Agile Methodology/JIRA/Confluence
- Handson in Handling all Processors.
Responsibilities:
- Extensive knowledge in understanding Data and creating Data Pipelines.
- Interact with Business to understand the requirement on a daily evolving need and adapt to the needs.
- Handle streaming data platforms .
- Able to handle all the database storage and retrieval mechanisms for the Mongo DB on and extensive experience in handling.
- Able to understand the business requirements tech stack involved and guide the team towards Integral solution approach.
- Provide extensive development support to the Team in achieving the Project Milestones.
- Dedicated and committed approach with excellent communication skills.
- Overall 8 years of IT Development experience
- 5 years of expereince as a PySpark Developer or a related role
- Good experience in AWS AWS Glue Hudi & Kafka
- Experience in working with AWS cloud PostGreSQL and AWS DocuDB
- Familiarity with big data processing tools and techniques
- Experience with streaming data platforms
- Excellent exposure with both relational and nonrelation Databases
- Experience in Nifi will be a plus
- Excellent analytical and problemsolving skills