Note: Need a Strong Scala Developer with Spark and AWS
Role: Scala Developer with Spark and AWS
Location: South Carolina
Mode: hybrid 2 days a week
Position Summary: We are seeking a highly skilled Scala Developer with extensive experience in Spark and AWS to design develop and maintain highperformance data processing systems. The ideal candidate will have a strong background in big data technologies and cloud computing with a passion for building scalable and efficient data solutions.
Key Responsibilities:
- Design develop and maintain scalable data processing applications using Scala and Apache Spark.
- Collaborate with crossfunctional teams to define design and deliver new features and enhancements.
- Develop and implement data pipelines on AWS leveraging services such as S3 EMR Lambda and Redshift.
- Optimize and tune Spark applications for performance and scalability.
- Write clean maintainable and welldocumented code.
- Troubleshoot and resolve issues related to data processing and application performance.
- Participate in code reviews and provide constructive feedback to team members.
- Stay uptodate with the latest industry trends and technologies in big data and cloud computing.
Required Qualifications:
- 6 years of experience in software development with a focus on Scala and Spark.
- Proven experience with AWS services such as S3 EMR Lambda Redshift etc.
- Strong understanding of distributed computing principles and big data technologies.
- Experience with data processing frameworks and tools (e.g. Hadoop Hive Kafka).
- Proficiency in SQL and experience with relational and NoSQL databases.
- Excellent problemsolving skills and the ability to work independently or as part of a team.
Preferred Qualifications:
- Masters degree in Computer Science Engineering or a related field.
- Experience with containerization and orchestration tools such as Docker and Kubernetes.
- Familiarity with CI/CD pipelines and DevOps practices.
- Experience with machine learning frameworks and libraries.
- Knowledge of other programming languages such as Python or Java.