DataSoftware Engineer

Job Title: Data/Software Engineer
Job Location: Dallas TX(Remote workable but needs to travel to the client location 3X per year)
Interview: Virtual
Job Duration: 6 Months

Project Overview: The current project involves migrating from Teradata to Redshift. We are seeking a candidate with experience in AWS Glue Hudi and Change Data Capture (CDC).

Key Requirements:

• AWS Glue: Seniorlevel experience in ETL processes using AWS Glue
• Python: Proficiency in Python
• PySpark: Advanced knowledge of PySpark
• AWS S3: Experience with AWS S3
• AWS EventBridge Scheduler SQS and Lambda: Working knowledge of these AWS services
• Apache Hudi: Handson experience with Apache Hudi including at least intermediatelevel expertise in Hudi and CDC
• Change Data Capture (CDC): Advanced knowledge of CDC processes
• Data Loading: Experience in loading data from Apache Hudi to Amazon Redshift

Preferred Qualifications:

• Spark: Knowledge of Spark
• Industry Experience: Experience in the airline industry