Job Description:
- Are you interested in guiding key business decisions around one of Clients most significant customers facing teams
- Do you want to build a cuttingedge highly scalable analytics big data platform using AWS technologies such as Redshift RDS S3 EMR Glue ADP Hive Kinesis SNS/SQS and NAWS supported streaming services
- Do you want to collaborate with Business Intelligence Engineers (BIE) and Data Scientists (DS) to build ML/LLM models to support our major customer facing features and initiatives to drive team efficiency
- We are seeking an experienced selfdriven analytical and strategic Sr. Data Engineer.
- In this role you will be working in one of the worlds largest and most complex data warehouse environments.
- You should be passionate about working with huge datasets and be someone who loves to bring data together to answer business questions.
- You should have deep expertise in creation and management of data lake and the proven ability to guide continuous enhancement of data architecture by identifying efficiency gaining solutions and leveraging evolving ne technologies.
- In this role you will have ownership of endtoend development of data engineering solutions to complex questions and youll play an integral role in strategic decisionmaking.
- The right candidate will possess excellent business and communication skills be able to work with business owners to tackle ambiguous business questions with creative data/science solution designs and be able to collaborate with BIEs and DSs to build those solutions or answer business questions.
- You should have a solid understanding of how to build efficient and scalable data infrastructure and data models and have the capability or the desire to learn and implement Elastic MapReduce (EMR)based solutions where appropriate.
Business Group:
About the team
- We consider ourselves a startup team with a big vision and anything is possible mindset when faced with highly ambiguous and complex problems.
- We are a highly collaborative and highenergy team that isnt afraid to swing for the fences or exceed expectations even on tactical projects.
Primary responsibilities
In this role you will have the opportunity to display your skills in the following areas:
- Design implement and support an analytical data infrastructure providing ad hoc access to large datasets and computing power
- Managing AWS resources including EC2 RDS Redshift etc
- Interface with other technology teams to extract transform and load data from a wide variety of data sources using SQL and AWS big data technologies
- Explore and learn the latest AWS technologies to provide new capabilities and increase efficiency
- Collaborate with BIEs to recognize and help adopt best practices in reporting and analysis: data integrity test design analysis validation and documentation
- Collaborate with DS to implement advanced analytics algorithms that exploit our rich data sets for statistical analysis prediction clustering and machine learning
- Help continually improve ongoing reporting and analysis processes automating or simplifying selfservice support for customers
- AWS technologies such as Redshift RDS S3 EMR Glue ADP Hive Kinesis SNS/SQS and NAWS supported streaming services