Lead Data Engineer

Role : Data engineering lead

Location : New York City / New Jersey || remote

Skills

8+ years of experience in data engineering with at least 4 years of hands on experience in system integration, data and cloud architecture, and technologies listed in the following section:
Data Engineering: Python, Kafka, Snowflake
Cloud and Containers: Azure (ADLS2, Azure Data bricks), Open shift, Docker
SQL/Database: Microsoft SQL Server, MongoDB, Postgres
API: Node.JS, Apigee
Strong knowledge of algorithms and data structures.

Job Description

Build real-time data pipelines (inbound, outbound) through container-based solutions,
Integrate data with Cloud based platforms, publish data through APIs and Portal
Participate in Data curation requirements and support Data and Digital needs of business and technology stakeholders
Evaluate current state of data access control in regards to authentication, authorization and encryption practices across systems. Develop and support remediation strategy
Work in an agile team of Data Engineers, Developers and RBC business stakeholders.
Collaborate with data scientists, process engineers and business stakeholders on requirement gathering and assist with prescriptive and predictive analytics through consolidated data pipelines