Data Engineer Freelance MFMx

Trustpair is reinventing B2B payment security. We are building the leading antifraud solution for large corporations to help them avoid $20 billion in fraud every year. With Trustpair finance teams work with accurate data to avoid the risk of fraud and proceed to payments with peace of mind.

Trustpair at a glance:

• 200 companies preventing B2B payment fraud with Trustpair (Airliquide Generali Kering)
• A financial technology acclaimed by major banking actors (Socit Gnrale Natixis CACIB)
• Enterpriseready platform connected to marketleading financial softwares (SAP Kyriba and more)
• 25M raised in Series B to become #1 SaaS platform for thirdparty risk management
• A team of 100 people based in Europe and NYC

About the role:

As the referent Data Engineer at Trustpair reporting to Cyrille our VP Operations and working closely with our SRE VP Engineering and CTO you will be responsible for leading a significant improvement project (reliability automation infra security). Working on on our existing AWS Data lake youllhelp our stack scale and answer our current and future Data Analytics needs as well asevolving productrelated Data needs.

This is a freelance contract working five days per week. The improvement project will last at least 2 months and may be extended. Upon completion there is the possibilityto adopt a 2 days per week contract to maintain the stack.

This position is open to full remote but candidates must be based in France.

What youll do:

Stack improvement & simplification project

• Our current stack on AWS is: S3 (Lake) DMS (data change capture) Airflow (Orchestrator) DBT Athena (query engine) Glue EMR
• Initial audit:
  • Assess our technical stack with thecurrent use cases in mindand challenge our patterns
  • Document the processes the guidelines and when to use Airflow / DMS / DBT

Reliability

• Address the monitoring and observability of the stack: monitoring / alerting
• Deploy some data drift control mechanisms and realignment processes
• Challenge the staging environment to make it more meaningful before going to prod
  
  

Automation / Ingestion

• For now we have one Data Ingestion pattern by assessing the postgresql wal file and reconstructing images
• Deploy a new Ingestion pattern that could easily integrate within the data lake

Infra / Tech

• Migrate Airflow to Kubernetes with our SRE
• Adapt Airflow configuration to support Google Authenticator
• Challenge our EMR setup

Security

• Challenge Data security (RBAC) within the data lake

Other

• Stack day to day maintenance
• Ingestion of new sources when required to support our analytics projects

Whats in it for you

• A collaborative environment with a flat structure where everyones voice is heard
• Work with innovative and modern technology related to your role which evolves to provide value
• Trustpair is in scaling phase with career opportunities in France and internationally
• Flexible remote policy
• A talented team with senior colleagues you can learn and work with
• Inclusive environment with cultural diversity and parity

Why join Trustpair A list of our perks here!

Must Haves:

• 35 years of experience as a Data Engineer
• Ability to maintain and improve a whole Data Lake and/or Data Warehouse
• Good knowledge on data lake architectures and ingestion patterns
• Understanding on building a production system with performance and reliability drivers
• Professional experience with Python
• Good knowledge of Cloud environments(ideally AWS)
• Experience in Spark Airflowor equivalents
• Good understanding of SQL
• Fluent in English
• Strong problem solving skills
• Ability to work autonomously

Nice to Have:

• Experience in an AWS environment with some of the following technology: EMR Glue S3 Athena
• Experience working with Terraform and Github CI
• Experience working with Apache Hudi or equivalent
• Software Engineering background
• Basic knowledge of dbt

Recruitment Process

• First call with Aicha Talent Acquisition (30 min)
• Experience interviewwith Cyrille VP Operations (30 min)
• Technical test (at home)& interview with our SRE and VP Engineering (1h)
  
• Coffee fit with two members of Trustpair & one of our Cofounders (1h)

Equal Opportunity Statement
Trustpairs policy is to provide equal employment opportunity in all of our employment practices without regard to race color religion sex national origin ancestry marital status protected veteran status age individuals with disabilities sexual orientation or gender identity or expression or any other legally protected category.
Applicants for all positions in Trustpair must be legally authorized to work in the country which they are applying for or be a citizen from Schengen / EU zone. The verification of employment eligibility will be required as a condition of hire.