Data Engineer

As a Data Engineer you will be the central architect for backend development projects ensuring a comprehensive understanding of all technical aspects while collaborating closely with our Lead Engineer and CTO. This role offers a unique opportunity to engage directly with highperforming clients solving critical challenges with a financial impact in the tens of millions of dollars. You will drive initiatives that enhance efficiency leverage underutilized data and enable our clients to adopt AI in innovative ways previously unattainable.While you will gain exposure to transformative AI projects your primary focus will be on developing systems that facilitate the integration of these technologies.

Key Responsibilities

Develop and maintain efficient data pipelines addressing data challenges such as inconsistency quality issues and complex transformations.

Clean and process diverse data sets including internal client data and data from external providers.

Collaborate with the lead engineer and CTO to understand pipeline structure and data processing requirements.

Integrate predictive analytics into data pipelines autonomously and collaboratively.

Prepare and format data for reporting purposes.

Utilize GCP services such as Cloud Storage and Compute Engine.

Develop comprehensive testing strategies to ensure data integrity and pipeline functionality.

Collaborate closely with the Project Manager to design and execute development sprints drive iterative progress and effectively integrate client feedback into ongoing projects.

Lead technical project development with a high degree of autonomy owning key work streams and ensuring successful delivery

Required Qualifications

25 years of relevant experience.

Bachelors degree in Computer Science or a related field.

Proficiency in Python and its datarelated libraries (Pandas NumPy SciPy).

Familiarity with the use of NLP to set up experiments however deep understanding of how these models work is not required.

Experience working with major cloud platforms GCP a plus.

Experience with version control using Git.

Strong attention to processing integrity and accuracy.

Excellent communication skills.

Effective problemsolving abilities using best practices in product testing.

Demonstrated ability to work independently and collaboratively.

High attention to detail particularly with data security best practices.

No phone calls or third parties. Candidates must be United States citizens or legal permanent residents. Proof of legal residence and work authorization in the United States is required.

Remote Work :

No