Technically strong Data Engineer Python ETL APIs

Dark Light is seeking a skilled Data Engineer for an exciting opportunity with one of our esteemed clients. At Dark Light we connect talented professionals with leading companies offering you the chance to work on innovative projects and grow your career.

Tasks

As a Data Engineer you will be responsible for developing and implementing new functionalities on our clients data platform and building robust data pipelines.

You will collaborate closely with other data engineers a functional analyst solution architect technical architect and QA engineer within an agile team.

Your daily activities will primarily include programming delivering functional code consulting with colleagues validating solutions reviewing peer code addressing operational issues writing documentation and evaluating user stories.

Requirements

Technical Skills:

• Proficiency in Python
• Experience with NIFI or other ELT tools
• Familiarity with Airflow or similar orchestration tools
• Knowledge of API builders like FastAPI or Flask
• Bonus Skills: Spark PySpark Cloudera Data Platform Spark Streaming Kafka JDK languages (Java Scala Groovy) JavaScript (Angular D3) event processing JSON Apache AVRO & Parquet Apache Iceberg Apache Impala Vault Speed SingleStore data warehousing concepts data vault lakehouse architecture

Communication and Practical Skills:

• Ability to adjust communication style and tone to the audience
• Capability to process and apply best practices and guidelines in your development
• Independence in handling and completing tickets to deliver working code
• Proven experience in writing data pipelines and developing functionality for a data platform
• Integrity and courage in an open feedback culture

Agile and Scrum:

• Agile mindset and familiarity with agile principles
• Experience with Scrum methodology

Benefits

• Attractive Compensation: We offer competitive compensation packages that reflect your skills and experience. Our agency applies a minimal markup guaranteeing a great deal for you and the client.
• Opportunity to work with a dynamic and collaborative team
• Access to innovative projects and latest technologies
• Professional development and growth opportunities
• Supportive work environment with a focus on worklife balance

If you are interested in this opportunity wed love to hear from you!