Data Engineer

Job Title: Data Engineer Realtime Operations

Location: Houston TX ONSITE REQUIRED MF

Job Overview: Our client is looking for talented data engineering professionals who are passionate about leveraging technology to provide meaningful impact through their work. As part of the clients development teams you will contribute to the development of software solutions that aide in driving efficiencies for drilling completions production and subsurface evaluation activities for a premiere Fortune 200 Oil & Gas company.

This position and program will require the candidate to be onsite at our clients office in downtown Houston TX.

Responsibilities:

Data Management & Integration:

Design and build pipelines to ingest and transport data

Own data quality and reliability for apprelated data pipelines.

Collaborate with data and product teams to deliver robust scalable data solutions.

API Development & Management:

Design and develop secure robust userfriendly APIs for applications and users.

Ensure API performance fault tolerance and comprehensive documentation.

Data Storage & Accessibility:

Build and support databases specific to app usage.

Work with enterprise database teams to make relevant app data available to stakeholders.

Analytics & Monitoring:

Generate business rulebased alerts and notifications for stakeholders.

Develop and support app health monitoring infrastructure to ensure uptime and reliability.

Enhance and maintain the performance of realtime streaming data processes.

Additional Responsibilities:

Understand the oil and gas business domain to translate needs into technical solutions.

Participate in code review processes to ensure code quality and security.

Provide data quality support and maintenance for assigned applications.

Requirements:

Minimum 5 years of experience as a Data Engineer or in a similar role.

Direct exposure to developing scientific or engineering use cases; or degree in a STEM field.

Strong proficiency in Python preferred.

Demonstrated experience in stream processing and realtime data calculations ideally with IoT data.

Proven ability in working with data caching relational databases (RDBMS) and API creation/integration.

Strong problemsolving skills and a proven track record of learning and adapting to new technologies.

Excellent collaboration and communication skills with a keen ability to work effectively within dynamic team environments.

Clients Approach to Technology:

We prioritize finding the right cultural fit and strong technical aptitude with a willingness to learn and adapt. While weve listed technologies based on past implementations we are flexible to similar experience and value candidates who can demonstrate their ability to excel in a dynamic environment.

Understanding of Relational Database Management Systems (RDBMS)

o Oracle SingleStore MySQL or Postgres

Experience with NoSQL Databases

o Redis MongoDB and Elasticsearch

Exposure to Event Log/Message Queuing Systems

o RabbitMQ Pulsar or Kafka

API Development and Integration

o API creation concepts and experience with Python and FastAPI is a benefit

Stream Processing Expertise

o Experience with largescale IoT stream processing using Python for realtime data calculations and transformations (on data volumes exceeding MBs per second) is desirable.

Infrastructure and Deployment Skills

o GitHub Actions Kubernetes Docker Terraform and Azure for deployment and infrastructure management on Linux (CentOS)

If you are interested or have any references please share resume at