Design implement and maintain data pipelines/packages for the EDW by performing extraction transformation and loading activities.
Collaborate with data architects and analysts to understand data needs.
Ensure efficient and scalable data processing and storage.
Monitor the performance of data pipelines.
Troubleshoot and resolve data pipeline issues.
Implement improvements to enhance pipeline reliability and efficiency.
Work with various data sources including databases APIs and streaming data.
Ensure data quality and integrity.
Document data pipeline processes and procedures.
Stay current with the latest data engineering technologies and best practices.
Position Requirements:
Bachelors degree in Computer Science Engineering or a related field preferred. Related Associates degree certification or commiserate job experience also accepted.
3 years of experience in data engineering with a focus on EDW.
Proficiency in programming languages such as Python or Java.
Experience with data processing frameworks like Apache Spark or Hadoop.
Strong understanding of database technologies both SQL and NoSQL.
Experience with cloud platforms such as AWS Google Cloud or Azure preferred.
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.