Job Description:
We are looking for an experienced and detailoriented Senior Data Engineer to join our team. As a Senior Data Engineer you will play a crucial role in designing implementing and optimizing our data infrastructure ensuring that our systems are effective scalable and maintainable.
Responsibilities
- Data Architecture and Design: Develop and maintain scalable data architectures and pipelines to support data integration processing and analysis.
- Data Integration: Design and implement data ingestion processes from various data sources into our data warehouse.
- ETL/ELT Processes: Build robust ETL/ELT processes using tools like Apache Airflow Talend or similar ensuring data quality and integrity.
- Database Management: Manage and optimize databases ensuring high availability performance and security.
- Data Quality and Governance: Implement data quality checks data profiling and data governance practices to ensure the accuracy and reliability of data.
- Collaboration: Work closely with data scientists analysts and business stakeholders to understand data requirements and translate them into technical solutions.
- Documentation: Create and maintain comprehensive documentation for data processes architectures and best practices.
- Performance Optimization: Optimize and tune data processes for improved performance and scalability.
Requirements
- Experience: Minimum 4 years of experience in a Data Engineering role with a strong understanding of data architecture ETL processes and database management.
- Technical Skills: Proficiency with SQL Python and data engineering tools such as Apache Kafka Apache Spark and Hadoop.
- Database Expertise: Handson experience with relational and nonrelational databases like PostgreSQL MySQL MongoDB etc.
- Cloud Platforms: Experience with cloud platforms such as AWS Google Cloud or Azure including services like Redshift BigQuery or Snowflake.
- Data Warehousing: Expertise in data warehousing concepts and best practices.
- ProblemSolving Skills: Strong analytical and problemsolving skills with the ability to troubleshoot complex data issues.
- Communication: Excellent verbal and written communication skills in English.
- Team Collaboration: Proven ability to work collaboratively in a teamoriented environment.
Preferred Qualifications
- Experience with Docker and Kubernetes for containerization and orchestration.
- Familiarity with machine learning workflows and data science tooling.
- Knowledge of data visualization tools such as Tableau PowerBI or Looker.
If you are a proactive and passionate data engineer with a commitment to excellence we encourage you to apply and join our dynamic team. Together we can build a robust data infrastructure that drives informed business decisions and innovative solutions.
This job has been sourced from an external job board.
More jobs on