Data Engineer

Data warehouse

Job Description: As a Data Engineer at HDB Financial Ltd He/She will be responsible for designing developing and maintaining our data pipelines databases and systems. You will work closely with crossfunctional teams to ensure efficient data flow and support datadriven decisionmaking across the organization. Your main responsibilities will include:

Designing and implementing scalable reliable and efficient data pipelines and ETL processes to collect process and store large volumes of structured and unstructured data from various sources.

Collaborating with data scientists analysts and other stakeholders to understand data requirements and ensure data quality integrity and availability.

Building and optimizing data warehouses data lakes and other storage solutions to support analytics reporting and machine learning initiatives.

Developing and maintaining data infrastructure and tools automating processes and implementing best practices for data management governance and security.

Troubleshooting issues identifying bottlenecks and optimizing performance of data systems to meet business needs and performance goals.

Responsibilities:

• Manage the endtoend implementation of the Data Warehouse/Datalake project ensuring adherence to timelines and quality standards.
• Working closely with the development team to design and implement appropriate data models ETL processes and reporting solutions.

Requirements:

• Bachelors or Masters degree in Computer Science Information Technology or a related field.
• Proven experience (2to6 years) working as a Data Engineer or similar role handling largescale data infrastructure and ETL processes.
• Proficiency in programming languages such as Python Java or SQL for data processing and manipulation.
• Strong knowledge of database technologies (SQL Redshift) data warehousing concepts and big data tools/frameworks (Spark Kafka etc.).
• Excellent communication and interpersonal skills with the ability to convey technical concepts to nontechnical stakeholders.
• Experience with cloud platforms like AWS or Google Cloud and their data services (S3 Redshift etc.).

Location :Mahape

sql,java,s3,datalake,python,aws,spark,databases,redshift,kafka,reporting,google cloud,data lakes,data pipelines,data management,data models,troubleshooting issues,data engineer,data warehouse,data warehouses,data warehousing,machine learning,identifying bottlenecks,etl processes,ensure data quality, integrity,optimizing performance of data systems,developing and maintaining data infrastructure