drjobs Senior Data Engineer العربية

Senior Data Engineer

Employer Active

The job posting is outdated and position may be filled
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

others - USA

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Job Description

Responsibilities:

  • Designing and implementing Data Platforms, Data Pipeline(integration) technologies, and Common Data Services using cloud native integration and analytics technologies
  • Creating datasets for Machine learning algorithms and data analysis
  • Work closely and collaboratively with other members of the analytics teams to define requirements, mine and analyze data, integrate data from a variety of sources
  • Design and build low-code/no-code data pipeline frameworks to support large scale ingestions
  • Perform unit and integration testing
  • Perform detail assessments of current state data platforms and drive enhancements and optimization activities
  • Participate in implementation of BI visualizations
  • Design, implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects, including integrating new sources of data into our central data warehouse, and moving data out to applications and affiliates
  • Provide mentoring to junior engineers
  • Optimize data pipelines for large scale data lake implementations
  • Implement Common Data Services (e.g., Data Orchestration using AirFlow, Data Governance capabilities using Collibra) to support reuse across business functions
  • Desired Qualifications:

    Proven experience in the following:

    • Engineering experience in Big Data systems, Data Analytics and Data Integration related fields
    • GCP experience in Cloud Infrastructure, Data Integration, Data Engineering, Cloud Analytics solutions, and experience with operationalizing enterprise scale solutions
    • Architecting and designing data lakes on GCP cloud analytics, BI and Machine learning workloads
    • Middleware technologies, and Data Ingestion technologies like GCP DataFlow, Fusion, and AirFlow
    • Experience with AtScale is preferred
    • Writing complex SQL queries, stored procedures, etc.
    • Agile development skills.
    • CI/CD pipelines such as Concourse, Jenkins and Terraform technologies

    Employment Type

    Full Time

    Company Industry

    About Company

    100 employees
    Report This Job
    Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.