Data Engineer with Python and Postgres

Direct Client: Gartner

Location: Remote

Start Date: Immediate

Key Skills

Tech Skills

Level

Architect, Develop and maintain tables, views, procedures, functions and packages in Database

MUST HAVE

Performing complex relational databases queries using SQL. (PostgreSQL and Oracle, PostgreSQL is preferred)

MUST HAVE

Develop procedures, packages and scripts for data migration.

Processing large amounts of structured and unstructured data

MUST HAVE

Python ORMs like SQLAlchemy and Python libraries
like Pandas, Scikit-Learn, Numpy, NLTK, Scipy

MUST HAVE

Python programming language

MUST HAVE

Familiar with AWS functions related to ETL (AWS Batch, AWS Glue etc)

GOOD TO HAVE

Agile/Scrum , Communication (Spoken English, clarity of thought)

GOOD TO HAVE

Big Data, Data mining, machine learning and natural language processing

GOOD TO HAVE

Familiarity with CI/CD Pipelines, Jenkins Deployment, Git Repository

GOOD TO HAVE

Data Engineer with Python Developer and Postgres

Implement, Administer, Maintain, and Support Financial applications and related systems core to Client's operational excellence.

Design, Develop, Test, Implement and Maintain critical financial integrations, extensions, and add-ons

Utilize best practices, standard procedures, and techniques to develop and configure applications.

Provide daily operational support for production systems including providing on-call support

Write and maintain clear documentation that describes installation and operating procedures.

Maintain a strong working hands-on knowledge of the programming languages and tools relevant to our systems.

Analyze and interpret business requirements to define and develop technical requirements/specifications.

Participate in technical design, contributing insights and ideas

Successfully troubleshoot application problems independently or in a team setting.

Learn and maintain a strong working knowledge of multiple business areas and the applications that support them

Be able to transform unstructured raw data in to formats suitable for modeling

Be able to work in a globally distributed team in an Agile/Scrum approach

What you'll need:

• Bachelor's or Master's degree in Computer Science, Applied Statistics, or a related field
• Have 5+ years of development experience with Postgres/Oracle Database
• Hands on Python programming with 5+ years of experience

Ensure database architectures address business requirements, system scalability, performance, governance, and reliability.

Lead development of database applications, interfaces, data transfer mechanisms and business intelligence platforms.

Experience building scalable data models and performing complex relational databases queries using SQL (Postgres and Oracle), etc.

Able to integrate multiple data sources and databases into one system

• Hands on Experience in AWS like Amazon S3, Amazon Batch, Amazon Lambda, Amazon Glue.
• processing large amounts of structured and unstructured data
• familiar with version control systems (Git)
• Scrum software development methodology experience is a plus

Good experience in handling errors/exceptions and debugging issues in large scale applications. Knowledge of integration and web services technologies

• Good problem-solving skills
• Familiarity with CI/CD Pipelines, Jenkins Deployment, Git Repository.
• Excellent verbal and written communication skills

Who you are:

• Effective time management skills and ability to meet deadlines
• Excellent communications skills interacting with technical and business audience's
• Ability to work and collaborate with multiple teams spread across diverse geographical locations
• Must possess a willingness and aptitude to embrace new technologies/ideas and master concepts rapidly.
• Intellectual curiosity, passion for technology and keeping up with new trends
• Delivering project work on-time within budget with high quality