BigData Engineer

Requirements

• University Graduate in Computer Science or Related discipline
• 57 years of experience in developing maintaining and supporting Enterprise Class Big Data Applications preferably in banking environments
• Expertise in Big Data technologies/tools/platforms such as Hadoop HDFS Hive Impala HDFS Presto Spark Hive Impala Zeppelin Yarn Cloudera Hortonworks
• Experience in Relational Databases
• Knowledge and experience in coding and performance tuning of Spark jobs. Java Spark preferred but not compulsory
• Establish and adhere to best practices relating to Apache Spark programming
• Responsible for understanding functional/nonfunctional requirements and implement them in Apache Spark
• Experience in usage of CI/CD tools Jenkins Git Bitbucket
• Experience in writing Linux basic Shell Scripts
• Knowledge and experience in Apache Spark batch and streaming framework
• Knowledge of working with different file formats like Parquet ORC AVRO and JSON
• Knowledge of Micro Services architecture
• Knowledge of S3 is added advantage
• Ability to work proactively independently and with crossfunctional and crossregional teams
• Strong communication and analytical skills and experience in Agile projects

Remote Work :

No