Databricks Administrator with Cloud Administration expertise - HYBRID

We need local candidates or candidates from Near by states.

Santa Clara CA Hybrid Onsite

We are looking for a Databricks Administrator with Cloud Administration expertise inside and out.

Exp 12 years

Client is Cognizant

Responsibilities

• The candidate will work on building scaling and monitoring highly complex BigData platform on Databricks Snowflake DB and ElasticSearch cloud.
  
• The candidate will work on building scaling and monitoring Data science and ML hosting platform based on Databricks.
  
• The candidate will be responsible for defining and implementing our Data platform Data science workbench with ML hosting technology strategies in the Cloud.
  
• The candidate will also involve to design our architecture and define our roadmap.
  
• The candidate will be responsible to implement monitoring alerting and observability solutions using CSP standard monitoring and analytical tools and also 3^rd party tools like Zabbix and Datadog SaaS.
  
• The candidate has to be an expert in Docker and Cloud based containerization technologies.
  
• The candidate will also be responsible for building and improving our CI/CD pipelines and keeping themselves and their team uptodate with the latest industry trends and technologies.
  
• Develop automation scripts in Terraform YAML Helm charts az cli awscli Powershell and other cloud APIs.
  
• Participate in developer interaction calls and help.
  
• Participate in Management update calls and provide precise timely updates.
  

Skillset:

• Operations or systems administration experience particularly on Linux.
  
• Handson administration experience from setting up the Databricks environment to successfully administering it.
  
• Experience as the Databricks account owner managing workspaces Unity Catalog audit logs and highlevel usage monitoring
  
• Experience as Databricks workspace admin managing workspace users and groups including single signon provisioning access control and workspace storage.
  
• Experience Databricks administration configuring and installing libraries
  
• Experience managing storage accounts access across a large user base
  
• Experience managing cluster and jobs policies templates pools configuration options
  
• Experience with Databricks security and privacy setup
  
• Experience troubleshooting end user and platformlevel issues
  
• Experience optimizing usage for performance and cost preferred
  
• Experience in strategizing and implementing Disaster recovery for BigData platforms based on Databricks.
  
• Ability to multitask and reprioritize tasking on the fly according to the needs of a growing platform and its stakeholders
  
• Strong coding skills in SQL and Python (PySpark) with experience optimizing code
  
• Assist in N/W Data security IAM initiatives. Work with n/w team to create PEs troubleshoot network issues etc.