Azure Databricks Administrator

About the Role : We are seeking a highly skilled Azure Databricks Administrator to join our growing cloud data platform team. The ideal candidate will have extensive hands-on experience with Azure Databricks, Unity Catalog, Delta Lake, and automation processes. You will play a key role in managing, optimizing, and securing our cloud data platforms to ensure high availability and Responsibilities : - Administer, monitor, and optimize Azure Databricks environments and clusters. - Implement and manage Unity Catalog for secure, centralized data governance across the Databricks workspace. - Oversee and optimize Delta Lake storage layers to ensure efficient data management and performance. - Develop, maintain, and troubleshoot CI/CD pipelines for Databricks deployments. - Automate tasks using Python, Bash, and other scripting languages. - Ensure adherence to enterprise-level security, compliance, and governance frameworks. - Perform troubleshooting and performance tuning of Databricks clusters and related services. - Collaborate with data engineers, data scientists, and platform teams to provide a reliable and efficient data platform. - Prepare documentation, operational guidelines, and provide training to internal teams when necessary. - Stay updated with the latest trends and updates in Azure and Databricks Skills Required : - Cloud Platforms : Strong hands-on experience with Azure Databricks administration. - Databricks Components : Deep knowledge of Unity Catalog, Delta Lake, and Databricks runtime configurations. - Automation & Scripting : Proficiency in Python, Bash, and exposure to tools like Terraform (preferred). - CI/CD Tools : Experience with Azure DevOps, GitHub Actions, or similar pipeline tools. - Security & Governance : Familiarity with Azure RBAC, Key Vaults, data encryption, role-based access control, and compliance standards. - Monitoring & Optimization : Experience with monitoring tools (Azure Monitor, Databricks logs, etc.) and tuning cluster performance. - Version Control Systems : Git, Bitbucket, or equivalent Qualifications : - Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field. - Databricks Certified Associate Developer or Administrator (preferred). - Microsoft Azure certifications (e.g., Azure Administrator, Azure Data Engineer Associate) are a plus. - Strong analytical, problem-solving, and debugging skills. - Excellent communication and interpersonal skills. (ref:hirist.tech)

Location: pune, IN

Posted Date: 5/1/2025