Site Reliability Engineer

Job Title- Site Reliability Engineer Full Time Remote Job description SRE who manage and administer Cloudera Hadoop CDP Clusters and related big data services, with hands-on experience with Azure Cloud (VMs, ADLS, Key Vault, Vnet) and AWS Cloud (EC2, VPC, S3). Strong knowledge of DevOps tools: Docker, Kubernetes, GitLab and Jenkins. Expertise in implementing Kerberos authentication, user authorization via Ranger/Sentry, and HDFS access control. Experience in performance tuning, security configurations, and troubleshooting. Knowledge of scripting and automation using PowerShell and Bash. Familiarity with ITIL and Agile/Scrum methodologies. Responsibilities SRE: Key Responsibilities: • Manage and administer Cloudera Hadoop CDP clusters in public cloud environments (Azure and AWS). • Handle and maintain Data Hub and Data Lake clusters, ensuring high availability and zero downtime. • Configure and manage critical services, including HDFS, YARN, Spark, Kafka, Impala, Hive, Zookeeper, and Ranger. • Secure clusters by configuring Kerberos authentication, Ranger policies, and Active Directory integration. • Perform cluster maintenance, node commissioning and decommissioning, snapshot creation, and user quota management on HDFS. • Optimize cluster performance by tuning services such as YARN and Hive. • Automate administrative tasks and deployments using Azure DevOps, Docker, Kubernetes, and GitLab. • Resolve user tickets, troubleshoot issues, and document problem resolutions. • Collaborate with application teams for code deployment in production and DR environments. • Monitor and manage the Hadoop cluster health using Cloudera Manager. • Manage job queues, troubleshoot long-running jobs, and ensure efficient cluster resource allocation. • Perform DISK-based cluster-to-cluster data transfers (DISTCP) and other migration tasks. • Execute backup, recovery strategies, and performance monitoring for data-intensive environments.

Location: Mexico, MX

Posted Date: 8/2/2025