Pyramid Consulting, Inc
Site Reliability Engineer with Hadoop / 100% Remote in Mexico
Job Location
Mexico
Job Description
Job Profile: Site Reliability Engineer with Hadoop Job Type: Full-time based job opportunity Location: 100% Remote in Mexico YOE- 5 yrs Job Description General description SER who manage and administer Cloudera Hadoop CDP Clusters and related big data services, with hands-on experience with Azure Cloud (VMs, ADLS, Key Vault, Vnet) and AWS Cloud (EC2, VPC, S3). Strong knowledge of DevOps tools: Docker, Kubernetes, GitLab and Jenkins. Expertise in implementing Kerberos authentication, user authorization via Ranger/Sentry, and HDFS access control. Experience in performance tuning, security configurations, and troubleshooting. Knowledge of scripting and automation using PowerShell and Bash. Familiarity with ITIL and Agile/Scrum methodologies. Responsibilities SRE: Key Responsibilities: • Manage and administer Cloudera Hadoop CDP clusters in public cloud environments (Azure and AWS). • Handle and maintain Data Hub and Data Lake clusters, ensuring high availability and zero downtime. • Configure and manage critical services, including HDFS, YARN, Spark, Kafka, Impala, Hive, Zookeeper, and Ranger. • Secure clusters by configuring Kerberos authentication, Ranger policies, and Active Directory integration. • Perform cluster maintenance, node commissioning and decommissioning, snapshot creation, and user quota management on HDFS. • Optimize cluster performance by tuning services such as YARN and Hive. • Automate administrative tasks and deployments using Azure DevOps, Docker, Kubernetes, and GitLab. • Resolve user tickets, troubleshoot issues, and document problem resolutions. • Collaborate with application teams for code deployment in production and DR environments. • Monitor and manage the Hadoop cluster health using Cloudera Manager. • Manage job queues, troubleshoot long-running jobs, and ensure efficient cluster resource allocation. • Perform DISK-based cluster-to-cluster data transfers (DISTCP) and other migration tasks. • Execute backup, recovery strategies, and performance monitoring for data-intensive environments. ________________________________________ Preferred Experience: • Knowledge of containerization tools such as Docker and Kubernetes. • Familiarity with monitoring tools like Splunk, Cloudera Manager, and data security best practices. • Strong analytical skills and ability to lead troubleshooting efforts. Key Words Cloudera Hadoop CDP Clusters, Azure Cloud, DevOps Level Main technical skills Proficient Cloudera Hadoop CDP clusters Proficient Azure Cloud Proficient AWS Cloud Proficient DevOps Tools (Docker, Kubernetes, GitLab and Jenkins) Experienced Authentication (Kerberos, user authorization via Ranger/Sentry, and HDFS access control)
Location: Mexico, MX
Posted Date: 8/2/2025
Location: Mexico, MX
Posted Date: 8/2/2025
Contact Information
Contact | Human Resources Pyramid Consulting, Inc |
---|