Senior Data Engineer - Python/Spark

About the Role : We are looking for a highly skilled Senior Data Engineer to join our growing team. The ideal candidate will have over 6 years of experience in building and managing data systems, with expertise in Python, Spark, and Airflow. This role offers an exciting opportunity to work in a product-driven environment and make a significant impact on our data architecture and pipeline. Key Responsibilities : - Design, implement, and maintain scalable data pipelines and systems. - Work with Python, Spark, and Airflow to build robust and reliable data solutions. - Ensure the integrity and governance of code, focusing on best practices for deployment and testing. - Handle database management with hands-on experience in MySQL, PostgreSQL, DynamoDB, and MongoDB. - Collaborate with cross-functional teams to improve cloud-based data architectures, primarily focusing on GCP, AWS, Oracle OCI, and Huawei Cloud. - Implement Change Data Capture (CDC) mechanisms and work on continuous data integration and delivery. - Mentor and guide junior engineers, promoting best practices and knowledge sharing. - Support performance tuning, scalability, and system optimization efforts across the data stack. Key Requirements : - Experience : 6 years with significant hands-on experience in Python, Spark, and Airflow. - Databases : Proficiency in MySQL, PostgreSQL, DynamoDB, and MongoDB. - Cloud : Expertise with at least two of the following : GCP, AWS, Oracle OCI, or Huawei Cloud. - CDC & Code Governance : Strong understanding and implementation of Change Data Capture (CDC) and robust code governance. - Mentorship : Proven experience mentoring junior engineers, ensuring growth and development within the team. - Tenure : Minimum 3 years in the current/previous company to ensure deep technical expertise. Preferred Experience : Candidates from product-based companies with proven impact in their current role. Additional Notes : - The position is strictly office-based with a 5-day work week in Hyderabad. - Candidates must be willing to relocate or already be based in Hyderabad. - Due to previous backouts, we expect committed candidates ready to join promptly. (ref:hirist.tech)

Location: hyderabad, IN

Posted Date: 5/9/2025