Team Lead - Data Engineering

We are hiring for team lead Data Engineer, with 6 years of experience. Key Responsibilities : - Lead the design, development, and optimization of scalable data pipelines using technologies such as Python, SQL, Spark, Scala, and Airflow. - Oversee the management of cloud-based data infrastructure on AWS (S3, Redshift, Athena, Glue, EMR) to ensure high performance and availability. - Drive real-time data streaming initiatives using Kafka and Kinesis, ensuring reliability and low-latency performance. - Mentor and guide team members through code reviews, technical training, and best practices. - Collaborate with cross-functional teams to define requirements, set technical priorities, and ensure timely delivery of data solutions. - Provide on-call support, effectively triage incidents, and ensure rapid resolution. - Lead the adoption of industry best practices in data engineering, data governance, and system performance. - Ensure comprehensive documentation and clear communication across technical teams and stakeholders. - Drive continuous improvement in data quality, system performance, and operational processes. Required Skills & Experience : - 6-10 years of hands-on experience in data engineering with at least 2 years in a leadership capacity. - Proficiency in Scala, Python, Spark, and Airflow for building data pipelines. - Strong expertise in managing AWS data environments (Redshift, S3, Athena, Glue, EMR). - Experience with real-time streaming platforms such as Kafka and Kinesis. - Proven ability to manage on-call support operations and incident resolution. - Excellent communication and leadership skills with the ability to mentor and guide team members. - Strong problem-solving skills and ability to work in a fast-paced Skills : - Advanced knowledge in Java, Vertx, and Spring Boot. - Experience with MySQL, Redshift, and other relational and NoSQL databases. - Exposure to cloud services and DevOps practices. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 5/1/2025