Lead Data Engineer - Python/Hadoop

Role : Data Engineer Lead Description : We are seeking a Data Engineer Lead to join our team in India. In this role, you will be responsible for leading data engineering initiatives, overseeing the development of data pipelines and architectures, and ensuring the quality and security of our data. You will work closely with cross-functional teams to support their data needs and drive insights from our data. Responsibilities : - Lead the design and implementation of data pipelines and architectures for large-scale data processing. - Collaborate with data scientists and analysts to understand data needs and optimize data flow. - Manage and mentor a team of data engineers, providing guidance and support on best practices. - Ensure data quality, security, and governance throughout the data lifecycle. - Evaluate and implement new data technologies and tools to improve efficiency and effectiveness. - Monitor and troubleshoot data pipelines, ensuring high availability and performance. Skills and Qualifications : - 8-10 years of experience in data engineering or a related field. - Strong proficiency in SQL and experience with NoSQL databases such as MongoDB or Cassandra. - Experience with big data technologies like Hadoop, Spark, or Kafka. - Proficiency in programming languages such as Python, Java, or Scala. - Familiarity with cloud platforms such as AWS, Azure, or Google Cloud. - Knowledge of data warehousing solutions and ETL processes. - Strong understanding of data modeling and data architecture principles. (ref:hirist.tech)

Location: in, IN

Posted Date: 5/1/2025