Data Engineer - ETL/Python

Job Title : Data Engineer Experience : 4 to 10 Years Location : Bangalore Notice Period : Immediate to 15 Days Position Type : Full Time Job Summary : We are looking for a Data Engineer with expertise in Python, PySpark, and AWS to join our dynamic team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and solutions. You will work closely with cross-functional teams to develop data-driven solutions that support business objectives. Key Responsibilities : - Design, develop, and optimize data pipelines using Python and PySpark. - Implement and manage big data processing solutions on AWS (S3, Glue, EMR, Redshift, Lambda, etc.). - Work with structured and unstructured data from multiple sources and ensure data quality. - Develop ETL processes and data integration solutions to enable analytics and reporting. - Collaborate with data scientists, analysts, and business teams to provide clean and reliable data. - Ensure scalability, reliability, and efficiency of data infrastructure. - Monitor, troubleshoot, and optimize data workflows for performance and cost-effectiveness. - Implement best practices for data governance, security, and compliance. Required Skills & Qualifications : - Strong programming skills in Python and experience with PySpark. - Hands-on experience with AWS services (S3, Glue, EMR, Lambda, Redshift, etc.). - Experience in Big Data technologies and processing large-scale datasets. - Solid understanding of SQL and database management (Redshift, Snowflake, or similar). - Experience in ETL development and data transformation techniques. - Knowledge of data modeling, warehousing, and data lake architectures. - Familiarity with workflow orchestration tools like Apache Airflow is a plus. - Strong problem-solving and analytical skills. - Ability to work independently and as part of a collaborative team. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 5/9/2025