Data Engineer - ETL/Python

Job Title : Data Engineer- Location : Bangalore, India- Experience: 5-7 Years- Job Summary : We are seeking a skilled - Data Engineer- with - 5-7 years of experience- in designing, building, and maintaining data pipelines. The ideal candidate should have strong expertise in - Python and PySpark- , along with experience working with big data technologies and cloud platforms. Key Responsibilities : - Design, develop, and maintain scalable - ETL/ELT pipelines- for data ingestion and processing. - Work with - PySpark- and - Python- to implement efficient data transformation logic. - Optimize and troubleshoot - big data workflows- for performance and reliability. - Collaborate with - Data Scientists, Analysts, and Business teams- to understand data requirements. - Manage and process large-scale structured and unstructured datasets. - Ensure - data quality, governance, and security- across all data pipelines. - Work with - cloud platforms (AWS/Azure/GCP)- for data storage and processing. - Monitor and improve - database performance, indexing, and query execution- . Required Skills : - Strong hands-on experience with - Python- and - PySpark- . - Proficiency in - SQL- and relational databases. - Experience with - big data frameworks- such as - Apache Spark, Hadoop- . - Familiarity with - cloud-based data services- (AWS, Azure, GCP). - Expertise in - ETL processes- and - data pipeline orchestration- . - Strong problem-solving skills and ability to optimize data workflows. Preferred Skills : - Experience with - workflow orchestration tools- (Airflow, Luigi, etc.). - Knowledge of - NoSQL databases- (MongoDB, Cassandra, etc.). - Exposure to - Kafka, Kinesis, or similar streaming platforms- . - Understanding of - data security and governance best practices- . Educational Qualification : - Bachelor's or Master's degree- in Computer Science, Information Technology, or a related field. Why Join Us ? - Opportunity to work on cutting-edge - big data projects- . - Collaborative and growth-oriented work environment. - Competitive compensation and - career development opportunities- . (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 5/1/2025