ETL Developer - Python/SQL

We're Hiring : ETL Developer . Are you a skilled professional with experience in SQL, Python (Pandas & SQLAlchemy), and data engineering? We have an exciting opportunity for an ETL Developer to join our team. Job Description : Responsibilities : - Design, develop, and implement ETL processes using a combination of SQL and Python (Pandas, SQLAlchemy). - Write complex and efficient SQL queries to extract and transform data from disparate databases (primarily MS SQL). - Utilize Python libraries (Pandas, SQLAlchemy) to process and manipulate large datasets (2M rows). - Develop and maintain data pipelines to ensure timely and accurate data delivery for reporting and analytics purposes. - Perform thorough SQL tuning to optimize query performance and ensure efficient data processing. - Debug and troubleshoot data-related issues, including code debugging in Python, analyzing logs, and performing root cause analysis (RCA). - Create and maintain databases for development, testing, education, and production environments. - Monitor and support on-call challenges related to ETL processes and data pipelines (3 years of experience required). - Collaborate effectively with data analysts, data scientists, and other stakeholders to understand data requirements and deliver appropriate solutions. - Interpret complex data and provide actionable insights to support business goals. - Ensure adherence to coding standards and best practices. - Work comfortably within an agile environment, participating in sprint planning, daily stand-ups, and other agile ceremonies. - Utilize source control systems such as GitLab and GitHub for code management and collaboration. - Develop and maintain clear and concise technical documentation for ETL processes and data pipelines. - Continuously seek opportunities to improve data quality, efficiency, and reliability. Required Qualifications : - Bachelor's degree in Computer Science or a related field, or equivalent work experience. - 5 years of hands-on experience working with MS SQL, including writing complex queries and performing data manipulation. - 3 years of practical experience with Python, specifically using Pandas and SQLAlchemy for data processing and database interaction. - 3 years of experience in providing support for on-call challenges related to data pipelines or similar systems. Key Skills : - SQL Expertise : Proven expertise (5 years) in running complex SQL queries across multiple disparate databases to integrate data for analytical purposes. - Python Experience : Demonstrated experience (3 years) working with large datasets (2M rows) using Python, particularly with the Pandas and SQLAlchemy libraries. Experience with SSIS or similar ETL tools is also valuable. - SQL Tuning : Proficient in MS SQL performance tuning techniques and possess a solid understanding of SQL query execution plans. - Data Debugging : Solid knowledge of Python (Pandas, SQLAlchemy, and familiarity with Spark is a plus) and proven experience in code debugging, log analysis, and performing root cause analysis (RCA) for data issues. - Agile Experience : Comfortable working in an agile environment and collaborating effectively with cross-functional teams. - Source Control : Familiarity with GitLab, GitHub, or other similar source code repositories for version control and collaboration. - Database Management : Ability to create, maintain, and manage databases in development, testing, education, and production environments. - Data Insights : Demonstrated experience in interpreting complex data sets and providing actionable insights that contribute to business goals. Desired Skills : - Familiarity with Azure cloud platform and Azure Data Factory (ADF). - Understanding of Spark and Scala concepts for large-scale data processing. Process Skills : - Strong analytical and problem-solving skills. - Ability to translate business requirements into technical specifications. - - Excellent organizational and time management skills. - Ability to work independently and as part of a team. (ref:hirist.tech)

Location: delhi, IN

Posted Date: 5/7/2025