Data Engineer

Data Engineer Location : Bangalore/Chennai (1 week in a month) Years of Experience : 5 to 10 Years. Job Description : - 5 years of total IT experience. 5 years of experience as a Data Engineer with large, complex data sources - Experience designing, building and operationalizing large scale enterprise data solutions and applications using AWS data and analytics services in combination with other services/platforms Spark, EMR, RedShift, Kinesis, Kinesis Firehose, Athena, Lambda & AWS Glue - Experience with data pipeline and workflow management tools: Airflow, Step Functions etc - Ability to implement both batch and streaming data pipelines in the AWS and change data capture (CDC) experience - Advanced working SQL knowledge and experience working with relational databases and NOSQL databases. - Experience designing and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Scala. - Experience with infrastructure-as-code tools such as Terraform (preferably) or CloudFormation - Kubernetes experience for developing, deploying, and orchestrating - Micro-services is plus - Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations - Understanding of concepts regarding security, privacy, performance, etc (ref:hirist.tech)

Location: chennai, IN

Posted Date: 5/1/2025