Big Data Engineer

Job Title: Full Stack Engineer (Big Data) Location: Kraków About the Role You will work as part of a newly established engineering team in Kraków, responsible for the development, enhancement, and support of high-volume data processing systems and OLAP solutions used in global traded risk management. Key Responsibilities Design, develop, test, and deploy scalable IT systems to meet business objectives Build data processing and calculation services integrated with risk analytics components Collaborate with BAs, business users, vendors, and IT teams across regions Integrate with analytical libraries and contribute to overall architecture decisions Apply DevOps and Agile methodologies, focusing on test-driven development Provide production support, manage incidents, and ensure platform stability Contribute to both functional and non-functional aspects of delivery Required Qualifications & Skills Degree in Computer Science, IT, or a related field Fluent in English, with strong communication and problem-solving skills Hands-on experience with big data solutions and distributed systems (e.g., Apache Spark) Strong backend development using Java 11, Python, and Groovy Experience in building REST APIs, microservices, and integrating with API gateways Exposure to public cloud platforms, especially GCP or AWS Familiarity with Spring (Boot, Batch, Cloud), Git, Maven, Unix/Linux Experience with RDBMS (e.g., PostgreSQL) and data orchestration tools (e.g., Apache Airflow) Solid understanding of test automation tools like JUnit, Cucumber, Karate, Rest Assured Desirable Skills Knowledge of financial or traded risk systems Experience with UI/BI tools and streaming solutions OLAP and distributed computation platforms such as ClickHouse, Druid, or Pinot Familiarity with data lakehouse technologies (e.g., Dremio, Trino, Delta Lake, Iceberg) Exposure to technologies like Apache Flink, Beam, Samza, Redis, Hazelcast Containerization and orchestration tools: Docker, Kubernetes Certifications: Scrum Master, PMP, FRM, or CFA Knowledge of RPC frameworks (e.g., gRPC) Sprawdź inne ciekawe oferty pracy na: https://antal.pl/dla-kandydata

Location: Kraków, PL

Posted Date: 7/4/2025