Big Data Engineer

Job Title: Full Stack Engineer (Big Data)

Location: Kraków

About the Role

You will work as part of a newly established engineering team in Kraków, responsible for the development, enhancement, and support of high-volume data processing systems and OLAP solutions used in global traded risk management.

Key Responsibilities

• Design, develop, test, and deploy scalable IT systems to meet business objectives
• Build data processing and calculation services integrated with risk analytics components
• Collaborate with BAs, business users, vendors, and IT teams across regions
• Integrate with analytical libraries and contribute to overall architecture decisions
• Apply DevOps and Agile methodologies, focusing on test-driven development
• Provide production support, manage incidents, and ensure platform stability
• Contribute to both functional and non-functional aspects of delivery

Required Qualifications & Skills

• Degree in Computer Science, IT, or a related field
• Fluent in English, with strong communication and problem-solving skills
• Hands-on experience with big data solutions and distributed systems (e.g., Apache Spark)
• Strong backend development using Java 11+, Python, and Groovy
• Experience in building REST APIs, microservices, and integrating with API gateways
• Exposure to public cloud platforms, especially GCP or AWS
• Familiarity with Spring (Boot, Batch, Cloud), Git, Maven, Unix/Linux
• Experience with RDBMS (e.g., PostgreSQL) and data orchestration tools (e.g., Apache Airflow)
• Solid understanding of test automation tools like JUnit, Cucumber, Karate, Rest Assured

Desirable Skills

• Knowledge of financial or traded risk systems
• Experience with UI/BI tools and streaming solutions
• OLAP and distributed computation platforms such as ClickHouse, Druid, or Pinot
• Familiarity with data lakehouse technologies (e.g., Dremio, Trino, Delta Lake, Iceberg)
• Exposure to technologies like Apache Flink, Beam, Samza, Redis, Hazelcast
• Containerization and orchestration tools: Docker, Kubernetes
• Certifications: Scrum Master, PMP, FRM, or CFA
• Knowledge of RPC frameworks (e.g., gRPC)

Sprawdź inne ciekawe oferty pracy na: https://antal.pl/dla-kandydata