Senior Data Engineer

Join an international media and broadcasting organization as a Senior Data Engineer. You will design, optimize, and maintain enterprise-grade cloud data platforms, building robust ETL/ELT pipelines capable of processing massive data volumes. This role demands a strong focus on Data Quality and the engineering rigor required to manage complex data ecosystems spanning both AWS and Google Cloud environments.

Details

Start Date: ASAP

Duration: Long-term

Working Hours:  preferably 9:00–17:00

Rate: 130–160 PLN/hour

Responsibilities

• Pipeline Engineering: Build, optimize, and maintain scalable cloud-native data pipelines (ETL/ELT) using PySpark and SQL.

• Cloud & Platform Infrastructure: Develop and maintain data solutions across distributed cloud environments (AWS, GCP, and Databricks).

• Data Quality & Testing: Ensure high-fidelity data processing with a strict focus on Data Quality, backed by comprehensive unit and integration testing.

• Automation & CI/CD: Automate deployment pipelines and manage infrastructure as code.

• Cross-functional Collaboration: Partner with both technical and business stakeholders in an international, distributed team setup.

Requirements

• Core Languages: Deep, senior-level mastery of PySpark and SQL.

• Cloud & Orchestration Ecosystem:

  • AWS: AWS CDK, AWS Lambda.

  • GCP: Google Cloud Platform, Google App Engine, BigQuery, Dataproc.

  • Data Platforms: Databricks, Airflow.

  • Infrastructure as Code: Terraform.

• CI/CD Tools: GitHub Actions, Jenkins.

• Quality Assurance: Proven experience in Data Quality frameworks alongside Unit and Integration Testing methodologies.

• Soft Skills & Languages: Exceptional communication skills for international project delivery; English minimum B2+ (for daily communication).