Czym będziesz się zajmować? Design, develop, and optimize data engineering processes.Create and maintain robust data pipelines covering generation, ingestion, transformation, and serving of data.Work on new and existing banking applications with a global reach.Participate in digital transformation and system migration to the cloud.Collaborate with data analytics, ML, and DevOps teams

Kogo poszukujemy? Excellent understanding of the data engineering lifecycle.Experience in building and maintaining data pipelines.Proficiency in Python and Pyspark, along with knowledge of the Python ecosystem.Expertise in Hadoop (especially Cloudera) and Big Data technologies: HDFS, HIVE, Spark, Databricks.Experience working with cloud services (AWS, Azure, GCP – GCP preferred).Experience in migrating on-premise solutions to the cloud is a plus.Knowledge of technologies such as Airflow, Kafka, Apache Flink, Apache Beam, Google PubSub, Google Data Flow.Strong understanding of data modeling, data warehousing principles, and data formats (Parquet, ORC, Avro).Excellent SQL skills and understanding of SQL vs. NoSQL differences.Understanding of ETL/ELT processes and best practices in data engineering.Familiarity with DevOps tools, including containerization (Docker, Kubernetes) and CI/CD (Jenkins, CircleCI, GitHub Actions).Experience managing code using version control systems (Git).Experience with MLOps and maintaining Machine Learning models in production is a plus.