Czym będziesz się zajmować? Design, implement, and maintain large-scale distributed data processing systems using Hadoop, Spark, and related technologiesDevelop scalable and efficient data pipelines using Scala, Spark, Hive, and SQLWork with Google Cloud Platform (GCP) services for data ingestion, transformation, storage, and orchestrationMigrate and process data using GCP tools such as BigQuery, Dataflow, Dataproc, Cloud Storage, Pub/Sub, and Composer (Airflow).Collaborate with architects and development teams to define technically sound and scalable solution designs.Debug and troubleshoot data processing and code-related issues; communicate findings with the development teamCreate automated data workflows using tools like Airflow and Jenkins as part of CI/CD pipelines.Ensure proper version control, testing (unit/integration), and deployment practices in accordance with DevOps methodologies.Communicate effectively with business stakeholders and contribute to a collaborative team environmentWork in Agile methodologies (Scrum/Kanban) and participate in planning, stand-ups, and retrospectives

Kogo poszukujemy? Strong experience with the Hadoop ecosystem: Hadoop, HDFS, HiveProficiency in Apache Spark and ScalaAdvanced SQL skillsExperience with Google Cloud Platform (GCP), especially: BigQueryCloud DataflowCloud DataprocCloud StoragePub/SubCloud Composer & AirflowFamiliarity with CI/CD tools such as Jenkins and Git/GitHubExperience with Airflow or similar orchestration toolsUnderstanding of big data architecture and data modeling techniques (both relational and non-relational)Experience in designing and deploying scalable data solutionsStrong debugging and code review skillsExposure to Enterprise Data Warehousing conceptsExperience with DevOps practices and tools (Ansible, JIRA)Knowledge of Agile frameworks (Scrum, Kanban)