Aplikuj teraz

Senior Data AWS Engineer

Bayer

Warszawa
20000 - 28500 PLN
Praca stała
☁️ AWS
Praca stała

Must have

  • AWS

  • Data engineering

  • Glue

  • Athena

  • AWS S3

  • AWS Lambda

  • Amazon RDS

  • Python

  • PySpark

  • ETL

  • Apache Spark

  • Data Lake

  • Infrastructure as Code

  • DevOps

  • English

Nice to have

  • GitHub

  • NoSQL

  • CD pipeline

  • Kafka

Requirements description

  •        5+ years of experience in data engineering on AWS

  •        Strong knowledge of AWS data stack: Glue, Athena, Lake Formation, S3, Step Functions, Lambda, RDS etc.

  •        Proficient in Python for scripting, automation and data manipulation tasks

  •        Experience with PySpark for building scalable, distributed ETL/ELT pipelines using Apache Spark (especially within AWS Glue)

  •        Experience designing enterprise data lakes and data mesh architecture

  •        Experience in structuring and modelling data in both relational and non-relational forms

  •        Ability to elaborate and propose relational/non-relational approach

  •        Advanced knowledge of databases, including query optimization, relational and non-relational schema design

  •        Expertise in data storage technologies, including files, relational databases, NoSQL and various data types (structured, unstructured, metrics, logs)

  •        Deep understanding of data governance, lineage and metadata management

  •        Experience in implementing data quality frameworks, validation checks and monitoring to ensure reliability of data

  •        Hands-on experience with real-time data streaming technologies and patterns (e.g. Kinesis, Kafka, or similar) for event-driven architectures

  •        Solid awareness of DevSecOps practices, including automation of CI/CD pipelines (GitHub Actions or similar), infrastructure as code (Terraform), IAM roles, encryption, SAST/SCA tools integration, auditability

  •        Leadership and team coordination skills - ability to lead distributed teams

  •        AWS Certified Data Engineer - Associate, additional certifications such as AWS Certified DevOps Engineer, AWS Certified Solutions Architect or AWS Certified Developer are a plus

  •        Fluent in English (written and spoken)

Offer description

For Digital Hub Warsaw, we are looking for:

Senior Data AWS Engineer

Participate in a global, strategic project in the Bayer Consumer Health division that will influence data in our business and manufacturing processes going forward. Our AWS-based data platform aggregates information from various sources to promote efficiency, creativity and better decision-making. To build scalable, high-performing and secure pipelines while working with teams around the world, we are seeking a hands-on Data Engineer. Contribute to a platform that will shape Bayer's digital future for Consumer Health division.

Your responsibilities

  1. Play a key role in driving the design and implementation of AWS Data Lake, including orchestration and security guardrails
  2. Define and enforce data architecture standards, including metadata, lineage and governance
  3. Build and optimize ETL/ELT pipelines using AWS Glue, Spark, Athena, Lake Formation, S3, Step Functions, Lambda
  4. Collaborate with DevSecOps engineers on infrastructure automation and CI/CD pipelines using tools such as GitHub Actions and Terraform
  5. Automate deployment and management of data infrastructure and workflows to ensure reliability and scalability
  6. Implement and manage IAM policies, KMS encryption, VPC configurations and audit mechanisms to ensure security and compliance

show all (12)

Wyświetlenia: 7
Opublikowana4 dni temu
Wygasaza 29 dni
Rodzaj umowyPraca stała
Źródło
Logo

Podobne oferty, które mogą Cię zainteresować

Na podstawie "Senior Data AWS Engineer"