Data Engineer - Location 360

Digital Hub Warsaw at Bayer

Warszawa, Ochota
15 000–21 000 zł brutto / mies.
Praca hybrydowa
Umowa o pracę
Umowa o pracę
🏠 Praca hybrydowa
Pełny etat
🐍 Python
Go
Kafka
☁️ AWS SQS
🔍 Google Cloud Pub/Sub
GitHub
☁️ AWS
GCP

About the project

  • In our Location 360 team we believe that the location of things, and the relationships between them in time and space, are of fundamental importance to creating transformational digital products. We are passionate about enabling teams to seamlessly incorporate spatial and location data into their applications, analyses, operations, and models. We do this by ingesting and stewarding much of the location related data for Bayer Crop Science, by integrating models that enrich that data, and by building platforms and interfaces that make it easy for teams to integrate that data into their work. Our Environmental team is looking for an experienced and innovative Data Engineer to join us.
  • As a Data Engineer, you will focus on designing and developing large-scale, event driven data pipelines using modern data infrastructure. You will be the primary developer for multiple spatial data workflows involving planting and harvesting geospatial data, building robust data pipelines, services, and APIs to enable research, analysis, and product innovation across Bayer’s business functions. You’ll work closely with data engineers, cloud engineers, data stewards, software developers, data scientists and domain experts to build scalable cloud-based solutions using modern cloud-native and open-source technologies.

Your responsibilities

  • Design, build, deploy and support cloud-based and open-source solutions for geospatial data handling
  • Implement scalable data pipelines in Python and Go for ingestion, transformation, and delivery of structured and unstructured geospatial data.
  • Build highly scalable APIs for accessing geospatial data and initiating geospatial processing and analysis.
  • Develop event-driven data processing solutions using Kafka, AWS SQS, and Google Cloud Pub/Sub to orchestrate multi-stage spatial workflows.
  • Integrate and manage data flows across cloud platforms such as AWS and GCP, databases such as PostgreSQL/PostGIS and BigQuery, and cloud storage such as AWS S3 and Google Cloud Storage
  • Leverage Kubernetes (K8s) for deploying and managing containerized applications and workflows.
  • Work closely with SREs and platform engineers to integrate cloud infrastructure with CI/CD pipelines and deployment workflows.
  • Collaborate with data engineers and SREs to optimize and monitor data pipelines and services for performance, reliability, scalability, and cost-effectiveness.
  • Provide technical support, including incident response, troubleshooting and resolution for production issues in data pipelines and API services.
  • Ensure compliance with company and industry standards and best practices for data security and regulatory requirements.
  • Stay updated on emerging data engineering technologies and data infrastructures; evaluate their potential impact and application in our systems and processes.
  • Provide technical leadership and mentorship to junior data engineers. Forster a culture of knowledge sharing and continuous learning.

Our requirements

  • Bachelor's degree in Computer Science, Engineering, or relevant job experience
  • Strong proficiency in Python and/or Go programming languages
  • Strong experience with PostgreSQL/PostGIS and BigQuery, including schema design and query optimization.
  • Hands-on experience with event-driven and streaming data architectures using platform and services such as Kafka, AWS SQS, and Google Cloud Pub/Sub
  • Experience with building RESTful APIs using common frameworks
  • Experience with utilizing Docker to build and deploy containerized applications
  • Experience in cloud platforms such as GCP and AWS, including native data and compute services such as Bigquery, Aurora, GCS/S3, GKE/EKS, GCE/EC2, Cloud Functions/Lambda
  • Experience with code versioning and dependency management systems such as GitHub
  • Excellent problem-solving skills and the ability to work effectively in a fast-paced, collaborative environment.
  • Strong communication skills and the ability to articulate technical concepts to non-technical stakeholders.
  • Preferred:
  • Highly proficient in Golang or Python with a strong track record of building and maintaining production data pipelines and backend systems
  • Hands-on experience working with Kubernetes(K8s) for orchestrating and managing containerized data services and workflows.
  • Familiarity with CI/CD practices and tools such as GitHub Actions, Terraform, Google Cloud Build, ArgoCD
  • Experience with object-oriented design, coding and testing patterns, and implementing complex data projects in a large-scale data infrastructure.
  • Solid understanding of geospatial data concepts. Experience with data processing and analysis using geospatial libraries and tools.
  • Experience with monitoring and logging tools such as Grafana, Prometheus, ELK stack, or equivalent.
  • Familiarity with cloud-based machine learning services and platforms such as Google Cloud Vertex AI or AWS SageMaker. Experience with deploying invoking model endpoints.
  • Solid understanding of networking concepts, security principles, and best practices for cloud environments.
  • Experience working with customers and developers to deliver full-stack development solutions; the ability to translate customer requirements into technical requirements in an Agile environment.

Technologies we use

This is how we work on a project

  • event modeling

What we offer

  • A flexible, hybrid work model

  • Great workplace in a new modern office in Warsaw

  • Career development, 360° Feedback & Mentoring programme

  • Wide access to professional development tools, trainings, & conferences

  • Company Bonus & Reward Structure

  • Increased tax-deductible costs for authors of copyrighted works

  • VIP Medical Care Package (including Dental & Mental health)

  • Life & Travel Insurance

  • Pension plan

  • Co-financed sport card - FitProfit

  • Meals Subsidy in Office

  • Budget for Home Office Setup & Maintenance

  • Access to Company Game Room equipped with table tennis, soccer table, Sony PlayStation 5 and Xbox Series X consoles setup with premium game passes, and massage chairs

  • Tailored-made support in relocation to Warsaw when needed

Aufrufe: 1
Veröffentlichtvor 3 Tagen
Läuft abin 18 Tagen
Art des VertragsUmowa o pracę
ArbeitsmodusPraca hybrydowa
Quelle
Logo
Logo

Ähnliche Jobs, die für Sie von Interesse sein könnten

Basierend auf "Data Engineer - Location 360"