Big Data Engineer in Samsung Ads Project

Samsung R&D Institute Poland

Warszawa, Wola
Hybrydowa
🐍 Python
Scala
Spark
🚢 Kubernetes
🤖 Airflow
SQL
📊 Snowflake Data Cloud
☁️ AWS
Java
🐳 Docker
Rest APIs
Hybrydowa
Terraform
Sagemaker
🤖 Airflow MWAA
MapReduce
Flink
Kafka
TensorFlow
PyTorch
Prometheus
Grafana
Go
Redis

Requirements

Expected technologies

Python

Scala

Spark

Kubernetes

Airflow

SQL

Snowflake Data Cloud

AWS

Java

Docker

Rest APIs

Optional technologies

GoLang

GraphQL

Our requirements

  • At least 5 years of commercial experience in developing Python, Java or Scala
  • Proficient in working with big data technologies (e.g., Hadoop, Spark and MapReduce)
  • Knowledge of database (SQL/NoSQL) technologies (Snowflake, PostgreSQL, MySQL, DynamoDB)
  • Experience in working with Kubernetes and stream data processing frameworks frameworks (Flink, Apache Ignite)
  • Experience in optimizing SQL queries
  • Experience in working with large datasets
  • Hands-on experience with orchestration tools like Airflow or similar
  • Experience in AWS
  • Knowledge of Design Patterns
  • Knowledge of version control system: Git
  • Proficiency in English, enough to communicate and understand technical documentation
  • University degree in Computer Sciences, Telecommunication and/ or similar

Optional

  • GoLang
  • Experience with GraphQL
  • Experience in usage and administration of Amazon Web Services
  • Experience in development of micro services/server less solutions
  • Knowledge of container technologies like Docker and Kubernetes

Your responsibilities

  • Collaborate with data scientists, product managers, and other engineers to refine and improve data processing systems
  • Design and maintain scalable and optimized data pipelines for efficient collection, processing, and storage data
  • Collaborate with data scientists, product managers, and other engineers to refine and improve attribution methodologies
  • Participate in R&D projects in the area of Cloud Services
  • Establish and follow best coding practices
  • Work closely with stakeholders to understand and translate business requirements into technical solutions
  • Conduct A/B testing and performance analysis to validate and iterate on attribution models.
  • Ensure software quality: create and maintain unit, integration and functional tests, participate in code review
  • Report tasks progress

Company

Wyświetlenia: 6
Opublikowana5 dni temu
Wygasaza 7 dni
Tryb pracyHybrydowa
Źródło
Logo
Logo

Podobne oferty, które mogą Cię zainteresować

Na podstawie "Big Data Engineer in Samsung Ads Project"