Data Engineer (Databricks) (Praca zdalna)

BitPeak Sp. z o.o.

Warszawa, Bielany
Praca zdalna, Praca hybrydowa
Umowa o pracę, Kontrakt B2B
Umowa o pracę
💼 Kontrakt B2B
🌐 Praca zdalna
🏠 Praca hybrydowa
Pełny etat
Delta Lake
Unity Catalog
🐍 Python
SQL
Medallion Architecture
☁️ Azure Data Lake Storage
☁️ Azure Event Hubs
☁️ Azure Data Factory
📊 SQL Database
Synapse
Fabric

About the project

  • The person in this role will work with project teams developing a modern data platform in a cloud environment for global brands. They will work in an international environment, specializing in BI & Big Data cloud architecture and the latest technologies in that area, and promote the principles of the DataOps manifesto.

Your responsibilities

  • Design, build, and optimize scalable data pipelines in Databricks platform using SQL/Python/Spark
  • Developing existing projects in the Microsoft Azure environment to gain valuable insights for the business
  • Ensuring that data is modelled and processed according to the architecture and both functional and non-functional requirements
  • Planning and implementing processing pipelines for structured and unstructured data (e.g. video and images)
  • Working to automate and optimize internal processes in Azure
  • Collaborating with cross-functional and international teams both internally and externally

Our requirements

  • Minimum 3 years' experience working with Databricks platform (Delta Lake, Workflows/Jobs, DLT, Unity Catalog)
  • Strong experience with programming in Python
  • Solid understanding of SQL and relational databases
  • Knowledge of Data Warehouse, Business Intelligence and ETL/ELT data processing
  • Familiarity with Medallion Architecture
  • Very good knowledge of English (particular emphasis on written English)
  • Proactive approach to tasks, problem-solving attitude and critical thinking skills
  • Flexibility, independence and responsibility for assigned tasks
  • A constant desire to improve your skills and learn new technologies
  • Knowledge of Azure cloud components for data storage and processing: Azure Data Lake Storage, Azure Event Hubs, Azure Data Factory, SQL Database, Synapse, Fabric

Optional

  • Experience with other big data technologies such as Hadoop, Hive, Kafka, and Flink would be an asset

Technologies we use

What we offer

  • Global projects in clouds — we work with clients from all over the world based on modern cloud technologies

  • Certification reimbursement — we fund exams, certifications from Microsoft, AWS, Databricks, Snowflake

  • Time to learn — 60 paid hours per year

  • Flexible approach — you can choose to work from home or meet at our offices

  • Personalized benefits — medical care, subsidized sports packages, language tuition, new employee referral bonus (up to PLN 15,000) as well as annual and media bonus

Wyświetlenia: 2
Opublikowana3 dni temu
Wygasaza 7 dni
Rodzaj umowyUmowa o pracę, Kontrakt B2B
Tryb pracyPraca zdalna, Praca hybrydowa
Źródło
Logo
Logo

Podobne oferty, które mogą Cię zainteresować

Na podstawie "Data Engineer (Databricks)"