Job description

Senior DevOps Engineer with Kafka

We are looking for a DevOps Engineer with basic Kafka knowledge who would join the team from the logistics sector.

About project: The project involves migrating our client's main IT system to a new one, distributed cloud architecture. The new version of the system will consist of 70-90 independent applications, each with its own database and business autonomy. Communication between components will be asynchronous, based on an event-driven architecture. The central element of the new system is the Central Messaging Platform (CMP), which enables communication between all stand-alone business modules (SBMs) and the infrastructure.

Work mode: Hybrid model from Gdansk (2-3 days per week). You can also work remotely with obligatory visits in Gdansk once every 1-2 months

Duration of the project: long-term

Key Technologies: Kafka, AWS, Terraform, GitLab, Copilot, Python/Bash

Job responsibilities

• Design and build a robust and scalable Central Messaging Platform based on Apache Kafka aligned with our enterprise architecture to meet the organization's evolving needs.

• Deployment and administration of a cloud-based infrastructure for the Messaging Platform.

• Implementation and integration of deployment strategies (e.g. development of CI/CD pipelines)

• Implement resilience and disaster recovery strategies and capabilities.

• Deployment or development of solutions for comprehensive monitoring of the Kafka solution.

• Operation and optimization of the Kafka based Messaging Platform and the underlying cloud infrastructure.

• Deploy and manage supporting functionalities for a Kafka based solution (e.g. Schema Registry, Observability tools, etc).

• Handling possible incidents and problems at an expert level to guarantee stable operation.

• Consultation and collaboration with product teams on best-practice in use and seamless integration of the Platform.

• Provide and implement comprehensive tools and documentation for supporting teams.

Expectations

• At least basics in implementing and operating Apache Kafka solution.

• Experience in building and managing a suitable cloud environments (AWS preferably) incl. experience with IaC tools like Terraform and CloudFormation for managing cloud infrastructure (nice to have VPC understanding/experience).

• Knowledge and experience in using relevant strategies and components from Apache Kafka ecosystem such as Brokers, Zookeeper/KRaft, Kafka Connect,,Schema Registry, etc.

• Familiarity with authentication (SASL, OAuth), authorization, and encryption techniques for securing Kafka clusters.

• Experience in implementing monitoring and observability solutions e.g., Grafana Stack, Elastic Stack, etc.

• Experience in scripting languages like Python and Bash for automating Kafka deployments and maintenance. Experience in using Git for version control.

• Knowledge of CI/CD practices using tools such as,GitLab CI, Jenkins, or AWS CodePipeline.

• Willingness to manage and operate Kafka clusters in a production environment 24/7.

• Bachelor’s or master’s degree in computer science, software engineering, or a related field or otherwise proven experience in software engineering.

• We are an international company, so you should feel comfortable with communicating in English.

• Excellent communication and teamwork abilities.

• At least 5 years of relevant professional experience

We offer

• Ongoing support from a dedicated agent who is caring about your project continuity, contact with clients, necessary formalities, work comfort, and development

• Career Development Program – advice on career planning based on the latest trends and market needs in IT, including consultations with career agents and mentors

• Access to 7N Learning & Development – a development and educational platform offering webinars, a library of articles and industry reports, and frequent invitations to both one-time and recurring events focused on technical, business, and lifestyle topics

• Spectacular events, both for you (e.g., annual Kick-Off trip, Christmas parties, or Summer Olympics sports events) and for your loved ones (e.g. family picnics),

• Professional growth beyond your current project. You can actively engage in knowledge sharing through the 7N Services offering, designed for 7N clients.

• Connections and access to the expertise of top IT professionals in the market – the average professional tenure of our consultants in Poland is over 10 years

• A complete benefits package, including funding for medical care, life insurance, sports cards for you and your loved ones, as well as discounts in stores in Poland and abroad