• collaboration on the migration of client data from an existing solution to a modern data platform built on Azure Databricks

• the project focuses on modernizing the customer's data platform and migrating existing client data to a new cloud environment

• the project will include the design and implementation of data pipelines, data migration from existing solutions, optimization of processing large volumes of data, and a gradual transition from Azure Data Factory to Azure Databricks

• collaboration in a small international team with internal Data Engineers and the customer's business team

• tasks and responsibilities:

• Data Migration

• migration of client data to the new data platform

• design and implementation of ETL/ELT pipelines

• data transformation and cleaning

• validation of migrated data

• Data Engineering

• development and optimization of data pipelines

• implementation of solutions in Azure Databricks

• processing large volumes of data

• optimization of data process performance

• Cloud Platform

• working with Azure Data Factory

• implementation of solutions in Azure Databricks

• support for data architecture modernization

• collaboration in designing future architecture

• Collaboration

• collaboration with internal Data Engineers

• communication with the business team

• design of technical solutions

• documentation of implemented changes

• collaboration in an international team

• collaboration will be 100% REMOTE , with possible occasional travel to Germany

• final remuneration depends on the candidate's experience and the course of the selection process