Databricks & Data Engineer | Brussels

Remote work from Belgium

Experience (Years): 4 to 6 years

Pay Rate – TBN

Start Date - ASAP

6 Months Contract – Renewable

Key responsibilities:

Monitor and optimize data processing performance, identifying, and resolving bottlenecks.

Stay up to date with the latest advancements in data engineering and Databricks technologies. Experience with ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes

Essential Skills:

• Exposure and handling DataIQ
• Design, develop, and optimize data workflows and notebooks using Databricks to ingest, transform, and load data from various sources into the data lake.
• Experience in AWS cloud platforms
• Build and maintain scalable and efficient data processing workflows using Spark (PySpark or Spark SQL) by following coding standards and best practices.
• Collaborate with technical and business stakeholders to understand data requirements and translate them into technical solutions.
• Develop data models and schemas to support reporting and analytics needs. --Ensure data quality, integrity, and security by implementing appropriate checks and controls.
• Understanding of DevOps principles and practices

Desirable Skills:

• Experience with Python or SQL
• Experience with Delta Lak