Senior Data Engineer (Contract) | Azure & Databricks
On behalf of our client, we’re looking for a Senior Data Engineer to join a growing data team (currently three members plus a lead) and play a key role in strengthening the group’s engineering capability. The role involves migrating and connecting data platforms, integrating systems, cleaning and documenting old data, and helping design the new architecture.
This is an opportunity to get involved early in the platform’s development, close to Greenfield, and help establish engineering standards and best practices that will support long-term scalability. The environment is primarily Databricks-based, with legacy data quality posing some interesting challenges that the team is keen to resolve properly this time around.
What you’ll be doing:
- Building and optimising ETL/ELT pipelines with Databricks & Apache Spark
- Designing scalable solutions using Azure Data Factory, Synapse & Data Lake
- Implementing Delta Lake with ACID transactions and schema enforcement
- Automating testing and CI/CD with Azure DevOps & Terraform
- Driving data governance with Azure Purview & Unity Catalog
- Developing real-time data solutions with Event Hubs & Structured Streaming
- Managing infrastructure as code and optimising cloud costs
- Working closely with engineers, QA, Product Owner, and stakeholders
What we’re looking for:
- Strong hands-on experience with Azure & Databricks
- Proficiency in Python, Spark SQL, and Terraform
- Solid understanding of data governance and real-time processing
- Great communication skills and a collaborative mindset
£600/day - outside IR35 | Hybrid | Contract |
If this sounds like a good fit, feel free to reach out or share it with someone who might be interested