Data Engineer

The Role

The Data Engineer is responsible for designing, building, and maintaining secure, scalable data solutions for financial services customers. This role focuses on delivering Azure-based data platforms that support ingestion, transformation, processing, and data quality across structured and unstructured sources.

Working as part of Claranet’s Data & AI Practice, you will collaborate with customers, analysts, and platform teams to operationalise data pipelines, enable analytics and machine learning workloads, and ensure data environments are reliable, auditable, and compliant.

This is a hands-on role where you will play a key part in delivering modern, secure, and high-performing data solutions that support customer transformation and business outcomes.

Key Responsibilities

* Design and implement data ingestion, transformation, and processing pipelines on Azure

* Build and maintain scalable data pipelines for data cleaning, enrichment, and preparation

* Apply appropriate data modelling techniques, including medallion architecture principles

* Orchestrate and optimise Azure Databricks jobs and Azure Data Factory pipelines

* Configure data platforms and compute resources to optimise cost, performance, and reliability

* Implement CI/CD pipelines to deploy and manage data artefacts and workflows

* Operationalise data workflows created by analysts and data scientists

* Support customers in adopting Azure data, analytics, and machine learning services

* Ensure secure storage, processing, and governance of data across environments

* Apply networking and security best practices across all data solutions

* Design solutions for large-scale data processing using batch and streaming approaches

* Collaborate with analytics teams to support reporting and data visualisation use cases

* Maintain clear and comprehensive technical documentation, including pipelines and runbooks

* Support audits, risk assessments, and regulatory compliance requirements

* Contribute to continuous improvement of data platforms, pipelines, and processes

Skills and Attributes

* Positive mindset with a strong willingness to learn new technologies

* Analytical and methodical approach to problem-solving

* Strong awareness of ethical data usage and compliance considerations

* Excellent communication skills with both technical and non-technical stakeholders

Experience & Knowledge

Essential:

* Strong SQL skills

* Programming experience with Python and/or Scala

* Hands-on experience with Azure data platforms

* Experience building and maintaining data pipelines

* Strong understanding of data modelling (relational and analytical)

* Experience with Databricks and Data Factory orchestration

* Experience using CI/CD pipelines for data solutions

* Understanding of security, GDPR, PII, and data protection practices

Desirable:

* Experience with Azure Databricks in production environments and familiarity with Azure Machine Learning and AI services

* Experience with data visualisation tools (e.g. Power BI), big data frameworks such as Spark or Kafka

* Understanding of data governance, lineage, and metadata tools

Benefits

At Claranet, we go the extra mile with our people—because we believe in building a workplace where everyone feels valued and supported. Our flexible benefits package includes:

Pension Scheme: Employer-matched contributions to support your future

Private Healthcare: Comprehensive medical cover for peace of mind

Discounted Gym Memberships: Supporting your wellbeing and fitness

Wellbeing Support: 24/7 access to wellbeing resources and tools

Annual Leave: 25 days rising to 27 with service, plus bank holidays and your birthday off

Learning & Development: Ongoing opportunities to grow and progress your career

What makes us unique is Team Claranet, our internal community supporting causes that matter to our people. We offer paid charity leave, support local initiatives, and run company-wide fundraising events