Software Developer

Job Advertisement: Software Developer / Senior Data Engineer

Location: London
Contract Length: 12 Months
Daily Rate: £700 (Umbrella)

Are you ready to be part of a transformative journey? Our client is embarking on a major enterprise-wide data platform transformation, and they need a talented Software Developer / Senior Data Engineer to join their dynamic team!

About the Role:

You will play a pivotal role in designing and building a state-of-the-art data platform that consolidates data from various business areas into a centralised environment for reporting, analytics, and business consumption. This is your opportunity to contribute significantly as the project progresses towards crucial go-live milestones between March and June 2027!

Key Responsibilities:

Design & Build: Create and maintain scalable data pipelines using Python and SQL.
Optimise Solutions: Develop, optimise, and support enterprise data platform solutions.
Data Integration: Build and manage data ingestion, transformation, and integration processes.
Infrastructure Management: Create and maintain data models, tables, and supporting infrastructure within Databricks and associated data lake/lakehouse environments.
Business Logic Development: Implement business logic, calculations, and data processing solutions using Python.
Collaboration: Work closely with business stakeholders and engineering teams to deliver high-quality data assets.
Quality Assurance: Ensure data quality, performance, scalability, and governance standards are met.
Documentation: Produce technical documentation, architecture artefacts, and data flow specifications.
Performance Improvement: Identify and resolve performance bottlenecks across pipelines and processing workflows.

Required Skills & Experience:

Essential:

Strong commercial experience in Python development.
Proficient in SQL, including query optimisation and data modelling.
Hands-on experience with Databricks.
Proven track record in designing and building enterprise data platforms.
Experience in developing ETL/ELT pipelines and data integration solutions.
Strong understanding of data lakes and lakehouse architectures.
Experience working with large-scale datasets and modern data engineering practises.
Ability to design and deliver end-to-end data solutions.
Strong analytical and problem-solving skills.
Excellent stakeholder management and communication skills.

Highly Desirable:

Experience with Spark / PySpark.
Familiarity with Azure Data Lake, Snowflake, or similar platforms.
Knowledge of orchestration tools like Airflow or Azure Data Factory.
Exposure to financial services environments.
Experience supporting large-scale data transformation or migration programmes.

What We're Looking For:

A senior-level contractor who can hit the ground running.
Someone comfortable working autonomously with minimal oversight.
Proven experience in delivering long-term contract engagements (12 months or longer).
Strong interpersonal skills with a team-oriented approach.
Immediate availability or able to start quickly.

Key Deliverables:

Delivery of scalable, reliable, and performant data pipelines.
Development of robust data models and platform structures.
Successful implementation of data engineering solutions that support the enterprise data platform.
High-quality data assets for reporting, analytics, and business consumption.
Contribution to platform go-live milestones between March and June 2027.

Join our client and be part of something big! If you are ready to take on a challenging and rewarding role, we want to hear from you! Apply now and help shape the future of data