PwC is a global leader in professional services and emerging technologies, delivering sustained outcomes for clients through trusted assurance, advisory tax and expertise. As a part of a global network in over 150 countries, we bring together diverse perspectives and deep industry knowledge to solve today's most important problems with the mindset of tomorrow. We are committed to acting with integrity, fostering a culture where everyone can thrive. Join PwC and part of shaping the future of business.
About the role
We are looking for a skilled Platform Engineer with proven hands-on experience in Databricks and a strong understanding of the Microsoft Azure ecosystem. In this role you will build and maintain our Reporting and Analytics Databricks platform to support creation of data flows.
In collaboration with our team of platform engineers, architects and experts in BI, cloud, and integration to design you will contribute to designing and implementing robust CI/CD workflows and pipelines, standardizing environments and ensuring that the platform is resilient and scalable.
Key Responsibilities
- Design and develop metadata-based driven and scalable CI/CD pipelines and workflows with Databricks.
- Implement Lakeflow declarative pipelines for medallion architecture.
- Manage Azure components, including Key Vault, Gen2 Storage, and Azure Active Directory.
- Ingest data from multiple sources via API integration.
- Deploy jobs and pipelines using Databricks Asset Bundles.
- Implement unit testing.
- Manage performance optimization, cluster usage monitoring and system reporting.
- Manage downstream integrations for reporting (Fabric/PowerBi) and publishing to Databricks Lakebase.
- Work closely with a multidisciplinary team of data engineers, BI analysts and architects.
- Willingness to share knowledge with colleagues and contribute to writing documentation for the platform and its usage.
What we are looking for
- 5+ years of experience as a Platform Engineer or Data Engineer with focus on the Microsoft Azure ecosystem (e.g. ADLS Gen2, Key Vault, Active Directory).
- Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.
- Proficiency in programming with Python and knowledge of PySpark. SQL is a plus.
- Strong experience with (Azure) Databricks (Unity Catalog, Medallion Architecture, Lakeflow pipelines) and Databricks Asset Bundles (DABs).
- Hands?'on experience with version control, unit and integration testing.
- Having the DP-203 (Azure Data Engineer Associate) and at least one of the Databricks Data Engineer Associate or Databricks Data Engineer Professional.
- Experience in a scrum/agile environment and experience with Azure DevOps.
- Knowledge and proven experience of metadata-based driven programming.
- Strong problem-solving skills and ability to work independently.
- Fluency in English language.
What are we offering?
At PwC, you will have the opportunity to be yourself, get the best out of yourself in a high-performance organisation and grow within our global network. As part of our team we offer:
- A competitive salary, attractive pension plan and the opportunity to grow;
- Customized training for professional growth;
- Motivating work environment where collaboration with ambitious colleagues and recognition for your contributions are highly valued;
- Comprehensive benefits including "well-being budget" for physical and mental health;
- Flexibility of hybrid working, including ergonomic home office and fixed expense allowance including internet allowance;
- Attractive mobility options, including electric lease car, car waiver allowance and the possibility of using different shared transport providers;
32 vacation days per year.
Getting started at PwC
- You'll immediately receive confirmation in your inbox;
- If your qualifications match the profile that we have in mind, then we'll contact you within two weeks for a short introduction meeting;
- If everyone is enthusiastic, we'll schedule an online assessment. Depending on the result, you'll receive an invitation for an initial interview. Click for more information about the application process.
#LI-PD1