Ready to build the platform that will shape our company's data strategy? We're looking for a Databricks Data Engineer to help create our new Reporting and Analytics solution in Databricks and Azure. If you want to see your work make a direct impact, apply now!
About the role
We are looking for a skilled Data Engineer with proven hands-on experience in Databricks and a strong understanding of the Microsoft Azure ecosystem. This is a key internal role focused on building and optimizing scalable data pipelines and solutions for our new reporting and analytics platform that is built on Databricks. In collaboration with our team of data engineers, architects, tech lead and a scrum master you will contribute designing and implement robust CI/CD pipelines ensuring the platform is developed and maintained using Agile best practices.
Do you want to take our business processes to an even higher level with Business Intelligence solutions? Then apply for this job!
Key Responsibilities
In this hands-on role, you'll be building our new Reporting and Analytics platform from the ground up. Your primary focus will be designing and constructing scalable data pipelines and workflows within Databricks. Key responsibilities include:
- Design and develop metadata-based driven and scalable pipelines and workflows within Databricks.
- Build CI/CD pipelines for data pipeline deployments using Azure DevOps
- Implement Delta Live Tables (DLT) pipelines and write DLT expectations to facilitate data design for medallion architecture.
- Manage Azure components, including Key Vault, Gen2 Storage, and Azure Active Directory.
- Ingest data from multiple sources via API integration.
- Implement unit and testing.
- Manage performance optimization and cluster usage monitoring.
- Build and optimize Databricks pipelines and workflows to improve performance and cost-efficiency.
- Integrate with PowerBI and Delta Sharing.
- Work closely with a multidisciplinary team of data engineers, BI analysts and architects.
- Apply Data Engineering and DevOps best practices.
- Willingness to share knowledge with colleagues and contribute to writing documentation.
What we are looking for
- Bachelor's degree in Computer Science, Engineering, or a related field; Proficiency in programming with Python and knowledge of PySpark. 5+ years of experience in data engineering with a strong focus on Databricks and the Microsoft Azure ecosystem (e.g. ADLS Gen2, Key Vault, Active Directory).
- Hands-on experience with the Databricks platform and good knowledge and/or experience with Unity Catalog, Medallion Architecture and Delta Live Tables.
- Having the DP-203 (Azure Data Engineer Associate) and at least one of the Databricks Data Engineer Associate or Databricks Data Engineer Professional.
- Knowledge of CI/CD practices, version control (Git) and unit testing.
- Experience in a scrum/agile environment and experience with Azure DevOps.
- Knowledge and proven experience of metadata-based driven programming.
- Familiarity with data engineering best practices.
- Strong problem-solving skills and ability to work independently.
- Fluency in English language.
What Will Set you Apart
- Master's degree preferred.
- Experience with SQL is a plus.
- Familiarity with Infrastructure as Code (IaC) tools like Terraform is a plus.
What are we offering?
At PwC, you will have the opportunity to be yourself, get the best out of yourself in a high-performance organizsation and grow within our global network. As part of our team we offer:
- A competitive salary, attractive pension plan and the opportunity to grow;
- Customized training for professional growth;
- Motivating work environment where collaboration with ambitious colleagues and recognition for your contributions are highly valued;
- Comprehensive benefits including "well-being budget" for physical and mental health;
- Flexibility of hybrid working, including ergonomic home office and fixed expense allowance including internet allowance;
- Attractive mobility options, including electric lease car, car waiver allowance and the possibility of using different shared transport providers;
- 32 vacation days per year.
.
Getting started at PwC
Are you interested in this vacancy and do you meet the requirements? Then let us know what motivates you and fill in your details. After we have received your application,
- You'll immediately receive confirmation in your inbox;
- If your qualifications match the profile that we have in mind, then we'll contact you within two weeks for a short introduction meeting;
- for more information about the application process.
--
#LI-PD1