We are looking for an experienced Test Manager with a strong background in data platform testing, particularly across Microsoft Fabric, Azure services, PySpark notebooks, and automated testing frameworks. You will play a pivotal role in ensuring quality and governance across data pipelines, lakehouses, and reporting layers.
This role requires a hands-on leader who can define and implement a comprehensive quality strategy for a modern, cloud-native, notebook-driven environment.
Note this is a Fixed Term Contract (Salaried) to run to the end of 2025 with a likelihood for extension.
Location: Hybrid, but our Bournemouth offices are a key location (happy to discuss)
Key Responsibilities
- Define and implement the end-to-end test strategy for Microsoft Fabric workloads (Lakehouses, Pipelines, Notebooks, Power BI).
- Lead and manage the QA effort across multiple agile teams.
- Drive the development and maintenance of automated testing for:
1-PySpark notebooks in Fabric/Databricks
2-Data pipelines and transformations
3-Delta tables and lakehouse validation
- Embed testing into CI/CD pipelines (Azure DevOps or GitHub Actions).
- Ensure quality gates are enforced through all stages of the medallion architecture (bronze, silver, gold).
- Define test approaches for schema validation, data reconciliation, and business rule testing.
- Collaborate with data engineers, architects, product owners, and DevOps to deliver high-quality, scalable solutions.
- Establish reusable patterns for parameterized notebook testing and data-driven assertions.
- Own test planning, execution, environment readiness, and reporting.
- Ensure governance standards (e.g., audit, data privacy, regulatory compliance) are met.
Skills & Experience
Essential:
- Proven experience as a Test Manager or QA Lead in cloud data platform environments.
- Strong working knowledge of:
1-Microsoft Fabric (Lakehouses, Pipelines, Notebooks, Power BI)
2-Azure (Data Lake, Synapse, ADF, Key Vault)
3-Databricks / Fabric Notebooks using PySpark
- Experience building and managing automated data validation frameworks (e.g., Pytest, Nutter, Great Expectations).
- Good understanding of Delta Lake, Medallion Architecture, and schema evolution.
- Familiarity with CI/CD pipelines in Azure DevOps or GitHub Actions.
- Strong version control practices using Git and notebooks-as-code approach.
- Experience testing across structured, semi-structured, and unstructured data.
Desirable:
- Experience with Microsoft Purview, Unity Catalog, or other data governance tools.
- Familiarity with performance and volume testing of Spark jobs and data pipelines.
- Knowledge of Power BI testing (DAX validation, model integrity).
- Exposure to data lineage tools and data observability platforms.
Also
- Clear communicator with strong stakeholder engagement.
- Comfortable working in cross-functional, agile teams.
- Passionate about test automation and process improvement.
- Able to balance technical leadership with delivery timelines.
Why Join Us?
Work on a high-profile Greenfield Microsoft Fabric implementation.
Be part of a forward-thinking and innovative data team.
Drive the adoption of cutting-edge data testing methodologies.
Competitive salary, benefits, and career progression opportunities.
Apply now and be at the forefront of a transformative data journey
Rewards and Benefits
At LV= Life and Pensions, you’ll go above and beyond to do the right thing for our customers. We’ll reward your hard work with an attractive, competitive salary and benefits package, which includes:
• 30 days' holiday, with the option to buy up to 2 additional days
• Competitive pension scheme - LV= Life and Pensions will double-match the amount you pay, up to 14% (subject to National Minimum Wage requirements)
• An annual bonus scheme based on company and personal performance
• Single-cover private medical insurance (with the option for you to upgrade to family cover)
• Flexible benefits, including a cycle to work scheme, personal accident insurance, critical illness cover and dental insurance
• Up to 20% discount on our life products for you and your immediate family
• A group life assurance policy with 4 x your basic pay to go to your dependents (you’ll have the option to increase to 8 x cover)
• Group Income Protection (if you become a member of the Pension scheme and reach 5 years of service)
• Access to our Employee Assistance Programme (EAP) for support when you need it
• A virtual GP service
• Shared parental leave.