Senior Data Engineer

This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board.

Senior Data Engineer

Department: Tech Hub

Employment Type: Full Time

Location: Leeds, England, United Kingdom

Description

Contract type: Permanent
Hours: 37.5

Salary: circa GBP 72,000 depending on experience

Location: Leeds city centre

WFH policy: Employees are required to attend the office 2 days/week

Flexible working: Variety of flexible work patterns subject to line manager discretion e.g. Compressed 9-day fortnight.

Reports to: Lead Data Engineer

Deadline Note: We reserve the right to close the advert before the advertised deadline if there are a high volume of applications.

Role Summary:The Senior data engineer role will have a specific focus on data and integration, ensuring that they drive single version of the truth by developing and maintaining reliable solutions to store and manage key data.

The role will source, model, and provide data in a form which is ready for report / dashboard building. They will take ownership for the design, development, and maintenance of LCCCs databases and data warehouse, as well as ensure all data systems conform to the data architecture and strategy expectations.

The Senior Data Engineer will drive better data governance through the creation and embedding of principles and processes. They will also build and maintain key data governance and management artefacts such as the data model, data dictionary and KPI catalogue.

Key Responsibilities

• Own, design, develop and maintain LCCCs data platform ensuring reliable data across the organisation
• Extensive hands-on experience designing and delivering scalable, resilient cloud-based data lake platforms using modern lakehouse architectures
• Drive better data governance through the creation and embedding of principles and processes
• Build and maintain key data governance and management artefacts e.g., Flow Diagram, Data Dictionary, KPI Catalogue
• Define overall approach and data flow for Extract, Transform and Load; and application of this for a given deployment/project
• Identify patterns, anomalies, and structure of data in preparation for Extract Transformation and Load
• Design and implement data pipelines and processes based on business requirements
• Write ETL data validation and data reconciliation queries
• Define high level and low-level design of a data platform to ensure robustness e.g., restorability, traceability, ease to support, etc.
• Define, embed, and drive data management and governance approaches, principles, and processes
• Identify data quality issues through data profiling, analysis, and stakeholder engagement
• Design and maintain the Microsoft Azure modern Datawarehouse architecture, implementation, administration, and support
• Translate complex business requirements into clear, scalable technical designs and delivery plans, ensuring alignment between stakeholder outcomes and engineering execution

Skills Knowledge and Expertise

• Extensive experience in Cloud (preferably Microsoft Azure) Datawarehouse architecture as well as cloud data lakehouse platforms
• Experience of ETL and ELT processes, working with database architecture
• Able to develop and optimise coding in SQL and python
• Experience in creating data pipelines using Cloud (preferably Azure Data Factory)
• Experience with Cloud: ADLS, Databricks, SQL DW, Serverless Architecture
• Experience in CI/CD pipelines and monitoring
• Able to work with large datasets and extrapolate conclusions
• Strong analytical and critical thinking abilities

• Experience in building and maintaining reliable and scalable ETL on big data platforms as well as experience working with varied forms of data infrastructure
• Data Engineering experience in Microsoft stack

Employee Benefits

As if contributing to and supporting work that makes life better for millions wasn't rewarding enough, we offer a full range of benefits too. Key benefits that may be available depending on the role include:

• Annual performance based bonus, up to 10%
• 25 days annual leave, plus eight bank holidays
• Up to 8% pension contribution
• Financial support and time off for study relevant to your role, plus a professional membership subscription
• Employee referral scheme (up to GBP 1500), and colleague recognition scheme
• Family friendly policies, including enhanced maternity leave and shared parental leave
• Free, confidential employee assistance, including financial management, family care, mental health, and on-call GP service
• Three paid volunteering days a year
• Season ticket loan and cycle to work schemes
• Family savings on days out and English Heritage, gym discounts, cash back and discounts at selected retailers
• Employee resource groups