Data Engineer, Azure Integrations

Job Purpose

Internal job title: Azure Integration Specialist

Advertised Salary: £45,000 - £50,000 (depending on experience)

Location: Remote working with hub allocated when required.

Looking for a new Integration opportunity that offers professional development, flexible working, creative autonomy, and prioritises wellbeing?

We are the charity who look after and bring to life 2,000 miles of waterways across England and Wales, because we believe that life is better by water. Every role across the Trust plays it's part in transforming our canals and rivers into spaces where local people want to spend time and feel better, bringing wellbeing benefits to millions. See how we make difference: (https://canalrivertrust.org.uk/about-us/how-we-make-a-difference)

The role

The Trust is looking for an Azure Integration Specialist who is passionate about technology solutions to join the IT team. You will be required to work across the business and with third parties to design, build and maintain the enterprise integrations that will be central to our transformation program.

The successful applicant will be required to have a background and interest in integration and possess a track record in overseeing and delivering the integration process across all phases of delivery.

Responsible for integrations as part of a multi-year ERP transformation programme, you will be at the heart of an ambitious plan to mature our IT practices and services, embedding new ways of working to ensure end to end system connectivity, performance, security and control. This role will work closely with existing technology specialists in the IT team to standardise interfaces and approaches and will be a vital part of the team when new solutions are selected by the Trust, to ensure that implementations follow our integration standards (which you will also oversee).

The highly engaged IT team has a defined information strategy, encompassing some very exciting projects using the latest technologies, all covering a very diverse business in an organisation that is doing something good in the world. This makes the work fun, and at the same time provides opportunities for self-development, challenge and variety.

Location

You will be offered on a remote working basis, with a requirement to attend our main north/midlands hub spaces as and when required for team working and collaborative meetings.

Relevant north/midlands hubs include: Leeds, Liverpool, Burnley, Newark, Birmingham.

The regularity & flexibility of travel will be discussed further at interview stage.

See our canal network here: (https://canalrivertrust.org.uk/enjoy-the-waterways/canal-and-river-network).

Knowledge, Skills/Qualifications & Experience

As an Azure Integration Specialist, you will be responsible for the design, build and support of integrations between internal and external systems using tools in Microsoft Azure. You will gather the necessary requirements, ensuring any design is in line with our strategic direction, identifying opportunities for improvement and overcoming any technical challenges.

In your role you will deal with various components within Azure, such as Azure Data Factory, Azure Databricks, Logic Apps, Azure Functions, API Management, Service Bus, Storage, Event Grid, App Services, WCF services and Web API.

Besides the technical side of the job, collaboration within and outside the team is key. This means that you have the necessary communication skills and can easily work with colleagues in the IT team and with stakeholders outside.

Key accountabilities:

• Collaborate with cross-functional teams to understand integration requirements and design scalable and efficient solutions to meet business needs.
• Implement data pipelines, ETL processes, and data transformations using Azure Databricks, PySpark, and Python scripting.
• Integrate diverse data sources and formats, including structured and unstructured data, streaming data, and APIs.
• Ensure data quality, reliability, and consistency by implementing data validation and cleansing mechanisms.
• Optimize and tune data processing and integration workflows for performance and efficiency.
• Implement security best practices and data encryption mechanisms to ensure the confidentiality and integrity of data during transit and at rest.
• Develop monitoring, logging, and alerting solutions to proactively identify and address integration issues and anomalies.
• Document technical designs, configurations, and procedures for integration solutions, and provide training and knowledge transfer to other team members as needed.
• Engaging with the wider IT delivery teams to ensure solutions meet standards and are fit for purpose.
• Oversee the organisation's integration roadmap in conjunction with the Data & BI Manager and Solutions Manager.
• Championing solution integration/architecture across the organisation, and setting the integration standards and ways of working for all Trust technical solutions.
• Collaborate with others to create and maintain current and target-state solution architectures.
• Define and manage integration standards, guidelines, and processes to ensure the quality of delivered solution integrations.
• Evaluate and recommend emerging integration technologies and developments.
• Design, develop, and deploy end-to-end integration solutions on the Azure platform, with a primary focus on Azure Databricks and Python.
• Maintain and support integrations and associated tools to ensure Trust solutions and business services continue uninterrupted.

About you

The successful applicant will be required to have a background and interest in integration and possess a track record in overseeing and delivering the integration process.

As we are executing a multi-year ERP transformation programme, you will be at the forefront of embedding new ways of working to ensure end to end system connectivity, performance, security and control.

Technical:

• Strong proficiency in Python programming language, with experience in building data processing and integration scripts.
• Extensive hands-on experience with Azure Databricks, including Spark programming, data engineering, and cluster management.
• Experience with Azure services such as Azure Data Factory, Azure Functions, Azure SQL Database, Azure Storage, etc.
• Knowledge of RESTful APIs, JSON, XML, and other data exchange formats and protocols.
• Understanding of Medallion Architecture.
• Familiarity with DevOps practices and CI/CD pipelines for automated deployment and testing.
• Ability to define and implement Application and Software integration standards.
• The ability to turn business issues into documented solution design.
• Good awareness of risk and security in integration design.
• Expertise in application integration modelling within a structured architecture repository.
• Excellent understanding of integration architecture and patterns.
• Knowledge and experience of multiple integration and API enablement technologies.
• Sound understanding of contemporary software engineering practice.
• A structured approach to architectural design.
• Strong understanding and opinions on how integration has evolved from an on-premise, centralised function towards being a digital, cloud and API-driven capability.
• Knowledge and experience of hybrid cloud integration approaches, API-led architectures and digital-era integration governance methodologies.

General:

• Proactive and self-motivated.
• Strong understanding and opinions on how integration has evolved from an on-premise, centralised function towards being a digital, cloud and API-driven capability.
• Ability to manage conflicting priorities and meet deadlines.
• Ability to analyse complex technical landscapes and evaluate technical solutions.
• The ability to translate requirements into technical specifications.

To apply: click on the "Apply for this job" button and follow the process - complete the application form & upload current CV.

If you have any questions about the role, please contact CRT.recruitment@canalrivertrust.org.uk

We are currently conducting our interview processes virtually as we continue to respect and follow necessary social distancing guidance to protect our team and our candidates. You may be invited to a face to face further stage interview which will always be conducted following strict social distancing guidelines.

What We Offer

In addition to your salary of £40,000 - £50,000 depending on experience , you will benefit from a competitive contributory DC Pension scheme arrangement, great holiday entitlement and numerous other employee benefits, including several salary sacrifice benefits, all of which can be found here (https://canalrivertrust.org.uk/about-us/work-for-us/our-benefits). These include:

• 25 days paid holiday, plus paid Bank Holidays, increasing to 27 days plus Bank Holidays after 3 years
• Home working status with 'hub' facilities available if a need to work outside of home - flexibility. Monday to Friday working, no weekend working.
• Annual £200 personal learning & growth award to spend on any learning related activity - hobbies; aspirations etc.
• Free access to specialist counselling on a range of issues - health; financial; lifestyle; well-being; domestic & neighbourly matters.
• Access to a range of employee benefits including - store discounts; boating holiday discounts; holiday purchase scheme.
• 2 days paid volunteering leave, volunteering for local community project work.

At the Trust we care passionately for our waterways, and as importantly, for those who look after and use them. We strongly believe that a diverse workforce brings with it a diversity of ideas, thinking and ways of working which enhances what we do as a Trust. We are striving to represent the diverse communities that we are a part of and welcome applicants from across all sectors of the community.

All candidates will be treated on the basis of their merits, skills and abilities and solely by being assessed against the requirements for the job.

When you join the Canal & River Trust you become a member of an engaged team working to preserve our heritage for future generations. Come and share your passion and knowledge with a team that makes a difference to millions of people every day.

Find out more about us on our website: https://canalrivertrust.org.uk/about-us]]>