Data Engineer - Senior Consultant
This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board.
The role
You'll play a crucial role in designing, developing, and maintaining data solutions for our clients.
Your focus will be to create efficient and scalable data pipelines, enable data-driven decision-making, and support business intelligence initiatives.
Collaborating with cross-functional teams, you'll contribute to the successful delivery of data-driven projects. You'll ensure data integrity, security, and compliance.
Essential experience
Please note, you will need to hold valid Security Clearance or eligibility (5+ years residency in the UK)
We'll want you to demonstrate experience of data engineering. You don't need to have had the job title of data engineer before.
• knowledge of data modelling business processes for both operational (OLTP) and reporting (OLAP) stores, with a deep understanding of logical and physical data models.
• enabled data consistency, both via auditing existing data for contextual anomalies, as well as ensuring data quality in existing pipelines.
• familiarity with business intelligence (BI) processes and tools, such as PowerBI or Tableau, with the ability to support analysts using these tools to get the most out of the data.
• experience leveraging cloud services for big data storage, processing, and analytics, while optimising costs and performance, with specific expertise in Azure or AWS based workflows.
• proven experience in data integration techniques, including Extract, Transform, Load (ETL) processes with technologies such as Apache Hadoop or Spark.
• knowledge of database management systems, both traditional and NoSQL, with proficiency in at least one of SQL Server, PostgreSQL, Oracle, MongoDB.
• understanding of data warehousing principles and methodologies such as the Kimball and Inmon approaches.
• proficiency in at least one programming language (e.g., Python, Java, Scala) used for data processing and manipulation.
• knowledge of best practices including governance, data quality management, metadata management and data security measures.
As well as data engineering skills, there are essential core skills you'll need to be a great consultant.
In the interview, please show how you:
• have effective communication skills to collaborate with both technical and non-technical team stakeholders.
• work in an Agile development environment.
• use problem-solving to address complex challenges.
Desirable experience
Some areas of experience are not essential but relevant to the role:
• Microsoft Azure PaaS and IaaS.
• AWS PaaS and IaaS.
• Informatica Data Governance.
• Erwin data modelling solution.
• Databricks lakehouses and notebook based processing.
• Machine learning concepts and developing data pipelines for ML engines such as TensorFlow.
• DevOps/DataOps practices for continuous integration, deployment and processing of data solutions.
• Real-time data streaming technologies like Apache Kafka, AWS Kinesis or Azure Event Hubs.
If you don't have this experience please do still apply, as we can coach you in these areas if you join us.
Salary
Senior consultant salary range: £60,000-£78,000
What our offer includes
Competitive pension, health cash plan, share options and discretionary bonus.
Flexible hours and 25 days' holiday.
People to support you every step of the way.
Where you'll work
Your working time at Opencast will be split between multiple locations, including from our HQ and hub locations, client site or home. Travel across the UK is part of life at Opencast. This varies in frequency, and takes into account requirements of your work, our clients and your team.
We include you
We welcome candidates from all identities, attributes, ways of thinking and backgrounds to thrive in a career at Opencast. Our aim is for the diversity of our people to be reflected in the solutions we deliver, to help create a fairer society for all.
Interview
Job interviews are on Microsoft Teams. We'll make any adjustments to help you.
Want to know more?
Visit our website or email careers@opencastsoftware.com
£60,000 - £78,000 a year