Future Opportunity - Data Engineer Senior Consultant

This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board.

Apply for future opportunities

Are you looking for work that makes a difference? Do you want to work with people who learn and grow together?

If so, Opencast could be the place for you. We're a growing tech consultancy that creates user-centred solutions with purpose for our clients in government and business.

The role

You'll play a crucial role in designing, developing, and maintaining data solutions for our clients.

Your focus will be to create efficient and scalable data pipelines, enable data-driven decision-making, and support business intelligence initiatives.

Collaborating with cross-functional teams, you'll contribute to the successful delivery of data-driven projects. You'll ensure data integrity, security, and compliance.

Essential experience

We'll want you to demonstrate experience of data engineering. You don't need to have had the job title of data engineer before.

• knowledge of data modelling business processes for both operational (OLTP) and reporting (OLAP) stores, with a deep understanding of logical and physical data models.

• enabled data consistency, both via auditing existing data for contextual anomalies, as well as ensuring data quality in existing pipelines.

• familiarity with business intelligence (BI) processes and tools, such as PowerBI or Tableau, with the ability to support analysts using these tools to get the most out of the data.

• experience leveraging cloud services for big data storage, processing, and analytics, while optimising costs and performance, with specific expertise in Azure or AWS based workflows.

• proven experience in data integration techniques, including Extract, Transform, Load (ETL) processes with technologies such as Apache Hadoop or Spark.

• knowledge of database management systems, both traditional and NoSQL, with proficiency in writing and optimising SQL queries, with significant experience in at least one of:

o SQL Server

o PostgreSQL

o Oracle

o MongoDB

• understanding of data warehousing principles and methodologies such as the Kimball and Inmon approaches.

• proficiency in at least one programming language (e.g., Python, Java, Scala) used for data processing and manipulation.

• knowledge of best practices including governance, data quality management, metadata management and data security measures.

As well as data engineering skills, there are essential core skills you'll need to be a great consultant.

In the interview, please show how you:

• have effective communication skills to collaborate with both technical and non-technical team stakeholders.

• work in an Agile development environment.

• use problem-solving to address complex challenges.

Desirable experience

Some areas of experience are not essential but relevant to the role:

• Microsoft Azure PaaS and IaaS.

• AWS PaaS and IaaS.

• Informatica Data Governance.

• Erwin data modelling solution.

• Databricks lakehouses and notebook based processing.

• Machine learning concepts and developing data pipelines for ML engines such as TensorFlow.

• DevOps/DataOps practices for continuous integration, deployment and processing of data solutions.

• Real-time data streaming technologies like Apache Kafka, AWS Kinesis or Azure Event Hubs.

If you don't have this experience please do still apply, as we can coach you in these areas if you join us.

Salary

Senior consultant salary range: £60,000-£78,000

What our offer includes

Competitive pension, health cash plan, share options and discretionary bonus.

Flexible hours and 25 days' holiday.

People to support you every step of the way.

Where you'll work

Our hybrid model means you could work from our HQ, a city hub, client site or home.

We include you

We won't discriminate on age, disability, ethnicity, family status, gender, race, religion or sexual orientation. We'll consider applicants from overseas.

Interview

Job interviews are on Microsoft Teams. We'll make any adjustments to help you.

Want to know more?

Visit our website or email careers@opencastsoftware.com