Skip to main content

Senior Data Engineer

What is the opportunity?

Join our Data Engineering team in this exciting time as we implement Bank of Ireland's new cloud based data lake, take advantage of AI opportunities and transition workloads to that new Enterprise Data Lake platform.

As Senior Data Engineer, you will be responsible for the technical leadership, hands on engineering and mentoring of data engineers within the Data Engineering function.

We work in a very collaborative environment with a learning culture and you will use your experience to help guide future development across the team, the tools we use, help drive automation and introduce new and exciting test engineering patterns and frameworks.

In this Role, you will

  • Provide technical leadership and guidance to other data engineers
  • Take the lead in the design and build of complex data flows and process's using our Enterprise Data Lake and Cloud Data Platform
  • Make decisions on engineering frameworks, tooling and patterns
  • Advocate and drive Automation and the adoption of processes such as TDD
  • Be naturally curious and have experimented the use of AI to enhance software engineering processes
  • Solve complex technical problems and provide creative solutions from your experience or through a rational problem solving process.
  • Ensure teams are following engineering best practices, our engineering standards and process's while driving improvements in parallel
  • Ensure that technical development processes, standards, governance and tooling are appropriate and effective for the Enterprise Data Lake and Operational Data Store and meet business requirements

What Will Make You Stand Out

We are seeking a leader with enthusiasm and a growth mentality who prioritises collaboration with others. You are proactive to achieve the necessary outcome while improving processes, people and tooling along the way!

You have a proven track record (7+ years) as a Senior Engineer in the Data Lake or Data Warehouse domain working in an agile team. You have deep technical knowledge of Data Lakes, Cloud Technologies and Architecture, preferably AWS.

Further technical knowledge and/or experience in the below are necessary to apply:

  • Proficiency in SQL, Python and Scala.
  • Expertise in processing large datasets, streaming data, and unstructured data using HBase, Hive, Impala, Spark.
  • Streaming Data Pipelines with tools like Kafka, NiFi, Spark Streaming.
  • Workflow orchestration skills using Oozie, Airflow, Ctrl-M.
  • Familiar with AI concepts and willingness to explore LLM's, Generative AI and Machine Learning
  • Knowledge in Metadata Management, Governance frameworks (Atlas, Collibra), and Reporting tools (Observability, Looker, Tableau, Qlikview).
  • Building data solutions on AWS
  • Strong knowledge of Cloud Data Platforms and data pipelines
  • Data Ops expertise including Bitbucket, Jenkins, Terraform.
  • Scrum/Kanban, SAFe delivery methodologies.

Experience with any of the following will help you to stand out but is not necessary in order to apply for this role;

  • REST APIs
  • Cloudera CDH/CDP platform and appropriate Cloudera certifications
  • The ability to derive and share Data-Driven insights with Business and Technical teams
  • The ability of identifying and introducing process optimizations

Essential Qualifications

There are no specific qualifications or minimum educational requirements needed for this role.

More About The team

Our growing and exciting Data Engineering team provides the engineering services for the Group's Enterprise Data Warehouse, Enterprise Data Lake and Operational Data Store. We sit within the Group Data & Analytics Office which is the core team for all things data in the bank.

We deliver the data elements to support Digital, Customer, Regulatory and other change initiatives that drive the Group's transformation agenda.

We have fully embraced agile software engineering and a DevOps mentality and operate in a highly collaborative team environment.

#li-hybrid #ij-hybrid

Why work with us?

The Bank of Ireland company culture prioritises work-life balance with an opportunity for flexible working, along with 25 days annual leave and excellent pension contributions. Family can mean different things to different people; we offer 6 months paid maternity leave, an innovative fertility and surrogacy policy and working parent supports.

Your wellbeing is important to us; we have an employee assistance program, WebDoctor and financial wellbeing coaches available. We also encourage and support staff to pursue educational and professional qualifications to grow and enhance your career!

Flexible working matching promise

We know how important flexible working arrangements are to our colleagues, and we promise to try to match your current flexible working arrangement in this new role (all existing working arrangements considered!)

Key Competencies

  • Customer Focused - People Manager
  • One Group, one team - People Manager
  • Champion Transformation - People Manager
  • Accountable - People Manager
  • Manage Risk - People Manager

Where Agency assistance is required Bank of Ireland Recruitment Team will engage directly with suppliers. Unsolicited CVs / profiles supplied to Bank of Ireland by Recruitment Agencies will not be accepted for this role.

We're on a continuous journey to build an inclusive and diverse workplace. We welcome applications from people of all backgrounds, lived experience, abilities and perspectives. Reasonable accommodations are offered at every stage of our recruitment process. If you require any assistance, please complete this form and one of our recruitment team members will be in touch via email.

Any information provided will be treated as confidential within the recruitment team and used only for the purpose of determining and providing appropriate accommodations for the application and recruitment process.

Senior Data Engineer

Dublin
Full-Time

Published on 18/06/2024

Share this job now