Senior Data Engineer
What is the opportunity?
Join our Data Engineering team in this exciting time as we implement Bank of Ireland's new cloud based data platform and drive the near real-time exploitation of data to support our Digital and Customer strategies.
As Senior Data Engineer, you will be responsible for the technical leadership, hands on design and engineering, and mentoring of data engineers within the Data Engineering function.
We work in a very collaborative environment with a learning culture and you will use your experience to help guide future development across the team, the tools we use, help drive automation and introduce new and exciting test engineering patterns and frameworks.
In this Role, you will
- Provide technical leadership and guidance to other data engineers.
- Take the lead in the design and build of complex data flows and process's using our cloud hosted Enterprise Data Lake and Operational Data Store.
- Collaborate with Technical Leadership across the Bank, to identify market trends, implement internal initiatives, and contribute thought leadership.
- Advocate for and drive Automation across of all elements of Data Delivery, using a wide variety of technologies (including AI) to enhance data engineering processes.
- Drive evolution and implementation of best practices across Design, Engineering, and governance while continuing to meet business requirements
- Make decisions on engineering frameworks, tooling and patterns.
What Will Make You Stand Out
We are seeking a leader with enthusiasm and a growth mentality who prioritises collaboration with others. You are proactive to achieve the necessary outcome while improving processes, people and tooling along the way!
You have a proven track record (7+ years) as a Senior Engineer in Cloud Data Platforms working in an agile team. You have deep technical knowledge of Data Lakes, Cloud Technologies and Architecture, preferably AWS.
Further technical knowledge and/or experience in the below are necessary to apply:
- Strong proficiency in building and optimizing big data pipelines using Python, SQL, Apache Spark.
- Expertise in processing large datasets, streaming data, and unstructured data.
- Expertise in databases like HBase, Hive, Impala.
- Streaming Data Pipelines with tools like Kafka, NiFi, Spark Streaming.
- Design and build of complex data solutions in the cloud.
- Strong DevOps experience of best practices in code management, CI/CD, and merging/branching, utilising tools like Atlassian, git, Jenkins, Ansible etc.
- Strong experience with Workflow orchestration skills using Oozie, Airflow, Ctrl-M.
Experience with any of the following will help you to stand out but is not necessary to apply for this role;
- Cloudera CDH/CDP platform and appropriate Cloudera certifications.
- The ability to derive and communicate Data-Driven insights with Business and Technical teams.
- The ability of identifying and introducing process optimizations.
- Knowledge and experience of Metadata Management Frameworks
Essential Qualifications
There are no specific qualifications or minimum educational requirements needed for this role.
More About The team
Our growing and exciting Data Engineering team provides the engineering services for the Group's Enterprise Data Warehouse, Enterprise Data Lake and Operational Data Store. We sit within the Group Data & Analytics Office which is the core team for all things data in the bank.
We deliver the data elements to support Digital, Customer, Regulatory and other change initiatives that drive the Group's transformation agenda.
We have fully embraced agile software engineering and a DevOps mentality and operate in a highly collaborative team environment.
#li-hybrid #ij-hybrid
Why work with us?
The Bank of Ireland company culture prioritises work-life balance with an opportunity for flexible working, along with 25 days annual leave and excellent pension contributions. Family can mean different things to different people; we offer 6 months paid maternity leave, an innovative fertility and surrogacy policy and working parent supports.
Your wellbeing is important to us; we have an employee assistance program, WebDoctor and financial wellbeing coaches available. We also encourage and support staff to pursue educational and professional qualifications to grow and enhance your career!
Flexible working matching promise
We know how important flexible working arrangements are to our colleagues, and we promise to try to match your current flexible working arrangement in this new role (all existing working arrangements considered!)
Key Competencies
- Customer Focused - People Manager
- One Group, one team - People Manager
- Champion Transformation - People Manager
- Accountable - People Manager
- Manage Risk - People Manager
Where Agency assistance is required Bank of Ireland Recruitment Team will engage directly with suppliers. Unsolicited CVs / profiles supplied to Bank of Ireland by Recruitment Agencies will not be accepted for this role.
We`re on a continuous journey to build an inclusive and diverse workplace. We welcome applications from people of all backgrounds, lived experience, abilities and perspectives. We provide reasonable accommodations at every stage of our recruitment process for disabilities, neurodivergence or medical conditions. If you require an accommodation please complete this form and one of our recruitment team members will be in touch via email.
Any information provided will be treated as confidential within the recruitment team and used only for the purpose of determining and providing appropriate accommodations for the application and recruitment process.