Manager - Data Engineering

Job Ref. No. JLIL213

Role Purpose

The Manager-Data engineering will oversee expanding and optimizing of our data architecture and data pipeline with the purpose of improving data analysis and ML workflows. The role holder will be handling the design and construction of scalable data systems and research new use cases for data acquisition.

Qualifications

• Bachelors’ degree in IT or related field.
  
• Certification in Azure/GCP/AWS preferred.
  

Relevant Experience

• Minimum three years’ experience in a data engineer role or similar.
  
• Experience and knowledge of a coding language such as Python specifically data manipulation.
  

Job Ref. No. JLIL213

Role Purpose

The Manager-Data engineering will oversee expanding and optimizing of our data architecture and data pipeline with the purpose of improving data analysis and ML workflows. The role holder will be handling the design and construction of scalable data systems and research new use cases for data acquisition.

Qualifications

• Bachelors’ degree in IT or related field.
  
• Certification in Azure/GCP/AWS preferred.
  

Relevant Experience

• Minimum three years’ experience in a data engineer role or similar.
  
• Experience and knowledge of a coding language such as Python specifically data manipulation.
  

Operational

• Follow existing processes and work to improve/identify gaps in these processes.
  
• Ensure the correct SDLC promotion processes are followed.
  
• Follow the correct sign-off processes to ensure that only approved releases are deployed into Production.
  
• Ensure that all AWS/Azure development follows CI/CD processes and is repeatable.
  

Strategy

• Design and develop a data estate that is performant, accessible, secure, scalable, maintainable, and extensible. This includes AWS/Azure Data Lake and all other integrating functionalities and layers like ML, Analytics and data science.
  
• Design and develop and maintain data pipelines including ML pipelines.
  
• Model EDW entities and ensure all data is complete, accurate, timely, and well documented.
  
• Work towards the implementation of a true Self-Service analytics platform.
  
• Implementation of CI/CD practices within the data platform
  

Corporate Governance (Regulatory & Compliance)

• Ensure compliance with regulatory and industry standards, data privacy, security, and governance requirements.
  
• Ensure that all work follows the best security practices and fully adheres to DPA and other data regulations.
  
• Ensure that all work follows the correct approval and sign-off process before it is pushed into Production.
  
• Ensure that all work is documented and if needed, has a runbook in order to guarantee business continuity and support.
  
• Work with others in the team to keep the Data Dictionary and Ubiquitous Language complete and up to date.
  

Leadership & Culture

• Build relationships with members of the data team and the wider business team.
  
• Work closely and collaboratively with all members of the data team.
  
• Work closely with and learn from tech and team leads and challenge proposed solutions with your own ideas.