We are looking for a Data Engineer with DevOps experience, who is interested in joining our scrum team for the global reporting tool. Your tasks will include:
• DevOps tasks
o Maintaining and further developing the CI/CD pipeline of the service
o Configuration and administration of the used infrastructure components
o Accomplish improvement in performance, reliability, and automation levels.
• Data Engineering tasks
o Develop new functionalities for the data pipeline (including improving data quality functions, harmonization of data over multiple nationalities and calculating out of it new KPIs for the Dashboard usage)
o Maintain and improve existing Global Reporting functionalities
• Overall
o Understand and explain advantages and disadvantages of the proposed solutions to internal and external stakeholders
o Participate in Scrum ceremonies e.g. daily standup, Sprint review
o Resolve incidents and change requests
o Write technical documentation and apply best practices

KEY REQUIREMENTS/SKILLS/EXPERIENCE
The Global Reporting service is a reporting service based on Cloud components (at the moment Azure Data Factory, planned for future is a migration to AWS). Data is collected from individual country based databases, processed in our pipeline and aggregated to final KPIs. Those are used for analysis and underwriting purposes of the group.
A successful candidate is expected to provide the following knowledge:
• Experience building and optimizing “big data” pipelines and architectures particularly using Azure Data Factory and Apache spark
• Practical experience with development/maintenances of CI/CD pipelines
• Hands-on experience with Azure Cloud services
• Hands-on experience with relational databases (i.e. PostgreSQL)
• Hands-on experience with AWS is a plus
• General understanding of Networking and IT Security Principles
• Experience with Databricks is a plus
• Extensive practical experience with Linux, shell scripting and GIT
• Working Experience with Kubernetes and Docker containers
• Good knowledge of Terraform and Helm
• Experience with Data Governance Frameworks (e.g. Informatica) and principles is a plus

Other Skills
• Bachelor (BSc), Master (MSc) or equivalent practical experience in a technical field (for example, Computer Science, Engineering)