About the role
As part of the Zepz Data Team, you will have the power to ignite change and empower progress through our unwavering commitment to managing the platform and services that fuel insightful and automated decision-making for the betterment of our financial services users. You understand that for our platform to truly make a difference, it must be built on a foundation of reliable, fresh and trustworthy data, and it is our mission to ensure that this is a non-negotiable standard for every user and downstream application. As a Data Ops Engineer, you’ll help build the data platform that will enable multiple companies to better serve the financial needs of migrants. You will work closely with data engineering teams to bring agility, automation and governance to operational processes. Our mission is to build a world-class platform from first principles which will be leveraged both internally and externally. This new platform will enable Zepz (WorldRemit and Sendwave) and its partners to enter new markets while supporting the organisation’s goal of making remittance easy and secure for a global customer base.
Technologies and the environment…
We are using modern cloud-based technologies including databases services (Redshift, Bigquery, Aurora, RDS etc…), data analytics services (Athena, Looker, Glue, Databrew), storage (S3, GCS) and compute services (Lambdas, K8s). We use standard data transformation and orchestration technologies, such as dbt and Airflow. Python is the primary language used for data processing. Standalone applications and/or services may be required to provide supporting functionality, which may include additional frameworks and languages such as Java.
We put a strong emphasis on automation, unit/integration testing and performance testing. We treat our data processing pipelines like any production system because if they fail, our users will be impacted. In Technology we work closely with our product and architecture partners to design scalable solutions that serve our customers.
Reporting to the Snr Manager-Data Infrastructure, you will:
- Use code to solve problems. Configuration, infrastructure, tooling, and automation, everything must be solved by writing code.
- Helping design processes. You’ll be working closely with feature teams to assist with the release of new products, as such there is plenty of scope to design processes that fit in with the overall direction but allow teams to deliver code to production reliably and at pace.
- Helping design architecture. As well as owning the delivery of solutions you will also play a part in designing the architecture, how it interacts with dependencies from a logical and infrastructure viewpoint.
- Growing together. You’ll review others' work and happily seek feedback on yours to ensure we build a better codebase and sharpen each other's skills.
What we’re looking for from you
- Solid experience in a Data Engineer role with a keen interest in solving problems using code.
- 5+ years demonstrated experience, in platform engineering
- Expert Understanding of CI/CD and DevOps methodologies. You understand the build and deployment cycle of an application and how it fits into a global platform.
- High quality standards: data is messy but you treat your systems with the same level of care as any production service.
- Great Terraform Skills. All of our infrastructure is defined using Terraform and deployed using Atlantis. You should have a good understanding of Terraform and be able to solve common issues.
- Containerisation. You have a good understanding of Docker and Kubernetes and how you can leverage these tools to ensure there is zero downtime.
- Holistic view on application delivery. You understand the use of many systems, APM, monitoring, logging, alerting, scaling to build a robust platform for applications to respond to the varying demands from both external sources (traffic) and internal sources (feature team delivery) in a safe and controlled manner.
- Our Cloud Native platform is hosted in AWS. You’ll be comfortable working with a system that supports users from around the world, at scale.
- Agile outlook. You need to be excited about working in a fast-changing environment. Products, tools, frameworks and processes change, we evolve and take the best bits with us. The teams drive the evolution.