Senior Data Engineer - Data Platforms

Senior Data Engineer - Data Platforms

This job is no longer open

About the role

At Shopify, Senior Data engineers use their expertise and passion to multiply the overall output of their group. You and the team will empower all teams at Shopify to build data platform applications. Data Scientists depend on the work you do to get their job done. You will maintain a high bar for quality and mentor other engineers. And of course, you will be hands-on in the code and contribute technically.

As a technical leader of the Data Platform, you will:

  • Contribute to the development of systems for discovering, transforming and exploring large scale datasets

  • Work closely with peer teams in Data Platform to build out scalable solutions 

  • Collaborate on system architecture, design and drive implementation of Data Platform solutions 

  • Work closely with Shopify’s Data Scientists to build for their workflows 

Qualifications

Experience and skills that are important for success in this role:

  • Proven track record of success in providing technical leadership to large software development teams where strong technical mentorship is important

  • Experience working with data technologies (such as Apache Iceberg, Apache Spark, DBT, Trino)

  • Experience with the internals of large scale data engines (such as Apache Flink / Apache Spark / Trino)

  • Track record of productionizing distributed systems

  • End to end experience with technologies used for processing large scale data

  • Experience building and supporting the technical vision of distributed systems  

  • Experience with cloud infrastructure (Google Cloud Platform, Kubernetes, Terraform)

  • Exceptional communication skills

Preferred qualifications:

  • Committer to the Iceberg/Trino/Airflow/PySpark/DBT communities  or to other distributed data related open-source software projects

  • Experience with Experience with modern big data storage technologies (Apache Iceberg, Trino, Flink)

  • An opportunity to have massive impact. Joining us in the beginning of our journey, you will help us evolve the data platform to enable data processing applications processing data from millions of shops with strict reliability and performance needs. You will help us make working with data easy and operationally mature at Shopify.

  • A group of exceptionally talented and dedicated peers with which to collaborate. You will be joining a group of 40+ engineers as a senior technical lead,. 

  • A constant stream of new things to learn. We're always expanding into new areas, bringing in open source projects, contributing back, and exploring new technologies.

Our belief is that a strong commitment to diversity & inclusion enables us to truly make commerce better for everyone. We encourage applications from Indigenous peoples, racialized people, people with disabilities, people from gender and sexually diverse communities, and/or people with intersectional identities. Please take a look at our Sustainability Reports to learn more about Shopify’s commitments to our communities, and our planet.

At Shopify, we understand that experience comes in many forms. We’re dedicated to adding new perspectives to the team - so if your experience is this close to what we’re looking for, please consider applying.

This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.