Software Engineer, Data Platform (Data Catalog)

Software Engineer, Data Platform (Data Catalog)

This job is no longer open

See yourself at Twilio

Join the team as our next Software Engineer, Data Platform (Data Catalog)

Who we are & why we’re hiring

Twilio powers real-time business communications and data solutions that help companies and developers worldwide build better applications and customer experiences.

Although we're headquartered in San Francisco, we're on a journey to becoming a globally antiracist company that supports diversity, equity & inclusion wherever we do business. We employ thousands of Twilions worldwide, and we're looking for more builders, creators, and visionaries to help fuel our growth momentum.

About the job

Twilio's Data Platform org is looking for Software Engineers to join our Storage and Compute team. The team manages Twilio’s GDPR compliant data lake at PB scale and runs Twilio’s complex data pipelines. To achieve this, we leverage technologies that include AWS cloud infrastructure and APIs, open source projects like Apache Spark, Apache Kafka, Apache Hudi etc., Rest APIs and also build our own services or contribute to open source projects. This data lake is an integral part of some of Twilio’s core products and also enables business teams to do analytics and make well informed data driven decisions.

We’re looking for a software engineer to help us scale and build Twilio’s next gen Data Backbone providing a rock-solid end to end data pipeline on our data infrastructure and shape the ecosystem of how Twilio thinks about data engineering at large. They should live the Twilio Magic and also have :

Responsibilities

In this role, you’ll design, implement and operate services that will process hundreds of million records daily. You will live the Twilio Magic values:

  • WEAR THE CUSTOMER’S SHOES: You are driven more by customer impact than technology.
  • DRAW THE OWL: Not every problem has a textbook solution. You will be expected to research the unknowns, implement and iterate. Educate your team as you go.
  • DON’T SETTLE: Live and champion mature, high-quality engineering through writing tests, valuing code maintainability, documenting your work, etc
  • WRITE IT DOWN: Twilio is a global, fast-growing company that builds complex systems. To be successful in joining these globally built complex parts of the system, You will be expected to write down the requirements, design, implementation, etc.
  • EMPOWER OTHERS: Collaborate with other teams and work cross-functionally for product launches.

Qualifications 

Not all applicants will have skills that match a job description exactly. Twilio values diverse experiences in other industries, and we encourage everyone who meets the required qualifications to apply. While having “desired” qualifications make for a strong candidate, we encourage applicants with alternative experiences to also apply. If your career is just starting or hasn't followed a traditional path, don't let that stop you from considering Twilio. We are always looking for people who will bring something new to the table!

Required:

  • 4+ years of experience developing globally distributed systems
  • Experience in Java or Scala, Python familiarity is also useful
  • Understanding and experience in Agile/Scrum methodologies
  • Understanding of AWS (or similar) cloud infrastructure to own and operate production services
  • Strong communication skills and desire to make an impact and thrive in small, collaborative, energetic teams
  • Degree in Computer Science or a related field, or equivalent work experience

Desired:

  • Experience building data platforms and data pipelines
  • Committer or Contributor to open source projects such as Apache Spark, Hudi, Kafka, Hive, Presto etc.

Location 

This role will be based in Remote Canada. 

What We Offer

There are many benefits to working at Twilio, including, in addition to competitive pay, things like generous time-off, ample parental and wellness leave, healthcare, a retirement savings program, and much more. Offerings vary by location.

Twilio thinks big. Do you?

We like to solve problems, take initiative, pitch in when needed, and are always up for trying new things. That's why we seek out colleagues who embody our values — something we call Twilio Magic. Additionally, we empower employees to build positive change in their communities by supporting their volunteering and donation efforts.

So, if you're ready to unleash your full potential, do your best work, and be the best version of yourself, apply now!

If this role isn't what you're looking for, please consider other open positions.

 

This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.