Staff Data Platform Engineer, Compute - Twilio Engage

Staff Data Platform Engineer, Compute - Twilio Engage

This job is no longer open

See yourself at Twilio

Join the team as our next Staff Data Platform Engineer.

Who we are & why we’re hiring

Twilio powers real-time business communications and data solutions that help companies and developers worldwide build better applications and customer experiences.

 

Although we're headquartered in San Francisco, we're on a journey to becoming a globally antiracist company that supports diversity, equity & inclusion wherever we do business. We employ thousands of Twilions worldwide, and we're looking for more builders, creators, and visionaries to help fuel our growth momentum.

About the job

As a Data Platform Engineer on the Twilio Engage Compute team, you’ll build systems that process hundreds of thousands of data points per second and data models that unlock rich capabilities for our customer data platform (CDP) engine. Our Data Platform Engineers have a deep understanding of large distributed systems which comprise the compute kernels that rely on this data. You’ll be responsible for leading execution and guiding the technical decisions of the team to deliver high business impact.

 

Twilio Engage is the world’s first growth platform powered by customer data. Imagine a platform that can take hundreds of thousands of messages entering Twilio Segment’s pipelines every second, add in an identity graph, overlay high-speed databases and realtime and batch computation engines — and you have the Twilio Engage platform. This platform unlocks our ability to build key business growth features like audience management, real-time personalization, and data-driven marketing campaigns.  

 

We iterate quickly on these products and features and learn new things daily — all while writing quality code. We work closely with product and design and solve some of the toughest engineering problems to unlock new possibilities for our customers. If you get excited by building products with high customer impact — this is the place for you.

Responsibilities

In this role, you’ll:

 

  • Lead the execution of building our next query engine that powers the leading customer data platform (CDP)
  • Scale our existing data processing pipelines to match growth in customer demand
  • Build highly performant solutions that unlock differentiated CDP capabilities at scale
  • Collaborate with subject matter experts, fellow developers, and internal stakeholders to turn technical roadmaps and goals into business impact
  • Maintain a high bar of operational excellence for our systems and services as well as a high standard for data quality, consistency, and compliance
  • Mentor engineers on the team, leading projects, sharing domain knowledge, and positively influencing their careers

 

Qualifications

Not all applicants will have skills that match a job description exactly. Twilio values diverse experiences in other industries, and we encourage everyone who meets the required qualifications to apply. While having “desired” qualifications make for a strong candidate, we encourage applicants with alternative experiences to also apply. If your career is just starting or hasn't followed a traditional path, don't let that stop you from considering Twilio. We are always looking for people who will bring something new to the table!

 

Required:

  • 5+ years  of experience writing production-grade code in a modern programming language
  • Strong background in distributed data processing, software engineering of data services and/or data stores
  • Familiar with big data technologies like Apache Iceberg, Spark, Trino and comfortable working with commerce-scale datasets
  • Highly effective collaborator who works well with teammates and product partners to deliver completed work on time
  • Well-versed in concurrent programming
  • Solid grasp of Linux systems and networking concepts
  • Experience maintaining and operating always-on cloud services
  • Comfortable asking questions and taking initiative to solve problems in a rapidly growing company, where it is often necessary to “draw the owl
  • Demonstrated commitment to seeking diverse viewpoints and acting with intention to create an inclusive team environment
  • Excellent written and verbal communications skills

 

Desired:

  • Experience with Trino, Spark, or other distributed compute frameworks
  • Experience with Apache Iceberg and Parquet
  • Experience with Golang or Scala
  • Experience managing AWS infrastructure
  • Familiarity with BigQuery

 

Location 

This role will be remote and based in the USA.

What We Offer

There are many benefits to working at Twilio, including, in addition to competitive pay, things like generous time-off, ample parental and wellness leave, healthcare, a retirement savings program, and much more. Offerings vary by location.

Twilio thinks big. Do you?

We like to solve problems, take initiative, pitch in when needed, and are always up for trying new things. That's why we seek out colleagues who embody our values — something we call Twilio Magic. Additionally, we empower employees to build positive change in their communities by supporting their volunteering and donation efforts.

 

So, if you're ready to unleash your full potential, do your best work, and be the best version of yourself, apply now!


If this role isn't what you're looking for, please consider other open positions.

 

 

*Please note this role is open to candidates outside of Colorado, California, New York, and Washington. The information below is provided for candidates hired in those locations only.

The estimated pay ranges for this role are as follows:

  • Based in Colorado: $160,080.00-$220,110.00
  • Based in New York, Washington State or California (outside the San Francisco Bay Area): $169,520.00-$211,900.00
  • Based in the San Francisco Bay area, California: $188,320.00-$235,400.00
  • This role is eligible to participate in Twilio's equity plan and the following benefits: health care insurance, 401(k) retirement account, paid sick time, paid personal time off, paid parental leave. 

The successful candidate’s starting salary will be determined based on permissible, non-discriminatory factors such as skills, experience, and geographic location within the state. 

ined based on permissible, non-discriminatory factors such as skills, experience, and geographic location within the state.

This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.