The Position

Twitter has very large and complex datasets. As a Twitter Data Engineer you will build datasets and make them accessible to our partner teams by writing great production code to simplify the complexity. Your work will enable Product Managers and other decision-makers across the company to bring together insights and inform our product and strategy. In every decision that you influence, you will see the product improve and be more valuable to Twitter users.

We are trying to improve Twitter. To improve something, we need to be able to measure it. As a Data Engineer you will enable better measurements and ensure measurement accuracy so that we know where we are doing well and where we want to improve.

As such, you will:

• Design, develop, and launch extremely efficient and reliable data pipelines to move data and to provide intuitive analytics to our partner teams.
• Make Twitter-scale data more discoverable and easy to use for Data Scientists and Analysts across the company.
• Collaborate with other engineers and Data Scientists to discover the best solutions.
• Support your colleagues by reviewing code and designs.
• Diagnose and solve issues in our existing data pipelines and envision and build their successors.

Qualifications

• B.S. and/or M.S. in Computer Science or a related technical field, or equivalent experience
• 4+ years of experience in either data infrastructure or backend systems
• Strong understanding of SQL
• Broad knowledge of the data infrastructure ecosystem
• Experience with Hadoop or other MapReduce-based architectures
• Experience working with large data volumes
• Good understanding of one or more of the following: Scala, C++, or Java

Company Description

Twitter users generate many terabytes of data every day; Twitter engineers run hundreds of experiments; Twitter Data Engineers build data pipelines and data processes that calculate metrics and scale increasingly sophisticated models of users and content.

The Data Science team at Twitter is at the intersection of all this data and strives to make it actionable to all business units around Twitter. Data Engineers work alongside Data Scientists analyze this data via observational analyses, trend analyses, modeling, and new measurement strategies. We also implement metrics to track the impact of new product experiments and more generally find ways to make very large scale data approachable to guide our decisions.

Additional Information

We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, ethnicity, color, ancestry, national origin, religion, sex, sexual orientation, gender identity, age, disability, veteran, genetic information, marital status or any other legally protected status.

San Francisco applicants: Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.