Senior Data Engineer, Platform Engineering

Senior Data Engineer, Platform Engineering

This job is no longer open

Stack Overflow empowers the world to develop technology through collective knowledge. More than 100 million people visit Stack Overflow every month, making it one of the most-visited websites in the world.

Best known for its public platform, Stack Overflow helps people find the answers they need, when they need them. That includes serving up relevant technologies to the community through Stack Overflow Advertising, providing direct access to technology-specific subject matter experts with Collectives™, sharing more about companies as future employers, and helping teams scale with its market-leading knowledge sharing and collaboration platform, Stack Overflow for Teams.

The Data Platform team at Stack Overflow builds and maintains the data processing and analytic pipelines that democratize access to data across our organization.  Your cross-functional team will optimize flow and collection of all of our product and business data, enabling data at scale for Stack Overflow.  You’ll ensure that our data delivery architecture is optimized and consistent, enabling software engineers, database architects, data analysts, and data scientists to do their best work.

Data engineers have several key responsibilities:

  • Create and maintain optimal data pipeline architecture to extract, transform, and load data from a wide variety of data sources using SQL and Azure “big data” technologies
  • Assemble large, complex data sets that meet functional / non-functional business requirements
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Keep our data separated and secure across national boundaries through multiple data centers and Azure regions
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader

Skills and Requirements

We expect to see:

  • 5+ years experience building and optimizing “big data” pipelines, architectures, and data sets
  • 5+ years working SQL knowledge and experience working with relational databases, query authoring (SQL), as well as working familiarity with a variety of database platforms
  • 5+ years working with Python
  • Strong analytic skills related to working with free-form text
  • 5+ years experience building processes supporting data transformation, data structures, metadata, dependencies, and workload management 
  • A track record of leading and mentoring less experienced developers. You are eager to teach others and invested in the growth of your team.
  • Self-motivating, self-directing, and a great communicator (written and oral). You thrive in an environment that grants you a lot of autonomy to explore creative solutions.
  • Excellent problem solving skills. You excel at analyzing and solving problems using technology.
  • Living and working within GMT-7:00 (US) to GMT+2:00 (Europe) time zones.

We like to see (but not required):

  • Experience with Microsoft technologies and Azure cloud services for building and operating data pipelines
  • Experience working remotely and/or working with teams that are distributed geographically.
  • Experience with Agile methodologies such as Scrum, XP, or Kanban. Certification is a plus, but not a requirement.
  • An active Stack Overflow profile, open source code, example projects that you're proud of (whether open source or worked on at a previous job), or any other evidence of your passion for building great software.
  • Knowledge of how Stack Overflow works from our blog, podcasts, and other public artifacts. Ideas about how to evolve the platform and increase our impact on the developer community are even better.
  • Experience with leveraging cloud-native technologies and techniques to build product ecosystems

Some of what you’ll get in return:

  • Competitive Base Salary between $150,000 - $175,000
  • Generous paid vacation
  • Generous parental leave (16 weeks at 100% pay), family care leave, and unlimited sick days
  • Equity for all employees at all level
  • Industry-leading health benefits that are applicable per country of residence for all our full-time employees
  • Company-paid Life Insurance 
  • Health & wellness stipend
  • Home Internet stipend
  • Professional allocation for your growth and development
  • Company-paid access to Calm, Bravely, LinkedIn Learning, and Overdrive

If your role is not located in one of our offices…. We’ll reimburse you up to $2,000 to set up a great home office.

If you want to work in our office… You’ll be in our headquarters in New York City, and enjoy additional benefits like free lunches, transportation reimbursement, and all the espresso you can drink.

Work Environment:

We’re a remote-friendly team. Whether you work remotely or work out of our New York office (re-opening voluntarily Fall 2021), you’ll be part of a remote work culture that emphasizes online communication (Slack, GitHub, Hangouts, Zoom, Stack Overflow for Teams).

We value diversity at our company. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or any other applicable legally protected characteristics in the location in which the candidate is applying. For job positions in San Francisco, CA, and other locations where required, we will consider for employment qualified applicants with arrest and conviction records.

Diverse teams build better products.

Legally, we need you to know this:

Stack Exchange, Inc. does not discriminate in employment matters on the basis of race, color, religion, gender, national origin, age, military service eligibility, veteran status, sexual orientation, marital status, disability, or any other protected class. We support workplace diversity.

But we want to add this:

We strongly believe that diversity of experience contributes to a broader collective perspective that will consistently lead to a better company and better products. We are working hard to increase the diversity of our team wherever we can and we actively encourage everyone to consider becoming a part of it.

#LI-JO1

#LI-remote

This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.