Senior Data Engineer

Senior Data Engineer

This job is no longer open

Introduction to Demandbase: 

Demandbase is the Smarter GTM™ company for B2B brands. We help marketing and sales teams overcome the disruptive data and technology fragmentation that inhibits insight and forces them to spam their prospects. We do this by injecting Account Intelligence into every step of the buyer journey, wherever our clients interact with customers, and by helping them orchestrate every action across systems and channels - through advertising, account-based experience, and sales motions. The result? You spot opportunities earlier, engage with them more intelligently, and close deals faster. 

As a company, we’re as committed to growing careers as we are to building world-class technology. We invest heavily in people, our culture, and the community around us. We have offices in the San Francisco Bay Area, New York, Seattle, and teams in the UK and India, and allow employees to work remotely. We have also been continuously recognized as one of the best places to work in the San Francisco Bay Area.

We're committed to attracting, developing, retaining, and promoting a diverse workforce. By ensuring that every Demandbase employee is able to bring a diversity of talents to work, we're increasingly capable of living out our mission to transform how B2B goes to market. We encourage people from historically underrepresented backgrounds and all walks of life to apply. Come grow with us at Demandbase!

About the Role:

In this position, you will be creating and orchestrating multiple ETL pipelines. The pipelines will ingest data from various sources, transform the data using application-specific logic and then load the data to a data warehouse for analytical queries. The main technologies include Spark, Airflow, ClickHouse, Scala, Python, and SQL.

What we’re looking for:

  • 2+ years of experience in functional programming in Scala
  • Concepts like immutability, optional values, and pattern matching should feel familiar if not practiced.
  • Solid knowledge of backend server components, performance optimization, and scaling complex systems
  • Able to write complex database queries in SQL.
  • Able to write idiomatic Scala as well as easily understand existing code written in Scala
  • Collaborate with data scientists and architects to improve the architecture, scalability, stability, and improve performance of ML pipeline deployment
  • Build new services and integrations to connect machine learning intelligence with the Demandbase SaaS platform
  • Able to build, deploy and monitor a microservice from scratch.
  • Experience with Postgres and any columnar database.

Desired:

  • Experience in optimizing and scaling Spark applications
  • Hands-on development experience scaling complex systems

Benefits:

Our benefits include options for up to 100% paid Medical, Dental, and Vision premiums for you and your entire family, $1,000 personal development stipend, flexible PTO policy, no internal meeting Fridays, Modern Health mental wellness platform, Headspace, Ginger, and 13 paid holidays and 2 additional weeks where all Demandbase employees take off (week of July 4th and Thanksgiving). Plus 401(k), short-term/long-term disability, life insurance, and all those good things.

This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.