Senior Data Engineer (Data Systems)

Senior Data Engineer (Data Systems)

This job is no longer open

Introduction to Demandbase: 

Demandbase is the Smarter GTM™ company for B2B brands. We help marketing and sales teams overcome the disruptive data and technology fragmentation that inhibits insight and forces them to spam their prospects. We do this by injecting Account Intelligence into every step of the buyer journey, wherever our clients interact with customers, and by helping them orchestrate every action across systems and channels - through advertising, account-based experience, and sales motions. The result? You spot opportunities earlier, engage with them more intelligently, and close deals faster. 

As a company, we’re as committed to growing careers as we are to building world-class technology. We invest heavily in people, our culture, and the community around us. We have offices in the San Francisco Bay Area, New York, Seattle, and teams in the UK and India, and allow employees to work remotely. We have also been continuously recognized as one of the best places to work in the San Francisco Bay Area.

We're committed to attracting, developing, retaining, and promoting a diverse workforce. By ensuring that every Demandbase employee is able to bring a diversity of talents to work, we're increasingly capable of living out our mission to transform how B2B goes to market. We encourage people from historically underrepresented backgrounds and all walks of life to apply. Come grow with us at Demandbase!

About the Role:

The compensation range for this role is: $146,000 - $259,000

In this role, you will help build the next generation unified data platform that will combine datasets from across the Demandbase ecosystem. Using the latest open source tools, you'll solve complex data warehousing problems to ensure quality, discoverability and accessibility of data. You'll build batch and streaming data pipelines for ingestion, normalization and analysis; in addition, you'll develop standard design and access patterns that will allow these pipelines to stay flexible and grow over time as the needs of the business change. You'll be a leader in the unification of data from our multiple products as we come together as one Demandbase platform.

What you’ll be doing:

  • Build out all aspects of the Demandbase Data ecosystem and move products from R&D into production scale
  • Design and build data pipelines to create the next generation of Demandbase’s Unified Data Platform
  • Work across the data stack to build and productionalize data pipelines for massive amounts of data
  • Build DAGs in Airflow for orchestration and monitoring of data pipelines

What we’re looking for:

  • Four-year degree in Computer Science, or related field OR equivalent experience
  • Progressive experience in all of the following areas:
    • Designing frameworks and writing efficient data pipelines, including batches and real time streams
    • Understanding of data strategies, articulate data analysis & data model design and evolve data products according to business requirements.
    • Experience with the Spark Ecosystem (YARN, Executors, Livy, etc)
    • Experience in large scale data streaming, particularly Kafka or similar technologies (Pulsar, Kinesis, etc)
    • Experience with data orchestration frameworks, particularly Airflow or similar
    • Experience with columnar data stores, particularly Parquet and Clickhouse
    • Strong SDLC principles (CI/CD, Unit Testing, git, etc)
    • General understanding of AWS EMR, EC2, S3

Even better if you have….

  • Experience with 
    • “Lakehouse” technologies, particularly Iceberg or similar (DeltaLake, Hudi, etc)
    • Terraform for AWS
    • Astronomer
  • Open Source contribution experience

Benefits:

Our benefits include options for up to 100% paid Medical, Dental, and Vision premiums, flexible PTO policy, no internal meeting Fridays, Modern Health mental wellness platform, and 11 paid holidays and 2 additional weeks where all Demandbase employees take off (the week of July 4th and the week of Thanksgiving). Plus 401(k), short-term/long-term disability, life insurance, and all those good things.

 

This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.