Senior Data Platform Engineer

Senior Data Platform Engineer

This job is no longer open

Introduction to Demandbase: 

Demandbase is the Smarter GTM™ company for B2B brands. We help B2B companies hit their revenue goals using fewer resources. How? By aligning their sales and marketing teams around a combination of their data, our data, and artificial intelligence — what we call Account Intelligence — so they can identify, engage, and focus their time and money on the accounts most likely to buy. 

As a company, we’re as committed to growing careers as we are to building world-class technology. We invest heavily in people, our culture, and the community around us. We have offices in the San Francisco Bay Area, Seattle, and India, as well as a team in the UK, and allow employees to work remotely. We have also been continuously recognized as one of the best places to work in the San Francisco Bay Area including, “Best Workplaces for Millennials” and “Best Workplaces for Parents”!

We're committed to attracting, developing, retaining, and promoting a diverse workforce. By ensuring that every Demandbase employee is able to bring a diversity of talents to work, we're increasingly capable of living out our mission to transform how B2B goes to market. We encourage people from historically underrepresented backgrounds and all walks of life to apply. Come grow with us at Demandbase!

About the Role:

In this role, you will help build the next generation unified data platform that will combine datasets from across the Demandbase ecosystem. Using the latest open source tools, you'll solve complex data warehousing problems to ensure quality, discoverability and accessibility of data. You'll build batch and streaming data pipelines for ingestion, normalization and analysis; in addition, you'll develop standard design and access patterns that will allow these pipelines to stay flexible and grow over time as the needs of the business change. You'll be a leader in the unification of data from our multiple products as we come together as one Demandbase platform.

The compensation range for this role is: $150,000 - $180,000

What you’ll be doing:

  • Build out all aspects of the Demandbase Data ecosystem and move products from R&D into production scale
  • Design and build data pipelines to create the next generation of Demandbase’s Unified Data Platform
  • Work across the data stack to build and productionalize data pipelines for massive amounts of data
  • Build DAGs in Airflow for orchestration and monitoring of data pipelines

What we’re looking for:

  • Four-year degree in Computer Science, or related field OR equivalent experience
  • Progressive experience in all of the following areas:
    • Designing frameworks and writing efficient data pipelines, including batches and real time streams
    • Understanding of data strategies, articulate data analysis & data model design and evolve data products according to business requirements.
    • Experience with the Spark Ecosystem (YARN, Executors, Livy, etc)
    • Experience in large scale data streaming, particularly Kafka or similar technologies (Pulsar, Kinesis, etc)
    • Experience with data orchestration frameworks, particularly Airflow or similar
    • Experience with columnar data stores, particularly Parquet and Clickhouse
    • Strong SDLC principles (CI/CD, Unit Testing, git, etc)
    • General understanding of AWS EMR, EC2, S3

Desired:

  • Experience with 
    • “Lakehouse” technologies, particularly Iceberg or similar (DeltaLake, Hudi, etc)
    • Terraform for AWS
    • Astronomer
  • Open Source contribution experience

Benefits:

Our benefits include options for up to 100% paid Medical and Vision premiums for employees, flexible PTO policy, no internal meeting Fridays, Modern Health mental wellness platform, and 11 paid holidays and 2 additional weeks where all Demandbase employees take off (the week of July 4th and the week of Thanksgiving). Plus 401(k), short-term/long-term disability, life insurance, and all those good things.

Our Commitment to Diversity, Equity, and Inclusion at Demandbase

At Demandbase, we believe in creating a workplace culture that values and celebrates diversity in all its forms. We recognize that everyone brings unique experiences, perspectives, and identities to the table, and we are committed to building a community where everyone feels valued, respected, and supported. Discrimination of any kind is not tolerated, and we strive to ensure that every individual has an equal opportunity to succeed and grow, regardless of their gender identity, sexual orientation, disability, race, ethnicity, background, marital status, genetic information, education level, veteran status, national origin, or any other protected status. We do not automatically disqualify applicants with criminal records and will consider each applicant on a case-by-case basis.

We recognize that not all candidates will have every skill or qualification listed in this job description. If you feel you have the level of experience to be successful in the role, we encourage you to apply!

We acknowledge that true diversity and inclusion require ongoing effort, and we are committed to doing the work required to make our workplace a safe and equitable space for all. Join us in building a community where we can learn from each other, celebrate our differences, and work together.

This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.