Senior Data Engineer (Data Platform)

Senior Data Engineer (Data Platform)

This job is no longer open

Introduction to Demandbase:

The biggest and fastest-growing companies in the world rely on Demandbase to drive their account-based strategies and maximize B2B go-to-market performance. We pioneered the ABM category nearly a decade ago, and today we lead the industry as an indispensable part of the B2B tech stack. Demandbase offers the only end-to-end Account-Based Experience (ABX) solution that helps B2B companies find, engage, and close the accounts that matter most. Our success would not be possible without the driven and collaborative teams here at Demandbase. As a company, we’re as committed to growing careers as we are to building world-class technology. We invest heavily in people, our culture, and the community around us. We have offices in the Bay Area, New York, Seattle, and a team in the UK, and allow employees to work remotely from anywhere in the US. We have also continuously been recognized as one of the best places to work in the Bay Area.

Our success depends on our ability to create a diverse, equitable and inclusive environment. We're committed to attracting, developing, retaining and promoting a diverse workforce. By ensuring that every Demandbase employee is able to bring a diversity of talents to work, we're increasingly capable of living out our mission and providing real insight from our products to support our customers. We encourage people from underrepresented backgrounds and all walks of life to apply. Come grow with us at Demandbase!

About the Role:

In this role, you will help build the next generation unified data platform that will combine datasets from across the Demandbase ecosystem. Using the latest open source tools, you'll solve complex data warehousing problems to ensure quality, discoverability and accessibility of data. You'll build batch and streaming data pipelines for ingestion, normalization and analysis; in addition, you'll develop standard design and access patterns that will allow these pipelines to stay flexible and grow over time as the needs of the business change. You'll be a leader in the unification of data from our multiple products as we come together as one Demandbase platform.

What you'll be doing:

  • Build out all aspects of the Demandbase Data ecosystem and move products from R&D into production scale
  • Design and build data pipelines to create the next generation of Demandbase’s Unified Data Platform
  • Work across the data stack to build and productionalize data pipelines for massive amounts of data
  • Build DAGs in Airflow for orchestration and monitoring of data pipelines

What we're looking for:

  • Four-year degree in Computer Science, or related field OR equivalent experience
  • Progressive experience in all of the following areas:
    • Designing frameworks and writing efficient data pipelines, including batches and real time streams
    • Understanding of data strategies, articulate data analysis & data model design and evolve data products according to business requirements.
    • Experience with the Spark Ecosystem (YARN, Executors, Livy, etc)
    • Experience in large scale data streaming, particularly Kafka or similar technologies (Pulsar, Kinesis, etc)
    • Experience with data orchestration frameworks, particularly Airflow or similar
    • Experience with columnar data stores, particularly Parquet and Clickhouse
    • Strong SDLC principles (CI/CD, Unit Testing, git, etc)
    • General understanding of AWS EMR, EC2, S3

Even better if you have….

  • Experience with 
    • “Lakehouse” technologies, particularly Iceberg or similar (DeltaLake, Hudi, etc)
    • Terraform for AWS
    • Astronomer
  • Open Source contribution experience

Benefits: 

Our benefits include options for 100% paid for Medical, Dental and Vision for you and your entire family, short-term/long-term disability, life insurance, flexible vacation policy and 401K. 

More About Demandbase:

Demandbase is the leader in Account-Based Experience (ABX) and an indispensable part of the B2B Go-to-Market tech stack. The company offers simply the best account-based platform to find, engage, and close the accounts that matter. The biggest and fastest-growing companies in the world, such as Accenture, Adobe, DocuSign, GE, Salesforce, and others, rely on Demandbase to drive their ABX strategy and maximize their marketing performance. Demandbase has been named to the JMP Securities list “The Hot 100: The Best Privately Held Software Companies,” the Deloitte Fast 500, and named a Gartner Cool Vendor for Tech Go-To-Market.

For more information, please visit www.demandbase.com or follow the company on Twitter @Demandbase.

 

This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.