Data Engineer

Data Engineer

This job is no longer open
This position can be based in San Francisco or Remote.

Butter is building the payments stack for the modern subscription economy. We're creating an inclusive remote-first culture that enables our employees to contribute from anywhere in the world. Come join our team to help modernize subscription payments!

TLDR:
You're our data handler. You make sure our data shows up on time, arrives in good condition and leaves the party when appropriate. 

Problem TLDR:
Dirty data gets in the way of reporting, machine learning models and our general sanity.

Problem Expanded:
We ingest 3rd-party data from multiple payment providers, such as Stripe, clean it and normalize it for our schema and machine learning pipelines. We're seeking to build transformation and validation layers as far upstream as possible to ensure a smooth flow of data through our system. The transformation layer will make the data easier to work with for our reporting products and ML models, while the validation layer will ensure the data conforms to our expectations. For example: Is it null, NULL, or 'null'? Is 342 a valid country abbreviation code? 

As we expand our product offering and ingest data from additional companies and 3rd-party providers the complexity of the challenge will evolve over time, keeping the problem fresh.

Scope:
You'll get to architect our system and lay the foundation for the future from both a technology and a system design perspective. No longer will data show up without being tested and structured, as you'll create a system that checks its worst tendencies. You'll work closely with our ML and Eng team to ensure the design meets their requirements and that data properly flows through the system.

Areas you're comfortable with:
You'll have 3+ years experience and be familiar with distributed systems and data processing frameworks such as Scala and Spark and workflow orchestration tools like Argo and Airflow. You've worked in a cloud environment such as AWS, GCP or Azure. Yes, other languages/tools are fine as long as you can articulate how you've used the technology to solve similar problems.

Designing a data system from scratch is something that excites you and you're able to clearly articulate the tradeoffs of different approaches. You've likely built some version of this before, validated data, created reports and perhaps dabbled in an ML model or too.

Philosophies:
You strongly believe that action creates information.
You want to work on a small team and have lots of responsibility.
You look forward to being scrappy and enjoy overcoming challenges.
We are focused on building a diverse and inclusive workforce. If you’re excited about this role, but do not meet 100% of the qualifications listed above, we encourage you to apply.
-----
Butter Payments is an Equal Opportunity Employer and considers applicants for employment without regard to race, color, religion, sex, orientation, national origin, age, disability, genetics or any other basis forbidden under federal, state, or local law. Atomic considers all qualified applicants in accordance with the San Francisco Fair Chance Ordinance.

Please review our CCPA policies here.
This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.