Windfall Data
San Francisco
11-50 employees
Modern wealth intelligence: Windfall is on a mission to determine the net worth of everyone on the planet.
Data Engineer (Varying Levels)
Data Engineer (Varying Levels)
This job is no longer open
Founded in 2016, Windfall Data is on a mission to determine the net worth of everyone on the planet. The company helps nonprofit and for-profit organizations to more effectively identify, understand, and engage affluent consumers with the industry’s most reliable and accurate data set available. More than 750 organizations use Windfall Data to identify and engage their most promising constituents. As a company, we are growing quickly, and every member of our team has a tangible impact on the success of our business and our customers.
Windfall is seeking data engineers at the senior level and above to join our core data team. As a Data Engineer on our core data team at Windfall, you will be building out the core data asset that everything else at Windfall is built on top of. Communication and collaboration are at the heart of Windfall and you will work closely with our product, data science, and other engineering teams. You will personally design and build the pipelines for massive datasets taking them all the way from inception to exploration to production and customer use.
Qualifications
Not all applicants will have skills that match a job description exactly. Windfall values diverse experiences in other industries, and we encourage everyone who meets the required qualifications to apply. While having “bonus” qualifications make for a strong candidate, we encourage applicants with alternative experiences to also apply. If your career is just starting or hasn't followed a traditional path, don't let that stop you from considering Windfall. We are always looking for people who will bring something new to the table!
What you will do
- Construct data pipelines to ingest and merge billions of individual entities into Windfall’s core data asset
- Work closely with our data science team to run ML models on top of billions of data points
- Build supporting data services and applications to orchestrate and monitor our data systems
Some technologies you will use
- Cloud platform - GCP
- Programming languages - Java, Python, and Kotlin
- Data warehouse & databases - BigQuery, Postgres
- Distributed processing frameworks - Dataflow (Apache Beam) and Apache Spark
- Orchestration - Airflow
Requirements
- Professional data engineering experience
- Experience at a sub-200 person company
- Strong Object-oriented programming understanding
- Expert SQL knowledge
- You communicate as well as you code
- You can simplify complex problems into simple solutions
- You balance a strong sense of ownership and responsibility in your work with collaboration and team alignment
- You are comfortable making trade-offs between quality, complexity, and speed-of-delivery
Bonus
- Proven experience taking a large project from ideation to production
- Experience leading greenfield projects
- Past surface knowledge of databases, data warehouses, distributed computing frameworks, etc. for optimization and leveraging correct technologies
- Working knowledge of cloud-native data engineering infrastructure
This job is no longer open