The Team

The Data Engineering team (Part of Upstart's core platform vertical) provides developer tools, frameworks, and scalable data infrastructure as shared services across Upstart. The team's primary objective is to provide Data Analysts, Software Engineers, and ML scientists access to high-quality data and developer tools to create business metrics for respective product verticals, 

You will join the subdivision focusing on Data Capture. 

As the Data Platform Engineer on the Data Capture team, you will get the opportunity to contribute to 3 areas:

1. Expand the existing developer tools that capture business events, operational data and third party data into the Lakehouse.
2. Expand the self-serve and orchestration framework that developers use to build pipelines.
3. Improve the observability and SLAs for the above services and raw layer data in the Lakehouse.

We would love to hear from you if you are passionate about building data products!

Position Location - This role is available in the following locations: Remote, San Mateo, Columbus, Austin 

Time Zone Requirements - This team operates on the East/West Coast time zones.

Travel Requirements - This team has periodic on-site collaboration sessions twice or thrice a year. Upstart will cover all travel-related expenses if you need to travel to make these meetups.

How you’ll make an impact:

• Build and Improve the tools owned by the Capture team
• Own the service/raw layer data observability and SLAs
• Participate in planning and prioritization by collaborating with stakeholders across the various product verticals and functions (ML, Analytics, Finance) to ensure our architecture aligns with the overall business objectives.
• Collaborate with stakeholders such as Software Engineering, Machine Learning, Machine Learning Platform and Analytics teams to ingest well curated data into the Lakehouse and adopt the developer tools 
• Participate in code reviews and architecture discussions to exchange actionable feedback with peers. 
• Contribute to engineering best practices and mentor junior team members. 
• Help break down complex projects and requirements into sprints.
• Continuously monitor and improve data platform performance, reliability, and security.
• Stay up-to-date with emerging technologies and industry best practices in data engineering.

What we’re looking for: 

• Minimum requirements:
  • A bachelor's degree in Computer Science, Data Science, Engineering, or a related field.
  • 3+ years of experience in data engineering or related fields, with a strong focus on data quality, governance, and data infrastructure.
  • Proficiency in data engineering tech stack; Databricks / PostgreSQL / Python / Spark / Kafka/ Streaming / SQL / AWS / Airflow/ DBT / containers and orchestration (Docker, Kubernetes) and others.
  • Ability to approach problems with first principles thinking, embrace ambiguity, and enjoy collaborative work on complex solutions.
• Preferred qualifications:
  • Strong foundation in algorithms and data structures and their real-world use cases.
  • Experience and understanding of distributed systems, data architecture design, and big data technologies (e.g., Spark Streaming / Batch, Kafka Streaming, Lakehouse, Databricks, Redshift).
  • Experience with AWS technologies ( e.g.,  AWS Lambda, Redshift, RDS, S3, etc.).
  • Knowledge of data ingestion, software engineering and data security best practices.
  • Good knowledge of DevOps engineering using Continuous Integration/Delivery tools like Kubernetes, Jenkins, Terraform, etc., thinking about automation, alerting, monitoring, security, and other declarative infrastructure.
  • Ability to explain complex concepts in easy-to-understand ways and navigate environments where problems are not well-defined (and evolve quickly).

What you'll love: 

• Competitive Compensation (base + bonus & equity)
• Comprehensive medical, dental, and vision coverage with Health Savings Account contributions from Upstart 
• 401(k) with 100% company match up to $4,500 and immediate vesting and after-tax savings
• Employee Stock Purchase Plan (ESPP)
• Life and disability insurance
• Generous holiday, vacation, sick and safety leave  
• Supportive parental, family care, and military leave programs
• Annual wellness, technology & ergonomic reimbursement programs
• Social activities including team events and onsites, all-company updates, employee resource groups (ERGs), and other interest groups such as book clubs, fitness, investing, and volunteering
• Catered lunches + snacks & drinks when working in offices

#LI-REMOTE

#LI-Associate