The Team and Role

Upstart’s Data Engineering team builds the data infrastructure and platform for our AI lending products. Data engineering is part of our engineering organization, as we believe great data engineering relies on solid software engineering fundamentals. However, we also recognize that each Data Engineer has a unique blend of skills. Whether your strength is in data modeling or in stream processing, we want to talk to you.

As a Senior Data Engineer, you may work cross functionally with product, software engineering, machine learning, finance, growth, and other stakeholders, driving projects from conception to launch, in order to help teams leverage data in their decision making. Thus, helping accomplish our mission of enabling effortless credit based on true risk.

Position Location - This role is available in the following locations: Remote ^(#LI-REMOTE)

Time Zone Requirements - This team operates on the East/West Coast time zones.

Travel Requirements - This team has regular on-site collaboration sessions. These occur Quarterly at your home office. If you need to travel to make these meetups, Upstart will cover all travel related expenses.

How you'll make an impact:

• Develop and automate large scale, high-performance data processing systems
• Design data models for optimal storage and retrieval, to meet critical business requirements
• Understand and influence logging to support our data flow, architecting logging best practices where needed
• Ensure delivery of critical data with expected data quality in a rapid, reliable manner, following “lean startup” and Minimum Viable Product (MVP) principles
• Build robust data pipelines, while contributing to internal framework and tool expansion
• Influence cross-functional teams of business stakeholders, engineers, and team members to derive maximum value from data
• Maintain high standards of engineering excellence through code reviews, unit tests, and robust alerting
• Help organize developmental efforts while mentoring junior engineers

What we're looking for:

• Minimum requirements:
• 5+ year(s) of experience as a Data Engineer or Software Engineer with a focus in data engineering
• Extensive experience working with Python or Java, and SQL
• Expertise building real-time or batch data pipelines using Spark, Flink or other open source frameworks
• MS or BS in Computer Science, Engineering, Mathematics, Statistics, Bioinformatics or a related field OR equivalent practical experience in Data Engineering
• Preferred requirements:
• Experience with cloud computing platforms like Amazon AWS, Google Cloud
• Experience with building stream-processing applications using Apache Flink, Spark-Streaming, Apache Storm, Kafka Streams or others
• Experience with search systems (such as ElasticSearch, Solr), NoSQL datastores (such as HBase, Cassandra, MongoDB)
• Experience with a thorough understanding of data lake/warehouse architectures (BigQuery, Snowflake, RedShift)

Our stack:

• Python, SQL, Bash, Spark, Kafka, Airflow, Avro, Postgres, Redshift, Looker, Kubernetes, and Docker