Data Driven is a Udacity core value. Udacity Data Engineering Team is looking for a Senior Software Engineer to help us to design and develop Udacity’s company-wide data solutions in support of that value. The ideal candidate will be comfortable talking to data analysts, data scientists and business stakeholders, understand the data that powers their products, generalize it and implement common fact tables across the company.

This is a high-impact opportunity and you’ll be a part of a global Data Team of highly talented Software Engineers, Data Analysts and Data Scientists based primarily in India and the SF Bay Area. The system you will be working on consists of a cloud-based data lake and is built completely on AWS using technologies such as Apache Spark, Airflow, Postgres and Redshift.

Responsibilities:

• Providing technical leadership in the Data Engineering team across the globe
• Designing and developing infrastructure and tools for our data system
• Working across multiple data analysts to brainstorm the data points behind their dashboard, abstracting and generalizing it in the form of multi-dimensional “fact stores”
• Working with with data scientists to enable them with infrastructure and data and directly serve Udacity’s system with outcome from ML algorithms
• Working with BI manager and business users to support implementations of data governance models
• Building out cloud-based data solutions with strong focus on accuracy and reliability using technologies such as Spark and Airflow on AWS
• Working with stakeholders from other departments and successfully translating their requirements to engineering solutions 
• Being a champion and thought leader of effective agile software development practice and producing high quality readable code in such a setting

Qualifications:

• BS or MS in Computer Science , MIS or related degrees
• 6+ years of experience working in the software industry, with at least 3 of which in data engineering
• Solid understanding and experience practicing Agile software development methodologies such as test driven development 
• Good understanding in the principles of building robust data processing pipeline and track record of putting them in practice
• Proven ability to trace, identify and resolve issue in data, infrastructure and code 
• Hands-on experience working with Apache Spark, AWS and relational databases
• Proficiency in Scala, Python and SQL
• Experience with microservice architecture, Go, and node.js is a strong plus
• Experience of working with distributed global teams is a strong plus