Data Engineer for Landing Zone

Data Engineering role at InnovateEDU

Job type: Full Time

Location: Remote

About InnovateEDU

InnovateEDU is a non-profit whose mission is to eliminate the achievement gap by accelerating innovation in standards-aligned, next generation learning models and tools that serve, inform, and enhance teaching and learning. InnovateEDU is committed to massively disrupting K-12 public education by focusing on the development of scalable tools and practices that leverage innovation, technology, and new human capital systems to improve education for all students and close the achievement gap.

About the Project

InnovateEDU strives to create real tools and projects that greatly assist a school district in moving toward embracing a data standard and interoperability. Landing Zone, a project at InnovateEDU, provides school districts with a comprehensive data infrastructure through the implementation of an Ed-Fi Operational Data Store (ODS), data mart for analytics in Google BigQuery, and the necessary data workflows in Apache Airflow to connect previously siloed, disparate educational data systems. Landing Zone simplifies the process a district must go through to implement an Ed-Fi ODS, connecting Ed-Fi certified data sources, and consuming non Ed-Fi certified data once has been aligned to the standard. This project has a heavy focus on data engineering, backend work, dev ops, and using data analytics tools to verify data.

Who You Are

You are a mission-driven individual and believe in working to close the educational achievement gap through the use of data and technical solutions. You are excited about bringing order to disparate data, writing data pipelines, and don’t mind being relentless in the pursuit of data accuracy. You’ve worked as a backend developer or data engineer before and are fluent with SQL and Python. Bonus points for having worked with applications deployed on Kubernetes.

You are an optimistic problem-solver. You believe that together we can create real solutions that help the entire education sector move forward despite its complexity. You are excited to join a growing team working on an early-stage product and are looking forward to working on lots of different pieces of that product. You are open to feedback, bring your best every day, and are ready to grow in all areas of your work. You want to join a team of folks who share your vision for mission-driven work at the intersection of education and technology.  Finally, you know that sharing often is key to this work and are ready to document everything that you do so that data people in schools everywhere can benefit.

Experience and Skills

The ideal candidate will have experience in some or all of the following areas:

• 2+ years of experience working as a back end developer or data engineer
• Ability to work independently and with teams 
• Fluency in Python and SQL
• Experience developing and deploying solutions using Docker and Kubernetes
• Experience working with Apache Airflow
• Experience in test-driven development
• Experience with Pandas and Jupyter Notebooks a plus
• Experience working with data warehouses a plus
• Experience with the Google Cloud Platform (especially BigQuery and Kubernetes Engine) a plus
• Experience within K12 education a plus

Responsibilities

The Developer’s primary professional responsibilities will include, but not be limited to:

• Creating, troubleshooting, and maintaining data processing pipelines in Apache Airflow (ETL work)
• Writing SQL queries against many different types of databases (Microsoft SQL Server, Oracle, Postgres, Progress Open Edge, BigQuery) to extract and organize data
• Maintaining Landing Zone documentation
• Deploying code updates across the Landing Zone customer base
• Assisting in the design, development, and deployment of infrastructure on the Google Cloud Platform for new customers
• Assisting in the design and development of a historical/longitudinal data storage system (data warehouse)
• Responding to customer support tickets (this is a shared responsibility on our team)
• Working with internal systems such as JIRA, Asana, Slack to stay organized and ensure communication with team members
• Other duties as assigned 

Application Instructions

Please submit an application on this platform. Applications without both a resume and cover letter will not be considered.