Senior Data Engineer - Streaming

Senior Data Engineer - Streaming

This job is no longer open
Infogrid is helping protect the planet and improve the lives of billions of people by making every building a smart building.

Our goal is to be the global provider for connected devices in smart buildings. We already handle millions of events every day from tens of thousands of sensors and we’d like you to help us scale that by an order of magnitude over the coming months.

Sustainability is at our heart; buildings account for 39% of global carbon emissions and we’re creating real solutions to impact this!

We are still early in our journey but have already achieved a lot; we raised a successful series A funding round, grew 5x in employee numbers within 12 months, and voted one of the top 10 most flexible places to work.

Want to know more about how we'd building Infogrid? Our CTO wrote a blog post about this.

The role

As an Engineer within the Data Engineering function, you will build real-time streaming data pipelines to create, we hope, the richest and most extensive model of building health and energy usage in the world.  

A passion for agility is critical for success: a focus on outcomes and a willingness to pivot and change to meet the next challenge is vital - you and the team will look to provide tooling that enables the company to scale with stability, predictability and evolve-ability.

You will play a pivotal role in defining the technical architecture, working with peers from across Data and Tech.  While growing our data pipelines by several orders of magnitude, we must implement governance, security and ensure data is reliable and accurate.

We current work in AWS with tools like dbt, Spark, Kafka, Python etc, but we’d like you to help grow our tech stack as we go.  A healthy dose of pragmatism, an openness to change and a focus on outcomes is key!

What will you be doing? Glad you asked!

    • Build, support and manage our data ingestion capability
    • Work with the team to define requirements and rapidly iterate to build great products
    • Manage data pipelines in a live production environment - taking ownership of bugs and errors and ensuring they are fixed quickly and with minimal negative impact
    • Champion best practice in data modeling and usage.  Understand the domain and the business and ensure our models are the right fit.
    • Act as a domain expert, demonstrate the art of the possible and help stakeholders and peers build the best possible product.
    • Build tools to govern retention, control access and ensure compliance with relevant regulations.

In order to do the above, what will I need to bring with me?

    • Skills developing data pipelines using modern data engineering tools like Spark and Kafka
    • Development skills - ideally Python, but we're open to others
    • Experience with event driven architectures and patterns such as those mentioned here.
    • Managing, monitoring and supporting pipelines in critical production environments
    • Experience with ‘big data’ tooling as well as SQL and traditional databases
    • People oriented - keen to grow and support the rest of the team
    • Best practices like Git, CI/CD, infrastructure as code (e.g. Terraform)Strong data manipulation and numerical/stats skills
We're not just looking for seniors for this team but mid levels too, so please do apply for the role even if you don't consider yourself a senior yet :)

We think Infogrid is a great place to work - we’re a recently funded and rapidly growing startup so it’s not perfect but:

❤️ Feel good about your work: Infogrid is actively helping big companies reduce their environmental footprint. We also offset everyone’s carbon footprint.
🤸 We’re flexible: We encourage remote working and offered flexible working hours before COVID and we’ll keep that flexibility afterwards.
📚 Learn and get promoted: Join us at the start of our journey - we’re growing quickly and believe in promoting from within. You can learn and grow your career here.
🌟 Improve yourself: We give everyone a day per month to focus on personal development.
🧑🏽‍🤝‍🧑🏽 Make friends: Everyone here is lovely.
🏠 Added bonus: We give everyone options in the company.
🚀 Join a legitimately secure tech start-up: $15.5M funding round is great of course but more importantly we have real paying customers and a good, growing revenue stream.

And we'll do everything we can to support you during your application. If you need us to make any adjustments to your recruitment process, speak to our recruitment team who will be happy to support you.
This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.