YOUR MISSION

We are looking for a Data Engineer capable of helping create and maintain the data pipeline architecture of MURAL, as well as writing APIs and tools to help other teams work with data. You will be working in the Data Platform team and also collaborating closely with Product, Analytics and Data Science teams to help them achieve their goals. 

The Data Engineer role is a software development role with knowledge of data architectures, APIs, and the delivery and transformation of data in a reliable way.

The ideal candidate is passionate about both developing software and working with data, and is capable of challenging and redesigning existing solutions. He or she must be a team player, always willing to collaborate with others.

As a member of the Data Platform team, you will:

• Help create the platform, tools and APIs necessary to enable other teams to work with data.
• Improve the existing data platform and propose alternative solutions.
• Work closely with Product teams to help them explore the feasibility of experimental data-driven features, helping them narrow down preliminary or unclear requirements, and building the tools and APIs necessary to support those features. A strong analytical mindset is a must.
• Efficiently handle vast amounts of data from multiple sources and destinations, including relational and NoSQL databases as well as external systems, both in batch processing and real-time delivery.
• Follow modern development best practices such as code reviews, unit testing, continuous integration, and agile methodology
• Work as part of a team. We value team players who share their knowledge and like collaborating with others.
• Show initiative, completing your tasks and providing timely status updates to both the rest of your team and all of the stakeholders.
• Take full ownership of the solutions you build. This means analyzing requirements, building them, monitoring them, and troubleshooting them if problems arise.

YOUR PROFILE

We are looking for a Software Engineer with 5+ years of experience in a development role, preferably with Data Engineering experience, and who has attained a graduate degree in Computer Science, Software Engineering, or related field, or who has the equivalent relevant experience.

• Bachelor’s degree in Computer Science or related field.
• 5+ years experience in software development.
• Excellent communication skills and the ability to work well in a distributed team.
• Strong python skills with 3+ years experience in industry.
• You must be able to code an application from scratch following best practices such as writing clean code with unit tests, and using continuous integration.
• Experience in designing and developing web services and REST APIs.
• Advanced knowledge of relational databases such as PostgreSQL, and being capable of writing non-trivial SQL.
• 3+ years experience in data modeling, ETL development, and data warehousing.

Ideally you have...

• Experience with AWS big data technologies.  The main ones we look for are Redshift, Athena, and EMR
• 2+ years experience with MongoDB.
• 2+ years experience with CI/CD, with emphasis on Docker and Kubernetes.
• 2+ years experience with Airflow, with emphasis on developing ETL pipelines using Airflow.
• ETL development experience on large datasets (terabyte scale or larger)
• Experience with Apache Kafka is a plus

#LI-Remote #LI-DJ1