Big Data/ML Platform Engineer

Big Data/ML Platform Engineer

Clarity’s mission is to bring social impact to the market. Through our proprietary methodology, we are gaining a deeper understanding of the needs of the population and how to cover them more efficiently in order to better allocate capital to those most important needs. Therefore, we are creating a highly disruptive tech tool to systematically measure and optimize the social impact of investment portfolios powered by big data and machine learning algorithms.

People at Clarity don’t "talk" about ethics and values, we "live" values by example. Our international team is constantly embracing the challenge, solving problems, driven by the purpose of helping investors optimize the social impact of their portfolios. Together, we can become the “Gold Standard” offering solutions to all society stakeholders — we're just getting started.

Would you like to join an international and fast-growing Startup where you can play an important part in shaping its future? How about an opportunity to take part in next-generation social impact solutions in a highly collaborative work environment, where space for professional development is taken very seriously? Interesting, right? Keep reading!

What are we looking for?

In short, we are looking for a Platform Engineer with experience in Big Data and Machine Learning infrastructure; a passionate person with a small amount of experience working in a Platform team following a DevOps philosophy.

If building a reliable platform, that supports and boosts the development of Clarity AI's products in a sustainable way excites you, or if you have a constant need to learn better ways of doing your work, you’ll probably want to keep reading this.

We will love to see that these topics look familiar to you:

  • IAC concepts
  • Configuration Management concepts
  • Monitoring & Observability principles
  • Some knowledge or experience using containers and containers schedulers
  • Some knowledge or experience of AWS cloud platform
  • Some knowledge on Big Data and Machine learning common infrastructure
  • Working proficiency and communication skills in verbal and written English

What does our stack look like?

At this moment we have a hybrid architecture between the monolith and some microservices. We are thoroughly moving to a new architecture that may be closer to the microservices proposal and we would love to have you helping us.

We’re handling several stacks, like Java, node.js, Vue, and a good bunch of python at this moment, and we use MongoDB as the main storage system, but we would love to mix this approach with redshift in a while.

We use Redis as a distributed real-time database/cache and RabbitMQ for communications between some asynchronous services.

What do we need from you?

  • Help us to improve our platform (Improving dev experience, reliability, scalability) using a lean approach.
  • Help us to create a data platform and infrastructure optimized for developments using Machine Learning and massive data processing.
  • Help us to improve the Data Engineering and Data Science development experience.
  • Help us improve our delivery cadence for ML related products.
  • Help us to spread the DevOps culture in the company.

Our ideal candidate:

  • Has from 4 to 8 years of experience.
  • Has some previous experience with cloud-based services like AWS, Azure, or Google Cloud
  • Has worked with Linux systems in production
  • Has some development experience using python
  • Has some experience with Python Ecosystem for Data Science
  • Has knowledge or experience with two or more of these technologies:
    • AWS EMR or other BigData Platform
    • Airflow, Luigi, or other ETL/workflow scheduler
    • Aws Sagemaker, MLflow, kubeflow, or other ML platforms
    • Aws Redshift or other data warehouses
  • Has worked with relational or non-relational databases
  • Is eager to learn in a collaborative team environment
  • Has an interest in the DevOps engineering culture and practices
  • Is able to identify and communicate problems to the team
  • Pairs effectively with other team members
  • Has a small amount of experience in one technology used by Clarity (Terraform, k8s, GitLab)
  • Is able to ask for help when needed
  • Lean/agile mindset

What We Offer:

People are one of Clarity’s main assets. We have built a unique team and we all share 3 differential aspects: Excellence,

Passion and Values.

  • The team comprises professionals from leading consulting and banking firms, MBA graduates from top business schools, entrepreneurs and PhDs.
  • Clarity’s Founder and CEO, Rebeca Minguela, is a successful entrepreneur who has been recognized as one of the most distinguished leaders under the age of 40 by prestigious institutions like the World Economic Forum.

We are different. We work hard to become the best place to work.

  • Fact based: Promoting objective, fact-based and solution-oriented discussions.
  • Diverse: Encouraging diversity of personalities, cultures and experiences.
  • Transparent: Communicating feedback transparently, constructively and in real-time.
  • Meritocratic: Striving for excellence and rewarding the best.
  • Flexible: Working flexibly in the broadest sense (schedule, location, vacation, styles).

We care about our employees. We think that every effort has to be rewarded and want them to feel comfortable with us.

We are a US company with a Spanish subsidiary and presence in London.

Our investors believe in us and share our goals. We are a leading startup thanks to public and private funding.

Clarity has received several awards:

  • WEF Technology Pioneer 2020
  • Young Global Leader to Rebeca Minguela 2017.
  • Top 10 Fintech startup worldwide by BBVA Open Talent.
  • Top 2 start-ups with impact worldwide by IMPACT Growth 2017.
  • One of the most innovative Spanish companies by NeoTec.
  • One of the most innovative projects in the US. Harvard Innovation Lab.

***Please note that we will only review CV's in English

Privacy Policy

Responsibility: Clarity AI Inc. 160 Greentree Drive, Suite 101, City of Dover, County of Kent, Delaware 19904, United States. Purpose: Management of selection processes for new employees. Legitimation: Necessary processing for contract execution. Recipients: company of the Clarity Group in the country that would carry out the contract or where a position is being offered. Rights: The interested party may exercise the rights of access, rectification, opposition, limitation, suppression, portability and not to be the object of automated decisions according to the Privacy Policy. More info: To consult the privacy policy in detail, click on the following link (Privacy Policy)

Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.