Blackbird.AI is seeking an experienced and talented Machine Learning Quality Assurance Lead to join our team. As an ML QA Lead you will be the owner of model performance validation for our team, designing and implementing test strategies to perform testing and review of our machine learning models. You will work closely with our ML engineering team to ensure the quality of our models, contributing significantly to the mission of empowering the pursuit of information integrity globally.

At Blackbird.AI, our mission is to empower trust, safety and integrity across the information ecosystem. As pioneers in the Information Risk landscape, we're designing state-of-the-art technologies to detect and counteract narrative attacks at scale. Our multidisciplinary team of diverse experts collaborate with clients spanning Fortune 500 companies, National Security, Cybersecurity, and many other sectors. We are a multi-disciplinary team of founders, engineers, and industry professionals passionate about applying cutting-edge technology to this challenge. Our culture is dynamic, innovative and inclusive. We embrace creativity, teamwork, and open communication. Join us and become an integral part of a growing company that is changing the landscape of information integrity.

Responsibilities

• Lead model QA testing for our team of ML engineers
• Improve or design and develop test strategies for machine learning models
• Develop test plans, test cases, and test scripts
• Perform manual testing and automation testing of machine learning models
• Work closely with the ML engineering team to identify issues and provide feedback on quality improvement
• Work closely with internal users to identify problem areas
• Drive continuous improvement of the QA processes for machine learning models

• Bachelor's degree
• Minimum 3 years of experience in ML QA and testing of machine learning models
• Strong knowledge of machine learning concepts and algorithms
• Working knowledge of best practices for evaluating ML models
• Comfortable working in Python for building/evaluating ML models
• Excellent communication and interpersonal skills, ability to lead a functional area for our team and work collaboratively with cross-functional teams

Nice-to-Have

• Bachelor's degree in Computer Science, Computer Engineering, or related field
• Experience with Python frameworks/models for ML like PyTorch, Tensorflow, HuggingFace, FastText, transformers
• Experience with version control systems such as Git

• Health Care Plan (Medical, Dental & Vision)
• Paid Time Off (Vacation, Sick & Public Holidays)
• Work From Home
• Stock Option Plan
• Exciting career development prospects, to grow into leadership roles
  
  

Take note - due to the high volume of applicants, only shortlisted candidates will be notified. Thank you for taking the time to apply for the role at Blackbird.AI.

LI-Remote