Here at Hugging Face, we’re on a journey to advance good Machine Learning and make it more accessible. Along the way, we contribute to the development of technology for the better.

We have built the fastest-growing, open-source library of pre-trained models in the world. With over 100M+ installs and 65K+ stars on GitHub, over 10 thousand companies are using HF technology in production, including leading AI organizations such as Google, Elastic, Salesforce, Algolia, and Grammarly.

About the Role

For this position, you will deploy and benchmark transformer models for both training and inference on several cutting-edge hardware accelerators supported by the Optimum library. This internship will aim at writing an open-source tool for benchmarking models on numerous tasks and at publishing the results in various ways, such as (but not limited to):

• Lead a common Hugging Face/Habana submission to the MLPerf benchmark. This will consist in getting the best training time and throughput on the new Gaudi 2 accelerator.
• Benchmarking all supported devices (IPUs, CPUs, HPUs,...) to extract the best configurations. This will lead to Optimum's documentation with guidelines and plots that will improve the users’ experience.
• Training of large language models of hundreds of millions of parameters (e.g. BLOOM) on Habana Gaudi.

Benchmarks will not only measure raw performances but also the cost, the memory consumption and so on.

About You

If you love digging into the dark side of low-level system integrations, compiler support, and framework optimizations, then we can't wait to see your application!

If you're interested in joining us, but don't tick every box above, we still encourage you to apply! We're building a diverse team whose skills, experiences, and background complement one another. We're happy to consider where you might be able to make the biggest impact.

Preferred Location

Paris, France.

More about Hugging Face

We are actively working to build a culture that values diversity, equity, and inclusivity. We are intentionally building a workplace where people feel respected and supported—regardless of who you are or where you come from. We believe this is foundational to building a great company and community. Hugging Face is an equal opportunity employer and we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

We value development. You will work with some of the smartest people in our industry. We are an organization that has a bias for impact and is always challenging ourselves to continuously grow. We provide all employees with reimbursement for relevant conferences, training, and education.

We care about your well-being. We offer flexible working hours and remote options. We support our employees wherever they are. While we have office spaces around the world, especially in the US, Canada, and Europe, we're very distributed and all remote employees have the opportunity to visit our offices. If needed, we'll also outfit your workstation to ensure you succeed.

We support the community. We believe significant scientific advancements are the result of collaboration across the field. Join a community supporting the ML/AI community.