Internship for Machine Learning Engineer, Quantization - US Remote

Here at Hugging Face, we're on a mission to enhance beneficial Machine Learning and make it more widely available. In doing so, we're helping to improve technology for all.

We've developed the world's fastest-growing open-source library of pre-trained models. With over 500K models and 250K stars on GitHub, more than 15,000 companies utilize our technology in production, including leading AI organizations such as Google, Elastic, Salesforce, Algolia, and Grammarly.

About the Role

The quantization of large language models (LLMs) is a promising area of development, as it allows LLMs to operate and be fine-tuned on consumer-grade hardware, thus making these models available to a wider range of users. The race towards the first 1-bit precision transformer model has been initiated by numerous studies.

The internship's objective will be to explore these new quantization techniques by attempting to replicate some of the findings and merge the different strategies proposed in each study. The ultimate goal is to make the most promising approach widely available by incorporating it directly into the Hugging Face ecosystem (transformers, accelerate, peft).

About You

If you are a fan of open-source, have a passion for simplifying complex technology for engineers and artists, and are eager to contribute to one of the fastest-growing ML ecosystems, we look forward to receiving your application!

Even if you do not meet every criterion above, we still encourage you to apply! We're assembling a diverse team whose skills, experiences, and backgrounds complement each other. We're happy to consider where you could have the biggest impact.

More about Hugging Face

We're proactively fostering a culture that values diversity, equity, and inclusivity. We aim to establish a workplace where everyone feels respected and supported, irrespective of who you are or where you come from. We consider this foundational to building a great company and community. Here at Hugging Face, we offer equal opportunities and do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability.

We prioritize growth. You'll be working with some of the brightest minds in our industry. We're an organization that values results and continuous development. We cover all employees' costs for relevant conferences, training, and education.

We care for your well-being. We provide flexible hours and remote work options. We support our employees wherever they are located. While we have offices worldwide, particularly in the US, Canada, and Europe, we're highly distributed and all remote employees have the opportunity to visit our offices. If needed, we'll also equip your workstation to ensure your success.

We support the community. We believe that major scientific advancements are a result of collaboration across the field. Join a community that supports the ML/AI community.