Here at Hugging Face, we're on a mission to improve Machine Learning and make it more readily available. Along this journey, we contribute to the progression of technology for the better.
We've established the fastest-growing, open-source library of pre-trained models globally. With over 500K+ models and 250K+ stars on GitHub, our technology is used in production by over 15,000 companies, including leading AI organizations like Google, Elastic, Salesforce, Algolia, and Grammarly.
About the Role
The Quantization of significant language models (LLMs) is an exciting field as it allows LLMs to operate and be fine-tuned on everyday hardware, making these models available to a broader audience. The push towards achieving a 1-bit precision transformer model has begun in many professional papers.
The purpose of the internship will be to probe these innovative quantization techniques by attempting to replicate some results and integrate different strategies suggested in each piece. The ultimate aim is to disseminate the most successful method by integrating it directly into the Hugging Face system (transformers, accelerate, peft).
About You
If you're an open-source enthusiast, passionate about making advanced technology more accessible to engineers and artists, and eager to contribute to one of the quickly growing ML ecosystems, we're looking forward to your application!
Even if you don't meet all the requirements, we encourage you to apply! We're cultivating a diverse team whose skills, experiences, and backgrounds complete each other. We're eager to find out where you could have the largest impact.
More about Hugging Face
We are actively working towards creating a culture that appreciates diversity, fairness, and inclusivity. Our aim is to establish a safe and supportive work environment—irrespective of who you are or where you're from. We consider this a key factor in creating a great company and community. Hugging Face is an equal opportunity employer and we do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
We value development. You will work alongside some of the brightest minds in our industry. We're a company that values impact and is always pushing ourselves to grow consistently. We reimburse all employees for relevant conferences, training, and education.
We care about your well-being. We provide flexible working hours and remote options. We support our employees wherever they are. Although we have offices worldwide, primarily in the US, Canada, and Europe, we operate on a distributed basis and all remote employees have the opportunity to visit our offices. We'll also equip your workspace if required to ensure you succeed.
We support the community. We believe that significant scientific advancements are the result of collaboration across the field. Join a community that supports the ML/AI community.