HUGS helps 13 fashions: Llama-3.1-8B-Instruct, Llama-3.1-70B-Instruct, Llama-3.1-405B-Instruct-FP8, Hermes-3-Llama-3.1-8B, Hermes-3-Llama-3.1-70B, Hermes-3-Llama-3.1-405B-FP8, Nous-Hermes-2-Mixtral-8x7B-DPO, Mixtral-8x7B-Instruct-v0.1, Mistral-7B-Instruct-v0.3, Mixtral-8x22B-Instruct-v0.1, Gemma-2-27b-it, Gemma-2-9b-it, and Alibaba’s Qwen2.5-7B-Instruct.
The documentation web page on HUGS reveals that Hugging Face is predicted so as to add help for fashions akin to Deepseek, T5, Phi, and Command R quickly. Different multimodal and embeddings fashions which might be anticipated to be added quickly consists of Idefics, Llava, BGE, GTE, Micbread, Arctic, Jina, and Nomic.
Nvidia says NIM helps extra, although, together with its proprietary Nemotron fashions, fashions from Cohere, A121, Adept, Getty Photos, Shutterstock, and open fashions from Google, Hugging Face, Meta, Microsoft, Mistral AI, Stability AI.
