Adding more open-source LLMs to your hosted offerings | Voters

Adding more open-source LLMs to your hosted offerings

complete

Sachin Bhat

Would be nice if codeium could host some open-source models on their own infrastructure like LLaMa-3.2 (Vision and text), Mistral Large 2, Pixtral Large, Codestral, Qwen-2.5-coder 32B and the new Deepseek-R1-Lite and also (when it comes out) Deepseek-R1

November 22, 2024

Rohan Phadte

marked this post as

complete

It's available in Windsurf v1.2.4. Update Windsurf and its available for Pro and Pro Ultimate Accounts.

hg0428

Rohan Phadte
I don't see any of those suggested models except R1.
If you have indeed added models such as Llama3.2, Llama3.3, Mistral Large 2, Pixtral Large, Codestral, Qwen2.5 Coder 32b, and others, please show me where and how to access them.

Bhuvan Gnk

hg0428 https://huggingface.co/Qwen/Qwen2.5-Coder-32B
For mistral you can get mistral platform, for llama you can host in replicate. I can help you in this process, if you really are interested to integrate. 
Thanks!

hg0428

Bhuvan Gnk

I already know how to access those. But you cannot link them to Cascade yet.

.mortoc

Rohan Phadte This is very much not complete