Home

Windows

Models

Models (currently only .GGUF files)

**This is a list of some models that can be downloaded + run in Otherwise. For more, check out The Bloke here**

  • Gemma-7B

  • LLama-2-7B (Quant Q4_K_M)

  • Mistral-7B (Quant Q2_K)

  • Mistral-7B (Quant Q3_K_S)

  • Mistral-7B (Quant Q3_K_M)

  • Mistral-7B (Quant Q3_K_L)

  • Mistral-7B (Quant Q4_0)

  • Mistral-7B (Quant Q4_K_S)

  • Mistral-7B (Quant Q4_K_M)

  • Mistral-7B (Quant Q5_0)

  • Mistral-7B (Quant Q5_K_S)

  • Mistral-7B (Quant Q5_K_M)

  • Mistral-7B (Quant Q6_K)

  • Mistral-7B (Quant Q8_0)

  • CodeLLama-13B-Instruct (Quant Q2_K)

  • CodeLLama-13B-Instruct (Quant Q3_K_S)

  • CodeLLama-13B-Instruct (Quant Q3_K_M)

  • CodeLLama-13B-Instruct (Quant Q3_K_L)

  • CodeLLama-13B-Instruct (Quant Q4_0)

  • CodeLLama-13B-Instruct (Quant Q4_K_S)

  • CodeLLama-13B-Instruct (Quant Q4_K_M)

  • CodeLLama-13B-Instruct (Quant Q5_0)

  • CodeLLama-13B-Instruct (Quant Q5_K_S)

  • CodeLLama-13B-Instruct (Quant Q5_K_M)

  • CodeLLama-13B-Instruct (Quant Q6_K)

  • CodeLLama-13B-Instruct (Quant Q8_0)