Use Llama 405b for free
Use Llama 3.1 405b for free with OpenAI api compatible api access using Google Vertex AI and LiteLLM
LLM
Install ollama with amd gpu support on ubuntu
Install ollama with rx6600 support on ubuntu 24.04 with cmds to copy
Use Llama 3.1 405b for free with OpenAI api compatible api access using Google Vertex AI and LiteLLM
Install ollama with rx6600 support on ubuntu 24.04 with cmds to copy