Integrations
Groq
You can use Groq as LLM provider in RAGChat. To use an Groq model, first initialize RAGChat with the Groq model:
import { RAGChat, groq } from "@upstash/rag-chat";
export const ragChat = new RAGChat({
model: groq("llama-3.1-70b-versatile",{apiKey: "GROQ_AI_KEY"}),
});
Was this page helpful?