https://aider.chat/

Need to connect to a LLM

  1. Ollama run Llama 3.1 7B on local machine (cost computing and electricity)

https://www.google.com/search?client=firefox-b-lm&q=ollama+on+linux+delete#fpstate=ive&vld=cid:19f310e3,vid:orjg12_EC_8,st:57

https://www.linkedin.com/posts/vaibhavs10_llama-31-8b-running-on-mac-100-local-ugcPost-7223985474376192001-vs8J?utm_source=share&utm_medium=member_ios

  1. Gemini API (free but not powerful)

https://ai.google.dev/gemini-api/docs/workspace

  1. OpenAI API (costly)
  2. https://aider.chat/docs/llms/groq.html this is the best for now

Llama 3.1 on Groq inference

Untitled

GROQ API KEY

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

python -m pip install aider-chat

export GROQ_API_KEY=<key> # Mac/Linux
setx   GROQ_API_KEY <key> # Windows, restart shell after setx

aider --model groq/llama3-70b-8192

# List models available from Groq
aider --list-models groq/

export GROQ_API_KEY=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 # Mac/Linux