Setup ollama on Intel Mac

Hardware Requirements to run local LLM smoothly

• 64GB RAM
• Free disk space: ?? GB

ollama file locations

/usr/local/opt/ollama/
~/.ollama/

Install ollama

brew install ollama

Start ollama

To start ollama now and restart at login:

brew services start ollama

Or, if you don't want/need a background service you can just run:

OLLAMA_FLASH_ATTENTION="1" OLLAMA_KV_CACHE_TYPE="q8_0" /usr/local/opt/ollama/bin/ollama serve

Install models

ollama pull glm-4.7b-flash

Use ollama

ollama run llama3.1