Tag

mistral 7b

A collection of 2 posts

Run Mistral 7B on macOS: Step by Step Guide
mistral 7b

Run Mistral 7B on macOS: Step by Step Guide

Quick answer. Install Ollama on macOS, run `ollama pull mistral` then `ollama run mistral`. Mistral 7B (Q4_K_M, ~4.1 GB) runs on any 16 GB Apple Silicon Mac at roughly 20-30 tok/s. LM Studio works too for a GUI. For newer models, Mistral Small 3 (24B) needs

· 3 min read