AIToday
Large Language ModelsOpen-Source AILobsters AIPublished: Nov 9, 2026, 04:00 JST

Mac mini M5 Pro owner asks what local AI actually works on 48GB

Send on LINE
Mac mini M5 Pro owner asks what local AI actually works on 48GB

3 Key Points

  1. What happened

    A new Mac mini owner with an M5 Pro (base CPU config) and 48GB of unified memory asked which models and quantizations fit comfortably and are actually usable, not just "it runs."

  2. Why it matters

    The owner is trying to separate what works day to day from benchmark hype, wanting real tokens/sec numbers and "waste of time" stories from people running AI on this hardware.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

The post is a practical ask from someone who has just bought a Mac mini with an M5 Pro (base CPU config) and 48GB of unified memory. The owner frames the problem clearly: it is hard to separate what actually works day to day from benchmark hype. That framing drives the questions — which models and quantizations fit comfortably in 48GB and are actually usable, not just "it runs." The owner also asks which runtime and tools to use, and what others gave up on and returned to cloud APIs for. The request for real tokens/sec numbers and "waste of time" stories suggests the owner values hands-on experience over spec sheets. The scope covers coding autocomplete and agentic workflows, image generation, and other genuinely useful tasks like transcription and RAG over notes.

FAQ
What does the owner want to run locally?
Coding autocomplete and agentic workflows with local models, image generation, and other useful tasks like transcription and RAG over notes.
What kind of answers is the owner asking for?
Real tokens/sec numbers and "this was a waste of time" stories, to separate day-to-day usable setups from benchmark hype.
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleHao Fei's 59-page paper retargets AI design at 'cognitive symbionts'