<ul><li>Docker Model Runner is a tool designed to make running Large Language Models (LLMs) locally easier.</li><li>It runs LLMs directly on the local machine and uses Docker to wrap a convenient API interface around it.</li><li>Model Runner is currently in beta and works only on Docker Desktop for Mac with Apple Silicon.</li><li>It is useful for prototyping AI features, keeping data private, learning and experimenting with LLMs, and building offline-ready apps.</li></ul>

Getting started with local AI development using Docker Model Runner

Discover more