- Course
- Core Tech
Getting Started with Docker and AI
Learn how to run large language models locally using Docker Model Runner. This course will teach you how to install, configure, and integrate Docker Model Runner with Compose apps and third-party AI tools.
What you'll learn
Running AI models locally can be complex without the right tools and integrations. In this course, Getting Started with Docker and AI, you’ll gain the ability to run large language models (LLMs) locally using Docker Model Runner as part of your Docker workflow. First, you’ll explore how Docker Model Runner works, its architecture, and how it integrates with OpenAI-compatible apps. Next, you’ll discover how to install Docker Model Runner, manage models, and interact with them via Docker Hub and the command line. Finally, you’ll learn how to integrate Docker Model Runner into Compose apps and third-party tools to build local AI-powered applications, including private chatbots similar to ChatGPT and Claude. When you’re finished with this course, you’ll have the skills and knowledge needed to confidently run and integrate AI models locally with Docker.
Table of contents
About the author
Nigel is a Docker Captain and popular technology author. He is known for his engaging videos and books on cloud-native technologies such as Docker and Kubernetes.