Core Concepts

Llama Stack is a service-oriented platform. A few concepts arise from this design which may not feel natural if you're coming from other LLM frameworks.

info

Understanding these concepts will help you make the most of Llama Stack's modular architecture and provider system.

Architecture

How the system is structured, request flow, and provider dispatch

APIs

The core APIs and their stability levels

Distributions

Pre-configured deployment packages for different environments

Resources

Models, shields, vector stores, and their lifecycle