<ul><li>Comprehensive list of open source AI stack components for building GenAI applications with focus on modularity, scalability, and performance.</li><li>Components include models for data processing, model serving, retrieval-augmented generation (RAG), vector search, and orchestration.</li><li>Tools for serving models, managing prompts, memory, and chaining, frontend/chat UI, inference and runtime optimization, security & DevOps, and full stack boilerplates.</li><li>Experimental tools such as Ollama for managing LLMs locally, Modal for serverless infra, and LiteLLM for OpenAI-compatible APIs.</li></ul>

Open source AI stack components

Discover more