Chroma

Chroma is the vector database equivalent of SQLite - it's embedded, simple, and gets out of your way. If you're building a RAG application and don't want to think about infrastructure, Chroma is your starting point.

What it is

Chroma is an open-source embedding database designed from the ground up for AI applications. It runs in-process (no separate server needed for development), supports persistent storage, and includes built-in embedding functions that automatically vectorize your text.

Why this matters

Chroma prioritizes developer experience above all else:

1. pip install chromadb - that's it, you have a vector database
2. Built-in embeddings: automatic text vectorization, no separate embedding model to run
3. In-memory mode: zero-config for development and testing
4. LangChain native: first-class integration with LangChain, LlamaIndex, and Haystack

How it stacks up

Get started

pip install chromadb
 
import chromadb
client = chromadb.Client()
collection = client.create_collection("my_docs")
collection.add(documents=["Hello world"], ids=["doc1"])
results = collection.query(query_texts=["Hello"], n_results=1)

What the community says

"Chroma is the vector DB you use when you just want to get something working. pip install, three lines of code, done."

• u/rapid-prototyper on r/LocalLLaMA, 234 upvotes

When to use something else

• Production at scale: Qdrant or Milvus
• Need built-in vectorization: Weaviate has more modules
• Persistent long-term storage: Chroma works but Qdrant is more reliable