Use these when agent quality depends on retrieving durable knowledge, assembling user or business memory, or turning messy source files into structured context.

Retrieval, RAG, and Memory

This section keeps only retrieval tools that directly support , semantic search, , or long-term agent context. Generic databases are intentionally omitted.

Tool	Website	What it is for	Tier	Notes
QMD	github.com/tobi/qmd	Local-first document and search with , vectors, reranking, and	Core	Strong fit for local search, extra paths, Markdown memory, and session transcript recall.
Honcho	docs.honcho.dev	AI-native memory, cross-session continuity, and user/agent modeling	Core	Relevant when memory should model users, agents, and relationships rather than only retrieved chunks.
Cloudflare Agent Memory	blog.cloudflare.com	Managed persistent memory for agents with ingestion, recall, explicit remember/forget operations, and exportability	Watch	Private beta, but the shape is important: memory is treated as a constrained agent tool rather than raw database access.
Cloudflare AI Search	developers.cloudflare.com	Managed search for applications and agents with automated indexing, hybrid search, MCP endpoints, and UI snippets	Conditional	Good when a docs site, product corpus, or per-tenant file set should become an agent-searchable tool quickly.
Cloudflare Vectorize	developers.cloudflare.com	Vector database for semantic search, recommendations, and context retrieval	Conditional	Include for Cloudflare-native RAG rather than as generic database hosting.
pgvector	github.com/pgvector	Vector search inside Postgres	Core	Included as vector retrieval substrate, not as a reason to list every Postgres platform.
Turso / libSQL Vector Search	docs.turso.tech	SQLite-compatible vector similarity search built into Turso and libSQL	Conditional	Good for embedded, local-first, or serverless SQLite-style retrieval; do not choose it only because it is convenient for prototypes.
Pinecone	pinecone.io	Managed	Conditional	Mature managed vector option.
Qdrant	qdrant.tech	Vector database with strong filtering	Conditional	Good open-source and managed vector option.
Weaviate	weaviate.io	Vector database with hybrid search	Conditional	Strong for schema-rich and hybrid retrieval.
Chroma	trychroma.com	Embedding database for local and application RAG	Conditional	Useful for prototyping and smaller RAG systems.
LanceDB	lancedb.github.io	Embedded and serverless vector database	Conditional	Good for local, multimodal, and file-backed vector workflows.
DuckDB VSS	duckdb.org	Experimental DuckDB extension for vector similarity indexes	Conditional	Best for local analytics, offline , and retrieval experiments where DuckDB already holds the data; mind the experimental extension and memory constraints. Now a first-class vector-store adapter in agent frameworks, which makes the local-first path viable in product code rather than only in notebooks.
Milvus	milvus.io	Open-source vector database	Conditional	Good when vector scale and self-hosting are central requirements.
Astra DB Vector	docs.datastax.com	Managed Cassandra-compatible database with vector search	Conditional	Appears in Mastra and LlamaCloud vector sink docs; use when DataStax/Astra is already in the stack.
MongoDB Atlas Vector Search	mongodb.com	Vector search inside MongoDB Atlas	Conditional	Good when operational data and retrieval data already live in MongoDB.
Convex Vector Search	docs.convex.dev	Vector search inside Convex actions	Watch	Useful when Convex owns the app data model; avoid treating it as a standalone vector database replacement.
Couchbase Vector Search	docs.couchbase.com	Vector indexes inside Couchbase Search Service	Conditional	Consider when Couchbase already stores the product data and hybrid operational/vector retrieval should stay together.
Azure AI Search	learn.microsoft.com	Hybrid search, vector search, semantic ranking, and enterprise search on Azure	Conditional	Strong Azure-native retrieval option and a LlamaCloud Index data sink.
Elasticsearch Vector Search	elastic.co	Hybrid lexical and vector search	Conditional	Include when search is already Elastic-based or hybrid retrieval matters. Now carried as a framework-native vector-store adapter alongside the managed vector databases, so an existing Elastic cluster can back agent retrieval without a bespoke integration.
OpenSearch Vector Search	opensearch.org	Open-source hybrid search and vector search	Conditional	Include when OpenSearch is already the search platform.
Oracle AI Vector Search	docs.oracle.com	Native vector data type and similarity search inside Oracle Database 23ai	Conditional	Consider when the operational data already lives in Oracle and hybrid relational/vector retrieval should stay in one database.
Upstash Vector	upstash.com	Serverless vector database	Conditional	Appears in Mastra vector/storage references; good for lightweight serverless retrieval.
Turbopuffer	turbopuffer.com	Object-storage-backed vector and full-text search	Watch	Appears in Mastra vector stores; track for high-scale, cost-sensitive retrieval.
Amazon S3 Vectors	docs.aws.amazon.com	Native S3 vector buckets and vector indexes for storage-backed semantic retrieval	Conditional	Good for AWS-native, large, lower-query-frequency vector stores; pair with OpenSearch or another low-latency path when QPS is high.
ClickHouse Vector Search	clickhouse.com	Vector search inside ClickHouse analytics workloads	Conditional	Consider when should be queried alongside large analytical tables and metadata filters, not as a first-choice general vector DB.
Haystack	docs.haystack.deepset.ai	RAG pipelines, retrieval, readers, generators, and evals	Conditional	Strong Python RAG framework, especially for explicit pipelines.
Ragie	ragie.ai	Managed ingestion, connectors, and retrieval for AI applications	Conditional	Useful when RAG needs many data connectors without building ingestion plumbing.
Voyage AI	voyageai.com	Embeddings and reranking	Conditional	Retrieval-specialized model provider.
Jina AI	jina.ai	Embeddings, reranking, classifiers, and neural search tooling	Conditional	Useful for retrieval quality and multilingual embeddings.
FlagEmbedding / BGE	github.com/FlagOpen	Open embedding and reranking models	Conditional	Good when self-hosted retrieval quality matters.
Letta	docs.letta.com	Stateful agents and explicit memory systems	Conditional	Use when agent memory is a product requirement beyond RAG.
Zep	help.getzep.com	Context engineering and temporal memory for agents	Conditional	Strong for personalized context and user/business-memory assembly.
Graphiti	help.getzep.com	Temporal knowledge graph engine for memory	Conditional	Good when relationships and time matter more than flat vector chunks.
Mem0	docs.mem0.ai	Long-term memory layer for applications	Watch	Good signal in memory tooling; evaluate quality and control per product.

Document Ingestion, OCR, and Parsing

Use these when agent quality depends on reading messy source material rather than clean Markdown. Parsing quality caps the quality of everything downstream in a RAG pipeline.

Tool	Website	What it is for	Tier	Notes
LlamaParse	docs.cloud.llamaindex.ai	Document parsing service from LlamaIndex for PDFs, tables, layouts, and multimodal documents	Core	Strong default for RAG projects already using LlamaIndex or needing high-quality PDF-to-structured-text conversion.
Unstructured	docs.unstructured.io	Ingestion and partitioning for PDFs, Office docs, HTML, images, and enterprise files	Core	Good when the ingestion problem spans many file types and connectors.
Docling	docling-project.github.io	Open-source document conversion, parsing, OCR, layout, table, and multimodal extraction	Conditional	Strong local/open-source path when teams want control over document processing.
Reducto	docs.reducto.ai	Document ingestion and extraction for complex PDFs and	Conditional	Worth evaluating for finance, legal, healthcare, and other layout-heavy document workflows.
Mistral OCR	docs.mistral.ai	OCR and document AI through Mistral's Document AI stack	Conditional	Good when Mistral is already in the model/provider mix or OCR quality is central.
Azure AI Document Intelligence	learn.microsoft.com	Enterprise document extraction for forms, invoices, receipts, layout, and custom models	Conditional	Strong when compliance, Azure integration, and existing enterprise document flows matter.
Google Document AI	cloud.google.com	Document processors for OCR, forms, invoices, layout, and custom extraction	Conditional	Best when the app and data are already on Google Cloud.
AWS Textract	docs.aws.amazon.com	AWS document text, table, form, and layout extraction	Conditional	Best when documents already live in S3 or the system is AWS-native.
Chunkr	docs.chunkr.ai	Document parsing API for layout-aware extraction and chunking	Watch	Track for document-heavy RAG where chunk quality is a bottleneck.
Marker	github.com/datalab-to	Open-source document conversion to Markdown, JSON, and HTML	Conditional	Useful local option for PDF-to-Markdown pipelines and batch ingestion.
MinerU	github.com/opendatalab	Open-source document extraction and conversion toolkit	Watch	Track for open document parsing, especially PDFs with tables, formulas, and layout needs.

Sources are linked inline.

Retrieval and Memory

Retrieval, RAG, and Memory

Document Ingestion, OCR, and Parsing

On this page