Prototype to Production LLM App in Minutes
Chat History Memory & Privacy Compliance. Search. Data Enrichment. Embeddings.
Fast, scalable building blocks for LLM apps.
Zep is an open source platform for productionizing LLM apps. Using Zep's components, you can go from a prototype built in LangChain or LlamaIndex, or a custom app, to production in minutes without rewriting code.
Use Zep with the languages and frameworks you love
Join the Zep Cloud waitlist!
Get early access to the fully-managed Zep service.
Vector Search with a Great Developer Experience
Run semantic search over both chat histories and documents. Filter search results using metadata and/or Zep's named entity extraction and intent analysis output.
Automatic embedding with local, low-latency models, OpenAI, or bring your own vectors.
Thoughtful API design makes integrating into LLM apps simple and fast.
Adding, updating, and deleting documents is simple and fast.
Chat History Memory, Archival, and Enrichment
Populate your prompts with relevant chat history. Use Zep's automatic message enrichment to build powerful tools for agents, enhance prompts, or find relevant conversations using hybrid semantic search.
Archive all user messages and AI responses and meet corporate and regularity records retention obligations.
Automatic summary, named entity, and intent extractors enrich chat histories. Populate prompts with relevant topics, user intentions, & more.
Save your own custom metadata to messages and the user's session profile. Include this data in your prompts.
Manage Users and their Chat Sessions
Users and their Chat Sessions are first-class citizens in Zep, allowing you to manage user interactions with your bots or agents easily. Associate your own metadata with Users or Sessions to power stateful experiences across chat sessions.
Records Retention and Privacy Compliance
Comply with corporate and regulatory mandates for records retention while ensuring compliance with privacy regulations such as CCPA and GDPR.
Archive all user messages and AI responses and meet corporate and regularity records retention mandates.
Fulfill Right To Be Forgotten requests with a single API call or via the Zep Web App.
Execute time-based retention policies with an efficient, batched purge of records marked for deletion.
LangChain, LlamaIndex, & more
LangChain and LlamaIndex ship with Zep integrations, letting you implement Zep in minutes. Or use Zep's Python and TypeScript SDKs to implement Zep in your custom app.
Open source.
Simple to deploy.
Deploy using docker-compose, Kubernetes, or to Render.com. Cloud service coming soon!
