tcarambat.eth
tcarambat.eth

@tcarambat

7 Tweets 5 reads Jun 15, 2023
Announcing AnythingLLM. An open-source (MIT) full-stack app for chatting with... anything.
βœ… UI for managing documents
βœ… Uses @OpenAI , @pinecone & @LangChainAI
🚫 massive RAM requirements
🚫 LLM downloading or training
🚫 paying to re-embed documents
+ data tooling!
First, you can find AnythingLLM on Github here
github.com
Requirements:
- Python 3.8+
- npm and Node v16+
Thats it. No bulky CPU or GPU is required.
Chatting with your documents is the "hello world" of LLM use-cases, why not make it more accessible?
What is so special about AnythingLLM?
πŸ”₯ No crazy system requirements - runs fast and passively on your machine
🧰 Full data-collection tool suite. Collect anything
πŸ‘‰ Entire YouTube Channels
πŸ‘‰ Substacks
πŸ‘‰ Mediums
πŸ‘‰ Gitbooks
+ local document processing
⚑ Efficient vector-caching
Embed forever, pay once.
Embedding is low-cost using OpenAIs ada text embedding, but over thousands of tokens - why pay more than once?
AnythingLLMs vector caching allows you to use the same document across workspaces and pay once.
πŸ’Ž Persistent and Useable
Chatting and managing documents is all done from a web-browser UI.
Shut down the app and start it later - all your documents, chats, and more are still present. Picking up right where you left off.
The database is locally saved on your machine.
πŸ”‘ Bring-Your-Own-Keys
Use your own OpenAI API key and Pinecone (free) instance and you are already on the way to managing documents with ease.
This keeps overhead low by just using what is existing, easy and accessible.

Loading suggestions...