GPT4All Reviews and details

Social recommendations and mentions

• Ask HN: Are you using a local LLM? If yes, what for?

  I run one. I built an iMessage-like frontend to it using plain JS and a Python websocket backend. I mostly just use it for curiosity and playing with different prompts. I only have 16GB of RAM to dedicate to it, so I use an 8B parameter model which is enough for fun and chitchat, but I don't find it good enough to replace ChatGPT. https://github.com/nomic-ai/gpt4all. - Source: Hacker News / 8 months ago

• Will we ever be able to run a super-capable, unrestricted AI locally and not rely on larger companies?

  You can run the likes of GPT4All now, you can even use it to query local factual documents and source material, rather than make stuff up: https://github.com/nomic-ai/gpt4all. Source: 8 months ago

• Show HN: LlamaGPT – Self-hosted, offline, private AI chatbot, powered by Llama 2

  Agreed. Gpt4all[1] offers a similar 'simple setup' but with application exe downloads, but is arguably more like open core because the gpt4all makers (nomic?) want to sell you the vector database addon stuff on top. [1]https://github.com/nomic-ai/gpt4all I like this one because it feels more private / is not being pushed by a company that can do a rug pull. This... - Source: Hacker News / 9 months ago

• 1) That's why you should avoid using proprietary software. Nobody can screw around with your SD running locally with all your settings 2) A photographer also can't take photos without a camera, so luddites should really get down off their high horses "oh i don't need tools to create"

  For what it's worth, I haven't tried them yet, but there are also open-source large-language models and text-to-speech models. Source: 10 months ago

• Tool for chatting with your codebase and docs using OpenAI, LlamaCpp, and GPT-4-All

  Neat! I've been working on Khoj, which does something analogous. Khoj works best with natural language documents, so it's good with documentation (i.e., READMEs), not so much with code. First I've heard of GPT4All; this is super awesome. Source: 10 months ago

• Question regarding model compatibility for Alpaca Turbo

  Then there are graphical user interfaces like text-generation-webui and gpt4all for general purpose chat. There are also KoboldAI and SillyTavern, they have focus more on storytelling and roleplay and have tools to improve that. Source: 10 months ago

• Damn, I was so satisfied with my 3080 with 10GB of VRAM until I found this subreddit.

  Specifically with this project: https://github.com/nomic-ai/gpt4all. Source: 11 months ago

• Where's the napkin demo?

  What is way beyond that is that that capability of doing natural language processing and then writing code based off the interpretation of that language processing has already escaped into the wild. You dont HAVE to swipe credit card with openai you just have to take up the new skill of beginning junior data scientist :] gpt4all is free and runs on whatever your computer has available. Try the one click installer... Source: 11 months ago

• QLoRA: Efficient Finetuning of Quantized LLMs

  You might want to try some of the discord channels connected to some of the repos. i.e. GPT4All https://github.com/nomic-ai/gpt4all scroll down for the discord link. - Source: Hacker News / 11 months ago

• Worried About Sending Your Data to a Chatbot? 'PrivateGPT' Is Here

  I've been using for fun GPT4All on my Mac Mini M1 and it's surprisingly usable. It's slow but it's private as long as I can tell since it run locally. There are multiple models available. Source: 11 months ago

• March 2023

  Gpt4all: a chatbot trained on a massive collection of clean assistant data including code, stories and dialogue (https://github.com/nomic-ai/gpt4all). Source: 11 months ago

• Governance of Superintelligence

  > I wonder if AI will ever scale down to personal hardware Happened last week. Download here.[1] https://github.com/nomic-ai/gpt4all. - Source: Hacker News / 12 months ago

• llama.cpp running extremely slow via GPT4ALL

  I compiled llama.cpp to use with GPT4ALL and is providing good output and I am happy with the results. However unfortunately for a simple matching question with perhaps 30 tokens, the output is taking 60 seconds. Output really only needs to be 3 tokens maximum but is never more than 10. I used the standard GPT4ALL, and compiled the backend with mingw64 using the directions found here. I did use a different fork of... Source: 12 months ago

• Chief AI Scientist at Meta

  Https://github.com/nomic-ai/gpt4all Https://www.semianalysis.com/p/google-we-have-no-moat-and-neither. Source: 12 months ago

• GPT4All: A little helper to get started

  So, I have noticed GPT4All some time ago, but it did not really blew my socks off. Source: 12 months ago

• Performance of GPT-4 vs PaLM 2

  From there you have lots of other models: One of the best places to easily start using multiple models is using a multiple model UI program lik GPT4All, there are also some programs that provide access to more models or use different ways of interfacing with them, here are some of what I've found are the best / most popular programs to play around with lots of different models and compare them: LocalAI, ... Source: 12 months ago

• Has anyone tried the local LLM?

  I'm talking about GPT4All and all the projects that depend on it. Source: 12 months ago

• What is the best free or open-source alternative to chatGPT?

  GPT4All is one of the best alternatives for ChatGPT. You can find some others here as well. Source: about 1 year ago

• NovelAI vs Local Models?

  Another Offline models, but CHAT ONLY for now are there: Https://github.com/nomic-ai/gpt4all 6B (GPT-J) one is quite nice (comparable maybe to Sigurd), just don't know how to make it working for any NAI/AID-like GUI. Source: 12 months ago

• Run Llama to ask questions about your files

  In my experience, I have used this for my personal work notes i.e. "How to disable the auto-scaler" and stuff like that, and it worked quite good with gpt4all: https://github.com/nomic-ai/gpt4all. I am however, expecting that in the near future we will have something way better. The pace of this domains is blazingly fast. Source: about 1 year ago

• Show HN: Chat-DBT – Interact with your database using OpenAI GPT

  Cool. Now integrate your toy with https://github.com/nomic-ai/gpt4all then we can have fully offline chat and databases. - Source: Hacker News / about 1 year ago