AgentGPT was an early agent framework designed to create, configure, and deploy autonomous AI agents. It mostly relies on looping OpenAI's GPT models like GPT-3.5 and GPT-4. AgentGPT allows users to set a goal for the AI, which autonomously plans, executes, and refines strategies to achieve it. This platform allows for both web browser access and local operation via Docker, or server deployment. - Source: dev.to / about 1 month ago

Nowadays, running powerful LLMs locally is ridiculously easy when using tools such as ollama. Just follow the installation instructions for your #OS. From now on, we'll assume using bash on Ubuntu. - Source: dev.to / 4 days ago

I focused on supporting Ollama, GPT4All, and LMStudio, all of which run smoothly on a Mac computer. Many of these tools are user-friendly wrappers around Llama.cpp, allowing easy model downloads and providing a REST interface to query the available models. Last week, I also added "👋🏼 Jan" support because HuggingFace has endorsed this provider out-of-the-box. - Source: dev.to / 9 days ago

Ollama is an open-source tool for using LLMs like Llama 3 on your computer. Thanks to new research, these models don't need a lot of VRAM, computing power, or storage. They are designed to work well on laptops. - Source: dev.to / 21 days ago

One thing I've noticed is that gemma is much less verbose by default. [0] https://github.com/ollama/ollama. - Source: Hacker News / about 2 months ago

A few weeks ago, I started using Ollama to run language models (LLM), and I've been really enjoying it a lot. After getting the hang of it, I thought it was about time to try it out on one of our real-world cases (I'll share more about this later). - Source: dev.to / 2 months ago