The $0.47 bill seems reasonable for an experiment, but imagine someone doing a task of this complexity as a daily job - let's say 100x times, or a little more than 4 hours - the bill would be $47/day. It feels like there's still an opportunity for a cheaper solution. Have you or someone else experimented with e.g. https://localai.io/ ? - Source: Hacker News / 6 months ago

We're using LocalAI https://localai.io/ for inference on the back end amongst other tools. Source: 8 months ago

We recently added support to use open-source models by integrating with LocalAI (https://localai.io). With LocalAI, we can run open-source models like Llama2 and seamlessly build LLM applications using LLMStack and run everything on-prem. Source: 10 months ago

- Ability to use local open-source LLMs like Llama2 etc using LocalAI (https://localai.io) Background: We started as a closed source prompt management platform early this year (trypromptly.com) and eventually landed as an Enterprise LLM apps platform. In the process, we learned how hard it is to sell a horizontal SaaS platform. That combined with the concerns around data privacy (both with us hosting data as well... - Source: Hacker News / 10 months ago

LocalAI https://localai.io/ and LMStudio https://lmstudio.ai/ both have fairly complete OpenAI compatibility layers. llama-cpp-python has a FastAPI server as well: https://github.com/abetlen/llama-cpp-python/blob/main/llama_... (as of this moment it hasn't merged GGUF update yet though). - Source: Hacker News / 10 months ago

Define agency. Does AutoGPT or BabyAGI fit the definition? Source: 6 months ago

People also have been trying to build multi-agent and task-planning systems. MS research in Asia seems to produce decent results with Task Matrix and HuggingGPT. Similar things have been tried in the form of Auto-GPT and BabyAGI , but both projects are setting their goal so high that they may not achieve the at all, and they are likely to see a complete rework when multi-modal solutions become widespread. Source: about 1 year ago

BabyAGI AI-Powered Task Management for OpenAI + Pinecone or Llama.cpp. Source: about 1 year ago

Yes, we haven't seen anything like that yet. But we do see the people trying to build these things (see AutoGPT, babyagi, ChaosGPT, etc) today, and with the last few years of advancement in LLMs they now have the fundamental building blocks to succeed in the near term (say the next 5 years) rather than in some imaginary far future. Source: about 1 year ago

You should check out some of the projects that combine LangChain with LLMs to automate this process like BabyAGI (https://github.com/yoheinakajima/babyagi) and AutoGPT (https://github.com/Significant-Gravitas/Auto-GPT). They were originally designed around ChatGPT models but have expanded to include llamacpp as an alternative. These provide your language models with the ability to save long term memory, a... Source: about 1 year ago