We wire everything up with Vision Agents as the voice agent framework, Stream for WebRTC audio and video, OpenAI Realtime for speech in and speech out, Anam so the agent shows up as a face on the video, and Supermemory so answers come from search over your uploaded documents instead of guesswork. The code stays small and most of the behavior lives in one registered function that asks the memory store for relevant... - Source: dev.to / 4 months ago

In this tutorial, we build exactly that kind of AI teammate. Instead of piecing together complex infrastructure (audio pipelines, transcription, NLP, TTS, avatars), we'll use Vision Agents to tie everything together, using Stream's WebRTC APIs, and give the AI both a voice and a human-like video presence using ElevenLabs voice and Anam avatars. The system we’ll create can listen, query Postgres, and respond during... - Source: dev.to / 4 months ago

Hey HN, we're Ben and Caoimhe, cofounders of Anam. We built a service for interactive avatars and just shipped our latest model, cara-3. Try it at [anam.ai](http://anam.ai/), no sign-up required, or build with it at [lab.anam.ai](http://lab.anam.ai/) or [anam.ai/cookbook](http://anam.ai/cookbook). Some context on why we're working on this: faces carry emotional signal that text and voice don't. Almost half the... - Source: Hacker News / 7 months ago

It's from https://github.com/ggml-org/llama.cpp -- not associated with Meta, it's been around for years, and surely they know about it -- so I would guess either it's not a trademark violation or they don't care. - Source: Hacker News / 22 days ago

Anything that suggests curl into bash just plain sketches me out. Git clone llama.cpp and build it, it's not hard. https://github.com/ggml-org/llama.cpp/blob/master/docs/build.md literally just a few steps for the basics: git clone https://github.com/ggml-org/llama.cpp cmake -B build cmake --build build --config Release. - Source: Hacker News / 22 days ago

I was a bit suspicious of the url but it is also listed on llama.cpp github https://github.com/ggml-org/llama.cpp. - Source: Hacker News / 22 days ago

TurboFieldfare proves the idea beautifully, but it is a bespoke runtime: two supported models, Apple platforms only, custom kernels for everything. I wanted the same idea for the other cheap 8 GB machine on my desk, a Jetson Orin Nano, and I wanted it for any MoE model I could quantize. So instead of porting the runtime, I grafted the idea into llama.cpp, which already runs on the Jetson and already has... - Source: dev.to / about 1 month ago

Llama.cpp is a flexible runtime for GGUF models across CPU, CUDA, Metal, and other backends. - Source: dev.to / about 1 month ago