Llama-Server is All You Need (Plus a Management Layer)

1

TailScale

Both my home Mac Mini and a cloud VPS are connected via Tailscale. This creates a secure, private network that lets them communicate as if they were on the same LAN, regardless of where I am.

#Security & Privacy #VPN #Cloud VPN 529 social mentions

2

LM Studio

If you're running LLMs locally, you've probably used Ollama or LM Studio. They're both excellent tools, but I hit some limitations. LM Studio is primarily a desktop app that can't run truly headless, while Ollama requires SSH-ing into your server every time you want to switch models or adjust parameters.

#AI #Productivity #Writing Tools 29 social mentions