Low End Box VS Vast.ai

We normally recommend using Amazon's AWS "Free Tier" or Digital Ocean - but both require that you have a credit card. The same is true of the Microsoft Azure, Google's GCP and the vast majority of providers listed at Low End Box (https://lowendbox.com/). Source: 5 months ago

I get them from the aggregator https://lowendbox.com when companies offer deals; some have been great, some poor, but all very cheap; I think $14/year has been a decent one. Although my current one only has 512MB RAM and isn’t enough for Rust to compile Scryer Prolog. Prolog, a language first run on the computers of 1971 and standardised around 1998. - Source: Hacker News / 6 months ago

FWIW, I recently found a VPS offering for $1.41/month (!) @ 1.5GB RAM & 30GB HDD via https://lowendbox.com/, at https://my.racknerd.com/index.php?rp=/store/black-friday-2022 (please note I have no idea how reliable it is though!). I managed to deploy NixOS there through nixos-infect (https://github.com/elitak/nixos-infect. - Source: Hacker News / 7 months ago

Hetzner is still expensive for a blog. Check out offerings on http://lowendbox.com/ you can get a 4GB/2vCPU for like $45/year. Year, and not month. That is the kind of margin these big brand sellers have. I have been using a couple for the past 3-4 years and been pretty nice so yeah. - Source: Hacker News / 8 months ago

If your goal is to minimise costs, some of the cheaper providers that have offers on https://lowendbox.com/ will have reasonable annual discounts. - Source: Hacker News / 9 months ago

There are already ways to get around this. For example, renting compute from people who aren't in datacenters. Which is already a thing: https://vast.ai. - Source: Hacker News / 2 months ago

By "SETI" I assume you mean the SETI@Home distributed computing project. There's a two-way market where you can rent out your GPU here: https://vast.ai/. - Source: Hacker News / 4 months ago

- https://vast.ai/ (linked by gchadwick above). - Source: Hacker News / 4 months ago

Have you considered running on a cloud machine instead? You can rent machines on https://vast.ai/ for under $1 an hour that should work for small/medium models (I've mostly been playing with stable diffusion so I don't know what you'd need for an LLM off hand). Good GPUs and Apple hardware is pricey. Get a bit of automation setup with some cloud storage (e.g backblaze B2) and you can have a machine ready to run... - Source: Hacker News / 4 months ago

I have heard vast.ai is cheap but I haven't tried it out. https://websiteinvesting.com/reviews/vast-ai-review/. Source: 4 months ago