Vast.ai mentions (223)

• Nvidia pursues $30B custom chip opportunity with new unit

  There are already ways to get around this. For example, renting compute from people who aren't in datacenters. Which is already a thing: https://vast.ai. - Source: Hacker News / 4 months ago

• A SETI-like project to train LLM on libgen, scihub and the likes?

  By "SETI" I assume you mean the SETI@Home distributed computing project. There's a two-way market where you can rent out your GPU here: https://vast.ai/. - Source: Hacker News / 6 months ago

• Ask HN: What's the best hardware to run small/medium models locally?

  - https://vast.ai/ (linked by gchadwick above). - Source: Hacker News / 6 months ago

• Ask HN: What's the best hardware to run small/medium models locally?

  Have you considered running on a cloud machine instead? You can rent machines on https://vast.ai/ for under $1 an hour that should work for small/medium models (I've mostly been playing with stable diffusion so I don't know what you'd need for an LLM off hand). Good GPUs and Apple hardware is pricey. Get a bit of automation setup with some cloud storage (e.g backblaze B2) and you can have a machine ready to run... - Source: Hacker News / 6 months ago

• Budget-friendly Cloud server to host OpenAI Whisper?

  I have heard vast.ai is cheap but I haven't tried it out. https://websiteinvesting.com/reviews/vast-ai-review/. Source: 6 months ago

CurseHosting mentions (0)