There are already ways to get around this. For example, renting compute from people who aren't in datacenters. Which is already a thing: https://vast.ai. - Source: Hacker News / 4 months ago

By "SETI" I assume you mean the SETI@Home distributed computing project. There's a two-way market where you can rent out your GPU here: https://vast.ai/. - Source: Hacker News / 6 months ago

- https://vast.ai/ (linked by gchadwick above). - Source: Hacker News / 6 months ago

Have you considered running on a cloud machine instead? You can rent machines on https://vast.ai/ for under $1 an hour that should work for small/medium models (I've mostly been playing with stable diffusion so I don't know what you'd need for an LLM off hand). Good GPUs and Apple hardware is pricey. Get a bit of automation setup with some cloud storage (e.g backblaze B2) and you can have a machine ready to run... - Source: Hacker News / 6 months ago

I have heard vast.ai is cheap but I haven't tried it out. https://websiteinvesting.com/reviews/vast-ai-review/. Source: 6 months ago

2. Google Cloud Vertex AI: https://cloud.google.com/vertex-ai. Policy: https://cloud.google.com/vertex-ai/docs/generative-ai/data-governance#foundation_model_training. - Source: Hacker News / 4 months ago

Google Cloud Platform (GCP) provides a very befitting Machine Learning solution called Vertex Ai that handles Google Cloud's unified platform for building, deploying, and managing machine learning (ML) models. Our goal is to build a simple Machine Learning application that optimizes all that GCP provides plus an implementation of continuous integration and continuous development (CI/CD). - Source: dev.to / 6 months ago

Cross posting some links from another post that HNers found helpful - https://cloud.google.com/vertex-ai (marketing page) - https://cloud.google.com/vertex-ai/docs (docs entry point) - https://console.cloud.google.com/vertex-ai (cloud console) - https://console.cloud.google.com/vertex-ai/model-garden (all the models) - https://console.cloud.google.com/vertex-ai/generative (studio / playground) VertexAI is the... - Source: Hacker News / 6 months ago

For the peer comments - https://cloud.google.com/vertex-ai (main page) - https://cloud.google.com/vertex-ai/docs/start/introduction-unified-platform (docs entry point) - https://console.cloud.google.com/vertex-ai (cloud console). - Source: Hacker News / 6 months ago

Starting on December 13, developers and enterprise customers can access Gemini Pro via the Gemini API in Google AI Studio or Google Cloud Vertex AI. Source: 6 months ago