For the inference part, you can dockerise your model and use https://banana.dev for serverless GPU. They have examples on github on how to deploy and I’ve done it last year and was pretty straightforward. - Source: Hacker News / 2 months ago

I want to first check the user's ID and only if the user has an active subscription then the request will be forwarded to my API on banana.dev else the request will be blocked at the middleware itself. Should I use Express JS for the middleware i.e. Authentication and forwarding requests? Is there any other better way to improve my project structure? Currently it looks like:. Source: 7 months ago

Hey! Would love to have you try https://banana.dev (bias: I'm one of the founders). We run A100s for you and scale 0->1->n->0 on demand, so you only pay for what you use. I'm at erik@banana.dev if you want any help with it :). - Source: Hacker News / about 1 year ago

CAN you do this in AWS? Of course, do they have a service that does exactly what this banana.dev does? Probably not. Source: about 1 year ago

I've been using banana.dev for easily running my ML models on GPU in a serverless manner, and interacting with them as an API. Although the principle of the service is sound, it is currently too buggy to take into production (very long cold boots, errorring requests, always hitting capacity). Source: about 1 year ago

Scalr.com - Scalr is a Terraform Automation and COllaboration (TACO) product used to better collaboration and automation on infrastructure and configurations managed by Terraform. Full Terraform CLI support, OPA integration, and a hierarchical configuration model. No SSO tax. All features are included. Use up to 50 runs/month for free. - Source: dev.to / 5 months ago

Scalr is a tool that was created to give the Terraform community an affordable alternative to Terraform Cloud/Enterprise. Scalr is the only product in the space that has a hierarchical model to allow for object inheritance/sharing from a top-down perspective, cross-environment/workspace visibility, and custom RBAC to accommodate any complex org standards. Scalr can operate in a centralized or decentralized way... Source: over 2 years ago

Scalr.com - Remote state & operations backend for Terraform with full CLI support, integration with OPA and a hierarchical configuration model. Free up to 5 users. - Source: dev.to / almost 3 years ago

Actually, the "TACoS" term was coined by Sebastian, CTO of Scalr. Source: about 3 years ago