Instrument your LLM calls to analyze AI costs and usage

1

Vercel AI SDK

We use the Vercel AI SDK,  a popular choice for many TypeScript developers, to call the LLM from our TypeScript backend.

#Utilities #Communications #Large Language Model Tools 18 social mentions

2

Google Cloud Machine Learning

We use Vertex AI to simplify our implementation, to test different LLM providers and models, and to compare metrics such as cost, latency, errors, time to first token, etc, across models.

#Data Science And Machine Learning #Data Science Tools #Python Tools 33 social mentions