How Open is Generative AI? Part 2

AI Utilities Productivity

RedPajama Landing Page

1

RedPajama

RedPajama is a project to create a set of leading, fully open-source models. Today, we are excited to announce the completion of the first step of this project: the reproduction of the LLaMA training dataset of over 1.2 trillion tokens.

RedPajama, initiated in 2022 by Together AI, a non-profit advocating AI democratization, playfully references LLaMA and the children’s book “Llama Llama Red Pajama”.

#Utilities #Communications #Large Language Model Tools 1 social mentions
ShareGPT Landing Page
2

ShareGPT

Easy sharing for ChatGPT conversations
Pricing:
- Open Source
Vicuna is another instruction-focused LLM rooted in LLaMA, developed by researchers from UC Berkeley, Carnegie Mellon University, Stanford, and UC San Diego. They adapted Alpaca’s training code and incorporated 70,000 examples from ShareGPT, a platform for sharing ChatGPT interactions.

#Marketing #AI #Productivity 16 social mentions
Mistral.ai Landing Page
3

Mistral.ai

Frontier AI in your hands
Pricing:
- Open Source
MistralAI, a French startup, developed a 7.3 billion parameter LLM named Mistral for various applications. Committed to open-sourcing its technology under Apache 2.0, the training dataset details for Mistral remain undisclosed. The Mistral Instruct model was fine-tuned using publicly available instruction datasets from the Hugging Face repository, though specifics about the licenses and potential constraints are not detailed. Recently, MistralAI released Mixtral 8x7B, a model based on the sparse mixture of experts (SMoE) architecture, consisting of several specialized models (likely eight, as suggested by its name) activated as needed.

#AI #AI Tools #AI API 27 social mentions