Weaviate: An open-source, cloud-native vector database built for scalable and fast vector searches. It's particularly effective for semantic search applications, combining full-text search with vector search for AI-powered insights. - Source: dev.to / 3 months ago

Weaviate is an open-source vector search engine with out-of-the-box support for vectorization, classification, and semantic search. It is designed to make vector search accessible and scalable, supporting use cases such as semantic text search, automatic classification, and more. - Source: dev.to / 4 months ago

Congrats to them! What have your experiences with vector databases been? I've been using https://weaviate.io/ which works great, but just for little tech demos, so I'm not really sure how to compare one versus another or even what to look for really. - Source: Hacker News / 5 months ago

A RAG implementation's quality and performance highly depend on the similarity-based search of embeddings. The challenge arises from the fact that embeddings are usually high-dimensional vectors, and the knowledge base may have many documents. It's not surprising that the popularity of LLM catalyzed the development of specialized vector databases like Pinecone and Weaviate. However, SQL databases are also evolving... - Source: dev.to / 5 months ago

To find semantically similar texts we need to calculate the distance between vectors. While we have just a few short texts we can brute-force it: calculate the distance between our query and each text embedding one by one and see which one is the closest. When we deal with thousands or even millions of entries in our database, however, we need a more efficient way of comparing vectors. Just like for any other way... - Source: dev.to / 7 months ago

While looking into how to create text embeddings quickly and directly, we discovered a few helpful tools that allowed us to achieve our goal. Consequently, we created an easy-to-use PHP extension that can generate text embeddings. This extension lets you pick any model from Sentence Transformers on HuggingFace. It is built on the CandleML framework, which is written in Rust and is a part of the well-known... - Source: dev.to / 5 days ago

These libraries are fundamental for building and training our GPT model. PyTorch is a deep learning framework that provides flexibility and speed, while the Transformers library by Hugging Face offers pre-trained models and tokenizers, including GPT-2. - Source: dev.to / 10 days ago

Hugging Face is a company and community platform making AI accessible through open-source tools, libraries, and models. It is most notable for its transformers Python library, built for natural language processing applications. This library provides developers a way to integrate ML models hosted on Hugging Face into their projects and build comprehensive ML pipelines. - Source: dev.to / 18 days ago

We will use the OpenAI embeddings API to convert the content of the blog posts into vector embeddings. You will need to sign up for an API key on the OpenAI website to use the API. You will need to provide your credit card information as there is a cost associated with using the API. You can review the pricing on the OpenAI website. There are alternatives to generate embeddings. Hugging Face provides... - Source: dev.to / 17 days ago

Hugging-face 🤗 is a repository to host all the LLM models available in the world. https://huggingface.co/. - Source: dev.to / 24 days ago