Fun fact: We've implemented binary embedding search [1] without the need for a specialized vector database. Instead, we create dimensional tokens like 'embedding_0_0', 'embedding_1_0', and so on, and we harness the robust capabilities of Tantivy [2]. We're really satisfied with the exceptional quality and performance this approach yields. Moreover, Tabby remains a single binary, integrating all these components... - Source: Hacker News / 9 days ago

| Hm, I am interested, but I would love to use it as a rust lib and just have rust types instead of some json config... Yes that's how you use tantivy normally, not sure which json config you mean. `tantivy-cli` is more like a showcase, https://github.com/quickwit-oss/tantivy is the actual project. - Source: Hacker News / 24 days ago

Tantivy - a full-text indexing library written in Rust. Has a great Performance and featureset. - Source: dev.to / 5 months ago

By this I presume you mean build a search index that can retrieve results based on keywords? I know certain databases use Lucene to build a keyword-based index on top of unstructured blobs of data. Another alternative is to use Tantivy (https://github.com/quickwit-oss/tantivy), a Rust version of Lucene, if building search indices via Java isn't your cup of tea... - Source: Hacker News / 5 months ago

We also implemented our schemaless columnar storage optimized for object storage. The inverted index and columnar storage are part of tantivy [0], which is the fastest search library out there. We maintain it and we decided to build the distributed engine on top of it. [0] tantivy github repo: https://github.com/quickwit-oss/tantivy. - Source: Hacker News / 6 months ago

Check out Skyflow. They built a privacy vault to specifically address this issue. Source: over 1 year ago