Fun fact: We've implemented binary embedding search [1] without the need for a specialized vector database. Instead, we create dimensional tokens like 'embedding_0_0', 'embedding_1_0', and so on, and we harness the robust capabilities of Tantivy [2]. We're really satisfied with the exceptional quality and performance this approach yields. Moreover, Tabby remains a single binary, integrating all these components... - Source: Hacker News / 5 months ago
| Hm, I am interested, but I would love to use it as a rust lib and just have rust types instead of some json config... Yes that's how you use tantivy normally, not sure which json config you mean. `tantivy-cli` is more like a showcase, https://github.com/quickwit-oss/tantivy is the actual project. - Source: Hacker News / 6 months ago
Tantivy - a full-text indexing library written in Rust. Has a great Performance and featureset. - Source: dev.to / 9 months ago
By this I presume you mean build a search index that can retrieve results based on keywords? I know certain databases use Lucene to build a keyword-based index on top of unstructured blobs of data. Another alternative is to use Tantivy (https://github.com/quickwit-oss/tantivy), a Rust version of Lucene, if building search indices via Java isn't your cup of tea... - Source: Hacker News / 10 months ago
We also implemented our schemaless columnar storage optimized for object storage. The inverted index and columnar storage are part of tantivy [0], which is the fastest search library out there. We maintain it and we decided to build the distributed engine on top of it. [0] tantivy github repo: https://github.com/quickwit-oss/tantivy. - Source: Hacker News / 10 months ago
Search index : Custom-built using tantivy. Source: about 1 year ago
Hi /r/rust, I’m a SWE on Etsy’s Retrieval Systems team where we’re building a platform based on rust and tantivy (https://github.com/quickwit-oss/tantivy). We’re looking to bring two new engineers onto the team. Source: over 1 year ago
Quick Search: Easily find specific notes with Velo's fuzzy-search feature, powered by tantivy. Tantivy might have been a little overkill, but it was really easy to integrate. Source: over 1 year ago
Two years after, we are finally reaching a version that can deliver our promise. Two years is both very long for a startup and very short when building a distributed engine. And we decided to do it the hard way: we implemented our own OSS gossip library, our own {S3,JSON}-friendly columnar format for schemaless analytics, and of course, we maintain our own search library, tantivy. This is a lot of engineering... Source: over 1 year ago
- Another nice comment seen on HN « it seems to be very easy to run, not very IO intensive, and running fine on a single node with modest hardware with >2 billion log rows. It has a really cool dynamic schema feature too.» [9] Fun fact: at least 4 users are using Garage[10] as the object storage, this OSS project looks really promising and made the HN front page a few months ago[11], we really cherish the OSS for... - Source: Hacker News / over 1 year ago
It's mostly Rust with a sprinkling of python for some of the ML stuff. The transcription is done via whisper (https://github.com/ggerganov/whisper.cpp) and the search is handle via standard lexical search (https://github.com/quickwit-oss/tantivy) combined with a vector database (https://qdrant.tech) to find relevant pieces of content. Source: over 1 year ago
Good project, also thanks for being open about how you make use of Tantivy. Source: over 1 year ago
From my little knowledge of Loki's internals. I think contrary to Loki, Quickwit uses a fully feature search engine library underneath called Tantivy (https://github.com/quickwit-oss/tantivy). - Source: Hacker News / over 1 year ago
I'm learning rust, while migrating a small search engine server written in golang to rust with tantivy and axum. It's for an e-learning site to index questions and people. Source: over 1 year ago
I'm the lead developer on Spyglass, an open-source personal search application that let's you search your corner of the internet. Built using full-stack Rust, Tauri & Yew for the client, and Tantivy for our search backend. Source: over 1 year ago
Is this a posting list? There is a lot of bioinformatics in this post, but if I squint, some of the problems do look like general information retrieval problems. Even the discussion of ordering the arrays by mass sounds like search relevance scores and makes me wonder if it makes sense to try to get something off the shelf like meillisearch/milli or tantavy to support this use case. Source: about 2 years ago
My favorite, and the closest one to ElasticSearch (for its features) is probably Tantivy. I'd recommend anyone to check up this three projects and choose on what best fits your needs... it's awesome to see that more projects are becoming available by the day! [1]: https://github.com/quickwit-oss/tantivy [2]: https://github.com/meilisearch/meilisearch. - Source: Hacker News / about 2 years ago
I wish we had an extension like ZomboDB but using a lighter search engine like https://github.com/quickwit-oss/quickwit, https://github.com/toshi-search/Toshi and https://github.com/mosuka/bayard Here I'm listing engines based on https://github.com/quickwit-oss/tantivy - tantivy is comparable to Lucene in its scope - but I'm sure there are other engines that could tackle ElasticSearch. Another thing that could... - Source: Hacker News / about 2 years ago
Yup! I'd heard of Quickwit and sonic, but Quickwit seems to have pivoted to being a log-search focused engine. It's built on Tantivy[0] IIRC so I could have used something like Toshi[1]. Sonic[2] I know much less about but it also seems good. Honestly anything except ES is what I like to hear about (though OpenSearch is interesting). Another thing I think the world really needs is a CLI +/- API tool... - Source: Hacker News / about 2 years ago
You'll love what we're working on if you're interested in the implementation of:- Tantivy- Meilisearch- Finite State Transducers. Source: about 2 years ago
Another alternative - Tantivy (https://github.com/quickwit-oss/tantivy) - Tantivy is a full-text search engine library inspired by Apache Lucene and written in Rust. - Source: Hacker News / about 2 years ago
Do you know an article comparing Tantivy to other products?
Suggest a link to a post with product alternatives.
This is an informative page about Tantivy. You can review and discuss the product here. The primary details have not been verified within the last quarter, and they might be outdated. If you think we are missing something, please use the means on this page to comment or suggest changes. All reviews and comments are highly encouranged and appreciated as they help everyone in the community to make an informed choice. Please always be kind and objective when evaluating a product and sharing your opinion.