Tantivy Reviews and details

Social recommendations and mentions

• What is Hybrid Search?

  Tantivy - a full-text indexing library written in Rust. Has a great Performance and featureset. - Source: dev.to / 3 months ago

• RAG Using Unstructured Data and Role of Knowledge Graphs

  By this I presume you mean build a search index that can retrieve results based on keywords? I know certain databases use Lucene to build a keyword-based index on top of unstructured blobs of data. Another alternative is to use Tantivy (https://github.com/quickwit-oss/tantivy), a Rust version of Lucene, if building search indices via Java isn't your cup of tea... - Source: Hacker News / 3 months ago

• Show HN: Quickwit – OSS Alternative to Elasticsearch, Splunk, Datadog

  We also implemented our schemaless columnar storage optimized for object storage. The inverted index and columnar storage are part of tantivy [0], which is the fastest search library out there. We maintain it and we decided to build the distributed engine on top of it. [0] tantivy github repo: https://github.com/quickwit-oss/tantivy. - Source: Hacker News / 4 months ago

• Grimoire - A recipe management application.

  Search index : Custom-built using tantivy. Source: 7 months ago

• Job: Rust + Retrieval Systems at Etsy

  Hi /r/rust, I’m a SWE on Etsy’s Retrieval Systems team where we’re building a platform based on rust and tantivy (https://github.com/quickwit-oss/tantivy). We’re looking to bring two new engineers onto the team. Source: 10 months ago

• Announcing Velo - Your Rust-Powered Brainstorming and Note-Taking Tool

  Quick Search: Easily find specific notes with Velo's fuzzy-search feature, powered by tantivy. Tantivy might have been a little overkill, but it was really easy to integrate. Source: 10 months ago

• Quickwit 0.6.0 - Search and analytics on billions of logs with minimal hardware

  Two years after, we are finally reaching a version that can deliver our promise. Two years is both very long for a startup and very short when building a distributed engine. And we decided to do it the hard way: we implemented our own OSS gossip library, our own {S3,JSON}-friendly columnar format for schemaless analytics, and of course, we maintain our own search library, tantivy. This is a lot of engineering... Source: 11 months ago

• Show HN: Quickwit – Cost-efficient Elasticsearch alternative on object storage

  - Another nice comment seen on HN « it seems to be very easy to run, not very IO intensive, and running fine on a single node with modest hardware with >2 billion log rows. It has a really cool dynamic schema feature too.» [9] Fun fact: at least 4 users are using Garage[10] as the object storage, this OSS project looks really promising and made the HN front page a few months ago[11], we really cherish the OSS for... - Source: Hacker News / 11 months ago

• Ask ATP ... using LLMs!

  It's mostly Rust with a sprinkling of python for some of the ML stuff. The transcription is done via whisper (https://github.com/ggerganov/whisper.cpp) and the search is handle via standard lexical search (https://github.com/quickwit-oss/tantivy) combined with a vector database (https://qdrant.tech) to find relevant pieces of content. Source: 11 months ago

• New Cozo release! v0.7

  Good project, also thanks for being open about how you make use of Tantivy. Source: 12 months ago

• I can't recommend serious use of an all-in-one local Grafana Loki setup

  From my little knowledge of Loki's internals. I think contrary to Loki, Quickwit uses a fully feature search engine library underneath called Tantivy (https://github.com/quickwit-oss/tantivy). - Source: Hacker News / almost 1 year ago

• Am I using async rust correctly along with blocking rust?

  I'm learning rust, while migrating a small search engine server written in golang to rust with tantivy and axum. It's for an e-learning site to index questions and people. Source: about 1 year ago

• This Month in Spyglass #2 - Search your Reddit saved & upvoted posts, user configurable actions, and more!

  I'm the lead developer on Spyglass, an open-source personal search application that let's you search your corner of the internet. Built using full-stack Rust, Tauri & Yew for the client, and Tantivy for our search backend. Source: about 1 year ago

• Proteomics search engine written in Rust

  Is this a posting list? There is a lot of bioinformatics in this post, but if I squint, some of the problems do look like general information retrieval problems. Even the discussion of ordering the arrays by mass sounds like search relevance scores and makes me wonder if it makes sense to try to get something off the shelf like meillisearch/milli or tantavy to support this use case. Source: over 1 year ago

• An alternative to Elasticsearch that runs on a few MBs of RAM

  My favorite, and the closest one to ElasticSearch (for its features) is probably Tantivy. I'd recommend anyone to check up this three projects and choose on what best fits your needs... it's awesome to see that more projects are becoming available by the day! [1]: https://github.com/quickwit-oss/tantivy [2]: https://github.com/meilisearch/meilisearch. - Source: Hacker News / over 1 year ago

• Postgres Full Text Search vs. the Rest

  I wish we had an extension like ZomboDB but using a lighter search engine like https://github.com/quickwit-oss/quickwit, https://github.com/toshi-search/Toshi and https://github.com/mosuka/bayard Here I'm listing engines based on https://github.com/quickwit-oss/tantivy - tantivy is comparable to Lucene in its scope - but I'm sure there are other engines that could tackle ElasticSearch. Another thing that could... - Source: Hacker News / over 1 year ago

• Postgres Full Text Search vs. the Rest

  Yup! I'd heard of Quickwit and sonic, but Quickwit seems to have pivoted to being a log-search focused engine. It's built on Tantivy[0] IIRC so I could have used something like Toshi[1]. Sonic[2] I know much less about but it also seems good. Honestly anything except ES is what I like to hear about (though OpenSearch is interesting). Another thing I think the world really needs is a CLI +/- API tool... - Source: Hacker News / over 1 year ago

• Official /r/rust "Who's Hiring" thread for job-seekers and job-offerers [Rust 1.64]

  You'll love what we're working on if you're interested in the implementation of:- Tantivy- Meilisearch- Finite State Transducers. Source: over 1 year ago

• ZincSearch – lightweight alternative to Elasticsearch written in Go

  Another alternative - Tantivy (https://github.com/quickwit-oss/tantivy) - Tantivy is a full-text search engine library inspired by Apache Lucene and written in Rust. - Source: Hacker News / over 1 year ago

• I want to dive into how to make search engines

  I've never worked on a project that encompasses as many computer science algorithms as a search engine. There are a lot of topics you can lookup in "Information Storage and Retrieval": - Tries (patricia, radix, etc...) - Trees (b-trees, b+trees, merkle trees, log-structured merge-tree, etc..) - Consensus (raft, paxos, etc..) - Block storage (disk block size optimizations, mmap files, delta storage, etc..) -... - Source: Hacker News / over 1 year ago

• SurrealDB: A new scalable document-graph database written in Rust

  Hi u/mugendee, full-text indexing will be coming after our 1.0.0 release and isn't available just yet (this should be visible on our features page (https://surrealdb.com/features). We'll be leveraging some functionality from https://github.com/quickwit-oss/tantivy, but with a key-value store for the underlying storage. Source: over 1 year ago