RAG Using Unstructured Data and Role of Knowledge Graphs

1

txtai

#Search Engine #Databases #Utilities 62 social mentions

2

Tantivy

By this I presume you mean build a search index that can retrieve results based on keywords? I know certain databases use Lucene to build a keyword-based index on top of unstructured blobs of data. Another alternative is to use Tantivy (<a href="https://github.com/quickwit-oss/tantivy">https://github.com/quickwit-oss/tantivy</a>), a Rust version of Lucene, if building search indices via Java isn't your cup of tea :) Both libraries offer multilingual support for keywords, I believe, so that's a benefit to vector search where multilingual embedding models are rather expensive.

#Open Source #Search Engine #Tech 26 social mentions