Consume data into third party software (then let Open Search or Apache Spark or Apache Pinot) for analysis/datascience, GIS systems (so you can put reports on a map) or any ticket management system. - Source: dev.to / 4 months ago

As you can see the visualisation performs rather well with InfluxDB except for one button which appears to be disabled:** Logs for this span**. This button is automatically disabled when our trace data source (in this case, Jaeger with InfluxDB 3.0 acting as the gRPC storage engine) has not been configured with a log data source. A log data source within Grafana is usually represented by default using the log... - Source: dev.to / 10 months ago

Interesting work with the representation of the Content through the URL, to allow the agent/actor to discover the information through different path. ↓ [...] - CSS(--variable) - DOM(attributes=value) - FORM(input[name]) - URL(path?param#resource) - HTTP(?params{body}) - SCRIPT(--attribute) - DB(model?filters) - FS(folder/filer/{content}) [...] ↑ - https://www.w3.org/OWL/ maybe to harmonize the... - Source: Hacker News / 10 months ago

Scalable data ingestion is a key aspect for a large-scale distributed search and analytics engine like OpenSearch. One of the ways to build a real-time data ingestion pipeline is to use Apache Kafka. It's an open-source event streaming platform used to handle high data volume (and velocity) and integrates with a variety of sources including relational and NoSQL databases. For example, one of the canonical use... - Source: dev.to / 11 months ago

One more open source tool to consider here is opensearch, which is a fork of elasticsearch. https://opensearch.org/. Source: 12 months ago

Tantivy - a full-text indexing library written in Rust. Has a great Performance and featureset. - Source: dev.to / 4 months ago

By this I presume you mean build a search index that can retrieve results based on keywords? I know certain databases use Lucene to build a keyword-based index on top of unstructured blobs of data. Another alternative is to use Tantivy (https://github.com/quickwit-oss/tantivy), a Rust version of Lucene, if building search indices via Java isn't your cup of tea... - Source: Hacker News / 4 months ago

We also implemented our schemaless columnar storage optimized for object storage. The inverted index and columnar storage are part of tantivy [0], which is the fastest search library out there. We maintain it and we decided to build the distributed engine on top of it. [0] tantivy github repo: https://github.com/quickwit-oss/tantivy. - Source: Hacker News / 5 months ago

Search index : Custom-built using tantivy. Source: 8 months ago

Hi /r/rust, I’m a SWE on Etsy’s Retrieval Systems team where we’re building a platform based on rust and tantivy (https://github.com/quickwit-oss/tantivy). We’re looking to bring two new engineers onto the team. Source: 11 months ago