Consume data into third party software (then let Open Search or Apache Spark or Apache Pinot) for analysis/datascience, GIS systems (so you can put reports on a map) or any ticket management system. - Source: dev.to / 4 months ago

As you can see the visualisation performs rather well with InfluxDB except for one button which appears to be disabled:** Logs for this span**. This button is automatically disabled when our trace data source (in this case, Jaeger with InfluxDB 3.0 acting as the gRPC storage engine) has not been configured with a log data source. A log data source within Grafana is usually represented by default using the log... - Source: dev.to / 10 months ago

Interesting work with the representation of the Content through the URL, to allow the agent/actor to discover the information through different path. ↓ [...] - CSS(--variable) - DOM(attributes=value) - FORM(input[name]) - URL(path?param#resource) - HTTP(?params{body}) - SCRIPT(--attribute) - DB(model?filters) - FS(folder/filer/{content}) [...] ↑ - https://www.w3.org/OWL/ maybe to harmonize the... - Source: Hacker News / 10 months ago

Scalable data ingestion is a key aspect for a large-scale distributed search and analytics engine like OpenSearch. One of the ways to build a real-time data ingestion pipeline is to use Apache Kafka. It's an open-source event streaming platform used to handle high data volume (and velocity) and integrates with a variety of sources including relational and NoSQL databases. For example, one of the canonical use... - Source: dev.to / 10 months ago

One more open source tool to consider here is opensearch, which is a fork of elasticsearch. https://opensearch.org/. Source: 12 months ago

We tested S3 Express for our search engine quickwit[0] a couple of weeks ago. While this was really satisfying on the performance side, we were a bit disappointed by the price, and I mostly agree with the article on this matter. I can see some very specific use cases where the pricing should be OK but currently, I would say most of our users should just stay on the classic S3 and add some local SSD caching if they... - Source: Hacker News / 6 months ago

Quickwit (https://quickwit.io/) | Paris, France | Onsite and remote (based in Europe) | Full-time The company is fully remote but we also have a small office in Paris. We prefer candidates based in Europe but can make exceptions for the right profiles. - Senior Software Engineer 80-110k€ + 0.25-1% equity based on experience.

    We’re looking for a senior software engineer to contribute to...

- Source: Hacker News / 9 months ago

- Another nice comment seen on HN « it seems to be very easy to run, not very IO intensive, and running fine on a single node with modest hardware with >2 billion log rows. It has a really cool dynamic schema feature too.» [9] Fun fact: at least 4 users are using Garage[10] as the object storage, this OSS project looks really promising and made the HN front page a few months ago[11], we really cherish the OSS for... - Source: Hacker News / 12 months ago

The github repository (⭐ are welcome ❤️) Https://github.com/quickwit-oss/quickwit. Source: 12 months ago

Quickwit is an open source Loki alternative too. Like said in one comment here, it works on billions of logs on one modest instance. And Grafana integration is on the way :) https://github.com/quickwit-oss/quickwit (disclaimer: I'm one of the cofounders). - Source: Hacker News / about 1 year ago