fio Reviews

Apache Kafka Reviews

fio mentions (14)

• Dire SMB speed with on PC to NAS

  Assuming two systems use flash storage, network bandwidth is identical and it is configured the same way, there should be an issue within the PC, either system or storage drive. Check the system logs for errors and warning events related to data transfer from/to NAS. Try to benchmark the PCs' disks using fio to confirm they have similar performance. https://github.com/axboe/fio. Source: 12 months ago

• Ask HN: What are some good resources for learning about low level disk/file IO?

  Not specifically addressing your question, but when you get to the point of wanting to start doing some experiments you may find that 'fio' [1] is very handy. [1] https://github.com/axboe/fio. - Source: Hacker News / about 1 year ago

• KVM virtual machines on ZFS benchmarks

  The dd is not a good benchmarking tool, you should use something like fio and probably tune it to use the ioengine most similar to your use case (eg. a database server will probably use some async IO interface). In your first example (with bs=1G) probably something (the guest OS, the qemu/kvm or the host OS) have split into smaller chunks anyway. Source: about 1 year ago

• SSD Sequential Write Slowdowns

  All linux tests are run with fio 3.32 (github) with future commit 03900b0bf8af625bb43b10f0627b3c5947c3ff79 manually applied. Source: over 1 year ago

• Just write the f*****g parser.

  Agree, I used flex/yacc to add an arithmetic expression evaluator to fio a few years back to allow simple math with some units in fio's job files, and for stuff like that, they're fine, but I wouldn't want to use them for a real language, the error handling is kind of a nightmare. Source: over 1 year ago

Apache Kafka mentions (121)

• Best Practices for Building Microservices with NestJS

  Choose a consistent communication protocol for inter-service communication. Common protocols include HTTP, gRPC, and message brokers like RabbitMQ or Kafka. NestJS supports various communication strategies, allowing you to choose the one that best fits your needs. - Source: dev.to / 11 days ago

• Empowering Real-Time Data Pipelines: Leveraging Apache Kafka and Rudderstack

  In today’s fast-paced digital landscape, effective data management and analysis are essential for businesses aiming to stay ahead of the curve. Fortunately, modern tools like Apache Kafka and RudderStack have revolutionized the way we handle and derive insights from large datasets. In this blog post, we’ll explore our experience implementing the Kafka Sink Connector to facilitate seamless event data transfer to... - Source: dev.to / 3 months ago

• Choosing Between a Streaming Database and a Stream Processing Framework in Python

  Stream-processing platforms such as Apache Kafka, Apache Pulsar, or Redpanda are specifically engineered to foster event-driven communication in a distributed system and they can be a great choice for developing loosely coupled applications. Stream processing platforms analyze data in motion, offering near-zero latency advantages. For example, consider an alert system for monitoring factory equipment. If a... - Source: dev.to / 4 months ago

• How to Use Reductstore as a Data Sink for Kafka

  Apache Kafka is a distributed streaming platform capable of handling high throughput of data, while ReductStore is a databases for unstructured data optimized for storing and querying along time. - Source: dev.to / 4 months ago

• 🦿🛴Smarcity garbage reporting automation w/ ollama

  *Push data *(original source image, GPS, timestamp) in a common place (Apache Kafka,...). - Source: dev.to / 5 months ago