ZeroMQ might be a bit more popular than Apache Arrow. We know about 35 links to it since March 2021 and only 34 links to Apache Arrow. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
In this post from 2011, the creator of Omegle, Leif Brooks, explains what technology is used, including Python and a library called gevent for the backend. On top of that, Adobe Cirrus is used for streaming video. Though this post was 12 years ago, it is valuable to know what a web application like Omegle requires. A modern library that may provide some functionality for a text chat at a minimum may be... Source: 7 months ago
They might be thinking of something like ZeroMQ, which is pretty well liked: https://zeromq.org/ That said, I wouldn't call RabbitMQ that heavyweight myself, at least when compared to something like Apache Kafka. - Source: Hacker News / 8 months ago
If you want to learn message passing in an environment you're familiar with, you should check out ZeroMQ. It's a C++ lib for socket abstraction, it's immensely useful in distributed systems, it can also do in-process message passing, and it's got bindings/ports for C and Rust. Source: about 1 year ago
Inspired by the IDE language server protocol, I created an API interface between the electron and the Python ML interface. ZeroMQ turned out be an invaluable resource as a fast and lightweight messaging queue between the two. - Source: dev.to / about 1 year ago
If you really need it live, like for a chat or auctions you can use https://zeromq.org/ over websockets. Source: over 1 year ago
Apache Doris 2.1 has a data transmission channel built on Arrow Flight SQL. (Apache Arrow is a software development platform designed for high data movement efficiency across systems and languages, and the Arrow format aims for high-performance, lossless data exchange.) It allows high-speed, large-scale data reading from Doris via SQL in various mainstream programming languages. For target clients that also... - Source: dev.to / 11 days ago
In comes Polars: a brand new dataframe library, or how the author Ritchie Vink describes it... a query engine with a dataframe frontend. Polars is built on top of the Arrow memory format and is written in Rust, which is a modern performant and memory-safe systems programming language similar to C/C++. - Source: dev.to / 3 months ago
One is related to the heritage of being built around the NumPy library, which is great for processing numerical data, but becomes an issue as soon as the data is anything else. Pandas 2.0 has started to bring in Arrow, but it's not yet the standard (you have to opt-in and according to the developers it's going to stay that way for the foreseeable future). Also, pandas's Arrow-based features are not yet entirely on... - Source: dev.to / 6 months ago
IMO a good first step would be to use the txr FFI to write a library for Apache arrow: https://arrow.apache.org/. - Source: Hacker News / 6 months ago
Polars is an open-source library for Python, Rust, and NodeJS that provides in-memory dataframes, out-of-core processing capabilities, and more. It is based on the Rust implementation of the Apache Arrow columnar data format (you can read more about Arrow on my earlier blog post “Demystifying Apache Arrow”), and it is optimised to be blazing fast. - Source: dev.to / about 1 year ago
RabbitMQ - RabbitMQ is an open source message broker software.
Redis - Redis is an open source in-memory data structure project implementing a distributed, in-memory key-value database with optional durability.
Apache Kafka - Apache Kafka is an open-source message broker project developed by the Apache Software Foundation written in Scala.
Delta Lake - Application and Data, Data Stores, and Big Data Tools
Apache ActiveMQ - Apache ActiveMQ is an open source messaging and integration patterns server.
MongoDB - MongoDB (from "humongous") is a scalable, high-performance NoSQL database.