I’ve recently started my journey with Apache Flink. As I learn certain concepts, I’d like to share them. One such "learning" is the expansion of array type columns in Flink SQL. Having used ksqlDB in a previous life, I was looking for functionality similar to the EXPLODE function to "flatten" a collection type column into a row per element of the collection. Because Flink SQL is ANSI compliant, it’s no surprise... - Source: dev.to / 5 days ago

You should let the Apache Flink team know, they mention exactly-once processing on their home page (under "correctness guarantees") and in their list of features. [0] https://flink.apache.org/ [1] https://flink.apache.org/what-is-flink/flink-applications/#building-blocks-for-streaming-applications. - Source: Hacker News / 19 days ago

Data scientists often prefer Python for its simplicity and powerful libraries like Pandas or SciPy. However, many real-time data processing tools are Java-based. Take the example of Kafka, Flink, or Spark streaming. While these tools have their Python API/wrapper libraries, they introduce increased latency, and data scientists need to manage dependencies for both Python and JVM environments. For example,... - Source: dev.to / about 2 months ago

Other stream processing engines (such as Flink and Spark Streaming) provide SQL interfaces too, but the key difference is a streaming database has its storage. Stream processing engines require a dedicated database to store input and output data. On the other hand, streaming databases utilize cloud-native storage to maintain materialized views and states, allowing data replication and independent storage scaling. - Source: dev.to / 4 months ago

Also, this knowledge applies to learning more about data engineering, as this field of software engineering relies heavily on the event-driven approach via tools like Spark, Flink, Kafka, etc. - Source: dev.to / 5 months ago

In this post from 2011, the creator of Omegle, Leif Brooks, explains what technology is used, including Python and a library called gevent for the backend. On top of that, Adobe Cirrus is used for streaming video. Though this post was 12 years ago, it is valuable to know what a web application like Omegle requires. A modern library that may provide some functionality for a text chat at a minimum may be... Source: 7 months ago

They might be thinking of something like ZeroMQ, which is pretty well liked: https://zeromq.org/ That said, I wouldn't call RabbitMQ that heavyweight myself, at least when compared to something like Apache Kafka. - Source: Hacker News / 8 months ago

If you want to learn message passing in an environment you're familiar with, you should check out ZeroMQ. It's a C++ lib for socket abstraction, it's immensely useful in distributed systems, it can also do in-process message passing, and it's got bindings/ports for C and Rust. Source: about 1 year ago

Inspired by the IDE language server protocol, I created an API interface between the electron and the Python ML interface. ZeroMQ turned out be an invaluable resource as a fast and lightweight messaging queue between the two. - Source: dev.to / about 1 year ago

If you really need it live, like for a chat or auctions you can use https://zeromq.org/ over websockets. Source: over 1 year ago