When IoTDB was initiated in 2011, almost all influential distributed systems and databases were built in Java or on the JVM—such as Hadoop, HBase, Spark (Scala on JVM), Cassandra, Kafka, and Flink. To integrate deeply with the big data ecosystem, choosing Java was a natural decision. - Source: dev.to / 5 months ago

In the meantime, other query engine support is on the roadmap, including Apache Spark, Apache Flink, and others. - Source: dev.to / about 1 year ago

Many stream processing systems today still rely on local disks and RocksDB to manage state. This model has been around for a while and works fine in simple, single-tenant setups. Apache Flink, for example, uses RocksDB as its default state backend - state is kept on local disks, and periodic checkpoints are written to external storage for recovery. - Source: dev.to / about 1 year ago

Because the hosted catalog is a standard JDBC catalog, tools like Spark, Trino, and Flink can still access your tables. For example:. - Source: dev.to / about 1 year ago

I wrote a python based aircraft monitor which polls the adsb.fi feed for aircraft transponder messages, and publishes each location update as a new event into an Apache Kafka topic. I used Apache Flink — and more specially Flink SQL, to transform and analyse my flight data. The TL;DR summary is I can write SQL for my real-time data processing queries — and get the scalability, fault tolerance, and low latency... - Source: dev.to / about 1 year ago

Https://github.com/twitter/the-algorithm If it catches engagement, the main firehose feed will show it. They've begun using Grok and AI processes, which is hit and miss, but definitely improving. Having Japanese, French, other countries' tweets automatically translated back and forth has been fun, too. It'll be interesting to see where it gets to in the next few years. - Source: Hacker News / 5 months ago

In March 2023, Elon Musk open-sourced Twitter's recommendation algorithm at github.com/twitter/the-algorithm. Nearly three years later, the core pipeline remains the most detailed public look inside any major platform's ranking system. And while the trained model weights and live tuning parameters stay proprietary — meaning we can see the shape of the machine but not every dial setting — what's visible gives... - Source: dev.to / 6 months ago

I wonder if this'll turn out like the last time they published their algorithm to great fanfare, and then didn't bother to ever update it: https://github.com/twitter/the-algorithm. - Source: Hacker News / 8 months ago

What is the difference between this and https://github.com/twitter/the-algorithm. - Source: Hacker News / 8 months ago

> Elon will continue to mess with the algorithm until he gets his political goals. Twitter/X has open sourced their algorithm (https://github.com/twitter/the-algorithm). So what do you mean by “mess with the algorithm”? And how do you characterize the extreme moderation (AKA censorship) practiced by old Twitter? For example when they banned a sitting president on the flimsiest reasoning, that even their own blog... - Source: Hacker News / about 1 year ago