Apache Kafka Reviews

The Algorithm Reviews

Apache Kafka mentions (156)

• Building Fault-Tolerant, Event-Driven Kafka Pipelines in Go: Reliable Reprocessing & Dead Letter Queues

  Event Brokers: They sit between producers and consumers, decoupling them so neither needs a direct connection to the other. Brokers receive event messages, maintain their chronological order, make them available for consumption, and route them to the right consumers. Apache Kafka is an example of an event broker, and it's the one we'll use throughout this guide. - Source: dev.to / 23 days ago

• Building Kafka Producer-Consumer Using Go and Docker

  Kafka is a distributed streaming platform used to build real-time data pipelines and streaming applications. It allows producers to send messages to topics, which are then consumed by various consumers, making it ideal for event-driven architectures. - Source: dev.to / 3 months ago

• 7 Free Tools for Data Pipeline Reconciliation and Cross-Source Validation

  Apache Kafka is the most widely used distributed event streaming platform and the standard transport layer for event-driven reconciliation architectures. - Source: dev.to / 4 months ago

• How to Build a Dead Letter Queue System for Reliable Data Processing

  For message-queue-based pipelines: RabbitMQ has native DLQ support through dead letter exchanges. Messages that exceed their retry count or their time-to-live are automatically routed to a designated DLQ exchange. Apache Kafka does not have native DLQ semantics, but the standard pattern is to write failed records to a dedicated topic (-dlq by convention) and include the failure metadata in the record headers. - Source: dev.to / 4 months ago

• Idempotency in Data Pipelines: How to Prevent Duplicate Records

  Upsert with timestamp tracking. Keep the upsert approach but track which time windows have been fully processed. On retry, skip windows that are marked complete and reprocess only windows that failed mid-run. The Kafka documentation covers offset management patterns that implement this for stream-based pipelines. - Source: dev.to / 4 months ago

The Algorithm mentions (29)

• HBO Obtains DMCA Subpoena to Unmask 'Euphoria' Spoiler Account on X

  Https://github.com/twitter/the-algorithm If it catches engagement, the main firehose feed will show it. They've begun using Grok and AI processes, which is hit and miss, but definitely improving. Having Japanese, French, other countries' tweets automatically translated back and forth has been fun, too. It'll be interesting to see where it gets to in the next few years. - Source: Hacker News / 5 months ago

• Crack the Code: What the 𝕏 Algorithm Actually Rewards (And How to Use It)

  In March 2023, Elon Musk open-sourced Twitter's recommendation algorithm at github.com/twitter/the-algorithm. Nearly three years later, the core pipeline remains the most detailed public look inside any major platform's ranking system. And while the trained model weights and live tuning parameters stay proprietary — meaning we can see the shape of the machine but not every dial setting — what's visible gives... - Source: dev.to / 6 months ago

• X algorithm has been open sourced

  I wonder if this'll turn out like the last time they published their algorithm to great fanfare, and then didn't bother to ever update it: https://github.com/twitter/the-algorithm. - Source: Hacker News / 8 months ago

• X algorithm has been open sourced

  What is the difference between this and https://github.com/twitter/the-algorithm. - Source: Hacker News / 8 months ago

• X(Twitter) Shadow Bans Turkish Presidential Candidate

  > Elon will continue to mess with the algorithm until he gets his political goals. Twitter/X has open sourced their algorithm (https://github.com/twitter/the-algorithm). So what do you mean by “mess with the algorithm”? And how do you characterize the extreme moderation (AKA censorship) practiced by old Twitter? For example when they banned a sitting president on the flimsiest reasoning, that even their own blog... - Source: Hacker News / about 1 year ago