The Algorithm Reviews

Apache Spark Reviews

The Algorithm mentions (29)

• HBO Obtains DMCA Subpoena to Unmask 'Euphoria' Spoiler Account on X

  Https://github.com/twitter/the-algorithm If it catches engagement, the main firehose feed will show it. They've begun using Grok and AI processes, which is hit and miss, but definitely improving. Having Japanese, French, other countries' tweets automatically translated back and forth has been fun, too. It'll be interesting to see where it gets to in the next few years. - Source: Hacker News / 5 months ago

• Crack the Code: What the 𝕏 Algorithm Actually Rewards (And How to Use It)

  In March 2023, Elon Musk open-sourced Twitter's recommendation algorithm at github.com/twitter/the-algorithm. Nearly three years later, the core pipeline remains the most detailed public look inside any major platform's ranking system. And while the trained model weights and live tuning parameters stay proprietary — meaning we can see the shape of the machine but not every dial setting — what's visible gives... - Source: dev.to / 6 months ago

• X algorithm has been open sourced

  I wonder if this'll turn out like the last time they published their algorithm to great fanfare, and then didn't bother to ever update it: https://github.com/twitter/the-algorithm. - Source: Hacker News / 8 months ago

• X algorithm has been open sourced

  What is the difference between this and https://github.com/twitter/the-algorithm. - Source: Hacker News / 8 months ago

• X(Twitter) Shadow Bans Turkish Presidential Candidate

  > Elon will continue to mess with the algorithm until he gets his political goals. Twitter/X has open sourced their algorithm (https://github.com/twitter/the-algorithm). So what do you mean by “mess with the algorithm”? And how do you characterize the extreme moderation (AKA censorship) practiced by old Twitter? For example when they banned a sitting president on the flimsiest reasoning, that even their own blog... - Source: Hacker News / about 1 year ago

Apache Spark mentions (80)

• MLOps Lifecycle: Stages, Workflow, and Best Practices

  Feature transformations should be deterministic: The same input should produce the same output when the same feature definition and configuration are applied. This is what allows training, backtesting, and live inference to remain aligned. Tools such as Pandas, Spark, or feature platforms such as Feast can be used to implement that logic. - Source: dev.to / 3 months ago

• 7 Free Tools for Data Pipeline Reconciliation and Cross-Source Validation

  Apache Spark provides distributed in-memory data processing and is the appropriate tool when the data set to be reconciled does not fit in a single machine's memory, or when parallelizing the comparison across a cluster would reduce runtime from hours to minutes. - Source: dev.to / 4 months ago

• Why Apache IoTDB Is Written in Java: A Decade of Engineering Trade-offs

  When IoTDB was initiated in 2011, almost all influential distributed systems and databases were built in Java or on the JVM—such as Hadoop, HBase, Spark (Scala on JVM), Cassandra, Kafka, and Flink. To integrate deeply with the big data ecosystem, choosing Java was a natural decision. - Source: dev.to / 5 months ago

• I Scraped 47M+ Hacker News Items Into Parquet Files – Here's What I Discovered About HN's Hidden Data Patterns

  For handling even larger datasets or building production applications, Apache Spark provides excellent Parquet support with distributed processing capabilities. - Source: dev.to / 6 months ago

• Show HN: Spark – Zero-config IoT deployment tool written in Rust

  You may want to consider renaming this project. The name "Spark" already refers to: A popular data analytics framework of the Apache Foundation: https://spark.apache.org/ A subset of the Ada programming language used for formal verification: https://learn.adacore.com/courses/intro-to-spark/chapters/01_Overview.html An Nvidia AI development system: https://www.nvidia.com/en-us/products/workstations/dgx-spark/. - Source: Hacker News / 8 months ago