Apache Flink Reviews

Apache Zeppelin Reviews

Apache Flink mentions (29)

• Array Expansion in Flink SQL

  I’ve recently started my journey with Apache Flink. As I learn certain concepts, I’d like to share them. One such "learning" is the expansion of array type columns in Flink SQL. Having used ksqlDB in a previous life, I was looking for functionality similar to the EXPLODE function to "flatten" a collection type column into a row per element of the collection. Because Flink SQL is ANSI compliant, it’s no surprise... - Source: dev.to / 2 days ago

• Show HN: An SQS Alternative on Postgres

  You should let the Apache Flink team know, they mention exactly-once processing on their home page (under "correctness guarantees") and in their list of features. [0] https://flink.apache.org/ [1] https://flink.apache.org/what-is-flink/flink-applications/#building-blocks-for-streaming-applications. - Source: Hacker News / 16 days ago

• Top 10 Common Data Engineers and Scientists Pain Points in 2024

  Data scientists often prefer Python for its simplicity and powerful libraries like Pandas or SciPy. However, many real-time data processing tools are Java-based. Take the example of Kafka, Flink, or Spark streaming. While these tools have their Python API/wrapper libraries, they introduce increased latency, and data scientists need to manage dependencies for both Python and JVM environments. For example,... - Source: dev.to / about 1 month ago

• Choosing Between a Streaming Database and a Stream Processing Framework in Python

  Other stream processing engines (such as Flink and Spark Streaming) provide SQL interfaces too, but the key difference is a streaming database has its storage. Stream processing engines require a dedicated database to store input and output data. On the other hand, streaming databases utilize cloud-native storage to maintain materialized views and states, allowing data replication and independent storage scaling. - Source: dev.to / 4 months ago

• Go concurrency simplified. Part 4: Post office as a data pipeline

  Also, this knowledge applies to learning more about data engineering, as this field of software engineering relies heavily on the event-driven approach via tools like Spark, Flink, Kafka, etc. - Source: dev.to / 5 months ago

Apache Zeppelin mentions (7)

• Serverless Apache Zeppelin on AWS

  Now we can proceed with the definition of Apache Zeppelin. It is a web-based notebook that enables data-driven, interactive data analytics and collaborative documents with Python, Scala, SQL, Spark, and more. You can execute code and even schedule a job (via cron) to run at regular intervals. - Source: dev.to / 4 months ago

• Visualization using Pyspark Dataframe

  Have you tried Apache Zepellin I remember that you can pretty print spark dataframes directly on it with z.show(df). Source: about 2 years ago

• Fast CSV Processing with SIMD

  I used to use Zeppelin, some kind of Jupyter Notebook for Spark (that supports Parquet). But it may be better alternatives. https://zeppelin.apache.org/. - Source: Hacker News / over 2 years ago

• What libraries do you use for machine learning and data visualizing in scala?

  Another more widely used notebooks for scala and spark: Https://zeppelin.apache.org/. Source: over 2 years ago

• Dataflow, a self-hosted Observable Notebook Editor

  Apache Zeppelin is one open source option - https://zeppelin.apache.org. - Source: Hacker News / about 3 years ago