Apache Parquet Reviews

Snowflake Reviews

Apache Parquet mentions (19)

• [D] Is there other better data format for LLM to generate structured data?

  The Apache Spark / Databricks community prefers Apache parquet or Linux Fundation's delta.io over json. Source: 6 months ago

• Demystifying Apache Arrow

  Apache Parquet (Parquet for short), which nowadays is an industry standard to store columnar data on disk. It compress the data with high efficiency and provides fast read and write speeds. As written in the Arrow documentation, "Arrow is an ideal in-memory transport layer for data that is being read or written with Parquet files". - Source: dev.to / about 1 year ago

• Parquet: more than just "Turbo CSV"

  Googling that suggests this page: https://parquet.apache.org/. Source: about 1 year ago

• Beginner question about transformation

  You should also consider distribution of data because in a company that has machine learning workflows, the same data may need to go through different workflows using different technologies and stored in something other than a data warehouse, e.g. Feature engineering in Spark and loaded/stored in binary format such as Parquet in a data lake/object store. Source: about 1 year ago

• Pandas Free Online Tutorial In Python — Learn Pandas Basics In 5 Lessons!

  This section will teach you how to read and write data to and from a variety of file types, including CSV, Excel, SQL, HTML, Parquet, JSON etc. You’ll also learn how to manipulate data from other sources, such as databases and web sites. Source: about 1 year ago

Snowflake mentions (4)

• DeWitt Clause, or Can You Benchmark %DATABASE% and Get Away With It

  Snowflake, a data warehousing company founded by ex-Oracle and ex-VectorWise experts, responded with a blog post that critically reviewed Databricks' findings, reported different results for the same benchmark, and claimed comparable price/performance to Databricks. - Source: dev.to / almost 2 years ago

• Personal Support at Internet Scale

  Snowflake: Snowflake is fast, and works well as a product analytics database. - Source: dev.to / over 2 years ago

• Less than 1TB of data what tools should I get better at?

  If you just go to snowflake.com you can sign up for a demo account for free for a month and I'm fairly certain you can get more than one of these accounts (I would recycle emails doing it all the time.) Once you have an account there's lots of docs and videos out there either using the Database via their UI or via python using their connector. They also have a pyspark connector but you might want to just learn... Source: over 2 years ago

• *BOMATO*

  Early stage funding & VCs clearly demarcate between tech companies and tech enabled companies. But, once the PE comes into the picture at the scale of BlackStone, the border between doordash.com and snowflake.com starts to blur. The motivation is to make some bucks by going to IPO and they know how to get it done. Source: almost 3 years ago