data-diff Reviews and details

Social recommendations and mentions

• How to Check 2 SQL Tables Are the Same

  If the issue happen a lot, there is also: https://github.com/datafold/data-diff That is a nice tool to do it cross database as well. I think it's based on checksum method. - Source: Hacker News / 9 months ago

• Oops, I wrote yet another SQLAlchemy alternative (looking for contributors!)

  First, let me introduce myself. My name is Erez. You may know some of the Python libraries I wrote in the past: Lark, Preql and Data-diff. Source: 12 months ago

• Looking for Unit Testing framework in Database Migration Process

  Https://github.com/datafold/data-diff might be worth a look. Source: about 1 year ago

• Ask HN: How do you test SQL?

  I did data engineering for 6 years and am building a company to automate SQL validation for dbt users. First, by “testing SQL pipelines”, I assume you mean testing changes to SQL code as part of the development workflow? (vs. Monitoring pipelines in production for failures / anomalies). If so: 1 – assertions. Dbt comes with a solid built-in testing framework [1] for expressing assertions such as “this column... - Source: Hacker News / over 1 year ago

• Data-diff v0.3: DuckDB, efficient in-database diffing and more

  Hi HN: We at Datafold are excited to announce a new release of data-diff (https://github.com/datafold/data-diff), an open-source tool that efficiently compares tables within or across a wide range of SQL databases. This release includes a lot of new features, improvements and bugfixes. We released the first version 6 months ago because we believe that diffing data is as fundamental of a capability as diffing code... - Source: Hacker News / over 1 year ago

• How to test Data Ingestion Pipeline

  For data mismatches, check out data-diff https://github.com/datafold/data-diff. Source: over 1 year ago

• Show HN: Open-source infra for building embedded data pipelines

  Looks useful! Do you have a way to validate that the data was copied correctly and entirely? If not, you might want to consider integrating data-diff for that - https://github.com/datafold/data-diff. - Source: Hacker News / over 1 year ago