Earthly VS Apache Airflow

Earthly Reviews

Apache Airflow Reviews

Earthly mentions (47)

• I stopped worrying and loved Makefiles

  Make is excellent if you use it properly to model your dependencies. This works really well for languages like C/C++, but I think Make really struggles with languages like Go, JavaScript, and Python or when your using a large combination of technologies. I've found Earthly [0] to be the _perfect_ tool to replace Make. It's a familiar syntax (combination of Dockerfiles + Makefiles). Every target is run in an... - Source: Hacker News / 8 days ago

• Cache is King: A guide for Docker layer caching in GitHub Actions

  Earthly solves this really well: https://earthly.dev They rethink Dockerfiles with really good caching support. - Source: Hacker News / 29 days ago

• Ask HN: What Underrated Open Source Project Deserves More Recognition?

  Earthly https://earthly.dev/ Fast, consistent builds with an instantly familiar syntax – like Dockerfile and Makefile had a baby. - Source: Hacker News / about 2 months ago

• Streamlining CI/CD Pipelines with Code: A Developer's Guide

  We are big fans of https://earthly.dev/! Although we haven't personally used Dagger, Earthly has solved our multi-service integration testing problem with elegance. Simple builds + caching baked in. - Source: Hacker News / 6 months ago

• macOS Containers v0.0.1

  This one is ridiculous. This should already exist. Until GitHub builds it, you can use GitHub Actions to kick your builds off but run them remotely on Earthly Cloud (https://earthly.dev/). Even the free tier includes arm64 remote runners. Note: I work at Earthly, but I'm not wrong about this being a good, free, arm64-native workflow for GitHub Actions. - Source: Hacker News / 7 months ago

Apache Airflow mentions (65)

• The 2024 Web Hosting Report

  For the third, examples here might be analytics plugins in specialized databases like Clickhouse, data-transformations in places like your ETL pipeline using Airflow or Fivetran, or special integrations in your authentication workflow with Auth0 hooks and rules. - Source: dev.to / 3 months ago

• Best ETL Tools And Why To Choose

  Apache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows. The platform features a web-based user interface and a command-line interface for managing and triggering workflows. Source: 6 months ago

• Simplifying Data Transformation in Redshift: An Approach with DBT and Airflow

  Airflow is the most widely used and well-known tool for orchestrating data workflows. It allows for efficient pipeline construction, scheduling, and monitoring. - Source: dev.to / 6 months ago

• Share Your favorite python related software!

  AIRFLOW This is more of a library in my opinion, but Airflow has become an essential tool for scheduling in my work. All our ML training pipelines are ordered and scheduled with Airflow and it works seamlessly. The dashboard provided is also fantastic! Source: 7 months ago

• Ask HN: What is the correct way to deal with pipelines?

  I agree there are many options in this space. Two others to consider: - https://airflow.apache.org/ - https://github.com/spotify/luigi There are also many Kubernetes based options out there. For the specific use case you specified, you might even consider a plain old Makefile and incrond if you expect these all to run on a single host and be triggered by a new file... - Source: Hacker News / 8 months ago