Apache Airflow Reviews

Digger Reviews

Apache Airflow mentions (67)

• 10 Open Source Tools for Building MLOps Pipelines

  An integral part of an ML project is data acquisition and data transformation into the required format. This involves creating ETL (extract, transform, load) pipelines and running them periodically. Airflow is an open source platform that helps engineers create and manage complex data pipelines. Furthermore, the support for Python programming language makes it easy for ML teams to adopt Airflow. - Source: dev.to / 10 days ago

• AI Strategy Guide: How to Scale AI Across Your Business

  Level 1 of MLOps is when you've put each lifecycle stage and their intefaces in an automated pipeline. The pipeline could be a python or bash script, or it could be a directed acyclic graph run by some orchestration framework like Airflow, dagster or one of the cloud-provider offerings. AI- or data-specific platforms like MLflow, ClearML and dvc also feature pipeline capabilities. - Source: dev.to / about 1 month ago

• The 2024 Web Hosting Report

  For the third, examples here might be analytics plugins in specialized databases like Clickhouse, data-transformations in places like your ETL pipeline using Airflow or Fivetran, or special integrations in your authentication workflow with Auth0 hooks and rules. - Source: dev.to / 4 months ago

• Best ETL Tools And Why To Choose

  Apache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows. The platform features a web-based user interface and a command-line interface for managing and triggering workflows. Source: 7 months ago

• Simplifying Data Transformation in Redshift: An Approach with DBT and Airflow

  Airflow is the most widely used and well-known tool for orchestrating data workflows. It allows for efficient pipeline construction, scheduling, and monitoring. - Source: dev.to / 8 months ago

Digger mentions (12)

• OpenTofu 1.7.0 is out with State Encryption, Dynamic Provider-defined Functions

  None of these are a replacement of Terraform Cloud (recently rebranded to HCP Terraform). For example, when you create a PR, it could affect multiple workspaces. The new experimental version of TFC/TFE (I refuse to call it HCP!) implements Stacks, which is something like a workflow, and links one workspace output to other workspace inputs. None of the open-source solutions, including the paid Digger [0], support... - Source: Hacker News / about 2 months ago

• Call for a new public facing “validation metric” for Commercial OSS startups

  I'm part of the founding team at Digger, an Open Source Terraform Enterprise alternative. For the past few days, I have been wanting to talk about why the usual metrics in Commercial Open Source just don't cut it anymore. Source: 12 months ago

• publish terraform file to build artifacts in CI?

  Depending on the organisation, it is not always a good idea to make assumptions on what another team will be doing to use your module. Don't get me wrong, there are attempts at making cross-platform workflows like digger.dev, or RedHat who have recently released an ansible playbook that runs terraform (so in theory you'd only need ansible then) but at the very minimum, be aware if you tightly integrate your... Source: about 1 year ago

• Want to start an OSS bounty program - how do we structure it?

  We are building an open source terraform cloud alternative (https://digger.dev/) and are looking to start a bounty program. Source: about 1 year ago

• 7 websites a developer should definitely check to change their life (trust me):

  Digger Low code tool that can generate infrastructure for your code in your AWS account. So you can build on AWS without having to learn it. 🔗 http://digger.dev. - Source: dev.to / almost 2 years ago