Infoworks.io VS Meltano

Infoworks.io Reviews

Meltano Reviews

Infoworks.io mentions (4)

• Dilemmas of getting production data into staging

  You should check out infoworks.io - they have this concept of domains which can restrict data sets and the users that can do any transformations on it. They have a full airflow based visual orchestration engine as well as scheduler, transformation engine, ingestion, cataloging, etc. It's an end to end unified data engineering product. Source: over 2 years ago

• Replicating data out of a production replica RDS DB into Redshift, options?

  For a simpler no-code visual config-driven (data ingest+ ELT+ airflow-based orchestration), all in a single unified platform, you may consider infoworks.io. It will even auto create a metadata catalog for you and give you lineage, audit capabilities. Source: almost 3 years ago

• Fivetan vs. Stitch vs. Singer vs. Airbyte vs. Meltano

  As long as you're truly after a lo/no-code solution that can automate your data onboarding (beyond ingestion), you'd be amiss to not try infoworks.io. Source: almost 3 years ago

• No-code data engineering solutions

  I'm alerted to another vendor, infoworks.io, that offers a unified data engineering solution. I took their free personal testdrive. I learned that they have large number of source connectors (I think I read 200+), Spark based transformation engine, and visual workflow based on airflow. Source: almost 3 years ago

Meltano mentions (26)

• AI product development is being held back by data engineering

  Hey HN, Arch CEO here! Our team has been working at the intersection of data engineering and software engineering for a few years now with Meltano (https://meltano.com), and this year, the rise in Generative AI has made it clear that the bottleneck in unlocking the potential value of data has shifted from data integration on data teams to data engineering on software teams, so we’ve decided to do something about... - Source: Hacker News / 6 months ago

• How useful is Airbytes in production pipelines?

  We use Meltano for (EL) and Prefect for scheduling. Is not click-ops, but works very well for us! Behind the scenes Meltano wraps up Singer spec similarly like Airbyte does with its connectors. Before that we tried Airbyte (~5 months ago?) and it was so bad.. We could not choose the columns to replicate and the connectors were unstable i.e. Skipping data, all sort of odd errors and so on.. Source: 11 months ago

• Ask HN: Who is hiring? (May 2023)

  Meltano's all-remote team and community of thousands are on a mission to enable everyone to realize the full potential of their data. To this end, we are bringing software engineering best practices to data teams in the form of an open-source DataOps platform that we envision becoming the foundation of every team's ideal data stack. Our public company handbook (https://handbook.meltano.com/) has all the details on... - Source: Hacker News / 12 months ago

• Ask HN: Who is hiring? (April 2023)

  Meltano | Full-Time | Remote | https://meltano.com Meltano's all-remote team and community of thousands are on a mission to enable everyone to realize the full potential of their data. To this end, we are bringing software engineering best practices to data teams in the form of an open-source DataOps platform that we envision becoming the foundation of every team's ideal data stack. Our public company handbook... - Source: Hacker News / about 1 year ago

• If dbt is the "T" part of an "ELT", what do you use for "EL"?

  We switched from AWS Glue to Meltano for the EL part of ELT and it's been a joy to use. We're moving so much faster now. Source: about 1 year ago