Infoworks.io VS Singer

Infoworks.io Reviews

Singer Reviews

Infoworks.io mentions (4)

• Dilemmas of getting production data into staging

  You should check out infoworks.io - they have this concept of domains which can restrict data sets and the users that can do any transformations on it. They have a full airflow based visual orchestration engine as well as scheduler, transformation engine, ingestion, cataloging, etc. It's an end to end unified data engineering product. Source: almost 3 years ago

• Replicating data out of a production replica RDS DB into Redshift, options?

  For a simpler no-code visual config-driven (data ingest+ ELT+ airflow-based orchestration), all in a single unified platform, you may consider infoworks.io. It will even auto create a metadata catalog for you and give you lineage, audit capabilities. Source: almost 3 years ago

• Fivetan vs. Stitch vs. Singer vs. Airbyte vs. Meltano

  As long as you're truly after a lo/no-code solution that can automate your data onboarding (beyond ingestion), you'd be amiss to not try infoworks.io. Source: almost 3 years ago

• No-code data engineering solutions

  I'm alerted to another vendor, infoworks.io, that offers a unified data engineering solution. I took their free personal testdrive. I learned that they have large number of source connectors (I think I read 200+), Spark based transformation engine, and visual workflow based on airflow. Source: almost 3 years ago

Singer mentions (7)

• Why do companies still build data ingestion tooling instead of using a third-party tool like Airbyte?

  Coincidently, I saw a presentation today on a nice half-way-house solution: using embeddable Python libraries like Sling and dlt - both open-source. See https://www.youtube.com/watch?v=gAqOLgG2iYY There is also singer.io which is more of a protocol than a library, but can also be installed although it looks like it is a true community effort and not so well maintained. Source: 5 months ago

• Data sources episode 2: AWS S3 to Postgres Data Sync using Singer

  Singer is an open-source framework for data ingestion, which provides a standardized way to move data between various data sources and destinations (such as databases, APIs, and data warehouses). Singer offers a modular approach to data extraction and loading by leveraging two main components: Taps (data extractors) and Targets (data loaders). This design makes it an attractive option for data ingestion for... - Source: dev.to / 12 months ago

• CDC (Change Data Capture) with 3rd party APIs

  Or you could build your own such system and run it on Airflow, Prefect, Dagster, etc. Check out the Singer project for a suite of Python packages designed for such a task. Quality varies greatly, though. Source: over 1 year ago

• Looking to build a database for BI reports

  This is good advice and I think Airbyte created a great product here. I tried singer.io and pipewise but Airbyte is much better in my opinion and I love the UI. Source: over 2 years ago

• Recommendation for approach for populating and refreshing new data lake

  Suspect my question should have been regarding FREE systems, rather than BUYING a system. Sounds like singer.io will do what I need. Source: almost 3 years ago