Infoworks eliminates big data complexity by automating data engineering through the company’s Autonomous Data Engine, which has been adopted by some of the largest enterprises in the world. Using a code-free environment, Infoworks allows organizations to quickly create and manage data use cases from source to consumption. Customers deploy projects to production within days, dramatically increasing analytics agility and time to value.
No Infoworks.io videos yet. You could help us improve this page by suggesting one.
Based on our record, Singer should be more popular than Infoworks.io. It has been mentiond 7 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
You should check out infoworks.io - they have this concept of domains which can restrict data sets and the users that can do any transformations on it. They have a full airflow based visual orchestration engine as well as scheduler, transformation engine, ingestion, cataloging, etc. It's an end to end unified data engineering product. Source: almost 3 years ago
For a simpler no-code visual config-driven (data ingest+ ELT+ airflow-based orchestration), all in a single unified platform, you may consider infoworks.io. It will even auto create a metadata catalog for you and give you lineage, audit capabilities. Source: almost 3 years ago
As long as you're truly after a lo/no-code solution that can automate your data onboarding (beyond ingestion), you'd be amiss to not try infoworks.io. Source: almost 3 years ago
I'm alerted to another vendor, infoworks.io, that offers a unified data engineering solution. I took their free personal testdrive. I learned that they have large number of source connectors (I think I read 200+), Spark based transformation engine, and visual workflow based on airflow. Source: almost 3 years ago
Coincidently, I saw a presentation today on a nice half-way-house solution: using embeddable Python libraries like Sling and dlt - both open-source. See https://www.youtube.com/watch?v=gAqOLgG2iYY There is also singer.io which is more of a protocol than a library, but can also be installed although it looks like it is a true community effort and not so well maintained. Source: 5 months ago
Singer is an open-source framework for data ingestion, which provides a standardized way to move data between various data sources and destinations (such as databases, APIs, and data warehouses). Singer offers a modular approach to data extraction and loading by leveraging two main components: Taps (data extractors) and Targets (data loaders). This design makes it an attractive option for data ingestion for... - Source: dev.to / 12 months ago
Or you could build your own such system and run it on Airflow, Prefect, Dagster, etc. Check out the Singer project for a suite of Python packages designed for such a task. Quality varies greatly, though. Source: over 1 year ago
This is good advice and I think Airbyte created a great product here. I tried singer.io and pipewise but Airbyte is much better in my opinion and I love the UI. Source: over 2 years ago
Suspect my question should have been regarding FREE systems, rather than BUYING a system. Sounds like singer.io will do what I need. Source: almost 3 years ago
Airbyte - Replicate data in minutes with prebuilt & custom connectors
Apache Camel - Apache Camel is a versatile open-source integration framework based on known enterprise integration patterns.
Meltano - Open source data dashboarding
Hevo Data - Hevo Data is a no-code, bi-directional data pipeline platform specially built for modern ETL, ELT, and Reverse ETL Needs. Get near real-time data pipelines for reporting and analytics up and running in just a few minutes. Try Hevo for Free today!
Apache Kafka - Apache Kafka is an open-source message broker project developed by the Apache Software Foundation written in Scala.
logstash - logstash is a tool for managing events and logs.