Open Source
Meltano is open-source, which means that it is free to use and can be customized according to specific business needs. The open-source nature fosters a community-driven approach to improvements and updates.
Modular Architecture
Meltano offers a modular architecture that allows users to mix and match different components like extractors, loaders, and transformers, providing flexibility and adaptability.
Integration with Singer Taps
It is compatible with Singer Taps and Targets, enabling Meltano to connect with a wide variety of data sources and destinations, making data integration seamless.
Command Line Interface (CLI)
Meltano provides a robust CLI that simplifies managing and orchestrating ETL workflows, which can be advantageous for developers who prefer working with command-line tools.
Community and Support
There is a vibrant community and an active support system, which can be helpful for troubleshooting and getting advice on best practices regarding Meltano usage.
We have collected here some useful links to help you find out if Meltano is good.
Check the traffic stats of Meltano on SimilarWeb. The key metrics to look for are: monthly visits, average visit duration, pages per visit, and traffic by country. Moreoever, check the traffic sources. For example "Direct" traffic is a good sign.
Check the "Domain Rating" of Meltano on Ahrefs. The domain rating is a measure of the strength of a website's backlink profile on a scale from 0 to 100. It shows the strength of Meltano's backlink profile compared to the other websites. In most cases a domain rating of 60+ is considered good and 70+ is considered very good.
Check the "Domain Authority" of Meltano on MOZ. A website's domain authority (DA) is a search engine ranking score that predicts how well a website will rank on search engine result pages (SERPs). It is based on a 100-point logarithmic scale, with higher scores corresponding to a greater likelihood of ranking. This is another useful metric to check if a website is good.
The latest comments about Meltano on Reddit. This can help you find out how popualr the product is and what people think about it.
Hey HN, Arch CEO here! Our team has been working at the intersection of data engineering and software engineering for a few years now with Meltano (https://meltano.com), and this year, the rise in Generative AI has made it clear that the bottleneck in unlocking the potential value of data has shifted from data integration on data teams to data engineering on software teams, so weโve decided to do something about... - Source: Hacker News / almost 2 years ago
We use Meltano for (EL) and Prefect for scheduling. Is not click-ops, but works very well for us! Behind the scenes Meltano wraps up Singer spec similarly like Airbyte does with its connectors. Before that we tried Airbyte (~5 months ago?) and it was so bad.. We could not choose the columns to replicate and the connectors were unstable i.e. Skipping data, all sort of odd errors and so on.. Source: over 2 years ago
Meltano's all-remote team and community of thousands are on a mission to enable everyone to realize the full potential of their data. To this end, we are bringing software engineering best practices to data teams in the form of an open-source DataOps platform that we envision becoming the foundation of every team's ideal data stack. Our public company handbook (https://handbook.meltano.com/) has all the details on... - Source: Hacker News / over 2 years ago
Meltano | Full-Time | Remote | https://meltano.com Meltano's all-remote team and community of thousands are on a mission to enable everyone to realize the full potential of their data. To this end, we are bringing software engineering best practices to data teams in the form of an open-source DataOps platform that we envision becoming the foundation of every team's ideal data stack. Our public company handbook... - Source: Hacker News / over 2 years ago
We switched from AWS Glue to Meltano for the EL part of ELT and it's been a joy to use. We're moving so much faster now. Source: over 2 years ago
There are other providers of CDC software. Notably Fivetran, Meltano and Airbyte. There are a few open source I personally recommend you use Google's platform since you are already going to have billing setup with them because of BigQuery. My experience is that Fivetran is expensive and Airbyte is buggy. But rather than take my opinion on the matter, consult the many threads on this sub referencing them. Source: over 2 years ago
Meltano for extracting and loading data. Source: almost 3 years ago
I built my data pipeline to Extract some data from websites and CSV files, Load it into my database, and Transform it into a reporting-ready schema. I used Python and Pandas to extract and load some of the data and Meltano to load some additional supporting data. All of that data went into a PostgreSQL database hosted in the cloud on Azure where I then used dbt to create data models in the database optimized for... - Source: dev.to / almost 3 years ago
I'm learning https://meltano.com/ right now, so am building custom Taps, mostly for fun. I'm enjoying it. I'm pulling in a variety of data from https://www.geonames.org/ and Canadian weather/climate data into BigQuery. Source: almost 3 years ago
We chose Airbyte because of their open source self-hosted offering and their connector flexibility. There are other open source tools in the market like StitchData or Meltano but have limitations as discussed in this post by the Airbyte team. If you donโt want to self host extraction, consider Fivetran. - Source: dev.to / over 3 years ago
Depending on your workload, you could give Meltano a shot, which includes some connectors / extractors out of the box. Source: almost 4 years ago
You could look at something like Meltano. Lots of connectors if you donโt mind getting hands dirty. Source: almost 4 years ago
Is https://meltano.com/ a more general version of this ? I am wondering how this compares to it? - Source: Hacker News / almost 4 years ago
Meltano | All positions are full time and remote | https://meltano.com (follow the code blocks on our website for a demo!) We're a seed stage startup that recently spun out of GitLab. A bit about us: Meltano is an open source DataOps platform that brings together best-in-class open source tools and technologies for the data lifecycle, including the Singer standard for data integration, dbt for transformation,... - Source: Hacker News / almost 4 years ago
I suggest looking into some ETL tools for syncing into your PostgreSQL database, e.g. Tools like Meerschaum, Airbyte, and Meltano. Source: almost 4 years ago
Also I'd recommend looking at https://meltano.com/ , built on python and uses the Singer spec to standardize how data flows. Since you're a developer you'd probably really like https://gitlab.com/meltano/sdk which is an sdk that makes writing taps/targets much easier. Source: over 4 years ago
We'll be sharing in a bunch of places - the Meltano website, twitter, slack, and we're doing a special office hours on zoom/youtube that day too. Source: over 4 years ago
Ansible for DevOps. I'm looking into adding taps/targets for Ops to https://meltano.com/ (open source - MIT, and free) if you're interested in hoping in on the early days please let me know trying to crawl first before making a post to invite a bunch of people to join! Source: over 4 years ago
I don't have much info about the pricing, but I would definitely suggest checking out some other (what I would consider newer) options. I am not sure what your use case is so they may not be a good fit, but you can use tools like Fivetran or Tray, or open-source specs like Meltano/Airbyte. There are also some SaaS tools like Paragon Connect or hotglue. Source: over 4 years ago
Https://meltano.com/ and singer.io dumping data to Amazon Redshift + apache Superset for reporting (any BI tool will do). Source: over 4 years ago
I thought it was time for a speedrun showing off Meltano! Source: over 4 years ago
Meltano, a versatile, open-source data integration platform, has consistently garnered attention from the data engineering and software development communities. Originating as an internal tool at GitLab in 2018, Meltano was created to facilitate efficient data and analytics workflows. Built on the Singer protocol, a framework initially developed by Stitch's founders, Meltano serves as a comprehensive Python-based solution for Extract, Load, and Transform (ELT) processes.
Meltano is positioned in the market as a robust open-source alternative within the data integration, data dashboard, and business intelligence spheres. The platform leverages numerous integration options, including an extensive range of connectors for databases, APIs, and application logs. Its capability to support data transformations and orchestration while integrating with cloud-based data warehouses significantly enhances its appeal. It also wraps up the Singer specification in a manner akin to Airbyte, although users often perceive Meltano's implementation as more reliable.
The community's reception of Meltano is generally positive, underscoring the platformโs reliability and the support it provides for automation and orchestration through DevOps best practices, such as version control and CI/CD. Users frequently commend Meltano for its non-reliance on click operations, contrasting it favorably against some alternatives such as Airbyte, which have been critiqued for connector instability and data skipping errors.
Meltanoโs strength lies in its open-source foundation, which encourages continuous community involvement and contributions. This development model resonates well among tech-savvy users who appreciate the flexibility and customizability offered by such projects. The platformโs commitment to open-source principles, even amid corporate changes in the surrounding ecosystem, has fostered a dedicated user base.
In the competitive arena of data integration tools, Meltano often finds itself compared to other notable players like Airbyte, Apache Superset, and Fivetran. However, the platform distinguishes itself through its open-source nature, which stands in contrast to the more commercial approaches of its peers. This aspect is particularly attractive to organizations and developers seeking cost-effective and customizable solutions that can be self-hosted.
While Airbyte and Fivetran are frequently mentioned together with Meltano, users appreciate the flexibility of Meltano in deploying custom solutions, which is particularly beneficial for those who wish to tailor their data pipelines. It is often suggested as a viable option for startups and small organizations seeking to harness the benefits of a self-hosted solution without incurring high costs.
Meltanoโs evolution from a GitLab project to a prominent open-source data integration platform underscores its adaptability and the efficacy it offers in data engineering. The platform's ability to integrate seamlessly with other open-source tools further reinforces its status as a cornerstone in modern data stacks. As organizations continue to pursue greater agility and efficiency in data processing, Meltano's community-driven growth and commitment to developer empowerment through open-source methods position it as a strong contender in the data integration landscape.
Do you know an article comparing Meltano to other products?
Suggest a link to a post with product alternatives.
Is Meltano good? This is an informative page that will help you find out. Moreover, you can review and discuss Meltano here. The primary details have not been verified within the last quarter, and they might be outdated. If you think we are missing something, please use the means on this page to comment or suggest changes. All reviews and comments are highly encouranged and appreciated as they help everyone in the community to make an informed choice. Please always be kind and objective when evaluating a product and sharing your opinion.