Airbyte Reviews and details

Social recommendations and mentions

• Launch HN: Bracket (YC W22) – Two-Way Sync Between Salesforce and Postgres

  I'l also give a shout-out to Airbyte (https://airbyte.com/), with which I've had some limited success with integrating Salesforce to a local database. The particular pull for Airbyte is that we can self-host the open source version, rather than pay Fivetran a significant sum to do this for us. It's an immature tool, so I don't yet know that I can claim we've spent _less_ than... - Source: Hacker News / 5 months ago

• Need help moving 16gb of mongodb data to tableau

  As possible solution, I can suggest Airbyte(https://airbyte.com/). it's more performant than generic python script. Source: 9 months ago

• Connecting data sources to Xata with Airbyte and Zapier integrations

  Airbyte, an open-source data integration engine that offers hundreds of connectors with data warehouses and databases, has gained popularity for its seamless integration and data syncing capabilities. Xata's integration with Airbyte offers a streamlined data ingestion process from any Airbyte input source directly into your Xata database. - Source: dev.to / 10 months ago

• Driving Business Success: Unleashing the Power of Data Integration

  In conclusion, data integration is not just a luxury for companies but a necessity for striving toward success in today’s data-driven world. In today’s competitive business environment, those who can effectively integrate and leverage data from different sources will have a strategic advantage over others who don’t. So, as technology continues to advance and data continues to grow exponentially, businesses that... - Source: dev.to / about 1 year ago

• Sync Snowflake and Google Sheets

  Even looking past these limitations, internal scripts invariably require development and maintenance time, and as any developer knows, can break at the worst of times :) Method #2: Use Zapier? (https://zapier.com) Want to use Zapier to do this? You can’t. Not only because it doesn’t track deletes, updates to existing records, and only does one way syncs. But because Snowflake isn’t supported. Method #3:... - Source: Hacker News / about 1 year ago

• Is it safe to update docker/docker-compose?

  I'm trying to insall https://airbyte.com/ is a great selfhosted ELT platform. In common words, it's an app that can access all kinds of api to scrub the data and put it in a database. I really like the idea of being able to own my data and make all kinds of analyse with it. Source: about 1 year ago

• Data Pipeline: From ETL to EL plus T

  Yes, absolutely, Airbyte, and there are many similar solutions, but Airbyte is open source and relatively easy to use. - Source: dev.to / over 1 year ago

• Continuously import Aurora MySQL data into BigQuery

  There are other providers of CDC software. Notably Fivetran, Meltano and Airbyte. There are a few open source I personally recommend you use Google's platform since you are already going to have billing setup with them because of BigQuery. My experience is that Fivetran is expensive and Airbyte is buggy. But rather than take my opinion on the matter, consult the many threads on this sub referencing them. Source: over 1 year ago

• What are the alternatives to Connect?

  Alternatives: Conduit, Fivetran, AirByte. Or a stream processor (Flink). Plus all the enterprise data platforms: CData, Striim, Talend, Attaccamma.. Why: Connect is packaged with Kafka and has the huge ecosystem of battle-tested connectors. That is just a huge benefit. But Connect is simply a “Java application server”, e.g. a pre-cloud/K8s way of dealing with multi-tenancy and scale. It suffers from noisy... Source: over 1 year ago

• Data from MYSQL to BigQuery

  Take a look at Airbyte. They have CDC support and I find them much easier to use than Airflow, etc. Source: over 1 year ago

• Transfer data in Fauna to your analytics tool using Airbyte

  We are excited to introduce Fauna’s new Airbyte open source connector. This connector lets you replicate Fauna data into your data warehouses, lakes, and analytical databases, such as Snowflake, Redshift, S3, and more. - Source: dev.to / over 1 year ago

• Debezium+Kafka alternatives for CDC stream

  Airbyte, it uses debezium but it's all taken care of. Plus the mascot it's a purple octopus called octavia. Source: over 1 year ago

• How to sync tables and views between two oracle database ?

  I don't have Oracle DBA experience, but I would assume Oracle has some sort of built-in replication. However, if you can't use that for whatever reason, check out Airbyte. I use it to sync PostgreSQL to Google BigQuery. Source: over 1 year ago

• The Dev-X Project: Featuring Shawn 'swyx' Wang

  In this episode, we’re featuring Shawn @swyx Wang. Swyx has worked on React and serverless JavaScript at Two Sigma, Netlify and AWS, and most recently as Head of Developer Experience at Temporal.io and Airbyte. He has started and run communities for hundreds of thousands of developers, like Svelte Society, /r/reactjs, and the React TypeScript Cheatsheet. His nontechnical writing was recently published in the... - Source: dev.to / over 1 year ago

• using Debezium to replicate data from GCP cloud SQL

  Maybe https://airbyte.com/ can help to solve the task. It uses Debezium under the hood. Source: over 1 year ago

• best ETL/ELT options?

  Take a look at Airbyte: https://airbyte.com/ You can go with the open source option or SaaS. Or just use some simple Python jobs to drop the files into S3 or ADLS and create pipes to let Snowpipe load the data and dbt for transformation layer. Source: almost 2 years ago

• The Best Way To Learn on the Job

  In March of 2022, I started a new role as a Developer Advocate at Airbyte, making the transition from more of a Frontend focus to a Data Engineering focus. This in itself is one of the biggest challenges I am currently going through. But being surrounded by Data Engineers and Data Analysts, I know I will get through this 😉. - Source: dev.to / almost 2 years ago

• Show HN: Cube – open-source headless BI

  Looks super polished. Will have to give it a spin. What we use right now is Airbyte https://airbyte.com/ - super exhaustive in connectors but configuring some connectors like SFDC was very painful. - Source: Hacker News / almost 2 years ago

• Best ‘E’TL tools for extracting data from on-prem SQL databases

  I really like airbyte. Works great unless you have to deal with hundreds of gigabytes. It’s open source and you can host it wherever you want. Also supports lots of other sources besides SQL databases. Source: about 2 years ago

• Seafood business startup market intelligence dashboard/platform

  I think you have a good point with scraping data using python. But, it would be great to think about it more systematically - you scrape the data, and then what? It whole goes to some sort of ETL/ELT pipelines - at the start, you have a bunch of websites to scrape and in the end, you end up with data that are ready to visualize/analyze. If you start doing it right from the start, it can save you a lot of trouble... Source: about 2 years ago

• Announcing RepliByte - an application to synchronize cloud databases and obfuscate sensitive data written in Rust

  This looks great ! It reminds me of Airbyte, how does it compare to it ? Source: about 2 years ago