AWS Fargate VS Meltano

AWS Fargate Reviews

Meltano Reviews

AWS Fargate mentions (44)

• Lambda on hard mode: serverless HTTP in Rust

  I never had a case where cold starts mattered because either 1) it was the kind of service where cold starts intrinsically didnt matter, or 2) we generally had > 1 req/15mins meaning we always had something warm. 3) Also you can pay for provisioned capacity[1] if the cold start thing makes it worth the money, though also just look into fargate[2] if that's the case. [1]:... - Source: Hacker News / about 2 months ago

• Serverless Data Processor using AWS Lambda, Step Functions and Fargate on ECS (with Rust 🦀🦀)

  One great option in the serverless world for something like this is to run containers using AWS Fargate (https://aws.amazon.com/fargate/). Fargate is a service from AWS where you don't need to spin up or manage EC2 VMs to get access to compute. Also you don't need to pay for a container orchestration layer. You just provide a docker image and the specs of what you need to run it (cpu, ram, disk, etc) and AWS spins... - Source: dev.to / 3 months ago

• Best Practices for Seamless EKS Cluster Upgrades with Fargate: A Hands-On Guide

  As cloud-native architectures evolve, managing Kubernetes clusters becomes pivotal for maintaining optimal performance and security. Amazon EKS, combined with Fargate for serverless pod execution, offers a powerful solution. In this guide, we'll delve into best practices for EKS cluster upgrades with Fargate, providing a hands-on approach to ensure a seamless transition. Let's embark on the journey of mastering... - Source: dev.to / 4 months ago

• Fargate cost optimisation - using Fargate Spot with Terraform

  AWS Fargate is pay as you go serveless compute for containers. You can use Fargate if you have small, batch, or burst workloads or if you want zero maintenance overhead of your containers, as this is all taken care of by AWS. In this post I will be talking about how to cost optimise your Fargate workloads and utilise Fargate Spot using Terraform. - Source: dev.to / 8 months ago

• Trace-based Testing AWS Lambda with Tracetest, ECS Fargate, and Terraform

  AWS Fargate is a serverless, pay-as-you-go compute engine that lets you focus on building applications without managing servers. AWS Fargate is compatible with both Amazon Elastic Container Service (ECS) and Amazon Elastic Kubernetes Service (EKS). - Source: dev.to / 10 months ago

Meltano mentions (26)

• AI product development is being held back by data engineering

  Hey HN, Arch CEO here! Our team has been working at the intersection of data engineering and software engineering for a few years now with Meltano (https://meltano.com), and this year, the rise in Generative AI has made it clear that the bottleneck in unlocking the potential value of data has shifted from data integration on data teams to data engineering on software teams, so we’ve decided to do something about... - Source: Hacker News / 6 months ago

• How useful is Airbytes in production pipelines?

  We use Meltano for (EL) and Prefect for scheduling. Is not click-ops, but works very well for us! Behind the scenes Meltano wraps up Singer spec similarly like Airbyte does with its connectors. Before that we tried Airbyte (~5 months ago?) and it was so bad.. We could not choose the columns to replicate and the connectors were unstable i.e. Skipping data, all sort of odd errors and so on.. Source: 12 months ago

• Ask HN: Who is hiring? (May 2023)

  Meltano's all-remote team and community of thousands are on a mission to enable everyone to realize the full potential of their data. To this end, we are bringing software engineering best practices to data teams in the form of an open-source DataOps platform that we envision becoming the foundation of every team's ideal data stack. Our public company handbook (https://handbook.meltano.com/) has all the details on... - Source: Hacker News / almost 1 year ago

• Ask HN: Who is hiring? (April 2023)

  Meltano | Full-Time | Remote | https://meltano.com Meltano's all-remote team and community of thousands are on a mission to enable everyone to realize the full potential of their data. To this end, we are bringing software engineering best practices to data teams in the form of an open-source DataOps platform that we envision becoming the foundation of every team's ideal data stack. Our public company handbook... - Source: Hacker News / about 1 year ago

• If dbt is the "T" part of an "ELT", what do you use for "EL"?

  We switched from AWS Glue to Meltano for the EL part of ELT and it's been a joy to use. We're moving so much faster now. Source: about 1 year ago