Rancher might be a bit more popular than Benthos. We know about 24 links to it since March 2021 and only 23 links to Benthos. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
Streaming and transforming structured documents at scale used to require some awfully complex machinery such as Apache Camel, Kafka Connect, Flink, etc. I was so happy when I bumped into Benthos https://benthos.dev which can be used as a lightweight replacement in most cases. Bonus: It’s written in Golang, so I don’t have to bother with heavy dependencies and slow start times. - Source: Hacker News / 26 days ago
If you're interested in Golang and data streaming, https://benthos.dev is a good project to contribute to. There are quite a few issues open on the GitHub project which anyone can pick up. Writing new connectors and adding tests / docs is always a good place to start. The maintainer is super-friendly and he's always active on the https://benthos.dev/community channels. I'm also there most of the time, since I've... - Source: Hacker News / 3 months ago
I have been working in the stream processing space since 2020 and I used Benthos. Since Benthos is a stateless stream processor, I have other components around it which deal with various types of application state, such as Kafka, NATS, Redis, various flavours of SQL databases, MongoDB etc. Source: about 1 year ago
You might want to add Benthos to your stack. It’s Open Source and it works great for data streaming tasks. You could have your task orchestrator (Airflow, Flyte etc) run it on demand. I demoed it at KnativeCon last year. Source: over 1 year ago
A few years ago, I found Benthos (the Open Source data streaming processor) and it was really easy to dive into it and add new features. Going through the various 3rd party libraries that it includes is usually straightforward and I'm comfortable enough with the language and various design patterns now to quickly get what's going on. That was rarely the case with C++. Source: over 1 year ago
I don't know in which extend you plan to use Kubernetes in the future, but if it is aimed to become several huge production clusters, you should looks into Apps like Rancher: https://rancher.com. Source: almost 2 years ago
But I think once you have a good understanding of K8S internal (components, how thing work underlying, etc.), you can use some tool to help you provision / maintain k8s cluster easier (look for https://rancher.com/ and alternatives). Source: almost 2 years ago
A few years, I would have said no. Now, I'm cautiously optimistic about it. Personally, I think that you can use something like Rancher (https://rancher.com/) or Portainer (https://www.portainer.io/) for easier management and/or dashboard functionality, to make the learning curve a bit more approachable. For example, you can create a deployment through the UI by following a wizard that also offers you... - Source: Hacker News / almost 2 years ago
Alternatively, it is also possible to use a multi-cloud or hybrid-cloud approach, which combines several cloud providers or even public and private clouds. Special tools such as Rancher and OpenShift can be very useful to run this type of system. - Source: dev.to / almost 2 years ago
Rancher provides a Rancher authentication proxy that allows user authentication from a central location. With this proxy, you can set the credential for authenticating users that want to access your Kubernetes clusters. You can create, view, update, or delete users through Rancher’s UI and API. - Source: dev.to / almost 2 years ago
Apache NiFi - An easy to use, powerful, and reliable system to process and distribute data.
Kubernetes - Kubernetes is an open source orchestration system for Docker containers
Databricks - Databricks provides a Unified Analytics Platform that accelerates innovation by unifying data science, engineering and business.What is Apache Spark?
Terraform - Tool for building, changing, and versioning infrastructure safely and efficiently.
Apache Beam - Apache Beam provides an advanced unified programming model to implement batch and streaming data processing jobs.
Puppet Enterprise - Get started with Puppet Enterprise, or upgrade or expand.