-
Apache Kafka is an open-source message broker project developed by the Apache Software Foundation written in Scala.Pricing:
- Open Source
The second approach is to use a message queue, as some others have suggested. The most powerful of these is probably Kafka, but it's almost certainly overkill. (Technically, Kafka is an event log, not a message queue, but that's semantics at this point).
#Stream Processing #Data Integration #ETL 120 social mentions
-
Amazon Simple Queue Service is a fully managed message queuing service.Pricing:
- Open Source
You're better off with something really, really straightforward, like AWS Simple Queue Service or SQS or RabbitMQ, which are two very popular message queues. (The "MQ" part means Message Queue, in case that wasn't obvious). There are a lot of these out there, including ActiveMQ, IronMQ, and others. Pick the one that makes the most sense to you.
#Data Integration #Stream Processing #Web Service Automation 64 social mentions