Serverless Event Driven AI as a Service

1

AWS Step Functions

The AWS Serverless service of choice for Orchestration are Step Functions, they allow defining a workflow and the service will control the flow and the handling of the integrations to do the precise defined steps. Nowadays Step Functions can integrate into the majority of AWS services directly without code and so a lot can be achieved in a no-code style.

#Project Management #Workflow Automation #Web Service Automation 57 social mentions

2

Amazon SQS

Twitter communicates via HTTP requests, therefore the logical solution here is to use API Gateway; a fully managed API service from AWS which gives you a public endpoint and they handle all scaling and infrastructural management. You can directly integrate with many services so you can have no-code API that pushes to a SQS Queue for example, and then suck in vast amounts of requests to process through in a manageable way.

#Data Integration #Stream Processing #Web Service Automation 64 social mentions

3

Amazon SES

In the CDK project, this is it's own distinct Stack, and could therefore be pulled out into it's own repository; it's a boxed off Microservice in the cloud Native sense of that word. And whilst this scenario is for Twitter, we could extend this to have a poller pulling comments from Reddit, driven from Slack, and even setup a system using Amazon SES as an email server that can then fire an event when an email is received - which is something I have used for handling CCTV alerts.

#Email Delivery #Email Marketing #Transactional Email 65 social mentions

4

AWS Secrets Manager

The Lambda needs an API secret to calculate a hash for hash checking, so Twitter API details are stored encrypted in Secrets Manager (outside of the Git repository) and Lambda can pull these due to permissions granted with IAM.

#Identity And Access Management #Identity Provider #SSO 67 social mentions

5

Amazon Rekognition

#Image Analysis #Machine Learning #Data Dashboard 33 social mentions

6

Amazon Lex

The text processing is a bit more interesting, as we have the original text and some insights into the content and sentiment, but we need a response. So for this application Amazon Lex has been configured to do this.

#Chatbots #Chatbot Platforms & Tools #CRM 13 social mentions

7

Amazon Key Management Service

On top of the EventBus itself, something that I've personally found very useful is to deploy a catch-all rule and set the target as a Cloudwatch Log Group (which can be encrypted by KMS if required too). This means all events are logged (and thus can be queried in CloudWatch too) . If you've ever setup an Event Bus then you can find it quite frustrating if you are sending events and "nothing" is happening as maybe your rule is wrong, or you just don't know what is being sent.

#Network & Admin #Security & Privacy #Password Management 34 social mentions

8

Amazon Kinesis Firehose

As you can see in the diagram, we are feeding all events from Event Bus via a catch-all rule into Kinesis Data Firehose. Firehose is a fully managed service that streams into specific destinations like Data Warehouses or Data Lakes. Unlike it's bigger brother of using Kinesis Data Streams directly, there are no setting up of shards and it's mostly configuration free. We are only defining a buffer interval which is part of how Kinesis works by delivering messages from the stream into the bucket every 60 seconds or if it hits a configured size (1MB).

#Data Dashboard #Data Management #Data Warehousing 6 social mentions

9

Amazon Kendra

It supports using Lambdas for fulfilling specific duties, such as placing orders, as well as integrating into Kendra which is a ML powered search service. You can effectively have a conversation asking for information and it can intelligently look through your business domain and respond with answers in a naturally conversational way.

#Custom Search #Custom Search Engine #Search Engine 7 social mentions

10

AWS Identity and Access Management

The Lambda needs an API secret to calculate a hash for hash checking, so Twitter API details are stored encrypted in Secrets Manager (outside of the Git repository) and Lambda can pull these due to permissions granted with IAM.

#Identity And Access Management #Identity Provider #SSO 52 social mentions

11

AWS Glue

Once it's in a Data Lake then you have different options depending on the analytics you need. For more advanced constant analytics then you could look into Amazon Kinesis Data Analytics instead of Firehose to S3, but for Ad-Hoc queries then this is where Glue and Athena come in.

#Data Integration #ETL #Data Workflow 13 social mentions

12

Amazon Comprehend

Comprehend is a natural-language processing (NLP) service using machine learning to get insights from text & documents.

#Spreadsheets #NLP And Text Analytics #Natural Language Processing 19 social mentions

13

Amazon CloudWatch

On top of the EventBus itself, something that I've personally found very useful is to deploy a catch-all rule and set the target as a Cloudwatch Log Group (which can be encrypted by KMS if required too). This means all events are logged (and thus can be queried in CloudWatch too) . If you've ever setup an Event Bus then you can find it quite frustrating if you are sending events and "nothing" is happening as maybe your rule is wrong, or you just don't know what is being sent.

#Monitoring Tools #Log Management #Application Performance Monitoring 54 social mentions

14

Amazon Athena

Once it's in a Data Lake then you have different options depending on the analytics you need. For more advanced constant analytics then you could look into Amazon Kinesis Data Analytics instead of Firehose to S3, but for Ad-Hoc queries then this is where Glue and Athena come in.

#Data Analysis #ETL #Business Intelligence 20 social mentions

15

Amazon API Gateway

Twitter communicates via HTTP requests, therefore the logical solution here is to use API Gateway; a fully managed API service from AWS which gives you a public endpoint and they handle all scaling and infrastructural management. You can directly integrate with many services so you can have no-code API that pushes to a SQS Queue for example, and then suck in vast amounts of requests to process through in a manageable way.

#API Tools #APIs #Web Service Automation 94 social mentions