AWS Summit London 2022 day recap

1

Google BigQuery

Amazon Redshift still remains a bit of a mystery to me, even after a whole session on it unpacking loads of its features, possibilities and use cases. Trying to draw some parallels in my head with BigQuery - Google Cloud Platform's own cloud data wharehouse service, which I know well - also didn't help much. So it remains one of those things that now I know a little bit more about than yesterday, but still feels like I haven't even begun to scratch its surface. So one to watch for me, and learn more about. The use case presented by National Rail was great and full of detail too.

#Data Management #Data Warehousing #Data Dashboard 35 social mentions

2

Amazon Redshift

Amazon Redshift still remains a bit of a mystery to me, even after a whole session on it unpacking loads of its features, possibilities and use cases. Trying to draw some parallels in my head with BigQuery - Google Cloud Platform's own cloud data wharehouse service, which I know well - also didn't help much. So it remains one of those things that now I know a little bit more about than yesterday, but still feels like I haven't even begun to scratch its surface. So one to watch for me, and learn more about. The use case presented by National Rail was great and full of detail too.

#Big Data #Databases #Relational Databases 26 social mentions

3

AWS CloudFormation

Implementing Infrastructure-as-Code (IaC) using the AWS Cloud Development Kit (CDK) to model your infrastructure seems like a very good option for those like me that are still not much versed on CloudFormation (which the CDK uses under the hood) or Terraform. Watching the live demo expressing some sample infrastructure with just a few lines of Python code was great fun, and I'd love to try that out.

#Continuous Integration #DevOps Tools #Continuous Deployment 113 social mentions

4

Apache Airflow

Automating data pipelines with Apache Airflow was the session of the day for me. To programmatically create workflows in Python that help you run, schedule, monitor and manage data engineering pipelines could not be any more up my alley right now. You know the guys at Airbnb were onto something great when they decided to create Airflow, and then open source it to get a great community behind it. The session had loads of code samples and cool demos too, so it was all a real treat in the end. I'll be diving more into Airflow - and also Cloud Composer for comparison, which is GCP's own SaaS offering of the AirFlow OpenSource product - for sure!

#Workflows #Workflow Automation #Data Pipelines 65 social mentions