How to Serve Massive Computations Using Python Web Apps.

1

Apache Cassandra

In large-scale applications, we collect every action of users in a dedicated database. Datastores such as Cassandra are an excellent choice for this purpose. Based on the nature of the application, periodic tasks update the models with new data, or the system uses triggers to do the same. If they happen before your next visit to the platform, you're lucky to be served by an up-to-date model.

#Databases #NoSQL Databases #Relational Databases 41 social mentions

2

Apache Airflow

In this demo, we use the request itself as the trigger and begin computation immediately. But it may vary according to the nature of your application. Often, you might have to use a separate pipeline as well. In such scenarios, you may need technologies such as Apache Airflow or Prefect.

#Workflows #Workflow Automation #Data Pipelines 65 social mentions