It is doable. However the main focus of MLFlow is in experiment tracking. I would suggest for you to look into another monitoring tools such evidentlyai . You can track more things than performance (e.g.data drift). Which may be helpful in a production setting. Source: almost 2 years ago

Evidently is an open-source Python library that analyzes and monitors machine learning models. It generates interactive reports based on Panda DataFrames and CSV files for troubleshooting models and checking data integrity. These reports show model health, data drift, target drift, data integrity, feature analysis, and performance by segment. - Source: dev.to / over 2 years ago

Thankfully, there's a solution! obzrv.it allows you to "subscribe" to watch a piece of page - the service keeps watching the page for you and notifies you as soon as the content changes. Source: about 1 year ago

We just released a new version of https://obzrv.it - web pages monitoring tool. Our service keeps checking web pages - entire page or selected content - and sends you notification when something changes. You can use it to monitor products prices, job offers or social media profiles. Source: about 1 year ago

I got mine from my graphics designer whom I found on freelancer.org - he made it for $50 within couple of days. Source: over 1 year ago

I'm releasing a major feature & UX redesign of obzrv.it soon - aiming Dec/Jan 2023. Source: over 1 year ago

I created a simple Messenger Bot for obzrv.it - mostly to deliver notifications and also very simple conversations with buttons - show website, show history, mute, unsubscribe. Once I figured out how this works, I thought it would be cool to offer bot-hosting service for small businesses. Source: over 1 year ago