It is doable. However the main focus of MLFlow is in experiment tracking. I would suggest for you to look into another monitoring tools such evidentlyai . You can track more things than performance (e.g.data drift). Which may be helpful in a production setting. Source: almost 2 years ago

Evidently is an open-source Python library that analyzes and monitors machine learning models. It generates interactive reports based on Panda DataFrames and CSV files for troubleshooting models and checking data integrity. These reports show model health, data drift, target drift, data integrity, feature analysis, and performance by segment. - Source: dev.to / over 2 years ago

Many settings affect the outputs in interesting ways, but that's half the fun. These LoRAs are very lightly trained; more training may or may not help. The competitions are also performed using zero-shot text guessing, and if Facebook said it, you can bet that's actually Meta AI saying it, and they are leaders in the field. Source: over 1 year ago

You should look at the entire niche of MAE-related papers, that's quite exciting, and the neuroscience-inspired stream of stuff like Barlow Twins. As well, the official Facebook AI blog is surprisingly good coverage of much of the interesting un/semi-supervised DL research FAIR does, and worth going through. Source: almost 2 years ago