A model can be healthy, fast and wrong
Standard service monitoring tells you an inference endpoint is up and responsive. It cannot tell you the predictions stopped making sense three days ago.
Writing / tag
#observability
Articles carrying this tag.
Writing / tag
Articles carrying this tag.
Standard service monitoring tells you an inference endpoint is up and responsive. It cannot tell you the predictions stopped making sense three days ago.