ML Test Score
How can you test your machine learning system?
Last updated
Was this helpful?
How can you test your machine learning system?
Last updated
Was this helpful?
ML Test Score : A Rubric for Production Readiness and Technical Debt Reduction is an exhaustive framework/checklist from practitioners at Google.
The paper presents a rubric as a set of 28 actionable tests and offers a scoring system to measure how ready for production a given machine learning system is. These are categorized into 4 sections: (1) data tests, (2) model tests, (3) ML infrastructure tests, and (4) monitoring tests.
The scoring system provides a vector for incentivizing ML system developers to achieve stable levels of reliability by providing a clear indicator of readiness and clear guidelines for how to improve.