Evaluate
How to evaluate deep learning model?
Summary
You want to apply the bias-variance decomposition concept here: Test error = irreducible error + bias + variance + validation overfitting.
If the training, validation, and test sets come from different data distributions, then you should use 2 validation sets: one set sampled from the training distribution, and the other set sampled from the test distribution.
Last updated