A number of failures were introduced due to performance
improvements (like pre-calculating metrics).