Generate report even if some tests failed (but fail after report)

Summary

/cc @mlinhoff