Performance tester bots should report the number of failing tests