Try to make this test less timing dependent.