Add a unit-test to new EWS for scenario when there is flakiness with patch and also...
authoraakash_jain@apple.com <aakash_jain@apple.com@268f45cc-cd09-0410-ab3c-d52691b4dbfc>
Fri, 29 Nov 2019 18:20:45 +0000 (18:20 +0000)
committeraakash_jain@apple.com <aakash_jain@apple.com@268f45cc-cd09-0410-ab3c-d52691b4dbfc>
Fri, 29 Nov 2019 18:20:45 +0000 (18:20 +0000)
https://bugs.webkit.org/show_bug.cgi?id=204707
<rdar://problem/57533998>

Unreviewed unit-test.

* BuildSlaveSupport/ews-build/steps_unittest.py:
(TestAnalyzeLayoutTestsResults.test_mildly_flaky_patch_with_some_tree_redness_and_flakiness):

git-svn-id: https://svn.webkit.org/repository/webkit/trunk@252946 268f45cc-cd09-0410-ab3c-d52691b4dbfc

Tools/BuildSlaveSupport/ews-build/steps_unittest.py
Tools/ChangeLog

index 739ef04..dcb002e 100644 (file)
@@ -1658,6 +1658,14 @@ class TestAnalyzeLayoutTestsResults(BuildStepMixinAdditions, unittest.TestCase):
         self.expectOutcome(result=RETRY, state_string='Unable to confirm if test failures are introduced by patch, retrying build (retry)')
         return self.runStep()
 
+    def test_mildly_flaky_patch_with_some_tree_redness_and_flakiness(self):
+        self.configureStep()
+        self.setProperty('first_run_failures', ['PreExistingFail1', 'PreExistingFail2', 'Fail1'])
+        self.setProperty('second_run_failures', ['PreExistingFail1', 'PreExistingFail2'])
+        self.setProperty('clean_tree_run_failures', ['PreExistingFail1', 'PreExistingFail2', 'Fail2'])
+        self.expectOutcome(result=RETRY, state_string='Unable to confirm if test failures are introduced by patch, retrying build (retry)')
+        return self.runStep()
+
     def test_first_run_exceed_failure_limit(self):
         self.configureStep()
         self.setProperty('first_results_exceed_failure_limit', True)
index af9c234..0319d1f 100644 (file)
@@ -1,5 +1,16 @@
 2019-11-29  Aakash Jain  <aakash_jain@apple.com>
 
+        Add a unit-test to new EWS for scenario when there is flakiness with patch and also on clean tree
+        https://bugs.webkit.org/show_bug.cgi?id=204707
+        <rdar://problem/57533998>
+
+        Unreviewed unit-test.
+
+        * BuildSlaveSupport/ews-build/steps_unittest.py:
+        (TestAnalyzeLayoutTestsResults.test_mildly_flaky_patch_with_some_tree_redness_and_flakiness):
+
+2019-11-29  Aakash Jain  <aakash_jain@apple.com>
+
         Add a unit-test to old EWS for scenario when there is flakiness with patch and also on clean tree
         https://bugs.webkit.org/show_bug.cgi?id=204707