Add a unit-test to old EWS for scenario when there is flakiness with patch and also...
authoraakash_jain@apple.com <aakash_jain@apple.com@268f45cc-cd09-0410-ab3c-d52691b4dbfc>
Fri, 29 Nov 2019 18:09:48 +0000 (18:09 +0000)
committeraakash_jain@apple.com <aakash_jain@apple.com@268f45cc-cd09-0410-ab3c-d52691b4dbfc>
Fri, 29 Nov 2019 18:09:48 +0000 (18:09 +0000)
https://bugs.webkit.org/show_bug.cgi?id=204707

Unreviewed unit-test.

* Scripts/webkitpy/tool/bot/commitqueuetask_unittest.py:

git-svn-id: https://svn.webkit.org/repository/webkit/trunk@252943 268f45cc-cd09-0410-ab3c-d52691b4dbfc

Tools/ChangeLog
Tools/Scripts/webkitpy/tool/bot/commitqueuetask_unittest.py

index 268f285..af9c234 100644 (file)
@@ -1,3 +1,12 @@
+2019-11-29  Aakash Jain  <aakash_jain@apple.com>
+
+        Add a unit-test to old EWS for scenario when there is flakiness with patch and also on clean tree
+        https://bugs.webkit.org/show_bug.cgi?id=204707
+
+        Unreviewed unit-test.
+
+        * Scripts/webkitpy/tool/bot/commitqueuetask_unittest.py:
+
 2019-11-29  Paulo Matos  <pmatos@igalia.com>
 
         Move jsc-i386 from old to new EWS
index 6bf7924..0d70dc8 100644 (file)
@@ -545,6 +545,14 @@ command_failed: failure_message='Unable to land patch' script_error='MOCK land f
 
         self._run_and_expect_patch_analysis_result(commit_queue, PatchAnalysisResult.DEFER, expect_clean_tests_to_run=True, expected_reported_flaky_tests=["Fail1", "Fail2"])
 
+    def test_mildly_flaky_patch_with_some_tree_redness_and_flakiness(self):
+        commit_queue = MockSimpleTestPlanCommitQueue(
+            first_test_failures=["PreExistingFail1", "PreExistingFail2", "Fail1"],
+            second_test_failures=["PreExistingFail1", "PreExistingFail2"],
+            clean_test_failures=["PreExistingFail1", "PreExistingFail2", "Fail2"])
+
+        self._run_and_expect_patch_analysis_result(commit_queue, PatchAnalysisResult.DEFER, expect_clean_tests_to_run=True, expected_reported_flaky_tests=["Fail1"])
+
     def test_tree_more_red_than_patch(self):
         commit_queue = MockSimpleTestPlanCommitQueue(
             first_test_failures=["Fail1", "Fail2", "Fail3"],