WebDriver: add support for test expectations
[WebKit-https.git] / WebDriverTests / ChangeLog
1 2018-01-17  Carlos Garcia Campos  <cgarcia@igalia.com>
2
3         WebDriver: add support for test expectations
4         https://bugs.webkit.org/show_bug.cgi?id=180420
5
6         Reviewed by Carlos Alberto Lopez Perez.
7
8         Add initial test expectations. For now I'm only adding the W3C test expectations, selenium ones will be added in
9         a follow up patch.
10
11         * TestExpectations.json: Added.
12
13 2018-01-11  Carlos Garcia Campos  <cgarcia@igalia.com>
14
15         Unreviewed. Update Selenium WebDriver imported tests.
16
17         * imported/selenium/importer.json:
18         * imported/selenium/py/conftest.py:
19         * imported/selenium/py/selenium/__init__.py:
20         * imported/selenium/py/selenium/webdriver/__init__.py:
21         * imported/selenium/py/selenium/webdriver/common/action_chains.py:
22         * imported/selenium/py/selenium/webdriver/common/service.py:
23         * imported/selenium/py/selenium/webdriver/remote/remote_connection.py:
24         * imported/selenium/py/selenium/webdriver/remote/switch_to.py:
25         * imported/selenium/py/selenium/webdriver/remote/webdriver.py:
26         * imported/selenium/py/selenium/webdriver/remote/webelement.py:
27         * imported/selenium/py/selenium/webdriver/support/expected_conditions.py:
28         * imported/selenium/py/selenium/webdriver/webkitgtk/options.py:
29         * imported/selenium/py/test/selenium/webdriver/common/alerts_tests.py:
30         * imported/selenium/py/test/selenium/webdriver/common/api_example_tests.py:
31         * imported/selenium/py/test/selenium/webdriver/common/appcache_tests.py:
32         * imported/selenium/py/test/selenium/webdriver/common/driver_element_finding_tests.py:
33         * imported/selenium/py/test/selenium/webdriver/common/executing_async_javascript_tests.py:
34         * imported/selenium/py/test/selenium/webdriver/common/frame_switching_tests.py:
35         * imported/selenium/py/test/selenium/webdriver/common/interactions_tests.py:
36         * imported/selenium/py/test/selenium/webdriver/common/page_load_timeout_tests.py:
37         * imported/selenium/py/test/selenium/webdriver/common/position_and_size_tests.py:
38         * imported/selenium/py/test/selenium/webdriver/common/rendered_webelement_tests.py:
39         * imported/selenium/py/test/selenium/webdriver/common/select_class_tests.py:
40         * imported/selenium/py/test/selenium/webdriver/common/visibility_tests.py:
41         * imported/selenium/py/test/selenium/webdriver/common/w3c_interaction_tests.py:
42         * imported/selenium/py/test/selenium/webdriver/common/webdriverwait_tests.py:
43         * imported/selenium/py/test/selenium/webdriver/common/window_tests.py:
44
45 2018-01-10  Carlos Garcia Campos  <cgarcia@igalia.com>
46
47         Unreviewed. Update W3C WebDriver imported tests.
48
49         * imported/w3c/importer.json:
50         * imported/w3c/webdriver/tests/sessions/new_session/invalid_capabilities.py:
51         * imported/w3c/webdriver/tests/sessions/new_session/support/create.py:
52
53 2018-01-10  Carlos Garcia Campos  <cgarcia@igalia.com>
54
55         Unreviewed. Update W3C WebDriver imported tests.
56
57         * imported/w3c/importer.json:
58         * imported/w3c/tools/wptrunner/wptrunner/browsers/firefox.py:
59         * imported/w3c/tools/wptrunner/wptrunner/browsers/servo.py:
60         * imported/w3c/tools/wptrunner/wptrunner/environment.py:
61         * imported/w3c/tools/wptrunner/wptrunner/executors/base.py:
62         * imported/w3c/tools/wptrunner/wptrunner/executors/executormarionette.py:
63         * imported/w3c/tools/wptrunner/wptrunner/executors/executorservo.py:
64         * imported/w3c/tools/wptrunner/wptrunner/executors/pytestrunner/runner.py:
65         * imported/w3c/tools/wptrunner/wptrunner/testrunner.py:
66         * imported/w3c/tools/wptrunner/wptrunner/update/update.py:
67         * imported/w3c/tools/wptrunner/wptrunner/webdriver_server.py:
68         * imported/w3c/tools/wptrunner/wptrunner/wptlogging.py:
69         * imported/w3c/tools/wptrunner/wptrunner/wptrunner.py:
70         * imported/w3c/webdriver/OWNERS:
71         * imported/w3c/webdriver/interface/interface.html: Removed.
72         * imported/w3c/webdriver/tests/actions/modifier_click.py:
73         * imported/w3c/webdriver/tests/actions/mouse.py:
74         * imported/w3c/webdriver/tests/actions/mouse_dblclick.py: Added.
75         * imported/w3c/webdriver/tests/actions/sequence.py:
76         * imported/w3c/webdriver/tests/actions/support/mouse.py: Added.
77         * imported/w3c/webdriver/tests/cookies/add_cookie.py:
78         * imported/w3c/webdriver/tests/cookies/get_named_cookie.py:
79         * imported/w3c/webdriver/tests/element_retrieval/__init__.py: Copied from WebDriverTests/imported/w3c/webdriver/tests/retrieval/__init__.py.
80         * imported/w3c/webdriver/tests/element_retrieval/find_element.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/find_element.py.
81         * imported/w3c/webdriver/tests/element_retrieval/find_element_from_element.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/find_element_from_element.py.
82         * imported/w3c/webdriver/tests/element_retrieval/find_elements.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/find_elements.py.
83         * imported/w3c/webdriver/tests/element_retrieval/find_elements_from_element.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/find_element_from_elements.py.
84         * imported/w3c/webdriver/tests/element_send_keys/__init__.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/__init__.py.
85         * imported/w3c/webdriver/tests/element_send_keys/interactability.py: Added.
86         * imported/w3c/webdriver/tests/element_send_keys/scroll_into_view.py: Added.
87         * imported/w3c/webdriver/tests/execute_script/cyclic.py: Added.
88         * imported/w3c/webdriver/tests/get_window_rect.py:
89         * imported/w3c/webdriver/tests/interface.html:
90         * imported/w3c/webdriver/tests/navigation/current_url.py:
91         * imported/w3c/webdriver/tests/support/asserts.py:
92         * imported/w3c/webdriver/tests/support/fixtures.py:
93
94 2017-12-14  Carlos Garcia Campos  <cgarcia@igalia.com>
95
96         WebDriver: add a common way to run tests with pytest
97         https://bugs.webkit.org/show_bug.cgi?id=180800
98
99         Reviewed by Carlos Alberto Lopez Perez.
100
101         Remove conftest.py since pytest_timeout plugin is now always loaded from the command line.
102
103         * imported/w3c/conftest.py: Removed.
104
105 2017-12-04  Carlos Garcia Campos  <cgarcia@igalia.com>
106
107         Unreviewed. Update W3C WebDriver imported tests.
108
109         * imported/w3c/importer.json:
110         * imported/w3c/tools/webdriver/webdriver/client.py:
111         * imported/w3c/tools/webdriver/webdriver/error.py:
112         * imported/w3c/webdriver/tests/element_retrieval/get_active_element.py:
113         * imported/w3c/webdriver/tests/interaction/element_clear.py:
114         * imported/w3c/webdriver/tests/sessions/status.py:
115         * imported/w3c/webdriver/tests/support/wait.py:
116
117 2017-12-01  Carlos Garcia Campos  <cgarcia@igalia.com>
118
119         WebDriver: auto-install pytest instead of importing it from wpt tools directory
120         https://bugs.webkit.org/show_bug.cgi?id=180243
121
122         Reviewed by Brian Burg.
123
124         * imported/selenium/py/conftest.py: Stop patching this to use yield_fixture, new pytest supports this.
125         * imported/selenium/py/setup.cfg: Stop patching this, since pytest supports tool:pytest as group name.
126         * imported/selenium/py/test/selenium/webdriver/common/alerts_tests.py: Stop patching this to use yield_fixture,
127         new pytest supports this.
128         * imported/selenium/py/test/selenium/webdriver/common/cookie_tests.py: Ditto.
129         * imported/selenium/py/test/selenium/webdriver/common/frame_switching_tests.py: Ditto.
130         * imported/selenium/py/test/selenium/webdriver/common/page_load_timeout_tests.py: Ditto.
131         * imported/selenium/py/test/selenium/webdriver/common/window_switching_tests.py: Ditto.
132         * imported/selenium/py/test/selenium/webdriver/safari/conftest.py: Ditto.
133         * imported/selenium/py/test/selenium/webdriver/support/event_firing_webdriver_tests.py: Ditto.
134         * imported/w3c/importer.json: Stop importing pytest.
135         * imported/w3c/pytest.ini: Added.
136         * imported/w3c/tools/pytest/: Removed.
137
138 2017-11-30  Carlos Garcia Campos  <cgarcia@igalia.com>
139
140         WebDriver: add support for importing and running selenium tests
141         https://bugs.webkit.org/show_bug.cgi?id=180145
142
143         Reviewed by Brian Burg.
144
145         * imported/selenium/importer.json: Added.
146         * imported/selenium/common/: Added.
147         * imported/selenium/py/: Added.
148
149 2017-11-28  Carlos Garcia Campos  <cgarcia@igalia.com>
150
151         Unreviewed. Update W3C WebDriver imported tests.
152
153         * imported/w3c/importer.json:
154         * imported/w3c/tools/webdriver/webdriver/client.py:
155         * imported/w3c/tools/webdriver/webdriver/error.py:
156         * imported/w3c/tools/wptrunner/docs/conf.py:
157         * imported/w3c/tools/wptrunner/wptrunner/browsers/ie.py:
158         * imported/w3c/tools/wptrunner/wptrunner/executors/base.py:
159         * imported/w3c/tools/wptrunner/wptrunner/executors/pytestrunner/runner.py:
160         * imported/w3c/tools/wptrunner/wptrunner/stability.py:
161         * imported/w3c/tools/wptrunner/wptrunner/testdriver-vendor.js: Added.
162         * imported/w3c/tools/wptrunner/wptrunner/update/sync.py:
163         * imported/w3c/tools/wptrunner/wptrunner/wptcommandline.py:
164         * imported/w3c/webdriver/interface/interface.html:
165         * imported/w3c/webdriver/tests/document_handling/page_source.py: Added.
166         * imported/w3c/webdriver/tests/element_click/bubbling.py: Added.
167         * imported/w3c/webdriver/tests/element_retrieval/get_active_element.py:
168         * imported/w3c/webdriver/tests/execute_async_script/user_prompts.py: Added.
169         * imported/w3c/webdriver/tests/execute_script/user_prompts.py: Added.
170         * imported/w3c/webdriver/tests/sessions/status.py: Added.
171         * imported/w3c/webdriver/tests/status.py: Removed.
172         * imported/w3c/webdriver/tests/support/fixtures.py:
173         * imported/w3c/webdriver/tests/support/wait.py:
174         * imported/w3c/webdriver/tests/user_prompts/accept_alert.py:
175         * imported/w3c/webdriver/tests/user_prompts/dismiss_alert.py:
176         * imported/w3c/webdriver/tests/user_prompts/get_alert_text.py:
177         * imported/w3c/webdriver/tests/user_prompts/send_alert_text.py:
178
179 2017-11-28  Carlos Garcia Campos  <cgarcia@igalia.com>
180
181         WebDriver: add timeout option to run-webdriver-tests script
182         https://bugs.webkit.org/show_bug.cgi?id=179940
183
184         Reviewed by Carlos Alberto Lopez Perez.
185
186         Add a base conftest.py to load pytest_timeout plugin.
187
188         * imported/w3c/conftest.py: Added.
189
190 2017-11-21  Carlos Garcia Campos  <cgarcia@igalia.com>
191
192         Unreviewed. Update W3C WebDriver imported tests.
193
194         * imported/w3c/importer.json:
195         * imported/w3c/tools/webdriver/webdriver/client.py:
196         * imported/w3c/tools/webdriver/webdriver/error.py:
197         * imported/w3c/tools/webdriver/webdriver/protocol.py: Added.
198         * imported/w3c/tools/webdriver/webdriver/transport.py:
199         * imported/w3c/tools/wptrunner/MANIFEST.in:
200         * imported/w3c/tools/wptrunner/requirements_firefox.txt:
201         * imported/w3c/tools/wptrunner/requirements_opera.txt: Added.
202         * imported/w3c/tools/wptrunner/wptrunner/browsers/__init__.py:
203         * imported/w3c/tools/wptrunner/wptrunner/browsers/edge.py:
204         * imported/w3c/tools/wptrunner/wptrunner/browsers/firefox.py:
205         * imported/w3c/tools/wptrunner/wptrunner/browsers/opera.py: Added.
206         * imported/w3c/tools/wptrunner/wptrunner/environment.py:
207         * imported/w3c/tools/wptrunner/wptrunner/executors/base.py:
208         * imported/w3c/tools/wptrunner/wptrunner/executors/executoredge.py: Added.
209         * imported/w3c/tools/wptrunner/wptrunner/executors/executormarionette.py:
210         * imported/w3c/tools/wptrunner/wptrunner/executors/executoropera.py: Added.
211         * imported/w3c/tools/wptrunner/wptrunner/executors/executorselenium.py:
212         * imported/w3c/tools/wptrunner/wptrunner/executors/pytestrunner/runner.py:
213         * imported/w3c/tools/wptrunner/wptrunner/executors/testharness_webdriver.js:
214         * imported/w3c/tools/wptrunner/wptrunner/executors/testharness_webdriver_resume.js: Added.
215         * imported/w3c/tools/wptrunner/wptrunner/stability.py: Added.
216         * imported/w3c/tools/wptrunner/wptrunner/testdriver-extra.js: Added.
217         * imported/w3c/tools/wptrunner/wptrunner/testloader.py:
218         * imported/w3c/tools/wptrunner/wptrunner/testrunner.py:
219         * imported/w3c/tools/wptrunner/wptrunner/update/state.py:
220         * imported/w3c/tools/wptrunner/wptrunner/update/sync.py:
221         * imported/w3c/tools/wptrunner/wptrunner/webdriver_server.py:
222         * imported/w3c/tools/wptrunner/wptrunner/wptcommandline.py:
223         * imported/w3c/tools/wptrunner/wptrunner/wptlogging.py:
224         * imported/w3c/tools/wptrunner/wptrunner/wptrunner.py:
225         * imported/w3c/tools/wptrunner/wptrunner/wpttest.py:
226         * imported/w3c/webdriver/tests/actions/conftest.py:
227         * imported/w3c/webdriver/tests/actions/key.py:
228         * imported/w3c/webdriver/tests/actions/key_shortcuts.py: Added.
229         * imported/w3c/webdriver/tests/actions/modifier_click.py: Added.
230         * imported/w3c/webdriver/tests/actions/mouse.py:
231         * imported/w3c/webdriver/tests/actions/sequence.py:
232         * imported/w3c/webdriver/tests/actions/special_keys.py:
233         * imported/w3c/webdriver/tests/actions/support/keys.py:
234         * imported/w3c/webdriver/tests/actions/support/test_actions_wdspec.html:
235         * imported/w3c/webdriver/tests/cookies/add_cookie.py:
236         * imported/w3c/webdriver/tests/cookies/get_named_cookie.py:
237         * imported/w3c/webdriver/tests/element_click/stale.py: Added.
238         * imported/w3c/webdriver/tests/element_retrieval/get_active_element.py:
239         * imported/w3c/webdriver/tests/interaction/element_clear.py: Added.
240         * imported/w3c/webdriver/tests/navigation/get_title.py:
241         * imported/w3c/webdriver/tests/retrieval/find_element.py:
242         * imported/w3c/webdriver/tests/retrieval/find_element_from_element.py:
243         * imported/w3c/webdriver/tests/retrieval/find_element_from_elements.py:
244         * imported/w3c/webdriver/tests/retrieval/find_elements.py:
245         * imported/w3c/webdriver/tests/sessions/new_session/support/__init__.py:
246         * imported/w3c/webdriver/tests/state/get_element_attribute.py:
247         * imported/w3c/webdriver/tests/state/get_element_property.py:
248         * imported/w3c/webdriver/tests/state/get_element_tag_name.py:
249         * imported/w3c/webdriver/tests/state/is_element_selected.py:
250         * imported/w3c/webdriver/tests/support/asserts.py:
251         * imported/w3c/webdriver/tests/user_prompts/send_alert_text.py: Added.
252
253 2017-09-21  Carlos Garcia Campos  <cgarcia@igalia.com>
254
255         WebDriver: Add support to import and run W3C tests
256         https://bugs.webkit.org/show_bug.cgi?id=177304
257
258         Reviewed by Brian Burg.
259
260         Add json file used by the importer and the result of running the importer.
261
262         * imported/w3c/importer.json: Added.
263         * imported/w3c/tools/pytest/: Added.
264         * imported/w3c/tools/webdriver/: Added.
265         * imported/w3c/tools/wptrunner/: Added.
266         * imported/w3c/webdriver/: Added.