092d769246a9a0b560c6900c86fbcfcf53caee74
[WebKit-https.git] / WebDriverTests / ChangeLog
1 2018-01-22  Carlos Garcia Campos  <cgarcia@igalia.com>
2
3         Unreviewed. Update W3C WebDriver imported tests.
4
5         * imported/w3c/importer.json:
6         * imported/w3c/tools/webdriver/webdriver/client.py:
7         * imported/w3c/tools/webdriver/webdriver/protocol.py:
8         * imported/w3c/tools/webdriver/webdriver/servo.py: Removed.
9         * imported/w3c/tools/webdriver/webdriver/transport.py:
10         * imported/w3c/tools/wptrunner/MANIFEST.in:
11         * imported/w3c/tools/wptrunner/README.rst:
12         * imported/w3c/tools/wptrunner/docs/conf.py:
13         * imported/w3c/tools/wptrunner/docs/usage.rst:
14         * imported/w3c/tools/wptrunner/setup.py:
15         * imported/w3c/tools/wptrunner/tox.ini:
16         * imported/w3c/tools/wptrunner/wptrunner/browsers/__init__.py:
17         * imported/w3c/tools/wptrunner/wptrunner/browsers/b2g_setup/certtest_app.zip: Removed.
18         * imported/w3c/tools/wptrunner/wptrunner/browsers/chrome_android.py: Copied from WebDriverTests/imported/w3c/tools/wptrunner/wptrunner/browsers/ie.py.
19         * imported/w3c/tools/wptrunner/wptrunner/browsers/firefox.py:
20         * imported/w3c/tools/wptrunner/wptrunner/browsers/ie.py:
21         * imported/w3c/tools/wptrunner/wptrunner/browsers/servo.py:
22         * imported/w3c/tools/wptrunner/wptrunner/environment.py:
23         * imported/w3c/tools/wptrunner/wptrunner/executors/base.py:
24         * imported/w3c/tools/wptrunner/wptrunner/executors/executormarionette.py:
25         * imported/w3c/tools/wptrunner/wptrunner/executors/executorselenium.py:
26         * imported/w3c/tools/wptrunner/wptrunner/executors/executorservo.py:
27         * imported/w3c/tools/wptrunner/wptrunner/executors/executorservodriver.py:
28         * imported/w3c/tools/wptrunner/wptrunner/manifestupdate.py:
29         * imported/w3c/tools/wptrunner/wptrunner/metadata.py:
30         * imported/w3c/tools/wptrunner/wptrunner/stability.py:
31         * imported/w3c/tools/wptrunner/wptrunner/testloader.py:
32         * imported/w3c/tools/wptrunner/wptrunner/testrunner.py:
33         * imported/w3c/tools/wptrunner/wptrunner/tests/test_hosts.py:
34         * imported/w3c/tools/wptrunner/wptrunner/update/__init__.py:
35         * imported/w3c/tools/wptrunner/wptrunner/update/sync.py:
36         * imported/w3c/tools/wptrunner/wptrunner/update/tree.py:
37         * imported/w3c/tools/wptrunner/wptrunner/vcs.py:
38         * imported/w3c/tools/wptrunner/wptrunner/webdriver_server.py:
39         * imported/w3c/tools/wptrunner/wptrunner/wptcommandline.py:
40         * imported/w3c/tools/wptrunner/wptrunner/wptmanifest/tests/test_serializer.py:
41         * imported/w3c/tools/wptrunner/wptrunner/wptmanifest/tests/test_tokenizer.py:
42         * imported/w3c/tools/wptrunner/wptrunner/wptrunner.py:
43         * imported/w3c/tools/wptrunner/wptrunner/wpttest.py:
44         * imported/w3c/webdriver/tests/execute_async_script/__init__.py: Added.
45         * imported/w3c/webdriver/tests/execute_script/__init__.py: Added.
46         * imported/w3c/webdriver/tests/sessions/new_session/response.py:
47
48 2018-01-22  Carlos Garcia Campos  <cgarcia@igalia.com>
49
50         [GTK] WebDriver: test imported/w3c/webdriver/tests/sessions/new_session/response.py is crashing in the bots
51         https://bugs.webkit.org/show_bug.cgi?id=181904
52
53         Reviewed by Carlos Alberto Lopez Perez.
54
55         Unskip imported/w3c/webdriver/tests/sessions/new_session/response.py.
56
57         * TestExpectations.json:
58
59 2018-01-19  Carlos Garcia Campos  <cgarcia@igalia.com>
60
61         Unreviewed GTK+ gardening. Skip imported/w3c/webdriver/tests/sessions/new_session/response.py.
62
63         It's causing a crash in the driver process and affecting all other tests.
64
65         * TestExpectations.json:
66
67 2018-01-18  Carlos Garcia Campos  <cgarcia@igalia.com>
68
69         Unreviewed. Update Selenium WebDriver imported tests.
70
71         * imported/selenium/importer.json:
72         * imported/selenium/py/test/selenium/webdriver/common/executing_async_javascript_tests.py:
73         (reset_timeouts):
74
75 2018-01-17  Carlos Garcia Campos  <cgarcia@igalia.com>
76
77         WebDriver: ignore the driver in selenium test names when getting expectations
78         https://bugs.webkit.org/show_bug.cgi?id=181738
79
80         Reviewed by Carlos Alberto Lopez Perez.
81
82         Add some expectations for selenium tests.
83
84         * TestExpectations.json:
85
86 2018-01-17  Carlos Garcia Campos  <cgarcia@igalia.com>
87
88         WebDriver: add support for test expectations
89         https://bugs.webkit.org/show_bug.cgi?id=180420
90
91         Reviewed by Carlos Alberto Lopez Perez.
92
93         Add initial test expectations. For now I'm only adding the W3C test expectations, selenium ones will be added in
94         a follow up patch.
95
96         * TestExpectations.json: Added.
97
98 2018-01-11  Carlos Garcia Campos  <cgarcia@igalia.com>
99
100         Unreviewed. Update Selenium WebDriver imported tests.
101
102         * imported/selenium/importer.json:
103         * imported/selenium/py/conftest.py:
104         * imported/selenium/py/selenium/__init__.py:
105         * imported/selenium/py/selenium/webdriver/__init__.py:
106         * imported/selenium/py/selenium/webdriver/common/action_chains.py:
107         * imported/selenium/py/selenium/webdriver/common/service.py:
108         * imported/selenium/py/selenium/webdriver/remote/remote_connection.py:
109         * imported/selenium/py/selenium/webdriver/remote/switch_to.py:
110         * imported/selenium/py/selenium/webdriver/remote/webdriver.py:
111         * imported/selenium/py/selenium/webdriver/remote/webelement.py:
112         * imported/selenium/py/selenium/webdriver/support/expected_conditions.py:
113         * imported/selenium/py/selenium/webdriver/webkitgtk/options.py:
114         * imported/selenium/py/test/selenium/webdriver/common/alerts_tests.py:
115         * imported/selenium/py/test/selenium/webdriver/common/api_example_tests.py:
116         * imported/selenium/py/test/selenium/webdriver/common/appcache_tests.py:
117         * imported/selenium/py/test/selenium/webdriver/common/driver_element_finding_tests.py:
118         * imported/selenium/py/test/selenium/webdriver/common/executing_async_javascript_tests.py:
119         * imported/selenium/py/test/selenium/webdriver/common/frame_switching_tests.py:
120         * imported/selenium/py/test/selenium/webdriver/common/interactions_tests.py:
121         * imported/selenium/py/test/selenium/webdriver/common/page_load_timeout_tests.py:
122         * imported/selenium/py/test/selenium/webdriver/common/position_and_size_tests.py:
123         * imported/selenium/py/test/selenium/webdriver/common/rendered_webelement_tests.py:
124         * imported/selenium/py/test/selenium/webdriver/common/select_class_tests.py:
125         * imported/selenium/py/test/selenium/webdriver/common/visibility_tests.py:
126         * imported/selenium/py/test/selenium/webdriver/common/w3c_interaction_tests.py:
127         * imported/selenium/py/test/selenium/webdriver/common/webdriverwait_tests.py:
128         * imported/selenium/py/test/selenium/webdriver/common/window_tests.py:
129
130 2018-01-10  Carlos Garcia Campos  <cgarcia@igalia.com>
131
132         Unreviewed. Update W3C WebDriver imported tests.
133
134         * imported/w3c/importer.json:
135         * imported/w3c/webdriver/tests/sessions/new_session/invalid_capabilities.py:
136         * imported/w3c/webdriver/tests/sessions/new_session/support/create.py:
137
138 2018-01-10  Carlos Garcia Campos  <cgarcia@igalia.com>
139
140         Unreviewed. Update W3C WebDriver imported tests.
141
142         * imported/w3c/importer.json:
143         * imported/w3c/tools/wptrunner/wptrunner/browsers/firefox.py:
144         * imported/w3c/tools/wptrunner/wptrunner/browsers/servo.py:
145         * imported/w3c/tools/wptrunner/wptrunner/environment.py:
146         * imported/w3c/tools/wptrunner/wptrunner/executors/base.py:
147         * imported/w3c/tools/wptrunner/wptrunner/executors/executormarionette.py:
148         * imported/w3c/tools/wptrunner/wptrunner/executors/executorservo.py:
149         * imported/w3c/tools/wptrunner/wptrunner/executors/pytestrunner/runner.py:
150         * imported/w3c/tools/wptrunner/wptrunner/testrunner.py:
151         * imported/w3c/tools/wptrunner/wptrunner/update/update.py:
152         * imported/w3c/tools/wptrunner/wptrunner/webdriver_server.py:
153         * imported/w3c/tools/wptrunner/wptrunner/wptlogging.py:
154         * imported/w3c/tools/wptrunner/wptrunner/wptrunner.py:
155         * imported/w3c/webdriver/OWNERS:
156         * imported/w3c/webdriver/interface/interface.html: Removed.
157         * imported/w3c/webdriver/tests/actions/modifier_click.py:
158         * imported/w3c/webdriver/tests/actions/mouse.py:
159         * imported/w3c/webdriver/tests/actions/mouse_dblclick.py: Added.
160         * imported/w3c/webdriver/tests/actions/sequence.py:
161         * imported/w3c/webdriver/tests/actions/support/mouse.py: Added.
162         * imported/w3c/webdriver/tests/cookies/add_cookie.py:
163         * imported/w3c/webdriver/tests/cookies/get_named_cookie.py:
164         * imported/w3c/webdriver/tests/element_retrieval/__init__.py: Copied from WebDriverTests/imported/w3c/webdriver/tests/retrieval/__init__.py.
165         * imported/w3c/webdriver/tests/element_retrieval/find_element.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/find_element.py.
166         * imported/w3c/webdriver/tests/element_retrieval/find_element_from_element.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/find_element_from_element.py.
167         * imported/w3c/webdriver/tests/element_retrieval/find_elements.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/find_elements.py.
168         * imported/w3c/webdriver/tests/element_retrieval/find_elements_from_element.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/find_element_from_elements.py.
169         * imported/w3c/webdriver/tests/element_send_keys/__init__.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/__init__.py.
170         * imported/w3c/webdriver/tests/element_send_keys/interactability.py: Added.
171         * imported/w3c/webdriver/tests/element_send_keys/scroll_into_view.py: Added.
172         * imported/w3c/webdriver/tests/execute_script/cyclic.py: Added.
173         * imported/w3c/webdriver/tests/get_window_rect.py:
174         * imported/w3c/webdriver/tests/interface.html:
175         * imported/w3c/webdriver/tests/navigation/current_url.py:
176         * imported/w3c/webdriver/tests/support/asserts.py:
177         * imported/w3c/webdriver/tests/support/fixtures.py:
178
179 2017-12-14  Carlos Garcia Campos  <cgarcia@igalia.com>
180
181         WebDriver: add a common way to run tests with pytest
182         https://bugs.webkit.org/show_bug.cgi?id=180800
183
184         Reviewed by Carlos Alberto Lopez Perez.
185
186         Remove conftest.py since pytest_timeout plugin is now always loaded from the command line.
187
188         * imported/w3c/conftest.py: Removed.
189
190 2017-12-04  Carlos Garcia Campos  <cgarcia@igalia.com>
191
192         Unreviewed. Update W3C WebDriver imported tests.
193
194         * imported/w3c/importer.json:
195         * imported/w3c/tools/webdriver/webdriver/client.py:
196         * imported/w3c/tools/webdriver/webdriver/error.py:
197         * imported/w3c/webdriver/tests/element_retrieval/get_active_element.py:
198         * imported/w3c/webdriver/tests/interaction/element_clear.py:
199         * imported/w3c/webdriver/tests/sessions/status.py:
200         * imported/w3c/webdriver/tests/support/wait.py:
201
202 2017-12-01  Carlos Garcia Campos  <cgarcia@igalia.com>
203
204         WebDriver: auto-install pytest instead of importing it from wpt tools directory
205         https://bugs.webkit.org/show_bug.cgi?id=180243
206
207         Reviewed by Brian Burg.
208
209         * imported/selenium/py/conftest.py: Stop patching this to use yield_fixture, new pytest supports this.
210         * imported/selenium/py/setup.cfg: Stop patching this, since pytest supports tool:pytest as group name.
211         * imported/selenium/py/test/selenium/webdriver/common/alerts_tests.py: Stop patching this to use yield_fixture,
212         new pytest supports this.
213         * imported/selenium/py/test/selenium/webdriver/common/cookie_tests.py: Ditto.
214         * imported/selenium/py/test/selenium/webdriver/common/frame_switching_tests.py: Ditto.
215         * imported/selenium/py/test/selenium/webdriver/common/page_load_timeout_tests.py: Ditto.
216         * imported/selenium/py/test/selenium/webdriver/common/window_switching_tests.py: Ditto.
217         * imported/selenium/py/test/selenium/webdriver/safari/conftest.py: Ditto.
218         * imported/selenium/py/test/selenium/webdriver/support/event_firing_webdriver_tests.py: Ditto.
219         * imported/w3c/importer.json: Stop importing pytest.
220         * imported/w3c/pytest.ini: Added.
221         * imported/w3c/tools/pytest/: Removed.
222
223 2017-11-30  Carlos Garcia Campos  <cgarcia@igalia.com>
224
225         WebDriver: add support for importing and running selenium tests
226         https://bugs.webkit.org/show_bug.cgi?id=180145
227
228         Reviewed by Brian Burg.
229
230         * imported/selenium/importer.json: Added.
231         * imported/selenium/common/: Added.
232         * imported/selenium/py/: Added.
233
234 2017-11-28  Carlos Garcia Campos  <cgarcia@igalia.com>
235
236         Unreviewed. Update W3C WebDriver imported tests.
237
238         * imported/w3c/importer.json:
239         * imported/w3c/tools/webdriver/webdriver/client.py:
240         * imported/w3c/tools/webdriver/webdriver/error.py:
241         * imported/w3c/tools/wptrunner/docs/conf.py:
242         * imported/w3c/tools/wptrunner/wptrunner/browsers/ie.py:
243         * imported/w3c/tools/wptrunner/wptrunner/executors/base.py:
244         * imported/w3c/tools/wptrunner/wptrunner/executors/pytestrunner/runner.py:
245         * imported/w3c/tools/wptrunner/wptrunner/stability.py:
246         * imported/w3c/tools/wptrunner/wptrunner/testdriver-vendor.js: Added.
247         * imported/w3c/tools/wptrunner/wptrunner/update/sync.py:
248         * imported/w3c/tools/wptrunner/wptrunner/wptcommandline.py:
249         * imported/w3c/webdriver/interface/interface.html:
250         * imported/w3c/webdriver/tests/document_handling/page_source.py: Added.
251         * imported/w3c/webdriver/tests/element_click/bubbling.py: Added.
252         * imported/w3c/webdriver/tests/element_retrieval/get_active_element.py:
253         * imported/w3c/webdriver/tests/execute_async_script/user_prompts.py: Added.
254         * imported/w3c/webdriver/tests/execute_script/user_prompts.py: Added.
255         * imported/w3c/webdriver/tests/sessions/status.py: Added.
256         * imported/w3c/webdriver/tests/status.py: Removed.
257         * imported/w3c/webdriver/tests/support/fixtures.py:
258         * imported/w3c/webdriver/tests/support/wait.py:
259         * imported/w3c/webdriver/tests/user_prompts/accept_alert.py:
260         * imported/w3c/webdriver/tests/user_prompts/dismiss_alert.py:
261         * imported/w3c/webdriver/tests/user_prompts/get_alert_text.py:
262         * imported/w3c/webdriver/tests/user_prompts/send_alert_text.py:
263
264 2017-11-28  Carlos Garcia Campos  <cgarcia@igalia.com>
265
266         WebDriver: add timeout option to run-webdriver-tests script
267         https://bugs.webkit.org/show_bug.cgi?id=179940
268
269         Reviewed by Carlos Alberto Lopez Perez.
270
271         Add a base conftest.py to load pytest_timeout plugin.
272
273         * imported/w3c/conftest.py: Added.
274
275 2017-11-21  Carlos Garcia Campos  <cgarcia@igalia.com>
276
277         Unreviewed. Update W3C WebDriver imported tests.
278
279         * imported/w3c/importer.json:
280         * imported/w3c/tools/webdriver/webdriver/client.py:
281         * imported/w3c/tools/webdriver/webdriver/error.py:
282         * imported/w3c/tools/webdriver/webdriver/protocol.py: Added.
283         * imported/w3c/tools/webdriver/webdriver/transport.py:
284         * imported/w3c/tools/wptrunner/MANIFEST.in:
285         * imported/w3c/tools/wptrunner/requirements_firefox.txt:
286         * imported/w3c/tools/wptrunner/requirements_opera.txt: Added.
287         * imported/w3c/tools/wptrunner/wptrunner/browsers/__init__.py:
288         * imported/w3c/tools/wptrunner/wptrunner/browsers/edge.py:
289         * imported/w3c/tools/wptrunner/wptrunner/browsers/firefox.py:
290         * imported/w3c/tools/wptrunner/wptrunner/browsers/opera.py: Added.
291         * imported/w3c/tools/wptrunner/wptrunner/environment.py:
292         * imported/w3c/tools/wptrunner/wptrunner/executors/base.py:
293         * imported/w3c/tools/wptrunner/wptrunner/executors/executoredge.py: Added.
294         * imported/w3c/tools/wptrunner/wptrunner/executors/executormarionette.py:
295         * imported/w3c/tools/wptrunner/wptrunner/executors/executoropera.py: Added.
296         * imported/w3c/tools/wptrunner/wptrunner/executors/executorselenium.py:
297         * imported/w3c/tools/wptrunner/wptrunner/executors/pytestrunner/runner.py:
298         * imported/w3c/tools/wptrunner/wptrunner/executors/testharness_webdriver.js:
299         * imported/w3c/tools/wptrunner/wptrunner/executors/testharness_webdriver_resume.js: Added.
300         * imported/w3c/tools/wptrunner/wptrunner/stability.py: Added.
301         * imported/w3c/tools/wptrunner/wptrunner/testdriver-extra.js: Added.
302         * imported/w3c/tools/wptrunner/wptrunner/testloader.py:
303         * imported/w3c/tools/wptrunner/wptrunner/testrunner.py:
304         * imported/w3c/tools/wptrunner/wptrunner/update/state.py:
305         * imported/w3c/tools/wptrunner/wptrunner/update/sync.py:
306         * imported/w3c/tools/wptrunner/wptrunner/webdriver_server.py:
307         * imported/w3c/tools/wptrunner/wptrunner/wptcommandline.py:
308         * imported/w3c/tools/wptrunner/wptrunner/wptlogging.py:
309         * imported/w3c/tools/wptrunner/wptrunner/wptrunner.py:
310         * imported/w3c/tools/wptrunner/wptrunner/wpttest.py:
311         * imported/w3c/webdriver/tests/actions/conftest.py:
312         * imported/w3c/webdriver/tests/actions/key.py:
313         * imported/w3c/webdriver/tests/actions/key_shortcuts.py: Added.
314         * imported/w3c/webdriver/tests/actions/modifier_click.py: Added.
315         * imported/w3c/webdriver/tests/actions/mouse.py:
316         * imported/w3c/webdriver/tests/actions/sequence.py:
317         * imported/w3c/webdriver/tests/actions/special_keys.py:
318         * imported/w3c/webdriver/tests/actions/support/keys.py:
319         * imported/w3c/webdriver/tests/actions/support/test_actions_wdspec.html:
320         * imported/w3c/webdriver/tests/cookies/add_cookie.py:
321         * imported/w3c/webdriver/tests/cookies/get_named_cookie.py:
322         * imported/w3c/webdriver/tests/element_click/stale.py: Added.
323         * imported/w3c/webdriver/tests/element_retrieval/get_active_element.py:
324         * imported/w3c/webdriver/tests/interaction/element_clear.py: Added.
325         * imported/w3c/webdriver/tests/navigation/get_title.py:
326         * imported/w3c/webdriver/tests/retrieval/find_element.py:
327         * imported/w3c/webdriver/tests/retrieval/find_element_from_element.py:
328         * imported/w3c/webdriver/tests/retrieval/find_element_from_elements.py:
329         * imported/w3c/webdriver/tests/retrieval/find_elements.py:
330         * imported/w3c/webdriver/tests/sessions/new_session/support/__init__.py:
331         * imported/w3c/webdriver/tests/state/get_element_attribute.py:
332         * imported/w3c/webdriver/tests/state/get_element_property.py:
333         * imported/w3c/webdriver/tests/state/get_element_tag_name.py:
334         * imported/w3c/webdriver/tests/state/is_element_selected.py:
335         * imported/w3c/webdriver/tests/support/asserts.py:
336         * imported/w3c/webdriver/tests/user_prompts/send_alert_text.py: Added.
337
338 2017-09-21  Carlos Garcia Campos  <cgarcia@igalia.com>
339
340         WebDriver: Add support to import and run W3C tests
341         https://bugs.webkit.org/show_bug.cgi?id=177304
342
343         Reviewed by Brian Burg.
344
345         Add json file used by the importer and the result of running the importer.
346
347         * imported/w3c/importer.json: Added.
348         * imported/w3c/tools/pytest/: Added.
349         * imported/w3c/tools/webdriver/: Added.
350         * imported/w3c/tools/wptrunner/: Added.
351         * imported/w3c/webdriver/: Added.