71908a21b9999a25ff9ca23cafa3120f3790153d
[WebKit-https.git] / WebDriverTests / ChangeLog
1 2018-01-23  Carlos Garcia Campos  <cgarcia@igalia.com>
2
3         WebDriver: matched capabilities should include setWindowRect
4         https://bugs.webkit.org/show_bug.cgi?id=180411
5
6         Reviewed by Carlos Alberto Lopez Perez.
7
8         Change the bug number of test imported/w3c/webdriver/tests/sessions/new_session/response.py::test_resp_data,
9         since now it's failing due to missing timeouts value.
10
11         * TestExpectations.json:
12
13 2018-01-23  Carlos Garcia Campos  <cgarcia@igalia.com>
14
15         WebDriver: test imported/selenium/py/test/selenium/webdriver/common/api_example_tests.py::testChangeWindowSize fails
16         https://bugs.webkit.org/show_bug.cgi?id=181728
17
18         Reviewed by Sergio Villar Senin.
19
20         Remove expectations for tests that are now passing.
21
22         * TestExpectations.json:
23
24 2018-01-22  Carlos Garcia Campos  <cgarcia@igalia.com>
25
26         WebDriver: implement get element CSS value command
27         https://bugs.webkit.org/show_bug.cgi?id=181736
28
29         Reviewed by Carlos Alberto Lopez Perez.
30
31         * TestExpectations.json: Unskip tests passing now.
32
33 2018-01-22  Carlos Garcia Campos  <cgarcia@igalia.com>
34
35         Unreviewed. Update W3C WebDriver imported tests.
36
37         * imported/w3c/importer.json:
38         * imported/w3c/tools/webdriver/webdriver/client.py:
39         * imported/w3c/tools/webdriver/webdriver/protocol.py:
40         * imported/w3c/tools/webdriver/webdriver/servo.py: Removed.
41         * imported/w3c/tools/webdriver/webdriver/transport.py:
42         * imported/w3c/tools/wptrunner/MANIFEST.in:
43         * imported/w3c/tools/wptrunner/README.rst:
44         * imported/w3c/tools/wptrunner/docs/conf.py:
45         * imported/w3c/tools/wptrunner/docs/usage.rst:
46         * imported/w3c/tools/wptrunner/setup.py:
47         * imported/w3c/tools/wptrunner/tox.ini:
48         * imported/w3c/tools/wptrunner/wptrunner/browsers/__init__.py:
49         * imported/w3c/tools/wptrunner/wptrunner/browsers/b2g_setup/certtest_app.zip: Removed.
50         * imported/w3c/tools/wptrunner/wptrunner/browsers/chrome_android.py: Copied from WebDriverTests/imported/w3c/tools/wptrunner/wptrunner/browsers/ie.py.
51         * imported/w3c/tools/wptrunner/wptrunner/browsers/firefox.py:
52         * imported/w3c/tools/wptrunner/wptrunner/browsers/ie.py:
53         * imported/w3c/tools/wptrunner/wptrunner/browsers/servo.py:
54         * imported/w3c/tools/wptrunner/wptrunner/environment.py:
55         * imported/w3c/tools/wptrunner/wptrunner/executors/base.py:
56         * imported/w3c/tools/wptrunner/wptrunner/executors/executormarionette.py:
57         * imported/w3c/tools/wptrunner/wptrunner/executors/executorselenium.py:
58         * imported/w3c/tools/wptrunner/wptrunner/executors/executorservo.py:
59         * imported/w3c/tools/wptrunner/wptrunner/executors/executorservodriver.py:
60         * imported/w3c/tools/wptrunner/wptrunner/manifestupdate.py:
61         * imported/w3c/tools/wptrunner/wptrunner/metadata.py:
62         * imported/w3c/tools/wptrunner/wptrunner/stability.py:
63         * imported/w3c/tools/wptrunner/wptrunner/testloader.py:
64         * imported/w3c/tools/wptrunner/wptrunner/testrunner.py:
65         * imported/w3c/tools/wptrunner/wptrunner/tests/test_hosts.py:
66         * imported/w3c/tools/wptrunner/wptrunner/update/__init__.py:
67         * imported/w3c/tools/wptrunner/wptrunner/update/sync.py:
68         * imported/w3c/tools/wptrunner/wptrunner/update/tree.py:
69         * imported/w3c/tools/wptrunner/wptrunner/vcs.py:
70         * imported/w3c/tools/wptrunner/wptrunner/webdriver_server.py:
71         * imported/w3c/tools/wptrunner/wptrunner/wptcommandline.py:
72         * imported/w3c/tools/wptrunner/wptrunner/wptmanifest/tests/test_serializer.py:
73         * imported/w3c/tools/wptrunner/wptrunner/wptmanifest/tests/test_tokenizer.py:
74         * imported/w3c/tools/wptrunner/wptrunner/wptrunner.py:
75         * imported/w3c/tools/wptrunner/wptrunner/wpttest.py:
76         * imported/w3c/webdriver/tests/execute_async_script/__init__.py: Added.
77         * imported/w3c/webdriver/tests/execute_script/__init__.py: Added.
78         * imported/w3c/webdriver/tests/sessions/new_session/response.py:
79
80 2018-01-22  Carlos Garcia Campos  <cgarcia@igalia.com>
81
82         [GTK] WebDriver: test imported/w3c/webdriver/tests/sessions/new_session/response.py is crashing in the bots
83         https://bugs.webkit.org/show_bug.cgi?id=181904
84
85         Reviewed by Carlos Alberto Lopez Perez.
86
87         Unskip imported/w3c/webdriver/tests/sessions/new_session/response.py.
88
89         * TestExpectations.json:
90
91 2018-01-19  Carlos Garcia Campos  <cgarcia@igalia.com>
92
93         Unreviewed GTK+ gardening. Skip imported/w3c/webdriver/tests/sessions/new_session/response.py.
94
95         It's causing a crash in the driver process and affecting all other tests.
96
97         * TestExpectations.json:
98
99 2018-01-18  Carlos Garcia Campos  <cgarcia@igalia.com>
100
101         Unreviewed. Update Selenium WebDriver imported tests.
102
103         * imported/selenium/importer.json:
104         * imported/selenium/py/test/selenium/webdriver/common/executing_async_javascript_tests.py:
105         (reset_timeouts):
106
107 2018-01-17  Carlos Garcia Campos  <cgarcia@igalia.com>
108
109         WebDriver: ignore the driver in selenium test names when getting expectations
110         https://bugs.webkit.org/show_bug.cgi?id=181738
111
112         Reviewed by Carlos Alberto Lopez Perez.
113
114         Add some expectations for selenium tests.
115
116         * TestExpectations.json:
117
118 2018-01-17  Carlos Garcia Campos  <cgarcia@igalia.com>
119
120         WebDriver: add support for test expectations
121         https://bugs.webkit.org/show_bug.cgi?id=180420
122
123         Reviewed by Carlos Alberto Lopez Perez.
124
125         Add initial test expectations. For now I'm only adding the W3C test expectations, selenium ones will be added in
126         a follow up patch.
127
128         * TestExpectations.json: Added.
129
130 2018-01-11  Carlos Garcia Campos  <cgarcia@igalia.com>
131
132         Unreviewed. Update Selenium WebDriver imported tests.
133
134         * imported/selenium/importer.json:
135         * imported/selenium/py/conftest.py:
136         * imported/selenium/py/selenium/__init__.py:
137         * imported/selenium/py/selenium/webdriver/__init__.py:
138         * imported/selenium/py/selenium/webdriver/common/action_chains.py:
139         * imported/selenium/py/selenium/webdriver/common/service.py:
140         * imported/selenium/py/selenium/webdriver/remote/remote_connection.py:
141         * imported/selenium/py/selenium/webdriver/remote/switch_to.py:
142         * imported/selenium/py/selenium/webdriver/remote/webdriver.py:
143         * imported/selenium/py/selenium/webdriver/remote/webelement.py:
144         * imported/selenium/py/selenium/webdriver/support/expected_conditions.py:
145         * imported/selenium/py/selenium/webdriver/webkitgtk/options.py:
146         * imported/selenium/py/test/selenium/webdriver/common/alerts_tests.py:
147         * imported/selenium/py/test/selenium/webdriver/common/api_example_tests.py:
148         * imported/selenium/py/test/selenium/webdriver/common/appcache_tests.py:
149         * imported/selenium/py/test/selenium/webdriver/common/driver_element_finding_tests.py:
150         * imported/selenium/py/test/selenium/webdriver/common/executing_async_javascript_tests.py:
151         * imported/selenium/py/test/selenium/webdriver/common/frame_switching_tests.py:
152         * imported/selenium/py/test/selenium/webdriver/common/interactions_tests.py:
153         * imported/selenium/py/test/selenium/webdriver/common/page_load_timeout_tests.py:
154         * imported/selenium/py/test/selenium/webdriver/common/position_and_size_tests.py:
155         * imported/selenium/py/test/selenium/webdriver/common/rendered_webelement_tests.py:
156         * imported/selenium/py/test/selenium/webdriver/common/select_class_tests.py:
157         * imported/selenium/py/test/selenium/webdriver/common/visibility_tests.py:
158         * imported/selenium/py/test/selenium/webdriver/common/w3c_interaction_tests.py:
159         * imported/selenium/py/test/selenium/webdriver/common/webdriverwait_tests.py:
160         * imported/selenium/py/test/selenium/webdriver/common/window_tests.py:
161
162 2018-01-10  Carlos Garcia Campos  <cgarcia@igalia.com>
163
164         Unreviewed. Update W3C WebDriver imported tests.
165
166         * imported/w3c/importer.json:
167         * imported/w3c/webdriver/tests/sessions/new_session/invalid_capabilities.py:
168         * imported/w3c/webdriver/tests/sessions/new_session/support/create.py:
169
170 2018-01-10  Carlos Garcia Campos  <cgarcia@igalia.com>
171
172         Unreviewed. Update W3C WebDriver imported tests.
173
174         * imported/w3c/importer.json:
175         * imported/w3c/tools/wptrunner/wptrunner/browsers/firefox.py:
176         * imported/w3c/tools/wptrunner/wptrunner/browsers/servo.py:
177         * imported/w3c/tools/wptrunner/wptrunner/environment.py:
178         * imported/w3c/tools/wptrunner/wptrunner/executors/base.py:
179         * imported/w3c/tools/wptrunner/wptrunner/executors/executormarionette.py:
180         * imported/w3c/tools/wptrunner/wptrunner/executors/executorservo.py:
181         * imported/w3c/tools/wptrunner/wptrunner/executors/pytestrunner/runner.py:
182         * imported/w3c/tools/wptrunner/wptrunner/testrunner.py:
183         * imported/w3c/tools/wptrunner/wptrunner/update/update.py:
184         * imported/w3c/tools/wptrunner/wptrunner/webdriver_server.py:
185         * imported/w3c/tools/wptrunner/wptrunner/wptlogging.py:
186         * imported/w3c/tools/wptrunner/wptrunner/wptrunner.py:
187         * imported/w3c/webdriver/OWNERS:
188         * imported/w3c/webdriver/interface/interface.html: Removed.
189         * imported/w3c/webdriver/tests/actions/modifier_click.py:
190         * imported/w3c/webdriver/tests/actions/mouse.py:
191         * imported/w3c/webdriver/tests/actions/mouse_dblclick.py: Added.
192         * imported/w3c/webdriver/tests/actions/sequence.py:
193         * imported/w3c/webdriver/tests/actions/support/mouse.py: Added.
194         * imported/w3c/webdriver/tests/cookies/add_cookie.py:
195         * imported/w3c/webdriver/tests/cookies/get_named_cookie.py:
196         * imported/w3c/webdriver/tests/element_retrieval/__init__.py: Copied from WebDriverTests/imported/w3c/webdriver/tests/retrieval/__init__.py.
197         * imported/w3c/webdriver/tests/element_retrieval/find_element.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/find_element.py.
198         * imported/w3c/webdriver/tests/element_retrieval/find_element_from_element.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/find_element_from_element.py.
199         * imported/w3c/webdriver/tests/element_retrieval/find_elements.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/find_elements.py.
200         * imported/w3c/webdriver/tests/element_retrieval/find_elements_from_element.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/find_element_from_elements.py.
201         * imported/w3c/webdriver/tests/element_send_keys/__init__.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/__init__.py.
202         * imported/w3c/webdriver/tests/element_send_keys/interactability.py: Added.
203         * imported/w3c/webdriver/tests/element_send_keys/scroll_into_view.py: Added.
204         * imported/w3c/webdriver/tests/execute_script/cyclic.py: Added.
205         * imported/w3c/webdriver/tests/get_window_rect.py:
206         * imported/w3c/webdriver/tests/interface.html:
207         * imported/w3c/webdriver/tests/navigation/current_url.py:
208         * imported/w3c/webdriver/tests/support/asserts.py:
209         * imported/w3c/webdriver/tests/support/fixtures.py:
210
211 2017-12-14  Carlos Garcia Campos  <cgarcia@igalia.com>
212
213         WebDriver: add a common way to run tests with pytest
214         https://bugs.webkit.org/show_bug.cgi?id=180800
215
216         Reviewed by Carlos Alberto Lopez Perez.
217
218         Remove conftest.py since pytest_timeout plugin is now always loaded from the command line.
219
220         * imported/w3c/conftest.py: Removed.
221
222 2017-12-04  Carlos Garcia Campos  <cgarcia@igalia.com>
223
224         Unreviewed. Update W3C WebDriver imported tests.
225
226         * imported/w3c/importer.json:
227         * imported/w3c/tools/webdriver/webdriver/client.py:
228         * imported/w3c/tools/webdriver/webdriver/error.py:
229         * imported/w3c/webdriver/tests/element_retrieval/get_active_element.py:
230         * imported/w3c/webdriver/tests/interaction/element_clear.py:
231         * imported/w3c/webdriver/tests/sessions/status.py:
232         * imported/w3c/webdriver/tests/support/wait.py:
233
234 2017-12-01  Carlos Garcia Campos  <cgarcia@igalia.com>
235
236         WebDriver: auto-install pytest instead of importing it from wpt tools directory
237         https://bugs.webkit.org/show_bug.cgi?id=180243
238
239         Reviewed by Brian Burg.
240
241         * imported/selenium/py/conftest.py: Stop patching this to use yield_fixture, new pytest supports this.
242         * imported/selenium/py/setup.cfg: Stop patching this, since pytest supports tool:pytest as group name.
243         * imported/selenium/py/test/selenium/webdriver/common/alerts_tests.py: Stop patching this to use yield_fixture,
244         new pytest supports this.
245         * imported/selenium/py/test/selenium/webdriver/common/cookie_tests.py: Ditto.
246         * imported/selenium/py/test/selenium/webdriver/common/frame_switching_tests.py: Ditto.
247         * imported/selenium/py/test/selenium/webdriver/common/page_load_timeout_tests.py: Ditto.
248         * imported/selenium/py/test/selenium/webdriver/common/window_switching_tests.py: Ditto.
249         * imported/selenium/py/test/selenium/webdriver/safari/conftest.py: Ditto.
250         * imported/selenium/py/test/selenium/webdriver/support/event_firing_webdriver_tests.py: Ditto.
251         * imported/w3c/importer.json: Stop importing pytest.
252         * imported/w3c/pytest.ini: Added.
253         * imported/w3c/tools/pytest/: Removed.
254
255 2017-11-30  Carlos Garcia Campos  <cgarcia@igalia.com>
256
257         WebDriver: add support for importing and running selenium tests
258         https://bugs.webkit.org/show_bug.cgi?id=180145
259
260         Reviewed by Brian Burg.
261
262         * imported/selenium/importer.json: Added.
263         * imported/selenium/common/: Added.
264         * imported/selenium/py/: Added.
265
266 2017-11-28  Carlos Garcia Campos  <cgarcia@igalia.com>
267
268         Unreviewed. Update W3C WebDriver imported tests.
269
270         * imported/w3c/importer.json:
271         * imported/w3c/tools/webdriver/webdriver/client.py:
272         * imported/w3c/tools/webdriver/webdriver/error.py:
273         * imported/w3c/tools/wptrunner/docs/conf.py:
274         * imported/w3c/tools/wptrunner/wptrunner/browsers/ie.py:
275         * imported/w3c/tools/wptrunner/wptrunner/executors/base.py:
276         * imported/w3c/tools/wptrunner/wptrunner/executors/pytestrunner/runner.py:
277         * imported/w3c/tools/wptrunner/wptrunner/stability.py:
278         * imported/w3c/tools/wptrunner/wptrunner/testdriver-vendor.js: Added.
279         * imported/w3c/tools/wptrunner/wptrunner/update/sync.py:
280         * imported/w3c/tools/wptrunner/wptrunner/wptcommandline.py:
281         * imported/w3c/webdriver/interface/interface.html:
282         * imported/w3c/webdriver/tests/document_handling/page_source.py: Added.
283         * imported/w3c/webdriver/tests/element_click/bubbling.py: Added.
284         * imported/w3c/webdriver/tests/element_retrieval/get_active_element.py:
285         * imported/w3c/webdriver/tests/execute_async_script/user_prompts.py: Added.
286         * imported/w3c/webdriver/tests/execute_script/user_prompts.py: Added.
287         * imported/w3c/webdriver/tests/sessions/status.py: Added.
288         * imported/w3c/webdriver/tests/status.py: Removed.
289         * imported/w3c/webdriver/tests/support/fixtures.py:
290         * imported/w3c/webdriver/tests/support/wait.py:
291         * imported/w3c/webdriver/tests/user_prompts/accept_alert.py:
292         * imported/w3c/webdriver/tests/user_prompts/dismiss_alert.py:
293         * imported/w3c/webdriver/tests/user_prompts/get_alert_text.py:
294         * imported/w3c/webdriver/tests/user_prompts/send_alert_text.py:
295
296 2017-11-28  Carlos Garcia Campos  <cgarcia@igalia.com>
297
298         WebDriver: add timeout option to run-webdriver-tests script
299         https://bugs.webkit.org/show_bug.cgi?id=179940
300
301         Reviewed by Carlos Alberto Lopez Perez.
302
303         Add a base conftest.py to load pytest_timeout plugin.
304
305         * imported/w3c/conftest.py: Added.
306
307 2017-11-21  Carlos Garcia Campos  <cgarcia@igalia.com>
308
309         Unreviewed. Update W3C WebDriver imported tests.
310
311         * imported/w3c/importer.json:
312         * imported/w3c/tools/webdriver/webdriver/client.py:
313         * imported/w3c/tools/webdriver/webdriver/error.py:
314         * imported/w3c/tools/webdriver/webdriver/protocol.py: Added.
315         * imported/w3c/tools/webdriver/webdriver/transport.py:
316         * imported/w3c/tools/wptrunner/MANIFEST.in:
317         * imported/w3c/tools/wptrunner/requirements_firefox.txt:
318         * imported/w3c/tools/wptrunner/requirements_opera.txt: Added.
319         * imported/w3c/tools/wptrunner/wptrunner/browsers/__init__.py:
320         * imported/w3c/tools/wptrunner/wptrunner/browsers/edge.py:
321         * imported/w3c/tools/wptrunner/wptrunner/browsers/firefox.py:
322         * imported/w3c/tools/wptrunner/wptrunner/browsers/opera.py: Added.
323         * imported/w3c/tools/wptrunner/wptrunner/environment.py:
324         * imported/w3c/tools/wptrunner/wptrunner/executors/base.py:
325         * imported/w3c/tools/wptrunner/wptrunner/executors/executoredge.py: Added.
326         * imported/w3c/tools/wptrunner/wptrunner/executors/executormarionette.py:
327         * imported/w3c/tools/wptrunner/wptrunner/executors/executoropera.py: Added.
328         * imported/w3c/tools/wptrunner/wptrunner/executors/executorselenium.py:
329         * imported/w3c/tools/wptrunner/wptrunner/executors/pytestrunner/runner.py:
330         * imported/w3c/tools/wptrunner/wptrunner/executors/testharness_webdriver.js:
331         * imported/w3c/tools/wptrunner/wptrunner/executors/testharness_webdriver_resume.js: Added.
332         * imported/w3c/tools/wptrunner/wptrunner/stability.py: Added.
333         * imported/w3c/tools/wptrunner/wptrunner/testdriver-extra.js: Added.
334         * imported/w3c/tools/wptrunner/wptrunner/testloader.py:
335         * imported/w3c/tools/wptrunner/wptrunner/testrunner.py:
336         * imported/w3c/tools/wptrunner/wptrunner/update/state.py:
337         * imported/w3c/tools/wptrunner/wptrunner/update/sync.py:
338         * imported/w3c/tools/wptrunner/wptrunner/webdriver_server.py:
339         * imported/w3c/tools/wptrunner/wptrunner/wptcommandline.py:
340         * imported/w3c/tools/wptrunner/wptrunner/wptlogging.py:
341         * imported/w3c/tools/wptrunner/wptrunner/wptrunner.py:
342         * imported/w3c/tools/wptrunner/wptrunner/wpttest.py:
343         * imported/w3c/webdriver/tests/actions/conftest.py:
344         * imported/w3c/webdriver/tests/actions/key.py:
345         * imported/w3c/webdriver/tests/actions/key_shortcuts.py: Added.
346         * imported/w3c/webdriver/tests/actions/modifier_click.py: Added.
347         * imported/w3c/webdriver/tests/actions/mouse.py:
348         * imported/w3c/webdriver/tests/actions/sequence.py:
349         * imported/w3c/webdriver/tests/actions/special_keys.py:
350         * imported/w3c/webdriver/tests/actions/support/keys.py:
351         * imported/w3c/webdriver/tests/actions/support/test_actions_wdspec.html:
352         * imported/w3c/webdriver/tests/cookies/add_cookie.py:
353         * imported/w3c/webdriver/tests/cookies/get_named_cookie.py:
354         * imported/w3c/webdriver/tests/element_click/stale.py: Added.
355         * imported/w3c/webdriver/tests/element_retrieval/get_active_element.py:
356         * imported/w3c/webdriver/tests/interaction/element_clear.py: Added.
357         * imported/w3c/webdriver/tests/navigation/get_title.py:
358         * imported/w3c/webdriver/tests/retrieval/find_element.py:
359         * imported/w3c/webdriver/tests/retrieval/find_element_from_element.py:
360         * imported/w3c/webdriver/tests/retrieval/find_element_from_elements.py:
361         * imported/w3c/webdriver/tests/retrieval/find_elements.py:
362         * imported/w3c/webdriver/tests/sessions/new_session/support/__init__.py:
363         * imported/w3c/webdriver/tests/state/get_element_attribute.py:
364         * imported/w3c/webdriver/tests/state/get_element_property.py:
365         * imported/w3c/webdriver/tests/state/get_element_tag_name.py:
366         * imported/w3c/webdriver/tests/state/is_element_selected.py:
367         * imported/w3c/webdriver/tests/support/asserts.py:
368         * imported/w3c/webdriver/tests/user_prompts/send_alert_text.py: Added.
369
370 2017-09-21  Carlos Garcia Campos  <cgarcia@igalia.com>
371
372         WebDriver: Add support to import and run W3C tests
373         https://bugs.webkit.org/show_bug.cgi?id=177304
374
375         Reviewed by Brian Burg.
376
377         Add json file used by the importer and the result of running the importer.
378
379         * imported/w3c/importer.json: Added.
380         * imported/w3c/tools/pytest/: Added.
381         * imported/w3c/tools/webdriver/: Added.
382         * imported/w3c/tools/wptrunner/: Added.
383         * imported/w3c/webdriver/: Added.