WebDriver: several tests in imported/w3c/webdriver/tests/sessions/new_session/merge...
[WebKit-https.git] / WebDriverTests / ChangeLog
1 2018-01-23  Carlos Garcia Campos  <cgarcia@igalia.com>
2
3         WebDriver: several tests in imported/w3c/webdriver/tests/sessions/new_session/merge.py are failing
4         https://bugs.webkit.org/show_bug.cgi?id=180407
5
6         Reviewed by Carlos Alberto Lopez Perez.
7
8         Remove expectations for tests that are passing now and update the bug number of the other ones referencing
9         #180407.
10
11         * TestExpectations.json:
12
13 2018-01-23  Carlos Garcia Campos  <cgarcia@igalia.com>
14
15         WebDriver: test imported/w3c/webdriver/tests/sessions/new_session/response.py::test_timeouts fails
16         https://bugs.webkit.org/show_bug.cgi?id=180412
17
18         Reviewed by Carlos Alberto Lopez Perez.
19
20         Remove expectations for imported/w3c/webdriver/tests/sessions/new_session/response.py since all tests are
21         passing now.
22
23         * TestExpectations.json:
24
25 2018-01-23  Carlos Garcia Campos  <cgarcia@igalia.com>
26
27         WebDriver: matched capabilities should include setWindowRect
28         https://bugs.webkit.org/show_bug.cgi?id=180411
29
30         Reviewed by Carlos Alberto Lopez Perez.
31
32         Change the bug number of test imported/w3c/webdriver/tests/sessions/new_session/response.py::test_resp_data,
33         since now it's failing due to missing timeouts value.
34
35         * TestExpectations.json:
36
37 2018-01-23  Carlos Garcia Campos  <cgarcia@igalia.com>
38
39         WebDriver: test imported/selenium/py/test/selenium/webdriver/common/api_example_tests.py::testChangeWindowSize fails
40         https://bugs.webkit.org/show_bug.cgi?id=181728
41
42         Reviewed by Sergio Villar Senin.
43
44         Remove expectations for tests that are now passing.
45
46         * TestExpectations.json:
47
48 2018-01-22  Carlos Garcia Campos  <cgarcia@igalia.com>
49
50         WebDriver: implement get element CSS value command
51         https://bugs.webkit.org/show_bug.cgi?id=181736
52
53         Reviewed by Carlos Alberto Lopez Perez.
54
55         * TestExpectations.json: Unskip tests passing now.
56
57 2018-01-22  Carlos Garcia Campos  <cgarcia@igalia.com>
58
59         Unreviewed. Update W3C WebDriver imported tests.
60
61         * imported/w3c/importer.json:
62         * imported/w3c/tools/webdriver/webdriver/client.py:
63         * imported/w3c/tools/webdriver/webdriver/protocol.py:
64         * imported/w3c/tools/webdriver/webdriver/servo.py: Removed.
65         * imported/w3c/tools/webdriver/webdriver/transport.py:
66         * imported/w3c/tools/wptrunner/MANIFEST.in:
67         * imported/w3c/tools/wptrunner/README.rst:
68         * imported/w3c/tools/wptrunner/docs/conf.py:
69         * imported/w3c/tools/wptrunner/docs/usage.rst:
70         * imported/w3c/tools/wptrunner/setup.py:
71         * imported/w3c/tools/wptrunner/tox.ini:
72         * imported/w3c/tools/wptrunner/wptrunner/browsers/__init__.py:
73         * imported/w3c/tools/wptrunner/wptrunner/browsers/b2g_setup/certtest_app.zip: Removed.
74         * imported/w3c/tools/wptrunner/wptrunner/browsers/chrome_android.py: Copied from WebDriverTests/imported/w3c/tools/wptrunner/wptrunner/browsers/ie.py.
75         * imported/w3c/tools/wptrunner/wptrunner/browsers/firefox.py:
76         * imported/w3c/tools/wptrunner/wptrunner/browsers/ie.py:
77         * imported/w3c/tools/wptrunner/wptrunner/browsers/servo.py:
78         * imported/w3c/tools/wptrunner/wptrunner/environment.py:
79         * imported/w3c/tools/wptrunner/wptrunner/executors/base.py:
80         * imported/w3c/tools/wptrunner/wptrunner/executors/executormarionette.py:
81         * imported/w3c/tools/wptrunner/wptrunner/executors/executorselenium.py:
82         * imported/w3c/tools/wptrunner/wptrunner/executors/executorservo.py:
83         * imported/w3c/tools/wptrunner/wptrunner/executors/executorservodriver.py:
84         * imported/w3c/tools/wptrunner/wptrunner/manifestupdate.py:
85         * imported/w3c/tools/wptrunner/wptrunner/metadata.py:
86         * imported/w3c/tools/wptrunner/wptrunner/stability.py:
87         * imported/w3c/tools/wptrunner/wptrunner/testloader.py:
88         * imported/w3c/tools/wptrunner/wptrunner/testrunner.py:
89         * imported/w3c/tools/wptrunner/wptrunner/tests/test_hosts.py:
90         * imported/w3c/tools/wptrunner/wptrunner/update/__init__.py:
91         * imported/w3c/tools/wptrunner/wptrunner/update/sync.py:
92         * imported/w3c/tools/wptrunner/wptrunner/update/tree.py:
93         * imported/w3c/tools/wptrunner/wptrunner/vcs.py:
94         * imported/w3c/tools/wptrunner/wptrunner/webdriver_server.py:
95         * imported/w3c/tools/wptrunner/wptrunner/wptcommandline.py:
96         * imported/w3c/tools/wptrunner/wptrunner/wptmanifest/tests/test_serializer.py:
97         * imported/w3c/tools/wptrunner/wptrunner/wptmanifest/tests/test_tokenizer.py:
98         * imported/w3c/tools/wptrunner/wptrunner/wptrunner.py:
99         * imported/w3c/tools/wptrunner/wptrunner/wpttest.py:
100         * imported/w3c/webdriver/tests/execute_async_script/__init__.py: Added.
101         * imported/w3c/webdriver/tests/execute_script/__init__.py: Added.
102         * imported/w3c/webdriver/tests/sessions/new_session/response.py:
103
104 2018-01-22  Carlos Garcia Campos  <cgarcia@igalia.com>
105
106         [GTK] WebDriver: test imported/w3c/webdriver/tests/sessions/new_session/response.py is crashing in the bots
107         https://bugs.webkit.org/show_bug.cgi?id=181904
108
109         Reviewed by Carlos Alberto Lopez Perez.
110
111         Unskip imported/w3c/webdriver/tests/sessions/new_session/response.py.
112
113         * TestExpectations.json:
114
115 2018-01-19  Carlos Garcia Campos  <cgarcia@igalia.com>
116
117         Unreviewed GTK+ gardening. Skip imported/w3c/webdriver/tests/sessions/new_session/response.py.
118
119         It's causing a crash in the driver process and affecting all other tests.
120
121         * TestExpectations.json:
122
123 2018-01-18  Carlos Garcia Campos  <cgarcia@igalia.com>
124
125         Unreviewed. Update Selenium WebDriver imported tests.
126
127         * imported/selenium/importer.json:
128         * imported/selenium/py/test/selenium/webdriver/common/executing_async_javascript_tests.py:
129         (reset_timeouts):
130
131 2018-01-17  Carlos Garcia Campos  <cgarcia@igalia.com>
132
133         WebDriver: ignore the driver in selenium test names when getting expectations
134         https://bugs.webkit.org/show_bug.cgi?id=181738
135
136         Reviewed by Carlos Alberto Lopez Perez.
137
138         Add some expectations for selenium tests.
139
140         * TestExpectations.json:
141
142 2018-01-17  Carlos Garcia Campos  <cgarcia@igalia.com>
143
144         WebDriver: add support for test expectations
145         https://bugs.webkit.org/show_bug.cgi?id=180420
146
147         Reviewed by Carlos Alberto Lopez Perez.
148
149         Add initial test expectations. For now I'm only adding the W3C test expectations, selenium ones will be added in
150         a follow up patch.
151
152         * TestExpectations.json: Added.
153
154 2018-01-11  Carlos Garcia Campos  <cgarcia@igalia.com>
155
156         Unreviewed. Update Selenium WebDriver imported tests.
157
158         * imported/selenium/importer.json:
159         * imported/selenium/py/conftest.py:
160         * imported/selenium/py/selenium/__init__.py:
161         * imported/selenium/py/selenium/webdriver/__init__.py:
162         * imported/selenium/py/selenium/webdriver/common/action_chains.py:
163         * imported/selenium/py/selenium/webdriver/common/service.py:
164         * imported/selenium/py/selenium/webdriver/remote/remote_connection.py:
165         * imported/selenium/py/selenium/webdriver/remote/switch_to.py:
166         * imported/selenium/py/selenium/webdriver/remote/webdriver.py:
167         * imported/selenium/py/selenium/webdriver/remote/webelement.py:
168         * imported/selenium/py/selenium/webdriver/support/expected_conditions.py:
169         * imported/selenium/py/selenium/webdriver/webkitgtk/options.py:
170         * imported/selenium/py/test/selenium/webdriver/common/alerts_tests.py:
171         * imported/selenium/py/test/selenium/webdriver/common/api_example_tests.py:
172         * imported/selenium/py/test/selenium/webdriver/common/appcache_tests.py:
173         * imported/selenium/py/test/selenium/webdriver/common/driver_element_finding_tests.py:
174         * imported/selenium/py/test/selenium/webdriver/common/executing_async_javascript_tests.py:
175         * imported/selenium/py/test/selenium/webdriver/common/frame_switching_tests.py:
176         * imported/selenium/py/test/selenium/webdriver/common/interactions_tests.py:
177         * imported/selenium/py/test/selenium/webdriver/common/page_load_timeout_tests.py:
178         * imported/selenium/py/test/selenium/webdriver/common/position_and_size_tests.py:
179         * imported/selenium/py/test/selenium/webdriver/common/rendered_webelement_tests.py:
180         * imported/selenium/py/test/selenium/webdriver/common/select_class_tests.py:
181         * imported/selenium/py/test/selenium/webdriver/common/visibility_tests.py:
182         * imported/selenium/py/test/selenium/webdriver/common/w3c_interaction_tests.py:
183         * imported/selenium/py/test/selenium/webdriver/common/webdriverwait_tests.py:
184         * imported/selenium/py/test/selenium/webdriver/common/window_tests.py:
185
186 2018-01-10  Carlos Garcia Campos  <cgarcia@igalia.com>
187
188         Unreviewed. Update W3C WebDriver imported tests.
189
190         * imported/w3c/importer.json:
191         * imported/w3c/webdriver/tests/sessions/new_session/invalid_capabilities.py:
192         * imported/w3c/webdriver/tests/sessions/new_session/support/create.py:
193
194 2018-01-10  Carlos Garcia Campos  <cgarcia@igalia.com>
195
196         Unreviewed. Update W3C WebDriver imported tests.
197
198         * imported/w3c/importer.json:
199         * imported/w3c/tools/wptrunner/wptrunner/browsers/firefox.py:
200         * imported/w3c/tools/wptrunner/wptrunner/browsers/servo.py:
201         * imported/w3c/tools/wptrunner/wptrunner/environment.py:
202         * imported/w3c/tools/wptrunner/wptrunner/executors/base.py:
203         * imported/w3c/tools/wptrunner/wptrunner/executors/executormarionette.py:
204         * imported/w3c/tools/wptrunner/wptrunner/executors/executorservo.py:
205         * imported/w3c/tools/wptrunner/wptrunner/executors/pytestrunner/runner.py:
206         * imported/w3c/tools/wptrunner/wptrunner/testrunner.py:
207         * imported/w3c/tools/wptrunner/wptrunner/update/update.py:
208         * imported/w3c/tools/wptrunner/wptrunner/webdriver_server.py:
209         * imported/w3c/tools/wptrunner/wptrunner/wptlogging.py:
210         * imported/w3c/tools/wptrunner/wptrunner/wptrunner.py:
211         * imported/w3c/webdriver/OWNERS:
212         * imported/w3c/webdriver/interface/interface.html: Removed.
213         * imported/w3c/webdriver/tests/actions/modifier_click.py:
214         * imported/w3c/webdriver/tests/actions/mouse.py:
215         * imported/w3c/webdriver/tests/actions/mouse_dblclick.py: Added.
216         * imported/w3c/webdriver/tests/actions/sequence.py:
217         * imported/w3c/webdriver/tests/actions/support/mouse.py: Added.
218         * imported/w3c/webdriver/tests/cookies/add_cookie.py:
219         * imported/w3c/webdriver/tests/cookies/get_named_cookie.py:
220         * imported/w3c/webdriver/tests/element_retrieval/__init__.py: Copied from WebDriverTests/imported/w3c/webdriver/tests/retrieval/__init__.py.
221         * imported/w3c/webdriver/tests/element_retrieval/find_element.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/find_element.py.
222         * imported/w3c/webdriver/tests/element_retrieval/find_element_from_element.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/find_element_from_element.py.
223         * imported/w3c/webdriver/tests/element_retrieval/find_elements.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/find_elements.py.
224         * imported/w3c/webdriver/tests/element_retrieval/find_elements_from_element.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/find_element_from_elements.py.
225         * imported/w3c/webdriver/tests/element_send_keys/__init__.py: Renamed from WebDriverTests/imported/w3c/webdriver/tests/retrieval/__init__.py.
226         * imported/w3c/webdriver/tests/element_send_keys/interactability.py: Added.
227         * imported/w3c/webdriver/tests/element_send_keys/scroll_into_view.py: Added.
228         * imported/w3c/webdriver/tests/execute_script/cyclic.py: Added.
229         * imported/w3c/webdriver/tests/get_window_rect.py:
230         * imported/w3c/webdriver/tests/interface.html:
231         * imported/w3c/webdriver/tests/navigation/current_url.py:
232         * imported/w3c/webdriver/tests/support/asserts.py:
233         * imported/w3c/webdriver/tests/support/fixtures.py:
234
235 2017-12-14  Carlos Garcia Campos  <cgarcia@igalia.com>
236
237         WebDriver: add a common way to run tests with pytest
238         https://bugs.webkit.org/show_bug.cgi?id=180800
239
240         Reviewed by Carlos Alberto Lopez Perez.
241
242         Remove conftest.py since pytest_timeout plugin is now always loaded from the command line.
243
244         * imported/w3c/conftest.py: Removed.
245
246 2017-12-04  Carlos Garcia Campos  <cgarcia@igalia.com>
247
248         Unreviewed. Update W3C WebDriver imported tests.
249
250         * imported/w3c/importer.json:
251         * imported/w3c/tools/webdriver/webdriver/client.py:
252         * imported/w3c/tools/webdriver/webdriver/error.py:
253         * imported/w3c/webdriver/tests/element_retrieval/get_active_element.py:
254         * imported/w3c/webdriver/tests/interaction/element_clear.py:
255         * imported/w3c/webdriver/tests/sessions/status.py:
256         * imported/w3c/webdriver/tests/support/wait.py:
257
258 2017-12-01  Carlos Garcia Campos  <cgarcia@igalia.com>
259
260         WebDriver: auto-install pytest instead of importing it from wpt tools directory
261         https://bugs.webkit.org/show_bug.cgi?id=180243
262
263         Reviewed by Brian Burg.
264
265         * imported/selenium/py/conftest.py: Stop patching this to use yield_fixture, new pytest supports this.
266         * imported/selenium/py/setup.cfg: Stop patching this, since pytest supports tool:pytest as group name.
267         * imported/selenium/py/test/selenium/webdriver/common/alerts_tests.py: Stop patching this to use yield_fixture,
268         new pytest supports this.
269         * imported/selenium/py/test/selenium/webdriver/common/cookie_tests.py: Ditto.
270         * imported/selenium/py/test/selenium/webdriver/common/frame_switching_tests.py: Ditto.
271         * imported/selenium/py/test/selenium/webdriver/common/page_load_timeout_tests.py: Ditto.
272         * imported/selenium/py/test/selenium/webdriver/common/window_switching_tests.py: Ditto.
273         * imported/selenium/py/test/selenium/webdriver/safari/conftest.py: Ditto.
274         * imported/selenium/py/test/selenium/webdriver/support/event_firing_webdriver_tests.py: Ditto.
275         * imported/w3c/importer.json: Stop importing pytest.
276         * imported/w3c/pytest.ini: Added.
277         * imported/w3c/tools/pytest/: Removed.
278
279 2017-11-30  Carlos Garcia Campos  <cgarcia@igalia.com>
280
281         WebDriver: add support for importing and running selenium tests
282         https://bugs.webkit.org/show_bug.cgi?id=180145
283
284         Reviewed by Brian Burg.
285
286         * imported/selenium/importer.json: Added.
287         * imported/selenium/common/: Added.
288         * imported/selenium/py/: Added.
289
290 2017-11-28  Carlos Garcia Campos  <cgarcia@igalia.com>
291
292         Unreviewed. Update W3C WebDriver imported tests.
293
294         * imported/w3c/importer.json:
295         * imported/w3c/tools/webdriver/webdriver/client.py:
296         * imported/w3c/tools/webdriver/webdriver/error.py:
297         * imported/w3c/tools/wptrunner/docs/conf.py:
298         * imported/w3c/tools/wptrunner/wptrunner/browsers/ie.py:
299         * imported/w3c/tools/wptrunner/wptrunner/executors/base.py:
300         * imported/w3c/tools/wptrunner/wptrunner/executors/pytestrunner/runner.py:
301         * imported/w3c/tools/wptrunner/wptrunner/stability.py:
302         * imported/w3c/tools/wptrunner/wptrunner/testdriver-vendor.js: Added.
303         * imported/w3c/tools/wptrunner/wptrunner/update/sync.py:
304         * imported/w3c/tools/wptrunner/wptrunner/wptcommandline.py:
305         * imported/w3c/webdriver/interface/interface.html:
306         * imported/w3c/webdriver/tests/document_handling/page_source.py: Added.
307         * imported/w3c/webdriver/tests/element_click/bubbling.py: Added.
308         * imported/w3c/webdriver/tests/element_retrieval/get_active_element.py:
309         * imported/w3c/webdriver/tests/execute_async_script/user_prompts.py: Added.
310         * imported/w3c/webdriver/tests/execute_script/user_prompts.py: Added.
311         * imported/w3c/webdriver/tests/sessions/status.py: Added.
312         * imported/w3c/webdriver/tests/status.py: Removed.
313         * imported/w3c/webdriver/tests/support/fixtures.py:
314         * imported/w3c/webdriver/tests/support/wait.py:
315         * imported/w3c/webdriver/tests/user_prompts/accept_alert.py:
316         * imported/w3c/webdriver/tests/user_prompts/dismiss_alert.py:
317         * imported/w3c/webdriver/tests/user_prompts/get_alert_text.py:
318         * imported/w3c/webdriver/tests/user_prompts/send_alert_text.py:
319
320 2017-11-28  Carlos Garcia Campos  <cgarcia@igalia.com>
321
322         WebDriver: add timeout option to run-webdriver-tests script
323         https://bugs.webkit.org/show_bug.cgi?id=179940
324
325         Reviewed by Carlos Alberto Lopez Perez.
326
327         Add a base conftest.py to load pytest_timeout plugin.
328
329         * imported/w3c/conftest.py: Added.
330
331 2017-11-21  Carlos Garcia Campos  <cgarcia@igalia.com>
332
333         Unreviewed. Update W3C WebDriver imported tests.
334
335         * imported/w3c/importer.json:
336         * imported/w3c/tools/webdriver/webdriver/client.py:
337         * imported/w3c/tools/webdriver/webdriver/error.py:
338         * imported/w3c/tools/webdriver/webdriver/protocol.py: Added.
339         * imported/w3c/tools/webdriver/webdriver/transport.py:
340         * imported/w3c/tools/wptrunner/MANIFEST.in:
341         * imported/w3c/tools/wptrunner/requirements_firefox.txt:
342         * imported/w3c/tools/wptrunner/requirements_opera.txt: Added.
343         * imported/w3c/tools/wptrunner/wptrunner/browsers/__init__.py:
344         * imported/w3c/tools/wptrunner/wptrunner/browsers/edge.py:
345         * imported/w3c/tools/wptrunner/wptrunner/browsers/firefox.py:
346         * imported/w3c/tools/wptrunner/wptrunner/browsers/opera.py: Added.
347         * imported/w3c/tools/wptrunner/wptrunner/environment.py:
348         * imported/w3c/tools/wptrunner/wptrunner/executors/base.py:
349         * imported/w3c/tools/wptrunner/wptrunner/executors/executoredge.py: Added.
350         * imported/w3c/tools/wptrunner/wptrunner/executors/executormarionette.py:
351         * imported/w3c/tools/wptrunner/wptrunner/executors/executoropera.py: Added.
352         * imported/w3c/tools/wptrunner/wptrunner/executors/executorselenium.py:
353         * imported/w3c/tools/wptrunner/wptrunner/executors/pytestrunner/runner.py:
354         * imported/w3c/tools/wptrunner/wptrunner/executors/testharness_webdriver.js:
355         * imported/w3c/tools/wptrunner/wptrunner/executors/testharness_webdriver_resume.js: Added.
356         * imported/w3c/tools/wptrunner/wptrunner/stability.py: Added.
357         * imported/w3c/tools/wptrunner/wptrunner/testdriver-extra.js: Added.
358         * imported/w3c/tools/wptrunner/wptrunner/testloader.py:
359         * imported/w3c/tools/wptrunner/wptrunner/testrunner.py:
360         * imported/w3c/tools/wptrunner/wptrunner/update/state.py:
361         * imported/w3c/tools/wptrunner/wptrunner/update/sync.py:
362         * imported/w3c/tools/wptrunner/wptrunner/webdriver_server.py:
363         * imported/w3c/tools/wptrunner/wptrunner/wptcommandline.py:
364         * imported/w3c/tools/wptrunner/wptrunner/wptlogging.py:
365         * imported/w3c/tools/wptrunner/wptrunner/wptrunner.py:
366         * imported/w3c/tools/wptrunner/wptrunner/wpttest.py:
367         * imported/w3c/webdriver/tests/actions/conftest.py:
368         * imported/w3c/webdriver/tests/actions/key.py:
369         * imported/w3c/webdriver/tests/actions/key_shortcuts.py: Added.
370         * imported/w3c/webdriver/tests/actions/modifier_click.py: Added.
371         * imported/w3c/webdriver/tests/actions/mouse.py:
372         * imported/w3c/webdriver/tests/actions/sequence.py:
373         * imported/w3c/webdriver/tests/actions/special_keys.py:
374         * imported/w3c/webdriver/tests/actions/support/keys.py:
375         * imported/w3c/webdriver/tests/actions/support/test_actions_wdspec.html:
376         * imported/w3c/webdriver/tests/cookies/add_cookie.py:
377         * imported/w3c/webdriver/tests/cookies/get_named_cookie.py:
378         * imported/w3c/webdriver/tests/element_click/stale.py: Added.
379         * imported/w3c/webdriver/tests/element_retrieval/get_active_element.py:
380         * imported/w3c/webdriver/tests/interaction/element_clear.py: Added.
381         * imported/w3c/webdriver/tests/navigation/get_title.py:
382         * imported/w3c/webdriver/tests/retrieval/find_element.py:
383         * imported/w3c/webdriver/tests/retrieval/find_element_from_element.py:
384         * imported/w3c/webdriver/tests/retrieval/find_element_from_elements.py:
385         * imported/w3c/webdriver/tests/retrieval/find_elements.py:
386         * imported/w3c/webdriver/tests/sessions/new_session/support/__init__.py:
387         * imported/w3c/webdriver/tests/state/get_element_attribute.py:
388         * imported/w3c/webdriver/tests/state/get_element_property.py:
389         * imported/w3c/webdriver/tests/state/get_element_tag_name.py:
390         * imported/w3c/webdriver/tests/state/is_element_selected.py:
391         * imported/w3c/webdriver/tests/support/asserts.py:
392         * imported/w3c/webdriver/tests/user_prompts/send_alert_text.py: Added.
393
394 2017-09-21  Carlos Garcia Campos  <cgarcia@igalia.com>
395
396         WebDriver: Add support to import and run W3C tests
397         https://bugs.webkit.org/show_bug.cgi?id=177304
398
399         Reviewed by Brian Burg.
400
401         Add json file used by the importer and the result of running the importer.
402
403         * imported/w3c/importer.json: Added.
404         * imported/w3c/tools/pytest/: Added.
405         * imported/w3c/tools/webdriver/: Added.
406         * imported/w3c/tools/wptrunner/: Added.
407         * imported/w3c/webdriver/: Added.