Update TestExpectations for fast/forms/textarea/textarea-state-restore.html
[WebKit-https.git] / LayoutTests / platform / wk2 / TestExpectations
1 #
2 # Copyright (C) 2010 Apple Inc. All rights reserved.
3 #
4 # Redistribution and use in source and binary forms, with or without
5 # modification, are permitted provided that the following conditions
6 # are met:
7 #
8 # 1.  Redistributions of source code must retain the above copyright
9 #     notice, this list of conditions and the following disclaimer.
10 # 2.  Redistributions in binary form must reproduce the above copyright
11 #     notice, this list of conditions and the following disclaimer in the
12 #     documentation and/or other materials provided with the distribution.
13 # 3.  Neither the name of Apple Inc. ("Apple") nor the names of
14 #     its contributors may be used to endorse or promote products derived
15 #     from this software without specific prior written permission.
16 #
17 # THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND ANY
18 # EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
19 # WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
20 # DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS CONTRIBUTORS BE LIABLE FOR ANY
21 # DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
22 # (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
23 # LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
24 # ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
25 # (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF
26 # THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
27 #
28
29 # This file should contain entries for expectations that are generic
30 # to any port running the WebKit2 variant (--webkit-test-runner)
31
32 ###### This file has four sections. When adding new tests, make sure to
33 ###### add to the right section:
34
35 ### (1) Classified failures with bug reports
36 ### (2) Classified failures without bug reports (yet)
37 ### (3) Unclassified failures
38 ### (4) Features that are not supported in WebKit2 and likely never will be
39 ### (5) Progressions, expected successes that are expected failures in WebKit1.
40
41
42 ########################################
43 ### START OF (1) Classified failures with bug reports
44
45 webkit.org/b/156612 http/tests/security/contentSecurityPolicy/embed-redirect-blocked3.html [ Failure ]
46 webkit.org/b/156612 http/tests/security/contentSecurityPolicy/object-redirect-blocked3.html [ Failure ]
47
48 # AX tests that require hit testing do not work in WK2.
49 webkit.org/b/71298 accessibility/loading-iframe-updates-axtree.html
50
51 # This test has been skipped for a long time. Temporarily marking as flaky to see what bots think.
52 webkit.org/b/48354 compositing/iframes/iframe-src-change.html [ Pass Failure ]
53
54 # This test has been skipped for a long time. Temporarily marking as flaky to see what bots think.
55 webkit.org/b/58183 editing/execCommand/convert-style-elements-to-spans.html [ Pass Failure ]
56
57 # This test has been skipped for a long time. Temporarily marking as flaky to see what bots think.
58 webkit.org/b/60648 fast/frames/flattening/frameset-flattening-subframesets.html [ Pass Failure ]
59
60 # WebKitTestRunner needs overridePreference for non-boolean values
61 # (zero-font-size.html passes because overridePreference does not work)
62 webkit.org/b/42197 fast/harness/override-preferences-2.html [ Failure ]
63 webkit.org/b/42197 fast/text/zero-font-size.html [ Pass ]
64
65 webkit.org/b/82665 http/tests/webarchive/test-css-url-encoding.html [ Skip ]
66 webkit.org/b/82665 http/tests/webarchive/test-css-url-encoding-shift-jis.html [ Skip ]
67 webkit.org/b/82665 http/tests/webarchive/test-css-url-encoding-utf-8.html [ Skip ]
68 webkit.org/b/82665 webarchive/test-css-url-resources-in-stylesheets.html [ Skip ]
69 webkit.org/b/82665 webarchive/test-css-url-resources-inline-styles.html [ Skip ]
70
71 # WebKitTestRunner needs textInputController
72 # <https://bugs.webkit.org/show_bug.cgi?id=42337>
73 editing/input/setting-input-value-cancel-ime-composition.html
74 svg/text/caret-in-svg-text.xhtml
75 editing/inserting/caret-position.html
76 editing/selection/5825350-1.html
77 editing/selection/5825350-2.html
78 editing/selection/move-left-right.html
79 editing/style/text-indent.html
80 fast/dom/tab-in-right-alignment.html
81 fast/events/ime-composition-events-001.html
82 fast/forms/cursor-at-editable-content-boundary.html
83 fast/text/international/thai-cursor-position.html
84 platform/mac/fast/dom/character-index-for-point.html
85 platform/mac/fast/text/attributed-substring-from-range-001.html
86 platform/mac/fast/text/attributed-substring-from-range-002.html
87 platform/mac/fast/text/attributed-substring-from-range-in-textfield.html
88 platform/mac/fast/text/attributed-substring-from-range.html
89 platform/mac/fast/text/justified-text-rect.html
90
91 # WebKitTestRunner needs testRunner.setMainFrameIsFirstResponder
92 # <https://bugs.webkit.org/show_bug.cgi?id=42685>
93 editing/selection/caret-and-focus-ring.html
94 editing/selection/designmode-no-caret.html
95 editing/selection/selection-background.html
96 fast/dom/Window/window-onFocus.html
97 platform/mac/scrollbars/key-window-not-first-responder.html
98
99 # WebKitTestRunner needs testRunner.encodeHostName
100 # <https://bugs.webkit.org/show_bug.cgi?id=42686>
101 fast/encoding/idn-security.html
102
103 # WebKitTestRunner needs testRunner.abortModal
104 # <https://bugs.webkit.org/show_bug.cgi?id=69548>
105 fast/events/show-modal-dialog-onblur-onfocus.html
106 fast/events/beforeunload-showModalDialog.html
107 fast/events/pagehide-showModalDialog.html
108 fast/events/unload-showModalDialog.html
109
110 # WebKitTestRunner needs testRunner.setWillSendRequestClearHeader
111 # <https://bugs.webkit.org/show_bug.cgi?id=42699>
112 http/tests/security/no-referrer.html
113
114 # WebKitTestRunner needs testRunner.setDomainRelaxationForbiddenForURLScheme
115 # <https://bugs.webkit.org/show_bug.cgi?id=42700>
116 http/tests/security/setDomainRelaxationForbiddenForURLScheme.html
117
118 # WebKitTestRunner needs testRunner.removeAllVisitedLinks
119 http/tests/globalhistory/history-delegate-basic-visited-links.html
120
121 # WebKit2 passes the wrong source URL for client redirects
122 http/tests/globalhistory/history-delegate-basic-refresh-redirect.html
123
124 # transitions/default-timing-function.html failing on WebKit2 since it was added
125 # <https://bugs.webkit.org/show_bug.cgi?id=56531>
126 transitions/default-timing-function.html
127
128 # Sometimes fails
129 # http://webkit.org/b/58990
130 editing/undo/undo-iframe-location-change.html
131
132 # PasteBoard::plainText() does not support file names.
133 editing/pasteboard/drag-files-to-editable-element-as-attachment.html [ Skip ]
134 editing/pasteboard/drag-files-to-editable-element-as-URLs.html [ Skip ]
135
136 # Times out
137 # https://bugs.webkit.org/show_bug.cgi?id=63806
138 http/tests/cache/history-only-cached-subresource-loads-max-age-https.html
139
140 # Frame::findString does nothing on pages that prevent selection
141 # https://bugs.webkit.org/show_bug.cgi?id=40361
142 editing/text-iterator/findString-selection-disabled.html
143
144 # testRunner.setWindowIsKey() has no effect on the web process side in WebKit2
145 # https://bugs.webkit.org/show_bug.cgi?id=81736 rdar://problem/11088268
146 fast/events/blur-focus-window-should-blur-focus-element.html
147 fast/selectors/querySelector-window-inactive.html
148 fast/selectors/selection-window-inactive.html
149 fast/dom/Window/window-focus-self.html
150 scrollbars/corner-resizer-window-inactive.html
151
152 # WebKitTestRunner needs to implement testRunner.closeIdleLocalStorageDatabases().
153 # https://bugs.webkit.org/show_bug.cgi?id=103861
154 storage/domstorage/localstorage/close-idle-localstorage-databases-immediately.html
155
156 # WKTR needs a implementation of setStorageDatabaseIdleInterval
157 # https://bugs.webkit.org/show_bug.cgi?id=91778
158 storage/domstorage/storage-close-database-on-idle.html
159
160 # [WK2] The new npruntime/embed-property-iframe-equality.html fails
161 # https://bugs.webkit.org/show_bug.cgi?id=105266
162 plugins/npruntime/embed-property-iframe-equality.html
163
164 webkit.org/b/105952 fast/loader/submit-form-while-parsing-2.html [ Pass Failure ]
165
166 webkit.org/b/127683 http/tests/navigation/new-window-redirect-history.html [ Skip ]
167
168 # Causes next test to crash only on WebKit2
169 webkit.org/b/98345 fast/parser/document-open-in-unload.html [ Skip ]
170
171 webkit.org/b/141122 editing/selection/programmatic-selection-on-mac-is-directionless.html [ Pass Failure ]
172
173 webkit.org/b/149087 http/tests/cache/disk-cache/disk-cache-cancel.html [ Pass Failure ]
174
175 http/tests/appcache/decide-navigation-policy-after-delay.html [ Pass ]
176
177 # DatabaseProcess cannot open some of these database filenames (DRT can open the exact same database filenames)
178 webkit.org/b/154681 storage/indexeddb/database-odd-names.html
179 webkit.org/b/154681 storage/indexeddb/odd-strings.html
180
181 # WKTR does not support overriding WebKitUsesPageCachePreferenceKey.
182 # https://bugs.webkit.org/show_bug.cgi?id=114153
183 fast/harness/use-page-cache.html
184
185 # eventSender.dragMode is unimplemented in WKTR
186 # Mac: https://bugs.webkit.org/show_bug.cgi?id=68552
187 fast/events/controlclick-no-onclick.html
188 fast/events/moving-text-should-fire-drop-and-dragend-events.html
189 fast/events/moving-text-should-fire-drop-and-dragend-events-2.html
190 fast/events/ondrop-text-html.html
191 editing/pasteboard/drag-drop-url-with-style.html
192
193 # WTR needs an implementation for eventSender.continuousMouseScrollBy
194 # https://bugs.webkit.org/show_bug.cgi?id=69417
195 fast/events/wheelevent-direction-inverted-from-device.html
196
197 # This should only be a layer change.
198 # http://webkit.org/b/82129
199 fast/box-shadow/shadow-buffer-partial.html
200 fast/block/lineboxcontain/block-font.html
201 fast/block/lineboxcontain/block-glyphs.html
202 fast/block/lineboxcontain/font.html
203
204 # https://bugs.webkit.org/show_bug.cgi?id=115203
205 # Downloaded file name tests fail because of incorrect custom policy delegate implementation
206 http/tests/download/default-encoding.html
207 http/tests/download/inherited-encoding-form-submission-result.html
208 http/tests/download/inherited-encoding.html
209
210 ### END OF (1) Classified failures with bug reports
211 ########################################
212
213
214 ########################################
215 ### START OF (2) Classified failures without bug reports (yet)
216
217 # WebKitTestRunner needs testRunner.shouldPaintBrokenImage
218 fast/images/support-broken-image-delegate.html
219
220 # WebKitTestRunner needs testRunner.dumpSourceAsWebArchive
221 webarchive/doctype.html
222 webarchive/archive-empty-frame-source.html
223
224 # WebKitTestRunner needs testRunner.setIconDatabaseEnabled
225 webkit.org/b/115809 webarchive/test-link-rel-icon.html
226 webkit.org/b/115809 http/tests/misc/favicon-loads-with-images-disabled.html
227 webkit.org/b/115809 http/tests/misc/favicon-loads-with-icon-loading-override.html
228 webkit.org/b/115809 http/tests/misc/link-rel-icon-beforeload.html
229 webkit.org/b/115809 http/tests/security/contentSecurityPolicy/allow-favicon.html
230 webkit.org/b/115809 http/tests/security/contentSecurityPolicy/block-favicon.html
231
232 # WebKitTestRunner should dump text/plain content as text
233 http/tests/incremental/slow-utf8-text.pl
234
235 # WebKitTestRunner needs plainText.plainText
236 editing/text-iterator/basic-iteration.html
237
238 # WebKitTestRunner needs testRunner.setNewWindowsCopyBackForwardList
239 fast/loader/crash-copying-backforwardlist.html
240
241 # WebKitTestRunner needs testRunner.authenticateSession
242 http/tests/xmlhttprequest/cross-origin-authorization-with-embedder.html
243
244 # WebKitTestRunner needs testRunner.addDisallowedURL
245 plugins/get-url-that-the-resource-load-delegate-will-disallow.html
246
247 # WebKitTestRunner needs testRunner.pageProperty
248 printing/page-rule-selection.html
249
250 # WebKitTestRunner needs testRunner.dumpUserGestureInFrameLoadCallbacks
251 fast/frames/location-redirect-user-gesture.html
252 fast/frames/meta-refresh-user-gesture.html
253
254 # WebKitTestRunner needs testRunner.addURLToRedirect
255 http/tests/loading/cross-origin-XHR-willLoadRequest.html
256
257 # WebKit2 needs showModalDialog
258 fast/events/scroll-event-during-modal-dialog.html
259 fast/harness/show-modal-dialog.html
260
261 # WebKit2 needs to support synchronous creation of about:blank/data:url frames
262 fast/dom/HTMLDocument/hasFocus.html
263 fast/frames/sandboxed-iframe-navigation-targetlink.html
264 fast/loader/about-blank-hash-kept.html
265 http/tests/security/cross-frame-access-get-override.html
266 http/tests/security/cross-frame-access-history-get-override.html
267 http/tests/security/cross-frame-access-location-get-override.html
268 http/tests/security/javascriptURL/xss-ALLOWED-to-javascript-url-sub-frame-2-level.html
269
270 # These tests use Flash, which is not a good idea, because it is not installed on all machines that run tests.
271 # WebKitTestRunner detects attempts to use Flash, and raises an assertion.
272 fast/dom/beforeload/flash-before-load.html [ Skip ]
273 fast/dom/beforeload/remove-flash-in-beforeload-listener.html [ Skip ]
274 fast/loader/sandboxed-plugin-crash.html [ Skip ]
275 plugins/hidden-iframe-with-swf-plugin.html [ Skip ]
276 plugins/plugin-document-load-prevented-userscript.html [ Skip ]
277 plugins/plugin-document-willSendRequest-null.html [ Skip ]
278 plugins/plugin-remove-readystatechange.html [ Skip ]
279
280 # This test checks that NPN_GetURL with a blank target will return an error if the window isn't opened. This behavior doesn't
281 # match Firefox or Chrome. We should either fix the test, or get rid of it. This test also depends on implementing
282 # testRunner::setCanOpenWindows() such that opening windows are forbidden by default.
283 plugins/get-url-with-blank-target.html
284
285 # requires video.buffered to be able to return multiple timeranges
286 http/tests/media/video-buffered.html
287
288 # WebKit2 needs Java support
289 dom/html/level2/html/HTMLAppletElement01.html
290 dom/html/level2/html/HTMLAppletElement02.html
291 dom/html/level2/html/HTMLAppletElement03.html
292 dom/html/level2/html/HTMLAppletElement04.html
293 dom/html/level2/html/HTMLAppletElement06.html
294 dom/html/level2/html/HTMLAppletElement07.html
295 dom/html/level2/html/HTMLAppletElement08.html
296 dom/html/level2/html/HTMLAppletElement09.html
297 dom/html/level2/html/HTMLAppletElement10.html
298 dom/xhtml/level2/html/HTMLAppletElement01.xhtml
299 dom/xhtml/level2/html/HTMLAppletElement02.xhtml
300 dom/xhtml/level2/html/HTMLAppletElement03.xhtml
301 dom/xhtml/level2/html/HTMLAppletElement04.xhtml
302 dom/xhtml/level2/html/HTMLAppletElement06.xhtml
303 dom/xhtml/level2/html/HTMLAppletElement07.xhtml
304 dom/xhtml/level2/html/HTMLAppletElement08.xhtml
305 dom/xhtml/level2/html/HTMLAppletElement09.xhtml
306 dom/xhtml/level2/html/HTMLAppletElement10.xhtml
307 editing/selection/selection-applet.html
308 fast/replaced/applet-disabled-positioned.html
309 fast/replaced/applet-rendering-java-disabled.html
310
311 # WebKitTestRunner needs testRunner.displayInvalidatedRegion
312 compositing/plugins/invalidate_rect.html
313 plugins/windowless_plugin_paint_test.html
314
315 # eventSender.clearKillRing() is unimplemented
316 editing/pasteboard/emacs-cntl-y-001.html
317
318 # No CORS support for media elements is implemented yet.
319 http/tests/security/canvas-remote-read-remote-video-allowed-anonymous.html [ Failure ]
320 http/tests/security/canvas-remote-read-remote-video-allowed-with-credentials.html [ Failure ]
321 http/tests/security/video-cross-origin-readback.html
322
323 # Unexpected redirection happens.
324 http/tests/loading/redirect-methods.html
325
326 # Should pass now on ports other than EFL and GTK.
327 # But it needs to be checked first.
328 http/tests/loading/bad-scheme-subframe.html
329
330 # Some elements are skipped when focus is moved.
331 fast/spatial-navigation/snav-container-white-space.html
332 fast/spatial-navigation/snav-div-overflow-scrol-hidden.html
333 fast/spatial-navigation/snav-fully-aligned-horizontally.html
334 fast/spatial-navigation/snav-fully-aligned-vertically.html
335 fast/spatial-navigation/snav-iframe-no-scrollable-content.html
336 fast/spatial-navigation/snav-imagemap-overlapped-areas.html
337
338 # WebFrameLoaderClient::canHandleRequest() has to be implemented.
339 http/tests/misc/redirect-to-external-url.html
340
341 # testRunner.queueLoad should consider given target.
342 fast/frames/frame-navigation.html
343 http/tests/navigation/anchor-subframeload.html
344 http/tests/navigation/error404-subframeload.html
345 http/tests/navigation/javascriptlink-subframeload.html
346 http/tests/navigation/metaredirect-subframeload.html
347 http/tests/navigation/redirect302-subframeload.html
348 http/tests/navigation/response204.html
349 http/tests/navigation/success200-subframeload.html
350 http/tests/navigation/timerredirect-subframeload.html
351
352 # Unexpected output from scrolling. Might be EFL port specific issue.
353 http/tests/navigation/relativeanchor-frames.html
354
355 # Scrollbars appear, even though they should not.
356 fast/dynamic/window-resize-scrollbars-test.html [ Failure ]
357
358 # Machinery for updating view size has a race condition, a problem when moving between
359 # SVG tests that have a special view size and all the other tests that use a 800x600 view.
360 # This test is not the cause of the problem, just the one that happens to currently be the victim.
361 svg/filters/filter-hidden-content.svg [ Pass Failure ]
362
363 # No good way to test private browsing in WKTR right now
364 http/tests/security/private-browsing-http-auth.html
365
366 ### END OF (2) Classified failures without bug reports (yet)
367 ########################################
368
369
370 ########################################
371 ### START OF (3) Unclassified failures
372
373 # Uncategorized editing failures
374 editing/execCommand/find-after-replace.html
375 editing/inserting/break-blockquote-after-delete.html
376 editing/inserting/insert-3786362-fix.html
377 editing/inserting/insert-3907422-fix.html
378 editing/style/non-inheritable-styles.html
379 editing/style/smoosh-styles-001.html
380 editing/style/smoosh-styles-003.html
381 editing/style/style-boundary-005.html
382
383 # Unexplained failures that were formerly in the setCanOpenWindows or setCloseRemainingWindowsWhenComplete lists.
384 fast/dom/Window/new-window-opener.html
385 http/tests/misc/set-window-opener-to-null.html
386 http/tests/misc/window-open-then-write.html
387 http/tests/navigation/target-frame-from-window.html
388 http/tests/security/aboutBlank/xss-DENIED-navigate-opener-document-write.html
389 http/tests/security/aboutBlank/xss-DENIED-navigate-opener-javascript-url.html
390 http/tests/security/aboutBlank/xss-DENIED-set-opener.html
391 http/tests/security/dataURL/xss-DENIED-from-data-url-in-foreign-domain-window-open.html
392 http/tests/security/dataURL/xss-DENIED-from-javascript-url-window-open.html
393 http/tests/security/dataURL/xss-DENIED-to-data-url-in-foreign-domain-window-open.html
394 http/tests/security/dataURL/xss-DENIED-to-data-url-window-open.html
395 http/tests/security/frameNavigation/xss-DENIED-plugin-navigation.html
396 http/tests/security/frameNavigation/xss-DENIED-targeted-link-navigation.html
397 http/tests/security/javascriptURL/xss-ALLOWED-to-javascript-url-window-open.html
398 http/tests/security/javascriptURL/xss-DENIED-from-javascript-url-in-foreign-domain-window-open.html
399 http/tests/security/javascriptURL/xss-DENIED-to-javascript-url-in-foreign-domain-window-open.html
400
401 # Unexplained failures that were formerly in the "unsafe access" list.
402 http/tests/security/cross-frame-access-enumeration.html
403 http/tests/security/cross-frame-access-get-custom-property-cached.html
404 http/tests/security/cross-frame-access-get.html
405 http/tests/security/cross-frame-access-getOwnPropertyDescriptor.html
406 http/tests/security/cross-frame-access-history-get.html
407 http/tests/security/cross-frame-access-location-get.html
408 http/tests/security/cross-frame-access-protocol-explicit-domain.html
409 http/tests/security/cross-frame-access-protocol.html
410
411 # Flaky tests (slow)
412 http/tests/cache/subresource-expiration-1.html
413 http/tests/cache/subresource-expiration-2.html
414
415 # Unexplained failures
416 fast/frames/sandboxed-iframe-plugins.html
417 fast/frames/sandboxed-iframe-storage.html
418 fast/overflow/overflow_hidden.html
419 media/controls-after-reload.html
420 media/controls-styling.html
421 platform/mac/fast/loader/non-html-load-event.html
422 plugins/embed-attributes-style.html
423 plugins/plugin-initiate-popup-window.html
424 storage/websql/open-database-while-transaction-in-progress.html
425 svg/hixie/cascade/002.xml
426 transitions/font-family-during-transition.html
427
428 # [WK2] http/tests/navigation/anchor-frames-cross-origin.html fails.
429 # https://bugs.webkit.org/show_bug.cgi?id=83581
430 http/tests/navigation/anchor-frames-cross-origin.html
431
432 # [WK2] http/tests/navigation/anchor-frames-same-origin.html fails.
433 # https://bugs.webkit.org/show_bug.cgi?id=84227
434 http/tests/navigation/anchor-frames-same-origin.html
435
436 # Unexplained plugin failures
437 platform/mac/plugins/testplugin-onnew-onpaint.html
438
439 # Unexplained plugin failures that were formerly in the NPRuntime support for out-of-process plug-ins
440 # list.
441 plugins/netscape-plugin-setwindow-size.html
442 plugins/npruntime/plugin-scriptable-object-invoke-default.html
443 plugins/pass-different-npp-struct.html
444 plugins/reentrant-update-widget-positions.html
445 plugins/set-status.html
446
447 # Causes subsequent plugin tests to fail, time out or crash
448 plugins/destroy-on-setwindow.html
449
450 # Sporadically fails in WebKit2 for unknown reasons.
451 fast/forms/input-align.html
452
453 # New history tests added in r76205 fail on WebKit2 (perhaps the change
454 # as coded doesn't affect both processes for WebKit2)
455 fast/history/history-replace-updates-current-item.html
456 http/tests/navigation/redirect-on-back-updates-history-item.html
457 http/tests/navigation/redirect-on-reload-updates-history-item.html
458
459 # Newly added test fails in WebKit2 for mysterious reasons
460 webkit.org/b/158703 userscripts/window-onerror-for-isolated-world-1.html [ Skip ]
461 webkit.org/b/158703 userscripts/window-onerror-for-isolated-world-2.html [ Skip ]
462 webkit.org/b/158703 userscripts/window-onerror-for-isolated-world-3.html [ Skip ]
463
464 # These transition tests are flaky, sometimes it seems like the transition timing
465 # is off when the test completes
466 transitions/color-transition-all.html
467 transitions/min-max-width-height-transitions.html
468 transitions/text-indent-transition.html
469
470 # These storage tests fail in WebKit2 on the bot, but not running locally
471 storage/websql/multiple-databases-garbage-collection.html
472
473 # Mysterious failure after enabling paste tests
474 editing/mac/pasteboard/text-precomposed.html
475
476 # [WK2] http/tests/security/local-image-from-remote-whitelisted.html crashes
477 # https://bugs.webkit.org/show_bug.cgi?id=73435
478 http/tests/security/local-image-from-remote-whitelisted.html
479
480 # Editing input tests that time out unexpectedly.
481 # https://bugs.webkit.org/show_bug.cgi?id=81547
482 editing/input/reveal-edit-on-input-vertically.html
483 editing/input/reveal-contenteditable-on-input-vertically.html
484
485 # Times out unexpectedly.
486 # https://bugs.webkit.org/show_bug.cgi?id=81609
487 fast/loader/window-properties-restored-from-page-cache.html
488
489 # Flakey on Lion WK2 debug.
490 # https://bugs.webkit.org/show_bug.cgi?id=81616
491 fast/harness/page-cache-crash-on-data-urls.html
492
493 # Wrong logging order
494 fast/loader/file-protocol-fragment.html
495 http/tests/loading/pdf-commit-load-callbacks.html
496
497 # Times out unexpectedly.
498 http/tests/security/feed-urls-from-remote.html
499
500 # First two lines are reversed when test is flaky.
501 fast/preloader/document-write-2.html [ Pass Failure ]
502
503 ### END OF (3) Unclassified failures
504 ########################################
505
506 ########################################
507 ### START OF (4) Features that are not supported in WebKit2 and likely never will be
508
509 # Plug-ins are disallowed from evaluating JavaScript from NPP_Destroy().
510 plugins/attach-during-destroy.html [ WontFix ]
511 plugins/destroy-reentry.html [ WontFix ]
512 plugins/document-open.html [ WontFix ]
513 webkit.org/b/48929 plugins/evaluate-js-after-removing-plugin-element.html [ WontFix ]
514 plugins/geturlnotify-during-document-teardown.html [ WontFix ]
515 plugins/js-from-destroy.html [ WontFix ]
516 plugins/nested-plugin-objects.html [ WontFix ]
517 plugins/netscape-destroy-plugin-script-objects.html [ WontFix ]
518 plugins/open-and-close-window-with-plugin.html [ WontFix ]
519
520 # Internals.registerDefaultPortForProtocol() does not affect NetworkProcess. We should
521 # look to remove it and write these test to make use of an HTTP server running on port 80.
522 http/tests/security/contentSecurityPolicy/script-src-parsing-implicit-and-explicit-port-number.html
523 http/tests/security/http-0.9/default-port-plugin-blocked.html
524 http/tests/security/http-0.9/default-port-script-blocked.html
525 http/tests/security/http-0.9/image-default-port-allowed.html
526 http/tests/security/http-0.9/image-on-HTTP-0.9-default-port-page-allowed-ref-test.html
527 http/tests/security/http-0.9/image-on-HTTP-0.9-default-port-page-allowed.html
528 http/tests/security/http-0.9/image-on-HTTP-0.9-page-blocked.html
529 http/tests/security/http-0.9/sandbox-should-not-persist-on-navigation.html
530
531 # WebKitTestRunner doesn't have appleScriptController
532 platform/mac/fast/AppleScript/001.html
533 platform/mac/fast/AppleScript/array.html
534 platform/mac/fast/AppleScript/date.html
535
536 # WebKitTestRunner doesn't have objCController
537 platform/mac/fast/dom/objc-wrapper-identity.html
538 platform/mac/fast/dom/wrapper-classes-objc.html
539 platform/mac/fast/dom/wrapper-round-tripping.html
540 platform/mac/fast/objc/dom-html-select-activate.html
541 platform/mac/fast/objc/dom-html-select-live-pseudo-selectors.html
542 platform/mac/fast/objc/longlongTest.html
543 platform/mac/fast/objc/webScriptObject-hasWebScriptKey.html
544 platform/mac/fast/objc/webScriptObject-does-not-call-description-on-nsobject.html
545 platform/mac/plugins/bindings-array-apply-crash.html
546 platform/mac/plugins/bindings-objc-long-method-name.html
547 platform/mac/plugins/bindings-objc-method-name-conversion.html
548 platform/mac/plugins/bindings-test-objc.html
549 platform/mac/plugins/call-as-function-test.html
550 platform/mac/plugins/root-object-premature-delete-crash.html
551 platform/mac/plugins/undefined-property-crash.html
552 platform/mac/plugins/webScriptObject-exception-deadlock.html
553
554 # WebKitTestRunner doesn't have objCPlugin
555 editing/mac/pasteboard/5583362.html [ Skip ]
556 platform/mac/plugins/jsobjc-dom-wrappers.html
557 platform/mac/plugins/jsobjc-simple.html
558 platform/mac/plugins/throw-on-dealloc.html
559
560 # WebKitTestRunner doesn't have objCPlugin
561 # (but these tests sound like things we may want to test another way)
562 editing/pasteboard/paste-RTFD.html
563 editing/pasteboard/paste-TIFF.html
564
565 # WebKitTestRunner doesn't have eventSender.enableDOMUIEventLogging
566 platform/mac/fast/events/objc-event-api.html
567
568 # WebKitTestRunner needs an implementation of eventSender.beginDragWithFiles
569 # https://bugs.webkit.org/show_bug.cgi?id=64285
570 editing/pasteboard/datatransfer-items-drop-plaintext-file.html
571 editing/pasteboard/datatransfer-types-dropping-text-file.html
572 editing/pasteboard/entries-api
573 editing/pasteboard/file-drag-to-editable.html [ Skip ]
574 editing/pasteboard/file-input-files-access.html
575 fast/dom/FileList-iterator.html
576 fast/dom/Window/window-postmessage-clone-frames.html
577 fast/dom/Window/window-postmessage-clone.html
578 fast/events/data-transfer-files-attribute-identity.html
579 fast/events/drag-file-crash.html
580 fast/events/drag-to-navigate.html
581 fast/events/drop-handler-should-not-stop-navigate.html
582 fast/events/drop-with-file-paths.html
583 fast/events/dropzone-004.html
584 fast/events/file-input-hidden-in-ondrop.html
585 fast/events/input-element-display-none-in-dragleave-crash.html
586 fast/events/only-valid-drop-targets-receive-file-drop.html
587 fast/events/prevent-drag-to-navigate.html
588 fast/files/apply-blob-url-to-img.html
589 fast/files/apply-blob-url-to-xhr.html
590 fast/files/file-list-test.html
591 fast/files/file-reader-abort.html
592 fast/files/file-reader-directory-crash.html
593 fast/files/file-reader-event-listener.html
594 fast/files/filereader-zip-bundle.html
595 fast/files/local-file-drag-security.html
596 fast/files/null-origin-string.html
597 fast/files/read-blob-async.html
598 fast/files/read-file-async.html
599 fast/files/workers/worker-apply-blob-url-to-xhr.html
600 fast/files/workers/worker-read-blob-async.html
601 fast/files/workers/worker-read-blob-sync.html
602 fast/files/workers/worker-read-file-async.html
603 fast/files/workers/worker-read-file-sync.html
604 fast/forms/file/entries-api/drag-folder-webkitEntries.html
605 fast/forms/file/entries-api/webkitdirectory-drag-folder.html
606 fast/forms/file/entries-api/webkitdirectory-drag-folder-webkitEntries.html
607 fast/forms/file/file-input-change-event.html
608 fast/forms/file/file-input-reset.html
609 fast/forms/file/get-file-upload.html
610 fast/forms/file/input-file-re-render.html
611 fast/forms/file/input-file-value.html
612 fast/forms/file/input-file-write-files.html
613 fast/forms/file/recover-file-input-in-unposted-form.html
614 fast/forms/file/selected-files-from-history-state.html
615 fast/history/page-cache-createObjectURL.html
616 fast/workers/worker-copy-shared-blob-url.html
617 http/tests/local/blob/send-hybrid-blob.html
618 http/tests/local/fileapi/file-last-modified-after-delete.html
619 http/tests/local/fileapi/file-last-modified.html
620 http/tests/local/fileapi/send-dragged-file.html
621 http/tests/local/fileapi/send-sliced-dragged-file.html
622 http/tests/local/fileapi/upload-zip-bundle-as-blob.html
623 http/tests/local/formdata/form-data-with-unknown-file-extension.html
624 http/tests/local/formdata/send-form-data-constructed-from-form.html
625 http/tests/local/formdata/send-form-data-with-filename.html
626 http/tests/local/formdata/send-form-data-with-sliced-file.html
627 http/tests/local/formdata/send-form-data.html
628 http/tests/local/formdata/send-form-data-with-empty-file-filename.html
629 http/tests/local/formdata/upload-events.html
630 http/tests/security/clipboard/clipboard-file-access.html
631 imported/blink/storage/indexeddb/blob-basics-metadata.html
632 imported/blink/storage/indexeddb/empty-blob-file.html
633 media/video-src-blob.html
634 security/contentSecurityPolicy/image-with-blob-url-allowed-by-img-src-star-with-AllowContentSecurityPolicySourceStarToMatchAnyProtocol-enabled.html
635 security/contentSecurityPolicy/image-with-blob-url-blocked-by-img-src-star.html
636 security/contentSecurityPolicy/video-with-blob-url-allowed-by-media-src-star.html
637 storage/indexeddb/structured-clone.html
638 storage/indexeddb/structured-clone-private.html
639
640 # WebKitTestRunner doesn't have eventSender.fireKeyboardEventsToElement
641 platform/mac/fast/events/objc-keyboard-event-creation.html
642
643 # WebKit2 does not (should not?) support setting WebKitUsePreHTML5ParserQuirks
644 # in its WebPreferences implementation.
645 fast/parser/pre-html5-parser-quirks.html
646
647 # [WK2] New fast/events/drag-display-none-element.html fails
648 # https://bugs.webkit.org/show_bug.cgi?id=90177
649 fast/events/drag-display-none-element.html
650
651 # Skip tests in fast/text/shaping
652 fast/text/shaping
653
654 # WebKitTestRunner testRunner.setPrivateBrowsingEnabled doesn't work with NetworkProcess.
655 # We explicitly Skip the following tests instead of marking them as Failure because some of these tests will naturally pass
656 # as a consequence of testRunner.setPrivateBrowsingEnabled() effectively being a no-op as of the time of writing (07/08/2015).
657 webkit.org/b/115274 http/tests/security/contentSecurityPolicy/report-cross-origin-no-cookies-when-private-browsing-enabled.php [ Skip ]
658 webkit.org/b/115274 http/tests/security/contentSecurityPolicy/report-cross-origin-no-cookies-when-private-browsing-toggled.php [ Skip ]
659 webkit.org/b/115274 http/tests/security/contentSecurityPolicy/report-same-origin-no-cookies-when-private-browsing-toggled.php [ Skip ]
660 webkit.org/b/115274 http/tests/security/contentSecurityPolicy/report-same-origin-with-cookies-when-private-browsing-enabled.php [ Skip ]
661
662 ### END OF (4) Features that are not supported in WebKit2 and likely never will be
663 ########################################
664
665 ########################################
666 ### START OF (5) Progressions, expected successes that are expected failures in WebKit1.
667
668 # DumpRenderTree does not allow GIFs to animate, thus animated GIF tests don't work in WebKit1.
669 fast/images/animated-gif-no-layout.html [ Pass ]
670 fast/images/gif-loop-count.html [ Pass ]
671
672 # DumpRenderTree does not implement setWillSendRequestHTTPBody
673 http/tests/misc/will-send-request-with-client-provided-http-body.html [ Pass ]
674
675 # bug 162281
676 imported/w3c/web-platform-tests/fetch/api/request/request-cache-only-if-cached.html [ Failure ]
677
678 # Resource Load Statistics are only supported in WebKit2.
679 http/tests/resourceLoadStatistics/prevalent-resource-with-user-interaction.html [ Pass ]
680 http/tests/resourceLoadStatistics/non-prevalent-resource-with-user-interaction.html [ Pass ]
681 http/tests/resourceLoadStatistics/non-prevalent-resource-without-user-interaction.html [ Pass ]
682 http/tests/resourceLoadStatistics/prevalent-resource-without-user-interaction.html [ Pass ]
683 http/tests/resourceLoadStatistics/prevalent-resource-with-user-interaction-timeout.html [ Pass ]
684 http/tests/resourceLoadStatistics/classify-as-non-prevalent-based-on-mixed-statistics.html [ Pass ]
685 http/tests/resourceLoadStatistics/classify-as-non-prevalent-based-on-sub-frame-under-top-frame-origins.html [ Pass ]
686 http/tests/resourceLoadStatistics/classify-as-non-prevalent-based-on-subresource-under-top-frame-origins.html [ Pass ]
687 http/tests/resourceLoadStatistics/classify-as-non-prevalent-based-on-subresource-unique-redirects-to.html [ Pass ]
688 http/tests/resourceLoadStatistics/classify-as-prevalent-based-on-mixed-statistics.html [ Pass ]
689 http/tests/resourceLoadStatistics/classify-as-prevalent-based-on-sub-frame-under-top-frame-origins.html [ Pass ]
690 http/tests/resourceLoadStatistics/classify-as-prevalent-based-on-subresource-under-top-frame-origins.html [ Pass ]
691 http/tests/resourceLoadStatistics/classify-as-prevalent-based-on-subresource-unique-redirects-to.html [ Pass ]
692 webkit.org/b/181223 http/tests/resourceLoadStatistics/clear-in-memory-and-persistent-store.html [ Skip ]
693 http/tests/resourceLoadStatistics/grandfathering.html [ Pass ]
694 webkit.org/b/180703 http/tests/resourceLoadStatistics/telemetry-generation.html [ Pass Failure ]
695 http/tests/resourceLoadStatistics/prune-statistics.html [ Pass ]
696 http/tests/resourceLoadStatistics [ Pass ]
697 # Cookie partitioning is only supported in macOS High Sierra and iOS 11.
698 http/tests/resourceLoadStatistics/partitioned-and-unpartitioned-cookie-deletion.html [ Skip ]
699 http/tests/resourceLoadStatistics/partitioned-and-unpartitioned-cookie-with-partitioning-timeout.html [ Skip ]
700 http/tests/resourceLoadStatistics/partitioned-cookies-with-and-without-user-interaction.html [ Skip ]
701 http/tests/resourceLoadStatistics/third-party-cookie-with-and-without-user-interaction.html [ Skip ]
702 http/tests/resourceLoadStatistics/non-prevalent-resources-can-access-cookies-in-a-third-party-context.html [ Skip ]
703 http/tests/resourceLoadStatistics/add-partitioning-to-redirect.html [ Skip ]
704 http/tests/resourceLoadStatistics/add-blocking-to-redirect.html [ Skip ]
705 http/tests/resourceLoadStatistics/remove-partitioning-in-redirect.html [ Skip ]
706 http/tests/resourceLoadStatistics/remove-blocking-in-redirect.html [ Skip ]
707 http/tests/resourceLoadStatistics/strip-referrer-to-origin-for-prevalent-subresource-redirects.html [ Skip ]
708 http/tests/resourceLoadStatistics/strip-referrer-to-origin-for-prevalent-subresource-requests.html [ Skip ]
709
710 ### END OF (5) Progressions, expected successes that are expected failures in WebKit1.
711 ########################################
712
713 ###### This file has four sections. When adding new tests, make sure to
714 ###### add to the right section:
715
716 ### (1) Classified failures with bug reports
717 ### (2) Classified failures without bug reports (yet)
718 ### (3) Unclassified failures
719 ### (4) Features that are not supported in WebKit2 and likely never will be
720 ### (5) Progressions, expected successes that are expected failures in WebKit1.
721
722 webkit.org/b/168092 media/track/track-cues-sorted-before-dispatch.html [ Pass Failure ]
723
724 webkit.org/b/172662 [ Debug ] http/tests/cache/disk-cache/disk-cache-vary-cookie.html [ Pass Failure ]
725 webkit.org/b/172662 [ Debug ] http/tests/cache/disk-cache/redirect-chain-limits.html [ Pass Failure ]
726
727 webkit.org/b/174471 webrtc/filtering-ice-candidate-after-reload.html [ Pass Timeout ]
728
729 webkit.org/b/175678 media/W3C/video/events/event_progress.html [ Pass Failure ]
730