1 2012-05-14 Ryosuke Niwa <rniwa@webkit.org>
3 Build fix. Don't adjust calls per iteration in the second run.
6 (PerfTestRunner._perSecondRunner):
8 2012-05-13 Ryosuke Niwa <rniwa@webkit.org>
10 performance tests should be able to measure runs/sec rather than time
11 https://bugs.webkit.org/show_bug.cgi?id=86021
13 Reviewed by Ojan Vafai.
15 Add PerfTestRunner.runPerSecond. It uses _runLoop but replaces _runner by _perSecondRunner
16 to compute runs/s of runFunction.
18 When _perSecondRunner is called for the first time, i.e. _completedRuns is 0 (notice this is -1
19 in regular run/_runner), it slowly increases the number of function calls to runFunction between
20 time measurements in order to discount the time used by new Date() calls themselves until the
21 total time spent reaches 100 milliseconds.
23 By default, runPerSecond runs the test for at least 750 milliseconds in each run, and executes
24 21 runs, yielding the total run time of roughly 18 seconds. This is significantly faster than
25 most of existing performance tests. Also see http://ejohn.org/blog/accuracy-of-javascript-time/.
27 Finally, refactored the existing methods of PerfTestRunner to allow "runs/s" unit and share code.
29 * Layout/flexbox-column-nowrap.html:
30 * Layout/flexbox-column-wrap.html:
31 * Layout/flexbox-row-nowrap.html:
32 * Layout/flexbox-row-wrap.html:
33 * resources/runner.js:
34 (PerfTestRunner.computeStatistics): Takes unit.
35 (PerfTestRunner.logStatistics): Ditto.
36 (PerfTestRunner._runLoop):
37 (PerfTestRunner._runner):
38 (PerfTestRunner.runPerSecond): Added.
39 (PerfTestRunner._perSecondRunner): Added. Called by _runLoop.
40 (PerfTestRunner._perSecondRunnerIterator): Added.
42 2012-05-09 Tony Chang <tony@chromium.org>
44 add some basic perf-o-matic tests for flexbox
45 https://bugs.webkit.org/show_bug.cgi?id=86017
47 Reviewed by Ryosuke Niwa.
49 Each of these tests take < 3s on my machine.
51 * Layout/flexbox-column-nowrap.html: Added.
52 * Layout/flexbox-column-wrap.html: Added.
53 * Layout/flexbox-row-nowrap.html: Added.
54 * Layout/flexbox-row-wrap.html: Added.
56 2012-05-05 Ilya Tikhonovsky <loislo@chromium.org>
58 Web Inspector: unreviewed followup fix for the performance test after r116218.
60 * inspector/heap-snapshot.html:
62 2012-05-02 Tom Zakrajsek <tomz@codeaurora.org>
64 Need tests for PerfTestRunner.computeStatistics
65 https://bugs.webkit.org/show_bug.cgi?id=85410
67 Reviewed by Ryosuke Niwa.
69 * resources/runner.js:
71 2012-05-02 Sheriff Bot <webkit.review.bot@gmail.com>
73 Unreviewed, rolling out r115905.
74 http://trac.webkit.org/changeset/115905
75 https://bugs.webkit.org/show_bug.cgi?id=85435
77 New computeStatistics test is failing on chromium ports
78 (Requested by tomz on #webkit).
80 * resources/runner.js:
82 2012-05-02 Tom Zakrajsek <tomz@codeaurora.org>
84 Need tests for PerfTestRunner.computeStatistics
85 https://bugs.webkit.org/show_bug.cgi?id=85410
87 Reviewed by Ryosuke Niwa.
89 * resources/runner.js:
91 2012-04-29 Tom Zakrajsek <tomz@codeaurora.org>
93 PerfTestRunner.computeStatistics incorrectly calculates min, max and median
94 https://bugs.webkit.org/show_bug.cgi?id=85111
96 Reviewed by Ryosuke Niwa.
98 The sort of the data input was being done alphabetically.
99 So I provided a numeric compare function.
101 * resources/runner.js:
103 2012-04-17 Ilya Tikhonovsky <loislo@chromium.org>
105 Web Inspector: the fix for test after massive rename in r114271.
106 https://bugs.webkit.org/show_bug.cgi?id=84147
108 Drive by fix. The test was renamed to heap-snapshot.html
110 Reviewed by Yury Semikhatsky.
112 * inspector/heap-snapshot.html: Renamed from PerformanceTests/inspector/detailed-heapshots-smoke-test.html.
114 2012-04-16 Yury Semikhatsky <yurys@chromium.org>
116 Web Inspector: rename heap profiler files and classes DetailedHeapshot* ->HeapSnapshot*
117 https://bugs.webkit.org/show_bug.cgi?id=84038
119 A bunch of renames "detailed heapshot" -> "heap snapshot".
121 Reviewed by Pavel Feldman.
123 * inspector/detailed-heapshots-smoke-test.html:
125 2012-04-13 Ryosuke Niwa <rniwa@webkit.org>
131 2012-04-12 Ryosuke Niwa <rniwa@webkit.org>
133 Enable SVG page loading performance tests
134 https://bugs.webkit.org/show_bug.cgi?id=83861
136 Reviewed by Adam Barth.
138 Unskip PageLoad directory and skip tests that load too fast (less than 100ms) and are unstable,
139 and the ones that take too long to load (more than 20s).
143 2012-04-04 Ilya Tikhonovsky <loislo@chromium.org>
145 Web Inspector: Unreviewed. temporary disable broken inspector tests.
147 * inspector/first-open-scripts.html.broken: Renamed from PerformanceTests/inspector/first-open-scripts.html.
148 * inspector/network-append-30-requests.html.broken: Renamed from PerformanceTests/inspector/network-append-30-requests.html.
149 * inspector/show-panel.html.broken: Renamed from PerformanceTests/inspector/show-panel.html.
151 2012-04-04 Ilya Tikhonovsky <loislo@chromium.org>
153 Web Inspector: linearise aggregate's retaining size calculation.
154 https://bugs.webkit.org/show_bug.cgi?id=83125
156 This version is twice as fast as the original and it is non-recursive.
158 Reviewed by Yury Semikhatsky.
160 * inspector/detailed-heapshots-smoke-test.html:
162 2012-03-30 David Barr <davidbarr@chromium.org>
164 Split up top-level .gitignore and .gitattributes
165 https://bugs.webkit.org/show_bug.cgi?id=82687
167 Reviewed by Tor Arne Vestbø.
169 * .gitattributes: Added.
171 2012-03-28 Yury Semikhatsky <yurys@chromium.org>
173 Web Inspector: switch heap profiler front-end to separate storage of nodes and edges
174 https://bugs.webkit.org/show_bug.cgi?id=82453
176 Updated heap profiler performance test after heap profiler front-end
179 Reviewed by Pavel Feldman.
181 * inspector/detailed-heapshots-smoke-test.html:
183 2012-03-27 Alexis Menard <alexis.menard@openbossa.org>
185 Add a perf test which updates the value of an already declared CSS property.
186 https://bugs.webkit.org/show_bug.cgi?id=82321
188 Reviewed by Andreas Kling.
190 This benchmark update CSS existing properties of the style from JS.
192 * CSS/CSSPropertyUpdateValue.html: Added.
194 2012-03-15 Kentaro Hara <haraken@chromium.org>
196 [PerformanceTests] run-perf-tests should output correct units
197 https://bugs.webkit.org/show_bug.cgi?id=78303
199 Reviewed by Ryosuke Niwa.
201 Previously run-perf-tests just supported "ms" for units.
202 Consequently, Dromaeo perf tests had been reporting runs/s as "ms".
203 This patch fixes run-perf-tests so that they can support custom units.
204 The default unit is "ms".
206 The test result looks like this:
208 $ ./Tools/Scripts/run-perf-tests Dromaeo/dom-attr.html
209 RESULT Dromaeo: dom-attr= 6465.9525483 runs/s
210 median= 0.0 runs/s, stdev= 24.2983433436 runs/s, min= 6435.87649402 runs/s, max= 6515.63693392 runs/s
212 * Dromaeo/resources/dromaeorunner.js:
214 * resources/runner.js:
215 (PerfTestRunner.computeStatistics):
216 (PerfTestRunner.printStatistics):
218 2012-03-15 Alexis Menard <alexis.menard@openbossa.org>
220 Fix the test failing with run-perf-tests.
222 Rubber stamped by Ryosuke Niwa.
224 * CSS/CSSPropertySetterGetter.html:
226 2012-03-14 Alexis Menard <alexis.menard@openbossa.org>
228 Add a new perf test to benchmark setting and reading CSS properties from JS.
229 https://bugs.webkit.org/show_bug.cgi?id=81155
231 Reviewed by Ryosuke Niwa.
233 This benchmark read and set CSS properties from JS. It contains a list
234 of common CSS properties.
236 * CSS/CSSPropertySetterGetter.html: Added.
238 2012-03-14 Alexandru Chiculita <achicu@adobe.com>
240 Layout/floats.html should be runnable by run-perf-tests
241 https://bugs.webkit.org/show_bug.cgi?id=77051
243 Reviewed by Ryosuke Niwa.
245 I've split Layout/floats.html into multiple tests for each button in the original manual test.
246 Some tests take longer to run and I've changed the number of iterations, so that each tests finishes under 30s per run.
248 * DOM/resources/dom-perf.js:
249 * Layout/floats.html: Removed.
250 * Layout/floats_100_100.html: Added.
251 * Layout/floats_100_100_nested.html: Added.
252 * Layout/floats_20_100.html: Added.
253 * Layout/floats_20_100_nested.html: Added.
254 * Layout/floats_2_100.html: Added.
255 * Layout/floats_2_100_nested.html: Added.
256 * Layout/floats_50_100.html: Added.
257 * Layout/floats_50_100_nested.html: Added.
258 * Layout/resources/floats.css: Added.
263 * Layout/resources/floats.js: Added.
266 * resources/runner.js:
267 (PerfTestRunner.resetRandomSeed):
268 (PerfTestRunner.random):
270 Moved the Math.random to runner.js to be used by all tests.
271 Added resetRandomSeed to bring the randomizer back to initial seed.
272 It is useful to get the same results at every run and minimize the
273 differences between runs.
275 2012-03-14 Sheriff Bot <webkit.review.bot@gmail.com>
277 Unreviewed, rolling out r110559.
278 http://trac.webkit.org/changeset/110559
279 https://bugs.webkit.org/show_bug.cgi?id=81142
281 Broke Dromaeo tests (Requested by rniwa on #webkit).
283 * Dromaeo/resources/dromaeorunner.js:
286 2012-03-13 Kentaro Hara <haraken@chromium.org>
288 Dromaeo perf-tests results are wrong
289 https://bugs.webkit.org/show_bug.cgi?id=80974
291 Reviewed by Hajime Morita.
293 Dromaeo perf-tests had reported the sum of runs/seconds as "ms".
294 This patch fixes them to report the execution time per run.
296 At present, they report "0.0ms" for "stdev". This is because
297 dromaeorunner.js can just know stdev of "runs/seconds"
298 and cannot calculate stdev of "ms" from that. We can fix it later.
300 * Dromaeo/resources/dromaeorunner.js:
303 2012-03-12 Ilya Tikhonovsky <loislo@chromium.org>
305 Web Inspector: chromium: increase heap snapshot performance coverage.
306 https://bugs.webkit.org/show_bug.cgi?id=80829
308 Reviewed by Yury Semikhatsky.
310 * inspector/detailed-heapshots-smoke-test.html:
311 * inspector/performance-test.js:
312 (initialize_TimeTracker.InspectorTest.measureFunction):
314 2012-03-06 Kentaro Hara <haraken@chromium.org>
316 [Perf tests] Reduce the number of loops in dom-attributes.html
317 https://bugs.webkit.org/show_bug.cgi?id=80077
319 Reviewed by Ryosuke Niwa.
321 dom-attributes.html takes 100~ seconds in the perf bots. This patch reduces
322 the time by reducing the number of loops.
324 This is just a temporary fix. After more detailed investigation, I will reduce
325 the number of tests in dom-attributes.html, and revert back the number of loops
326 to guarantee the reliability of the perf test results.
328 * Bindings/dom-attributes.html:
330 2012-03-06 Ilya Tikhonovsky <loislo@chromium.org>
332 Web Inspector: Heap Snapshot test: split overal time metric into separate metrics.
333 https://bugs.webkit.org/show_bug.cgi?id=80409
335 Reviewed by Yury Semikhatsky.
337 * inspector/detailed-heapshots-smoke-test.html:
339 2012-03-05 Ilya Tikhonovsky <loislo@chromium.org>
341 Web Inspector: [chromium] introduce HeapSnapshot performance test.
342 https://bugs.webkit.org/show_bug.cgi?id=80280
344 Reviewed by Pavel Feldman.
346 * inspector/detailed-heapshots-smoke-test.html: Added.
348 2012-03-01 Ryosuke Niwa <rniwa@webkit.org>
350 DOM tests take too long to run
351 https://bugs.webkit.org/show_bug.cgi?id=80082
353 Reviewed by Eric Seidel.
355 Reduce benchmark.timeToRun from 500ms to 100ms. Doesn't seem to affect test results much
356 (except DOM/DOMTable.html) but significantly reduces the runtime of tests.
358 * DOM/resources/dom-perf.js:
359 (BenchmarkSuite.prototype.RunSingle):
361 2012-02-26 Kentaro Hara <haraken@chromium.org>
363 [Performance Tests] [Chromium] Bindings/dom-attributes.html is timing out
364 https://bugs.webkit.org/show_bug.cgi?id=79593
366 Reviewed by Adam Barth.
368 This patch halves the execution time of Bindings/dom-attributes.html
369 in order to avoid timeout in Chromium. The reason for the timeout is that
370 V8 DOM bindings are too much slower than JSC bindings.
371 I am a bit afraid that this patch will reduce the accuracy of the
372 perf test results, but it would make sense to reduce the execution time
373 until we fix the performance issue in V8 DOM bindings.
375 * Bindings/dom-attributes.html:
377 2012-02-24 Ryosuke Niwa <rniwa@webkit.org>
379 Rename dom*_*attributes.html to dom*-*attributes.html to follow the WebKit convention.
381 * Bindings/dom-attributes.html: Copied from PerformanceTests/Bindings/dom_attributes.html.
382 * Bindings/dom_attributes.html: Removed.
384 2012-02-24 Kentaro Hara <haraken@chromium.org>
386 Unreviewed, rolling out r108477.
387 http://trac.webkit.org/changeset/108477
388 https://bugs.webkit.org/show_bug.cgi?id=79209
390 The perf tests committed in r108748 covers the perf tests
391 committed in r108477. So I'll roll out r108477.
393 * Bindings/dom_attributes_id_getter.html: Removed.
394 * Bindings/dom_attributes_id_setter.html: Removed.
395 * Bindings/resources/dom_attributes_common.js: Removed.
397 2012-02-24 Kentaro Hara <haraken@chromium.org>
399 Add performance tests for DOM attribute getters and setters
400 https://bugs.webkit.org/show_bug.cgi?id=79208
402 Reviewed by Ryosuke Niwa.
404 This patch adds performance micro-benchmarks for DOM attribute
405 getters and setters. We selected DOM attributes from HTMLElement,
406 Element and Node which will most impact on the DOM performance
407 in the real Web and which have different call-paths from another
410 The perf test result in my local Chromium/Linux environment is as follows:
411 median= 14967.0 ms, stdev= 85.2385476178 ms, min= 14861.0 ms, max= 15155.0 ms
413 If we run the test with DumpRenderTree, we can get the following test results:
414 Info: [HTMLElement.id] avg=65.76ms, median=65.00ms, stdev=2.14ms, min=63, max=70
415 Info: [HTMLElement.title] avg=64.05ms, median=63.00ms, stdev=1.50ms, min=63, max=67
416 Info: [HTMLElement.lang] avg=64.19ms, median=63.00ms, stdev=1.82ms, min=62, max=67
417 Info: [HTMLElement.dir] avg=64.10ms, median=63.00ms, stdev=1.72ms, min=62, max=68
418 Info: [HTMLElement.className] avg=63.33ms, median=63.00ms, stdev=0.89ms, min=63, max=67
419 Info: [HTMLElement.classList] avg=1946.00ms, median=1945.00ms, stdev=38.22ms, min=1921, max=2110
420 Info: [HTMLElement.tabIndex] avg=83.52ms, median=80.00ms, stdev=6.00ms, min=79, max=94
421 Info: [HTMLElement.draggable] avg=78.14ms, median=81.00ms, stdev=3.51ms, min=74, max=82
422 Info: [HTMLElement.webkitdropzone] avg=64.33ms, median=63.00ms, stdev=1.98ms, min=63, max=68
423 Info: [HTMLElement.hidden] avg=65.57ms, median=64.00ms, stdev=3.27ms, min=63, max=71
424 Info: [HTMLElement.accessKey] avg=64.43ms, median=63.00ms, stdev=2.11ms, min=62, max=68
425 Info: [HTMLElement.children] avg=130.76ms, median=128.00ms, stdev=9.75ms, min=109, max=143
426 Info: [HTMLElement.isContentEditable] avg=74.29ms, median=75.00ms, stdev=2.00ms, min=71, max=77
427 Info: [HTMLElement.spellcheck] avg=79.52ms, median=80.00ms, stdev=2.52ms, min=76, max=82
428 Info: [HTMLElement.innerHTML] avg=279.05ms, median=279.00ms, stdev=1.96ms, min=276, max=283
429 Info: [HTMLElement.innerText] avg=204.14ms, median=203.00ms, stdev=2.95ms, min=200, max=210
430 Info: [HTMLElement.outerHTML] avg=1544.10ms, median=1546.00ms, stdev=15.56ms, min=1514, max=1568
431 Info: [HTMLElement.outerText] avg=216.05ms, median=207.00ms, stdev=18.19ms, min=201, max=247
432 Info: [HTMLElement.contentEditable] avg=334.24ms, median=323.00ms, stdev=36.06ms, min=318, max=446
433 Info: [HTMLElement.id="foo"] avg=53.19ms, median=53.00ms, stdev=1.76ms, min=52, max=58
434 Info: [HTMLElement.title="foo"] avg=63.14ms, median=63.00ms, stdev=0.35ms, min=63, max=64
435 Info: [HTMLElement.lang="foo"] avg=60.86ms, median=61.00ms, stdev=0.56ms, min=60, max=62
436 Info: [HTMLElement.dir="foo"] avg=53.57ms, median=54.00ms, stdev=0.58ms, min=53, max=55
437 Info: [HTMLElement.className="foo"] avg=64.52ms, median=64.00ms, stdev=0.91ms, min=63, max=66
438 Info: [HTMLElement.tabIndex="foo"] avg=367.86ms, median=369.00ms, stdev=8.06ms, min=352, max=380
439 Info: [HTMLElement.draggable="foo"] avg=79.43ms, median=79.00ms, stdev=0.58ms, min=79, max=81
440 Info: [HTMLElement.webkitdropzone="foo"] avg=62.14ms, median=62.00ms, stdev=0.35ms, min=62, max=63
441 Info: [HTMLElement.hidden="foo"] avg=61.67ms, median=62.00ms, stdev=0.71ms, min=61, max=64
442 Info: [HTMLElement.accessKey="foo"] avg=61.86ms, median=62.00ms, stdev=0.56ms, min=61, max=63
443 Info: [HTMLElement.spellcheck="foo"] avg=79.57ms, median=80.00ms, stdev=0.58ms, min=78, max=80
444 Info: [HTMLElement.innerHTML="foo"] avg=1176.67ms, median=1169.00ms, stdev=26.60ms, min=1146, max=1246
445 Info: [HTMLElement.innerText="foo"] avg=51.62ms, median=52.00ms, stdev=0.72ms, min=50, max=53
446 Info: [Element.tagName] avg=79.52ms, median=80.00ms, stdev=1.05ms, min=78, max=81
447 Info: [Element.style] avg=126.19ms, median=126.00ms, stdev=10.40ms, min=104, max=161
448 Info: [Element.offsetLeft] avg=98.95ms, median=104.00ms, stdev=4.01ms, min=100, max=99
449 Info: [Element.clientLeft] avg=98.33ms, median=102.00ms, stdev=2.59ms, min=100, max=99
450 Info: [Element.scrollLeft] avg=103.29ms, median=96.00ms, stdev=15.63ms, min=100, max=97
451 Info: [Element.dataset] avg=2448.62ms, median=2441.00ms, stdev=20.43ms, min=2426, max=2503
452 Info: [Element.firstElementChild] avg=58.71ms, median=58.00ms, stdev=2.37ms, min=57, max=65
453 Info: [Element.lastElementChild] avg=56.33ms, median=55.00ms, stdev=1.83ms, min=54, max=59
454 Info: [Element.previousElementSibling] avg=52.95ms, median=52.00ms, stdev=1.70ms, min=52, max=57
455 Info: [Element.nextElementSibling] avg=58.48ms, median=58.00ms, stdev=1.79ms, min=57, max=63
456 Info: [Element.childElementCount] avg=64.57ms, median=64.00ms, stdev=1.81ms, min=63, max=71
457 Info: [Element.onload] avg=98.38ms, median=98.00ms, stdev=0.49ms, min=98, max=99
458 Info: [Element.scrollLeft="foo"] avg=95.24ms, median=95.00ms, stdev=0.92ms, min=94, max=98
459 Info: [Element.onload="foo"] avg=67.14ms, median=67.00ms, stdev=0.56ms, min=66, max=68
460 Info: [Node.nodeName] avg=76.29ms, median=76.00ms, stdev=0.63ms, min=75, max=77
461 Info: [Node.nodeType] avg=53.05ms, median=52.00ms, stdev=2.61ms, min=52, max=61
462 Info: [Node.parentNode] avg=53.52ms, median=53.00ms, stdev=1.22ms, min=52, max=56
463 Info: [Node.childNodes] avg=118.33ms, median=123.00ms, stdev=8.85ms, min=107, max=129
464 Info: [Node.firstChild] avg=53.62ms, median=53.00ms, stdev=1.13ms, min=51, max=55
465 Info: [Node.lastChild] avg=53.14ms, median=53.00ms, stdev=1.21ms, min=52, max=55
466 Info: [Node.previousSibling] avg=51.86ms, median=51.00ms, stdev=1.55ms, min=50, max=54
467 Info: [Node.nextSibling] avg=52.86ms, median=54.00ms, stdev=1.81ms, min=50, max=55
468 Info: [Node.attributes] avg=2027.71ms, median=2026.00ms, stdev=10.48ms, min=2010, max=2051
469 Info: [Node.ownerDocument] avg=152.14ms, median=152.00ms, stdev=1.73ms, min=149, max=155
470 Info: [Node.namespaceURI] avg=60.86ms, median=59.00ms, stdev=3.85ms, min=56, max=66
471 Info: [Node.localName] avg=60.00ms, median=59.00ms, stdev=2.71ms, min=57, max=66
472 Info: [Node.baseURI] avg=671.10ms, median=668.00ms, stdev=10.66ms, min=659, max=706
473 Info: [Node.parentElement] avg=55.05ms, median=56.00ms, stdev=2.15ms, min=52, max=58
474 Info: [Node.nodeValue] avg=61.24ms, median=60.00ms, stdev=2.56ms, min=59, max=68
475 Info: [Node.prefix] avg=60.90ms, median=58.00ms, stdev=4.26ms, min=57, max=68
476 Info: [Node.textContent] avg=149.71ms, median=149.00ms, stdev=1.12ms, min=148, max=152
477 Info: [Node.nodeValue="foo"] avg=23.62ms, median=23.00ms, stdev=0.72ms, min=23, max=25
478 Info: [Node.prefix="foo"] avg=49.57ms, median=49.00ms, stdev=0.73ms, min=49, max=51
479 Info: [Node.textContent="foo"] avg=145.81ms, median=140.00ms, stdev=17.43ms, min=138, max=199
481 * Bindings/dom_attributes.html: Added.
482 * resources/runner.js:
483 (PerfTestRunner.info):
485 2012-02-22 Kentaro Hara <haraken@chromium.org>
487 Add performance tests for the Element.id getter and setter
488 https://bugs.webkit.org/show_bug.cgi?id=79209
490 Reviewed by Adam Barth.
492 This patch adds performance tests for the Element.id getter and setter.
494 The results of 10 runs in my local Chromium/Linux are as follows:
496 dom_attributes_id_getter.html:
497 median= 92.0 ms, stdev= 1.65151445649 ms, min= 89.0 ms, max= 96.0 ms
498 median= 87.5 ms, stdev= 1.84390889146 ms, min= 85.0 ms, max= 92.0 ms
499 median= 94.0 ms, stdev= 1.46543508898 ms, min= 90.0 ms, max= 95.0 ms
500 median= 86.0 ms, stdev= 1.66958078571 ms, min= 84.0 ms, max= 91.0 ms
501 median= 94.0 ms, stdev= 2.25610283454 ms, min= 103.0 ms, max= 98.0 ms
502 median= 86.0 ms, stdev= 1.49666295471 ms, min= 84.0 ms, max= 91.0 ms
503 median= 86.0 ms, stdev= 1.5321553446 ms, min= 84.0 ms, max= 90.0 ms
504 median= 86.0 ms, stdev= 2.20227155455 ms, min= 84.0 ms, max= 94.0 ms
505 median= 96.0 ms, stdev= 1.74570902501 ms, min= 101.0 ms, max= 99.0 ms
506 median= 86.0 ms, stdev= 1.63935963108 ms, min= 84.0 ms, max= 90.0 ms
507 median= 94.0 ms, stdev= 1.49248115566 ms, min= 90.0 ms, max= 95.0 ms
508 median= 88.0 ms, stdev= 5.20192272146 ms, min= 84.0 ms, max= 98.0 ms
509 median= 86.0 ms, stdev= 1.41067359797 ms, min= 84.0 ms, max= 89.0 ms
510 median= 86.0 ms, stdev= 1.48660687473 ms, min= 84.0 ms, max= 89.0 ms
511 median= 94.0 ms, stdev= 1.58113883008 ms, min= 93.0 ms, max= 97.0 ms
512 median= 86.0 ms, stdev= 1.95959179423 ms, min= 84.0 ms, max= 93.0 ms
513 median= 86.0 ms, stdev= 1.8547236991 ms, min= 84.0 ms, max= 92.0 ms
514 median= 86.0 ms, stdev= 1.39283882772 ms, min= 84.0 ms, max= 89.0 ms
515 median= 88.0 ms, stdev= 1.48660687473 ms, min= 85.0 ms, max= 90.0 ms
516 median= 86.5 ms, stdev= 2.3 ms, min= 84.0 ms, max= 93.0 ms
518 dom_attributes_id_setter.html:
519 median= 123.0 ms, stdev= 2.06397674406 ms, min= 119.0 ms, max= 128.0 ms
520 median= 119.0 ms, stdev= 1.92028643697 ms, min= 117.0 ms, max= 123.0 ms
521 median= 121.0 ms, stdev= 1.8781639971 ms, min= 118.0 ms, max= 123.0 ms
522 median= 123.0 ms, stdev= 2.21585198062 ms, min= 119.0 ms, max= 130.0 ms
523 median= 124.5 ms, stdev= 2.36378933071 ms, min= 119.0 ms, max= 129.0 ms
524 median= 122.0 ms, stdev= 2.4474476501 ms, min= 118.0 ms, max= 128.0 ms
525 median= 123.0 ms, stdev= 1.76351920885 ms, min= 118.0 ms, max= 125.0 ms
526 median= 119.0 ms, stdev= 1.79652442232 ms, min= 117.0 ms, max= 125.0 ms
527 median= 121.0 ms, stdev= 1.49916643506 ms, min= 119.0 ms, max= 123.0 ms
528 median= 119.5 ms, stdev= 1.85135085816 ms, min= 117.0 ms, max= 125.0 ms
529 median= 124.0 ms, stdev= 1.43090880213 ms, min= 120.0 ms, max= 124.0 ms
530 median= 122.0 ms, stdev= 1.45859521458 ms, min= 118.0 ms, max= 123.0 ms
531 median= 123.0 ms, stdev= 1.50332963784 ms, min= 120.0 ms, max= 124.0 ms
532 median= 123.0 ms, stdev= 1.3638181697 ms, min= 120.0 ms, max= 125.0 ms
533 median= 119.0 ms, stdev= 1.43527000944 ms, min= 117.0 ms, max= 121.0 ms
534 median= 122.5 ms, stdev= 1.71682847134 ms, min= 118.0 ms, max= 124.0 ms
535 median= 121.0 ms, stdev= 1.44481832768 ms, min= 118.0 ms, max= 123.0 ms
536 median= 120.0 ms, stdev= 1.40978721799 ms, min= 117.0 ms, max= 122.0 ms
537 median= 122.0 ms, stdev= 1.68522995464 ms, min= 119.0 ms, max= 125.0 ms
538 median= 122.0 ms, stdev= 1.55804364509 ms, min= 118.0 ms, max= 123.0 ms
541 * Bindings/dom_attributes_id_getter.html: Added.
542 * Bindings/dom_attributes_id_setter.html: Added.
543 * Bindings/resources/dom_attributes_common.js: Added.
545 2012-02-16 Alexis Menard <alexis.menard@openbossa.org>
547 Add a perf test for the CSS parser.
548 https://bugs.webkit.org/show_bug.cgi?id=78114
550 Reviewed by Ryosuke Niwa.
552 Add a perf test for the CSS parser. It load a big CSS chunk
553 which contains some snippets of the YUI library from Yahoo!.
555 * Parser/css-parser-yui.html: Added.
557 2012-02-08 Hajime Morrita <morrita@chromium.org>
559 [PerformanceTests] sunspider-crypto-md5.html and sunspider-crypto-sha1.html are timing out on cr-mac perf bot
560 https://bugs.webkit.org/show_bug.cgi?id=78174
562 Reviewed by Ryosuke Niwa.
564 Pulled back removed files.
566 * Dromaeo/resources/dromaeo/web/tests/sunspider-crypto-md5.html: Added.
567 * Dromaeo/resources/dromaeo/web/tests/sunspider-crypto-sha1.html: Added.
569 2012-02-02 Hajime Morrita <morrita@chromium.org>
571 [PerformanceTests] Each Dromaeo test needs its landing html.
572 https://bugs.webkit.org/show_bug.cgi?id=77504
574 Reviewed by Ryosuke Niwa.
576 - Added landing pages for each test which are listed in MANIFEST.json
577 - Removed some tests which depends on the library whose license is incompatible to WebKit.
578 - Added local copy of corresponding library. And replace the references to the remote sources
580 - Removed old library files under Dromaeo/resources/dromaeo/web/lib/.
581 - Skipped Sunsupier and v8 test. Such JS centric test should have its own test instead of
582 running as a part of Dromaeo.
584 * Dromaeo/cssquery-dojo.html: Added.
585 * Dromaeo/cssquery-jquery.html: Added.
586 * Dromaeo/cssquery-prototype.html: Added.
587 * Dromaeo/dom-attr.html: Added.
588 * Dromaeo/dom-modify.html: Added.
589 * Dromaeo/dom-traverse.html: Added.
590 * Dromaeo/dromaeo-3d-cube.html: Added.
591 * Dromaeo/dromaeo-core-eval.html: Added.
592 * Dromaeo/dromaeo-object-array.html: Added.
593 * Dromaeo/dromaeo-object-regexp.html: Added.
594 * Dromaeo/dromaeo-object-string.html: Added.
595 * Dromaeo/dromaeo-string-base64.html: Added.
596 * Dromaeo/jslib-attr-jquery.html: Added.
597 * Dromaeo/jslib-attr-prototype.html: Added.
598 * Dromaeo/jslib-event-jquery.html: Added.
599 * Dromaeo/jslib-event-prototype.html: Added.
600 * Dromaeo/jslib-modify-jquery.html: Added.
601 * Dromaeo/jslib-modify-prototype.html: Added.
602 * Dromaeo/jslib-style-jquery.html: Added.
603 * Dromaeo/jslib-style-prototype.html: Added.
604 * Dromaeo/jslib-traverse-jquery.html: Added.
605 * Dromaeo/jslib-traverse-prototype.html: Added.
606 * Dromaeo/resources/dromaeo/web/lib/dojo.js: Removed.
607 * Dromaeo/resources/dromaeo/web/lib/dojo-1.6.1.js: Added.
608 * Dromaeo/resources/dromaeo/web/lib/jquery.js: Removed.
609 * Dromaeo/resources/dromaeo/web/lib/jquery-1.6.4.js: Added.
610 * Dromaeo/resources/dromaeo/web/lib/mootools.js: Removed.
611 * Dromaeo/resources/dromaeo/web/lib/prototype.js: Removed.
612 * Dromaeo/resources/dromaeo/web/lib/prototype-1.7.js: Added.
613 * Dromaeo/resources/dromaeo/web/tests/cssquery-dojo.html:
614 * Dromaeo/resources/dromaeo/web/tests/cssquery-jquery.html:
615 * Dromaeo/resources/dromaeo/web/tests/cssquery-mootools.html: Removed.
616 * Dromaeo/resources/dromaeo/web/tests/cssquery-prototype.html:
617 * Dromaeo/resources/dromaeo/web/tests/jslib-attr-jquery.html:
618 * Dromaeo/resources/dromaeo/web/tests/jslib-attr-prototype.html:
619 * Dromaeo/resources/dromaeo/web/tests/jslib-event-jquery.html:
620 * Dromaeo/resources/dromaeo/web/tests/jslib-event-prototype.html:
621 * Dromaeo/resources/dromaeo/web/tests/jslib-modify-jquery.html:
622 * Dromaeo/resources/dromaeo/web/tests/jslib-modify-prototype.html:
623 * Dromaeo/resources/dromaeo/web/tests/jslib-style-jquery.html:
624 * Dromaeo/resources/dromaeo/web/tests/jslib-style-prototype.html:
625 * Dromaeo/resources/dromaeo/web/tests/jslib-traverse-jquery.html:
626 * Dromaeo/resources/dromaeo/web/tests/jslib-traverse-prototype.html:
627 * Dromaeo/sunspider-3d-morph.html: Added.
628 * Dromaeo/sunspider-3d-raytrace.html: Added.
629 * Dromaeo/sunspider-access-binary-trees.html: Added.
630 * Dromaeo/sunspider-access-fannkuch.html: Added.
631 * Dromaeo/sunspider-access-nbody.html: Added.
632 * Dromaeo/sunspider-access-nsieve.html: Added.
633 * Dromaeo/sunspider-bitops-3bit-bits-in-byte.html: Added.
634 * Dromaeo/sunspider-bitops-bits-in-byte.html: Added.
635 * Dromaeo/sunspider-bitops-bitwise-and.html: Added.
636 * Dromaeo/sunspider-bitops-nsieve-bits.html: Added.
637 * Dromaeo/sunspider-controlflow-recursive.html: Added.
638 * Dromaeo/sunspider-crypto-aes.html: Added.
639 * Dromaeo/sunspider-crypto-md5.html: Added.
640 * Dromaeo/sunspider-crypto-sha1.html: Added.
641 * Dromaeo/sunspider-date-format-tofte.html: Added.
642 * Dromaeo/sunspider-date-format-xparb.html: Added.
643 * Dromaeo/sunspider-math-cordic.html: Added.
644 * Dromaeo/sunspider-math-partial-sums.html: Added.
645 * Dromaeo/sunspider-math-spectral-norm.html: Added.
646 * Dromaeo/sunspider-regexp-dna.html: Added.
647 * Dromaeo/sunspider-string-fasta.html: Added.
648 * Dromaeo/sunspider-string-tagcloud.html: Added.
649 * Dromaeo/sunspider-string-unpack-code.html: Added.
650 * Dromaeo/sunspider-string-validate-input.html: Added.
651 * Dromaeo/v8-crypto.html: Added.
652 * Dromaeo/v8-deltablue.html: Added.
653 * Dromaeo/v8-earley-boyer.html: Added.
654 * Dromaeo/v8-raytrace.html: Added.
655 * Dromaeo/v8-richards.html: Added.
658 2012-02-02 Sheriff Bot <webkit.review.bot@gmail.com>
660 Unreviewed, rolling out r106543.
661 http://trac.webkit.org/changeset/106543
662 https://bugs.webkit.org/show_bug.cgi?id=77671
664 Made tests less stable (Requested by rniwa on #webkit).
666 * resources/init.html: Removed.
668 2012-02-02 Ryosuke Niwa <rniwa@webkit.org>
670 [PerformanceTests] tests have dependencies
671 https://bugs.webkit.org/show_bug.cgi?id=77506
673 Reviewed by Hajime Morita.
675 * resources/init.html: Added.
677 2012-02-01 Ryosuke Niwa <rniwa@webkit.org>
679 Fix after r106386. The empty anchor element was generating an erroneous whitespace.
681 * Bindings/event-target-wrapper.html:
683 2012-02-01 Ryosuke Niwa <rniwa@webkit.org>
685 Another fix after r106379.
687 * Parser/html5-full-render.html:
689 2012-01-31 Hajime Morrita <morrita@chromium.org>
691 Import Dromaeo to WebKit repository.
692 https://bugs.webkit.org/show_bug.cgi?id=77328
694 Reviewed by Ryosuke Niwa.
696 Imported a modified version of Dromaeo which is able to
699 The imported version originally came from:
700 https://github.com/omo/dromaeo/commit/c942a1452109cdd5f759b3c4aee8d68d490d44a2
702 * Dromaeo/resources/dromaeo/web/application.css: Added.
703 * Dromaeo/resources/dromaeo/web/favicon.ico: Added.
704 * Dromaeo/resources/dromaeo/web/favicon.png: Added.
705 * Dromaeo/resources/dromaeo/web/htmlrunner.js: Added.
706 * Dromaeo/resources/dromaeo/web/ie.css: Added.
707 * Dromaeo/resources/dromaeo/web/images/bg.png: Added.
708 * Dromaeo/resources/dromaeo/web/images/clouds.png: Added.
709 * Dromaeo/resources/dromaeo/web/images/clouds2.png: Added.
710 * Dromaeo/resources/dromaeo/web/images/comets.png: Added.
711 * Dromaeo/resources/dromaeo/web/images/dino1.png: Added.
712 * Dromaeo/resources/dromaeo/web/images/dino2.png: Added.
713 * Dromaeo/resources/dromaeo/web/images/dino3.png: Added.
714 * Dromaeo/resources/dromaeo/web/images/dino4.png: Added.
715 * Dromaeo/resources/dromaeo/web/images/dino5.png: Added.
716 * Dromaeo/resources/dromaeo/web/images/dino6.png: Added.
717 * Dromaeo/resources/dromaeo/web/images/dino7.png: Added.
718 * Dromaeo/resources/dromaeo/web/images/dino8.png: Added.
719 * Dromaeo/resources/dromaeo/web/images/left.png: Added.
720 * Dromaeo/resources/dromaeo/web/images/logo.png: Added.
721 * Dromaeo/resources/dromaeo/web/images/logo2.png: Added.
722 * Dromaeo/resources/dromaeo/web/images/logo3.png: Added.
723 * Dromaeo/resources/dromaeo/web/images/right.png: Added.
724 * Dromaeo/resources/dromaeo/web/images/top.png: Added.
725 * Dromaeo/resources/dromaeo/web/images/water.png: Added.
726 * Dromaeo/resources/dromaeo/web/index.html: Added.
727 * Dromaeo/resources/dromaeo/web/jquery.js: Added.
728 * Dromaeo/resources/dromaeo/web/lib/dojo.js: Added.
729 * Dromaeo/resources/dromaeo/web/lib/jquery.js: Added.
730 * Dromaeo/resources/dromaeo/web/lib/mootools.js: Added.
731 * Dromaeo/resources/dromaeo/web/lib/prototype.js: Added.
732 * Dromaeo/resources/dromaeo/web/pngfix.js: Added.
733 * Dromaeo/resources/dromaeo/web/reset.css: Added.
734 * Dromaeo/resources/dromaeo/web/test-head.html: Added.
735 * Dromaeo/resources/dromaeo/web/test-head.js: Added.
736 * Dromaeo/resources/dromaeo/web/test-tail.html: Added.
737 * Dromaeo/resources/dromaeo/web/test-tail.js: Added.
738 * Dromaeo/resources/dromaeo/web/tests/MANIFEST.json: Added.
739 * Dromaeo/resources/dromaeo/web/tests/cssquery-dojo.html: Added.
740 * Dromaeo/resources/dromaeo/web/tests/cssquery-jquery.html: Added.
741 * Dromaeo/resources/dromaeo/web/tests/cssquery-mootools.html: Added.
742 * Dromaeo/resources/dromaeo/web/tests/cssquery-prototype.html: Added.
743 * Dromaeo/resources/dromaeo/web/tests/cssquery-yui.html: Added.
744 * Dromaeo/resources/dromaeo/web/tests/dom-attr.html: Added.
745 * Dromaeo/resources/dromaeo/web/tests/dom-modify.html: Added.
746 * Dromaeo/resources/dromaeo/web/tests/dom-query.html: Added.
747 * Dromaeo/resources/dromaeo/web/tests/dom-traverse.html: Added.
748 * Dromaeo/resources/dromaeo/web/tests/dromaeo-3d-cube.html: Added.
749 * Dromaeo/resources/dromaeo/web/tests/dromaeo-core-eval.html: Added.
750 * Dromaeo/resources/dromaeo/web/tests/dromaeo-object-array.html: Added.
751 * Dromaeo/resources/dromaeo/web/tests/dromaeo-object-regexp.html: Added.
752 * Dromaeo/resources/dromaeo/web/tests/dromaeo-object-string.html: Added.
753 * Dromaeo/resources/dromaeo/web/tests/dromaeo-string-base64.html: Added.
754 * Dromaeo/resources/dromaeo/web/tests/jslib-attr-jquery.html: Added.
755 * Dromaeo/resources/dromaeo/web/tests/jslib-attr-prototype.html: Added.
756 * Dromaeo/resources/dromaeo/web/tests/jslib-event-jquery.html: Added.
757 * Dromaeo/resources/dromaeo/web/tests/jslib-event-prototype.html: Added.
758 * Dromaeo/resources/dromaeo/web/tests/jslib-modify-jquery.html: Added.
759 * Dromaeo/resources/dromaeo/web/tests/jslib-modify-prototype.html: Added.
760 * Dromaeo/resources/dromaeo/web/tests/jslib-style-jquery.html: Added.
761 * Dromaeo/resources/dromaeo/web/tests/jslib-style-prototype.html: Added.
762 * Dromaeo/resources/dromaeo/web/tests/jslib-traverse-jquery.html: Added.
763 * Dromaeo/resources/dromaeo/web/tests/jslib-traverse-prototype.html: Added.
764 * Dromaeo/resources/dromaeo/web/tests/sunspider-3d-morph.html: Added.
765 * Dromaeo/resources/dromaeo/web/tests/sunspider-3d-raytrace.html: Added.
766 * Dromaeo/resources/dromaeo/web/tests/sunspider-access-binary-trees.html: Added.
767 * Dromaeo/resources/dromaeo/web/tests/sunspider-access-fannkuch.html: Added.
768 * Dromaeo/resources/dromaeo/web/tests/sunspider-access-nbody.html: Added.
769 * Dromaeo/resources/dromaeo/web/tests/sunspider-access-nsieve.html: Added.
770 * Dromaeo/resources/dromaeo/web/tests/sunspider-bitops-3bit-bits-in-byte.html: Added.
771 * Dromaeo/resources/dromaeo/web/tests/sunspider-bitops-bits-in-byte.html: Added.
772 * Dromaeo/resources/dromaeo/web/tests/sunspider-bitops-bitwise-and.html: Added.
773 * Dromaeo/resources/dromaeo/web/tests/sunspider-bitops-nsieve-bits.html: Added.
774 * Dromaeo/resources/dromaeo/web/tests/sunspider-controlflow-recursive.html: Added.
775 * Dromaeo/resources/dromaeo/web/tests/sunspider-crypto-aes.html: Added.
776 * Dromaeo/resources/dromaeo/web/tests/sunspider-crypto-md5.html: Added.
777 * Dromaeo/resources/dromaeo/web/tests/sunspider-crypto-sha1.html: Added.
778 * Dromaeo/resources/dromaeo/web/tests/sunspider-date-format-tofte.html: Added.
779 * Dromaeo/resources/dromaeo/web/tests/sunspider-date-format-xparb.html: Added.
780 * Dromaeo/resources/dromaeo/web/tests/sunspider-math-cordic.html: Added.
781 * Dromaeo/resources/dromaeo/web/tests/sunspider-math-partial-sums.html: Added.
782 * Dromaeo/resources/dromaeo/web/tests/sunspider-math-spectral-norm.html: Added.
783 * Dromaeo/resources/dromaeo/web/tests/sunspider-regexp-dna.html: Added.
784 * Dromaeo/resources/dromaeo/web/tests/sunspider-string-fasta.html: Added.
785 * Dromaeo/resources/dromaeo/web/tests/sunspider-string-tagcloud.html: Added.
786 * Dromaeo/resources/dromaeo/web/tests/sunspider-string-unpack-code.html: Added.
787 * Dromaeo/resources/dromaeo/web/tests/sunspider-string-validate-input.html: Added.
788 * Dromaeo/resources/dromaeo/web/tests/v8-crypto.html: Added.
789 * Dromaeo/resources/dromaeo/web/tests/v8-deltablue.html: Added.
790 * Dromaeo/resources/dromaeo/web/tests/v8-earley-boyer.html: Added.
791 * Dromaeo/resources/dromaeo/web/tests/v8-raytrace.html: Added.
792 * Dromaeo/resources/dromaeo/web/tests/v8-richards.html: Added.
793 * Dromaeo/resources/dromaeo/web/tests/72px.png: Added.
794 * Dromaeo/resources/dromaeo/web/web-style.css: Added.
795 * Dromaeo/resources/dromaeo/web/webrunner.js: Added.
796 * Skipped: Unskip the dromaeo driver.
798 2012-01-31 Ryosuke Niwa <rniwa@webkit.org>
800 Fix Parser/html5-full-render.html after r106379.
802 * Parser/html5-full-render.html:
804 2012-01-31 Ryosuke Niwa <rniwa@webkit.org>
806 PerfTestRunner should automatically create pre#log
807 https://bugs.webkit.org/show_bug.cgi?id=77469
809 Reviewed by Tony Chang.
811 Automatically generate <pre id="log"></pre> if there isn't one.
813 * Bindings/event-target-wrapper.html:
814 * DOM/Accessors.html:
815 * DOM/CloneNodes.html:
816 * DOM/CreateNodes.html:
817 * DOM/DOMDivWalk.html:
821 * DOM/GetElement.html:
824 * Dromaeo/dom-query.html:
825 * Dromaeo/resources/dromaeorunner.js:
826 * Parser/html-parser.html:
827 * Parser/html5-full-render.html:
828 * Parser/simple-url.html:
829 * Parser/tiny-innerHTML.html:
830 * Parser/url-parser.html:
831 * Parser/xml-parser.html:
832 * resources/runner.js:
833 (PerfTestRunner.log):
834 (PerfTestRunner.printStatistics):
836 2012-01-31 Ryosuke Niwa <rniwa@webkit.org>
838 runner.js in performance tests should define a class
839 https://bugs.webkit.org/show_bug.cgi?id=77074
841 Reviewed by Eric Seidel.
843 Wrap all functions in runner.js by PerfTestRunner and update tests that runner.js accordingly.
844 Also replace compute* functions in runner.js by more robust code from dom-perf.js.
846 * Bindings/event-target-wrapper.html:
848 * DOM/resources/dom-perf.js:
849 (BenchmarkSuite.prototype.RunSingle):
851 * Mutation/append-child-deep.html:
852 * Mutation/append-child.html:
853 * Mutation/inner-html.html:
854 * Mutation/remove-child-deep.html:
855 * Mutation/remove-child.html:
856 * Parser/html-parser.html:
857 * Parser/html5-full-render.html:
858 * Parser/simple-url.html:
859 * Parser/tiny-innerHTML.html:
860 * Parser/url-parser.html:
861 * Parser/xml-parser.html:
862 * resources/runner.js:
863 (PerfTestRunner.log):
864 (PerfTestRunner.logInfo):
865 (PerfTestRunner.loadFile):
866 (PerfTestRunner.computeStatistics):
867 (PerfTestRunner.logStatistics):
868 (PerfTestRunner._runLoop.else):
869 (PerfTestRunner._runLoop):
870 (PerfTestRunner._runner):
872 2012-01-31 Hajime Morrita <morrita@chromium.org>
874 [PerformanceTests] Add landing html for Dromaeo dom-query test
875 https://bugs.webkit.org/show_bug.cgi?id=77329
877 Reviewed by Ryosuke Niwa.
879 Added a "landing html" which includes actual dromaemo page and
880 send messages to interact with it. The landing html also dumps the
881 score in run-perf-tests friendly format.
883 This test isn't enabled until Dromaemo itself is available for run-perf-tests.
884 It will happen in a separate change.
886 * Dromaeo/dom-query.html: Added.
887 * Dromaeo/resources/dromaeorunner.js: Added.
888 * Skipped: Skipping this for now.
890 2012-01-30 Ryosuke Niwa <rniwa@webkit.org>
892 Skip inspector tests since they have been timing out.
896 2012-01-29 Ryosuke Niwa <rniwa@webkit.org>
898 DOM/DOMDivWalk.html result is unreliable
899 https://bugs.webkit.org/show_bug.cgi?id=77313
901 Reviewed by Adam Barth.
903 Trigger garbage collection manually between test runs to avoid GC
904 to occur in the middle of runs.
906 * DOM/resources/dom-perf.js:
907 (BenchmarkSuite.prototype.RunSingle):
908 * resources/runner.js:
913 2012-01-26 Ryosuke Niwa <rniwa@webkit.org>
915 Import Chromium's dom_perf test
916 https://bugs.webkit.org/show_bug.cgi?id=77175
918 Reviewed by Adam Barth.
922 Note resources/dom/suites.js isn't used by any html file yet but it will be used by Chromium port
923 once its perf bots start pulling test files from WebKit repository instead of Google's internal repository.
926 * DOM/Accessors.html: Added.
927 * DOM/CloneNodes.html: Added.
928 * DOM/CreateNodes.html: Added.
929 * DOM/DOMDivWalk.html: Added.
930 * DOM/DOMTable.html: Added.
931 * DOM/DOMWalk.html: Added.
932 * DOM/Events.html: Added.
933 * DOM/GetElement.html: Added.
934 * DOM/GridSort.html: Added.
935 * DOM/Template.html: Added.
936 * DOM/resources: Added.
937 * DOM/resources/dom-perf.js: Added.
938 * DOM/resources/dom-perf: Added.
939 * DOM/resources/dom-perf/accessors.js: Added.
940 * DOM/resources/dom-perf/clonenodes.js: Added.
941 * DOM/resources/dom-perf/createnodes.js: Added.
942 * DOM/resources/dom-perf/domdivwalk.js: Added.
943 * DOM/resources/dom-perf/domtable.js: Added.
944 * DOM/resources/dom-perf/domwalk.js: Added.
945 * DOM/resources/dom-perf/events.js: Added.
946 * DOM/resources/dom-perf/getelement.js: Added.
947 * DOM/resources/dom-perf/gridsort.js: Added.
948 * DOM/resources/dom-perf/suites.js: Added.
949 * DOM/resources/dom-perf/template.js: Added.
950 * resources/runner.js:
952 2012-01-25 Ryosuke Niwa <rniwa@webkit.org>
954 html5-full-render.html fails due to a log
955 https://bugs.webkit.org/show_bug.cgi?id=77046
957 Reviewed by Adam Barth.
959 Replace the call to log() in html5-full-render.html by a call to newly added logInfo(),
960 which doesn't print anything inside DRT.
962 * Parser/html5-full-render.html:
963 * resources/runner.js:
966 2012-01-19 Adam Barth <abarth@webkit.org>
968 PerformanceTests's runner.js shouldn't be Parser-specific
969 https://bugs.webkit.org/show_bug.cgi?id=76670
971 Reviewed by Ryosuke Niwa.
973 This runner script is used by a bunch of difference performance tests.
974 It shouldn't be in the Parser directory anymore.
976 * Bindings/event-target-wrapper.html:
977 * Mutation/append-child-deep.html:
978 * Mutation/append-child.html:
979 * Mutation/inner-html.html:
980 * Mutation/remove-child-deep.html:
981 * Mutation/remove-child.html:
982 * Parser/html-parser.html:
983 * Parser/html5-full-render.html:
984 * Parser/resources/runner.js: Removed.
985 * Parser/simple-url.html:
986 * Parser/tiny-innerHTML.html:
987 * Parser/url-parser.html:
988 * Parser/xml-parser.html:
990 * resources/runner.js: Copied from PerformanceTests/Parser/resources/runner.js.
992 2012-01-19 Ryosuke Niwa <rniwa@webkit.org>
994 Some perf tests time out when ran by run-perf-tests
995 https://bugs.webkit.org/show_bug.cgi?id=76612
997 Reviewed by Dirk Pranke and Eric Seidel.
999 Replace all images in html5.html by geenbox.png to avoid accessing whatwg.org when
1000 running the parser tests. Also call dumpAsText, waitUntilDone, and notifyDone automatically
1001 inside runner.js to avoid having to call them in individual tests.
1003 * Bindings/event-target-wrapper.html: Removed calls to layoutTestController methods since
1004 they are now called by runner.js automatically.
1005 * Parser/resources/greenbox.png: Copied from LayoutTests/fast/css/resources/greenbox.png.
1006 * Parser/resources/html5.html:
1007 * Parser/resources/runner.js:
1010 2012-01-18 Ryosuke Niwa <rniwa@webkit.org>
1012 run-perf-tests should support Skipped list
1013 https://bugs.webkit.org/show_bug.cgi?id=76594
1015 Reviewed by Adam Barth.
1017 Add Skipped list to be used by run-perf-tests as it can only runs tests in
1018 Bindings, Parser, and inspector at the moment.
1022 2012-01-12 Ilya Tikhonovsky <loislo@chromium.org>
1024 Web Inspector: performance: restore 'log 300 messages into console' test.
1025 https://bugs.webkit.org/show_bug.cgi?id=76170
1027 It was removed in order of transition from layout tests to perf tests.
1029 Reviewed by Yury Semikhatsky.
1031 * inspector/console-300-lines.html: Added.
1033 2012-01-12 Ilya Tikhonovsky <loislo@chromium.org>
1035 Web Inspector: performance tests: fix memory leak in first-open-resources test.
1036 https://bugs.webkit.org/show_bug.cgi?id=76049
1038 first-open-resources doesn't reset resource panel properly after test run.
1040 Reviewed by Yury Semikhatsky.
1042 * inspector/first-open-resources.html:
1044 2012-01-10 Ilya Tikhonovsky <loislo@chromium.org>
1046 Unreviewed. WebInspector: Remove unnecessary logging from the test.
1048 * inspector/first-open-resources.html:
1050 2012-01-10 Ilya Tikhonovsky <loislo@chromium.org>
1052 Unreviewed. Restore test that was removed during migration from LayoutTests folder.
1054 * inspector/first-open-resources.html: Added.
1056 2012-01-09 Ilya Tikhonovsky <loislo@chromium.org>
1058 Unreviewed test fix after r103683.
1060 * inspector/first-open-scripts.html:
1061 * inspector/show-panel.html:
1063 2012-01-03 Adam Barth <abarth@webkit.org>
1065 html-parser.html takes too long to run
1066 https://bugs.webkit.org/show_bug.cgi?id=75515
1068 Reviewed by Eric Seidel.
1070 In working on runner.js, we introduced a factor of 10 increase to the
1071 running time of this benchmark. This patch dials down the number of
1072 iterations to something more user-friendly.
1074 * Parser/html-parser.html:
1076 2011-12-18 Ilya Tikhonovsky <loislo@chromium.org>
1078 Web Inspector: move heap data stats to separate tab.
1079 https://bugs.webkit.org/show_bug.cgi?id=74704
1081 Reviewed by Pavel Feldman.
1083 * inspector/performance-test.js:
1084 (initialize_TimeTracker.InspectorTest.runPerformanceTest.Timer.prototype._dump):
1085 (initialize_TimeTracker.InspectorTest.runPerformanceTest):
1087 2011-12-01 Ilya Tikhonovsky <loislo@chromium.org>
1089 Web Inspector: chromium: move and adapt Inspector's performance tests for running with run-inspector-perf-tests.py.
1090 https://bugs.webkit.org/show_bug.cgi?id=72260
1092 Reviewed by Pavel Feldman.
1094 * inspector/first-open-elements.html: Renamed from LayoutTests/inspector/performance/resources/first-open-elements.html.
1095 * inspector/first-open-scripts.html: Renamed from LayoutTests/inspector/performance/resources/first-open-scripts.html.
1096 * inspector/inspector-startup-time.html: Renamed from LayoutTests/inspector/performance/resources/inspector-startup-time.html.
1097 * inspector/network-append-30-requests.html: Renamed from LayoutTests/inspector/performance/resources/network-append-30-requests.html.
1098 * inspector/performance-test.js: Renamed from LayoutTests/inspector/performance/resources/performance-test.js.
1099 (initialize_TimeTracker.InspectorTest.runPerformanceTest.Timer):
1100 (initialize_TimeTracker.InspectorTest.runPerformanceTest.Timer.prototype.start):
1101 (initialize_TimeTracker.InspectorTest.runPerformanceTest.Timer.prototype.finish):
1102 (initialize_TimeTracker.InspectorTest.runPerformanceTest.Timer.prototype._getJSHeapSize):
1103 (initialize_TimeTracker.InspectorTest.runPerformanceTest.Timer.prototype.done):
1104 (initialize_TimeTracker.InspectorTest.runPerformanceTest.Timer.prototype._runTest):
1105 (initialize_TimeTracker.InspectorTest.runPerformanceTest.Timer.prototype._dump):
1106 (initialize_TimeTracker.InspectorTest.runPerformanceTest):
1107 (initialize_TimeTracker.InspectorTest.mark):
1108 * inspector/show-panel.html: Renamed from LayoutTests/inspector/performance/resources/show-panel.html.
1110 2011-11-09 Adam Klein <adamk@chromium.org>
1112 [MutationObservers] Microbenchmarks for appendChild, removeChild, and innerHTML
1113 https://bugs.webkit.org/show_bug.cgi?id=71939
1115 Reviewed by Ojan Vafai.
1117 These benchmarks time both the DOM mutations themselves and the time taken
1118 to call the MutationCallback. This measurement is achieved by
1119 executing the code entirely within the MutationCallback itself.
1121 * Mutation/append-child-deep.html: Added. Covers appendChild in a 200-node-deep tree with subtree observation.
1122 * Mutation/append-child.html: Added. Covers appendChild in a flat tree.
1123 * Mutation/inner-html.html: Added. Covers innerHTML adding and removing many nodes at a time.
1124 * Mutation/remove-child-deep.html: Added. Covers removeChild in a 200-node-deep tree with subtree observation.
1125 * Mutation/remove-child.html: Added. Covers removeChild in a flat tree.
1127 2011-10-25 Adam Barth <abarth@webkit.org>
1129 EventTargetFactory.in is not sorted
1130 https://bugs.webkit.org/show_bug.cgi?id=70855
1132 Reviewed by Eric Seidel.
1134 Add a microbenchmark for wrapping event target.
1137 * Bindings/event-target-wrapper.html: Added.
1138 * Parser/resources/runner.js:
1140 - Let the user of the harness get a callback when the test is done.
1142 2011-10-04 Eric Seidel <eric@webkit.org>
1144 Update html5-full-render.html to load the HTML5 spec incrementally, closer to how the browser would
1145 https://bugs.webkit.org/show_bug.cgi?id=69374
1149 Per https://bugs.webkit.org/show_bug.cgi?id=69374#c7
1150 updating the chunksize to be a bit smaller now that the total
1151 size of the html5 spec is smaller than when I wrote the test.
1153 This should increase the prevalence of style resolution in the
1154 sample time, which more closely matches instrument samples
1155 taken when loading the full page in Safari.
1157 * Parser/html5-full-render.html:
1159 2011-10-04 Eric Seidel <eric@webkit.org>
1161 Update html5-full-render.html to load the HTML5 spec incrementally, closer to how the browser would
1162 https://bugs.webkit.org/show_bug.cgi?id=69374
1164 Reviewed by James Robinson.
1166 This should finally be able to provide us with a repeatable metric
1167 for how fast we're currently able to load the HTML5 spec.
1168 There are a variety of interesting functions which show up in this
1169 sample, including of course style resolution.
1171 * Parser/html5-full-render.html:
1173 2011-10-04 Eric Seidel <eric@webkit.org>
1175 Update our copy of the HTML5 spec used for performance testing to match the latest version
1176 https://bugs.webkit.org/show_bug.cgi?id=69364
1178 Unreviewed. The patch is too large to post, so landing this unreviewed. :(
1180 The copy of the html5 spec we were using for testing was over a year old
1181 and didn't have any of the subresources with it (we were only using it
1182 as an HTML parsing benchmark). I'm about to use it for testing
1183 the full load/render time of the benchmark, so I've updated to the latest
1184 version of the spec (now 8mb instead of 5mb) and inlined two of the
1185 CSS files. (Inlining the CSS was necessary to make my testing consistent
1186 as there seems to be a race with some timer fired after CSS load.)
1188 Increasing from 5mb to 8mb showed a similar 30% slowdown in our parser
1189 benchmarks as expected.
1191 * Parser/resources/html5.html:
1193 2011-10-04 Eric Seidel <eric@webkit.org>
1195 Add loopsPerRun option to Parser performance test runner
1196 https://bugs.webkit.org/show_bug.cgi?id=69363
1198 Reviewed by Antti Koivisto.
1200 Add loopsPerRun option and abstract out runLoop function (to make the UI more responsive).
1201 No change in behavior in any of the tests.
1203 * Parser/resources/runner.js:
1208 2011-10-03 Eric Seidel <eric@webkit.org>
1210 Add a microbenchmark for a full-page render of the HTML5 spec
1211 https://bugs.webkit.org/show_bug.cgi?id=69285
1213 Reviewed by Adam Barth.
1215 This was designed to be a test for https://bugs.webkit.org/show_bug.cgi?id=68944
1216 But it seems that by far our dominating cost for the HTML5 benchmark is
1217 time spent laying out lines (which isn't actually that surprising).
1219 I'm adding the performance test for posterity.
1221 * Parser/html-parser.html:
1222 - Removed use of "about:blank" which abarth says is a no-op. Made comment more accurate.
1223 * Parser/html5-full-render.html: Copied from PerformanceTests/Parser/html-parser.html.
1225 2011-10-03 Eric Seidel <eric@webkit.org>
1227 PerformanceTests/Parser/html-parser is only testing parsing of the head element
1228 https://bugs.webkit.org/show_bug.cgi?id=69283
1230 Reviewed by Adam Barth.
1232 While investigating https://bugs.webkit.org/show_bug.cgi?id=68944
1233 I found that the html-parser benchmark was only parsing up to the
1234 first script tag per loop! We've fixed this by adding the sandbox
1235 tag which will deny all external loads and allow the parser to
1236 synchronously continue parsing the entire document to completion
1237 (as we had expected it was doing).
1239 This changes the profile somewhat. Line number counting is much
1240 hotter, since we're actually accounting for the parse of the entire
1241 document in our sample.
1243 Total sample time only about doubles, from 1800ms to 3800ms on my machine
1244 which is less than I would have expected.
1246 * Parser/html-parser.html:
1248 2011-08-09 Alexandru Chiculita <achicu@adobe.com>
1250 Fixing 65868 REGRESSION(r92610) caused by 65668 - Optimize floating elements lookup
1251 https://bugs.webkit.org/show_bug.cgi?id=65871
1253 Reviewed by Dave Hyatt.
1255 * Layout/floats.html: Added the nested divs, so that we can test the propagation impact of the floats tree.
1257 2011-08-08 Sheriff Bot <webkit.review.bot@gmail.com>
1259 Unreviewed, rolling out r92610.
1260 http://trac.webkit.org/changeset/92610
1261 https://bugs.webkit.org/show_bug.cgi?id=65868
1263 Caused assertion failures when running fast/multicol tests
1264 (Requested by andersca on #webkit).
1266 * Layout/floats.html:
1268 2011-08-08 Alexandru Chiculita <achicu@adobe.com>
1270 Optimize floating elements lookup
1271 https://bugs.webkit.org/show_bug.cgi?id=65668
1273 Reviewed by David Hyatt.
1275 * Layout/floats.html: Added the nested divs, so that we can test the propagation impact of the floats tree.
1277 2011-08-04 Alexandru Chiculita <achicu@adobe.com>
1279 Add a performance test for floating elements layout algorithm
1280 https://bugs.webkit.org/show_bug.cgi?id=65741
1282 The test creating lots of small floats and randomly changes
1283 the width of one element at a time. It measures how often it can do that.
1285 Reviewed by Adam Barth.
1287 * Layout/floats.html: Added.
1289 2011-05-30 Daniel Bates <dbates@webkit.org>
1291 Reviewed by Adam Barth.
1293 Rename XSSFilter to XSSAuditor
1294 https://bugs.webkit.org/show_bug.cgi?id=61718
1296 Currently we use the names XSSFilter and XSSAuditor throughout the project.
1297 Instead, we should choose one name for consistency.
1299 No functionality was changed. So, no new tests.
1301 * XSSAuditor: Copied from PerformanceTests/XSSFilter.
1302 * XSSFilter: Removed.
1303 * XSSFilter/large-post-many-events.html: Removed.
1304 * XSSFilter/large-post-many-inline-scripts-and-events.html: Removed.
1305 * XSSFilter/resources: Removed.
1306 * XSSFilter/resources/target-for-large-post-many-inline-scripts-and-events.html: Removed.
1308 2011-03-25 Leo Yang <leo.yang@torchmobile.com.cn>
1310 Reviewed by Dirk Schulze.
1312 SVG <use> element performance improvement
1313 https://bugs.webkit.org/show_bug.cgi?id=57077
1315 Add a manual test case which is from
1316 http://upload.wikimedia.org/wikipedia/commons/4/4e/Sierpinski_carpet_6.svg
1317 for svg <use> element performance test.
1319 * PageLoad/svg/files/Sierpinski_carpet_6.svg: Added.
1320 * PageLoad/svg/svg.pltsuite:
1322 2011-02-05 Eric Seidel <eric@webkit.org>
1324 Reviewed by Adam Barth.
1326 Add performance tests for URL parsing
1327 https://bugs.webkit.org/show_bug.cgi?id=53845
1329 The final-url-en URL corpus is from:
1330 http://corpus.leeds.ac.uk/internet.html
1332 There are also other language corpuses which we may want to use in the future.
1334 The usage instructions were as follows:
1335 "URL lists and other resources: you can freely use them in your research
1336 provided that you supply a link to this website: http://corpus.leeds.ac.uk/."
1339 * Parser/simple-url.html: Added.
1344 Opera: 2830ms (no, that is not a typo)
1345 * Parser/url-parser.html: Added.
1349 Opera: 1383ms (again, not a typo)
1350 * Parser/resources/final-url-en: Added.
1352 2011-02-03 Adam Barth <abarth@webkit.org>
1354 Reviewed by Daniel Bates.
1356 Add another XSSFilter PerformanceTest
1357 https://bugs.webkit.org/show_bug.cgi?id=53750
1359 This PerformanceTest tests the case that was slow in
1360 https://bugs.webkit.org/show_bug.cgi?id=49845
1362 * XSSFilter/large-post-many-inline-scripts-and-events.html: Added.
1363 * XSSFilter/resources: Added.
1364 * XSSFilter/resources/target-for-large-post-many-inline-scripts-and-events.html: Added.
1366 2011-02-03 Adam Barth <abarth@webkit.org>
1368 Reviewed by Eric Seidel.
1370 Add PerformanceTest for XSSFilter
1371 https://bugs.webkit.org/show_bug.cgi?id=53741
1373 This performance tests covers the case of a large POST data and many
1374 small event handlers.
1377 * XSSFilter/large-post-many-events.html: Added.
1379 2011-02-02 Adam Barth <abarth@webkit.org>
1381 Rubber-stamped by Eric Seidel.
1383 Merge PerformanceTests/Parser/ChangeLog and
1384 PerformanceTests/PageLoad/ChangeLog into PerformanceTests/ChangeLog.
1386 It's silly to have ChangeLogs for each of these directories separately.
1387 I've left SunSpider with its own ChangeLog because it's more of an
1392 2011-02-02 Eric Seidel <eric@webkit.org>
1394 Unreviewed. Just fixing an exception seen in Firefox.
1396 HTML5 TreeBuilder regressed a Peacekeeper DOM test by 40%
1397 https://bugs.webkit.org/show_bug.cgi?id=48719
1399 Make the benchmarks work in Firefox/Opera.
1401 * resources/runner.js:
1404 2011-01-27 Eric Seidel <eric@webkit.org>
1406 Reviewed by Darin Adler.
1408 HTML5 TreeBuilder regressed a Peacekeeper DOM test by 40%
1409 https://bugs.webkit.org/show_bug.cgi?id=48719
1411 It's unclear exactly what the Peacekeeper benchmark is testing,
1412 because I haven't found a way to run it myself.
1414 However, I constructed a benchmark which shows at least one possible slow point.
1415 The HTML5 spec talks about creating a new document for every time we use
1416 the fragment parsing algorithm. Document() it turns out, it a huge bloated
1417 mess, and the constructor and destructor do a huge amount of work.
1419 * benchmarks/parser/tiny-innerHTML.html: Added.
1421 2011-01-29 Sheriff Bot <webkit.review.bot@gmail.com>
1423 Unreviewed, rolling out r77050.
1424 http://trac.webkit.org/changeset/77050
1425 https://bugs.webkit.org/show_bug.cgi?id=53371
1427 Caused a crash in Chromium's test_shell_tests (Requested by
1430 * resources/performance-test.js: Removed.
1431 * tiny-innerHTML.html: Removed.
1433 2011-01-28 Eric Seidel <eric@webkit.org>
1435 Reviewed by Darin Adler.
1437 HTML5 TreeBuilder regressed a Peacekeeper DOM test by 40%
1438 https://bugs.webkit.org/show_bug.cgi?id=48719
1440 It's unclear exactly what the Peacekeeper benchmark is testing,
1441 because I haven't found a way to run it myself.
1443 However, I constructed a benchmark which shows at least one possible slow point.
1444 The HTML5 spec talks about creating a new document for every time we use
1445 the fragment parsing algorithm. Document() it turns out, it a huge bloated
1446 mess, and the constructor and destructor do a huge amount of work.
1447 To avoid constructing (or destructing) documents for each innerHTML call,
1448 this patch adds a shared dummy document used by all innerHTML calls.
1450 * benchmarks/parser/tiny-innerHTML.html: Added.
1452 2010-12-31 Adam Barth <abarth@webkit.org>
1454 Rubber-stamped by Eric Seidel.
1456 Move HTML and XML parser benchmarks into PerformanceTests/Parser
1457 https://bugs.webkit.org/show_bug.cgi?id=51772
1459 Add a ChangeLog for tracking changes to the Parser PerformanceTest.
1463 2010-12-31 Adam Barth <abarth@webkit.org>
1465 Rubber-stamped by Eric Seidel.
1467 Move PageLoadTests to PerformanceTests/PageLoad
1468 https://bugs.webkit.org/show_bug.cgi?id=51771
1470 Update URLs to point to the new directory name.
1474 2006-12-26 Eric Seidel <eric@webkit.org>
1478 * svg/svg.pltsuite: re-enable word-iso.svg after fixing http://bugs.webkit.org/show_bug.cgi?id=11987
1480 2006-12-26 Eric Seidel <eric@webkit.org>
1482 Reviewed by bradee-oh.
1484 Add new PageLoadTests directory (this one)
1485 Add LICENSES file to explain where each SVG came from.
1488 * svg/LICENSES: Added.
1489 * svg/files/33041-Samurai.svg: Added.
1490 * svg/files/42470-flower_from_my_garden_v2.svg: Added.
1491 * svg/files/Harvey_Rayner.svg: Added.
1492 * svg/files/az-lizard_benji_park_01.svg: Added.
1493 * svg/files/bamboo_01.svg: Added.
1494 * svg/files/cacuts_01.svg: Added.
1495 * svg/files/cowboy.svg: Added.
1496 * svg/files/crawfish2_ganson.svg: Added.
1497 * svg/files/deb9frac1.svg: Added.
1498 * svg/files/food_leif_lodahl_01.svg: Added.
1499 * svg/files/france.svg: Added.
1500 * svg/files/francobollo_gnome_ezechi_02.svg: Added.
1501 * svg/files/gearflowers.svg: Added.
1502 * svg/files/hereGear4.svg: Added.
1503 * svg/files/mtsthelens.svg: Added.
1504 * svg/files/mtsthelens0.jpg: Added.
1505 * svg/files/world-iso.svg: Added.
1506 * svg/files/worldcup.svg: Added.
1507 * svg/svg.pltsuite: Added.