1 2012-05-14 Tony Chang <tony@chromium.org>
3 Don't append log lines while perf tests are running.
4 https://bugs.webkit.org/show_bug.cgi?id=86028
6 Reviewed by Ryosuke Niwa.
8 In some tests, the extra DOM nodes can cause the test timing to change.
9 Avoid adding DOM nodes until the test is over. When running in a browser,
10 we append nodes as we run so the user can have some feedback.
12 * resources/runner.js:
13 (PerfTestRunner.log): Store the log lines in an array until the test is finished.
15 2012-05-14 Ryosuke Niwa <rniwa@webkit.org>
17 Build fix. Don't adjust calls per iteration in the second run.
19 * resources/runner.js:
20 (PerfTestRunner._perSecondRunner):
22 2012-05-13 Ryosuke Niwa <rniwa@webkit.org>
24 performance tests should be able to measure runs/sec rather than time
25 https://bugs.webkit.org/show_bug.cgi?id=86021
27 Reviewed by Ojan Vafai.
29 Add PerfTestRunner.runPerSecond. It uses _runLoop but replaces _runner by _perSecondRunner
30 to compute runs/s of runFunction.
32 When _perSecondRunner is called for the first time, i.e. _completedRuns is 0 (notice this is -1
33 in regular run/_runner), it slowly increases the number of function calls to runFunction between
34 time measurements in order to discount the time used by new Date() calls themselves until the
35 total time spent reaches 100 milliseconds.
37 By default, runPerSecond runs the test for at least 750 milliseconds in each run, and executes
38 21 runs, yielding the total run time of roughly 18 seconds. This is significantly faster than
39 most of existing performance tests. Also see http://ejohn.org/blog/accuracy-of-javascript-time/.
41 Finally, refactored the existing methods of PerfTestRunner to allow "runs/s" unit and share code.
43 * Layout/flexbox-column-nowrap.html:
44 * Layout/flexbox-column-wrap.html:
45 * Layout/flexbox-row-nowrap.html:
46 * Layout/flexbox-row-wrap.html:
47 * resources/runner.js:
48 (PerfTestRunner.computeStatistics): Takes unit.
49 (PerfTestRunner.logStatistics): Ditto.
50 (PerfTestRunner._runLoop):
51 (PerfTestRunner._runner):
52 (PerfTestRunner.runPerSecond): Added.
53 (PerfTestRunner._perSecondRunner): Added. Called by _runLoop.
54 (PerfTestRunner._perSecondRunnerIterator): Added.
56 2012-05-09 Tony Chang <tony@chromium.org>
58 add some basic perf-o-matic tests for flexbox
59 https://bugs.webkit.org/show_bug.cgi?id=86017
61 Reviewed by Ryosuke Niwa.
63 Each of these tests take < 3s on my machine.
65 * Layout/flexbox-column-nowrap.html: Added.
66 * Layout/flexbox-column-wrap.html: Added.
67 * Layout/flexbox-row-nowrap.html: Added.
68 * Layout/flexbox-row-wrap.html: Added.
70 2012-05-05 Ilya Tikhonovsky <loislo@chromium.org>
72 Web Inspector: unreviewed followup fix for the performance test after r116218.
74 * inspector/heap-snapshot.html:
76 2012-05-02 Tom Zakrajsek <tomz@codeaurora.org>
78 Need tests for PerfTestRunner.computeStatistics
79 https://bugs.webkit.org/show_bug.cgi?id=85410
81 Reviewed by Ryosuke Niwa.
83 * resources/runner.js:
85 2012-05-02 Sheriff Bot <webkit.review.bot@gmail.com>
87 Unreviewed, rolling out r115905.
88 http://trac.webkit.org/changeset/115905
89 https://bugs.webkit.org/show_bug.cgi?id=85435
91 New computeStatistics test is failing on chromium ports
92 (Requested by tomz on #webkit).
94 * resources/runner.js:
96 2012-05-02 Tom Zakrajsek <tomz@codeaurora.org>
98 Need tests for PerfTestRunner.computeStatistics
99 https://bugs.webkit.org/show_bug.cgi?id=85410
101 Reviewed by Ryosuke Niwa.
103 * resources/runner.js:
105 2012-04-29 Tom Zakrajsek <tomz@codeaurora.org>
107 PerfTestRunner.computeStatistics incorrectly calculates min, max and median
108 https://bugs.webkit.org/show_bug.cgi?id=85111
110 Reviewed by Ryosuke Niwa.
112 The sort of the data input was being done alphabetically.
113 So I provided a numeric compare function.
115 * resources/runner.js:
117 2012-04-17 Ilya Tikhonovsky <loislo@chromium.org>
119 Web Inspector: the fix for test after massive rename in r114271.
120 https://bugs.webkit.org/show_bug.cgi?id=84147
122 Drive by fix. The test was renamed to heap-snapshot.html
124 Reviewed by Yury Semikhatsky.
126 * inspector/heap-snapshot.html: Renamed from PerformanceTests/inspector/detailed-heapshots-smoke-test.html.
128 2012-04-16 Yury Semikhatsky <yurys@chromium.org>
130 Web Inspector: rename heap profiler files and classes DetailedHeapshot* ->HeapSnapshot*
131 https://bugs.webkit.org/show_bug.cgi?id=84038
133 A bunch of renames "detailed heapshot" -> "heap snapshot".
135 Reviewed by Pavel Feldman.
137 * inspector/detailed-heapshots-smoke-test.html:
139 2012-04-13 Ryosuke Niwa <rniwa@webkit.org>
145 2012-04-12 Ryosuke Niwa <rniwa@webkit.org>
147 Enable SVG page loading performance tests
148 https://bugs.webkit.org/show_bug.cgi?id=83861
150 Reviewed by Adam Barth.
152 Unskip PageLoad directory and skip tests that load too fast (less than 100ms) and are unstable,
153 and the ones that take too long to load (more than 20s).
157 2012-04-04 Ilya Tikhonovsky <loislo@chromium.org>
159 Web Inspector: Unreviewed. temporary disable broken inspector tests.
161 * inspector/first-open-scripts.html.broken: Renamed from PerformanceTests/inspector/first-open-scripts.html.
162 * inspector/network-append-30-requests.html.broken: Renamed from PerformanceTests/inspector/network-append-30-requests.html.
163 * inspector/show-panel.html.broken: Renamed from PerformanceTests/inspector/show-panel.html.
165 2012-04-04 Ilya Tikhonovsky <loislo@chromium.org>
167 Web Inspector: linearise aggregate's retaining size calculation.
168 https://bugs.webkit.org/show_bug.cgi?id=83125
170 This version is twice as fast as the original and it is non-recursive.
172 Reviewed by Yury Semikhatsky.
174 * inspector/detailed-heapshots-smoke-test.html:
176 2012-03-30 David Barr <davidbarr@chromium.org>
178 Split up top-level .gitignore and .gitattributes
179 https://bugs.webkit.org/show_bug.cgi?id=82687
181 Reviewed by Tor Arne Vestbø.
183 * .gitattributes: Added.
185 2012-03-28 Yury Semikhatsky <yurys@chromium.org>
187 Web Inspector: switch heap profiler front-end to separate storage of nodes and edges
188 https://bugs.webkit.org/show_bug.cgi?id=82453
190 Updated heap profiler performance test after heap profiler front-end
193 Reviewed by Pavel Feldman.
195 * inspector/detailed-heapshots-smoke-test.html:
197 2012-03-27 Alexis Menard <alexis.menard@openbossa.org>
199 Add a perf test which updates the value of an already declared CSS property.
200 https://bugs.webkit.org/show_bug.cgi?id=82321
202 Reviewed by Andreas Kling.
204 This benchmark update CSS existing properties of the style from JS.
206 * CSS/CSSPropertyUpdateValue.html: Added.
208 2012-03-15 Kentaro Hara <haraken@chromium.org>
210 [PerformanceTests] run-perf-tests should output correct units
211 https://bugs.webkit.org/show_bug.cgi?id=78303
213 Reviewed by Ryosuke Niwa.
215 Previously run-perf-tests just supported "ms" for units.
216 Consequently, Dromaeo perf tests had been reporting runs/s as "ms".
217 This patch fixes run-perf-tests so that they can support custom units.
218 The default unit is "ms".
220 The test result looks like this:
222 $ ./Tools/Scripts/run-perf-tests Dromaeo/dom-attr.html
223 RESULT Dromaeo: dom-attr= 6465.9525483 runs/s
224 median= 0.0 runs/s, stdev= 24.2983433436 runs/s, min= 6435.87649402 runs/s, max= 6515.63693392 runs/s
226 * Dromaeo/resources/dromaeorunner.js:
228 * resources/runner.js:
229 (PerfTestRunner.computeStatistics):
230 (PerfTestRunner.printStatistics):
232 2012-03-15 Alexis Menard <alexis.menard@openbossa.org>
234 Fix the test failing with run-perf-tests.
236 Rubber stamped by Ryosuke Niwa.
238 * CSS/CSSPropertySetterGetter.html:
240 2012-03-14 Alexis Menard <alexis.menard@openbossa.org>
242 Add a new perf test to benchmark setting and reading CSS properties from JS.
243 https://bugs.webkit.org/show_bug.cgi?id=81155
245 Reviewed by Ryosuke Niwa.
247 This benchmark read and set CSS properties from JS. It contains a list
248 of common CSS properties.
250 * CSS/CSSPropertySetterGetter.html: Added.
252 2012-03-14 Alexandru Chiculita <achicu@adobe.com>
254 Layout/floats.html should be runnable by run-perf-tests
255 https://bugs.webkit.org/show_bug.cgi?id=77051
257 Reviewed by Ryosuke Niwa.
259 I've split Layout/floats.html into multiple tests for each button in the original manual test.
260 Some tests take longer to run and I've changed the number of iterations, so that each tests finishes under 30s per run.
262 * DOM/resources/dom-perf.js:
263 * Layout/floats.html: Removed.
264 * Layout/floats_100_100.html: Added.
265 * Layout/floats_100_100_nested.html: Added.
266 * Layout/floats_20_100.html: Added.
267 * Layout/floats_20_100_nested.html: Added.
268 * Layout/floats_2_100.html: Added.
269 * Layout/floats_2_100_nested.html: Added.
270 * Layout/floats_50_100.html: Added.
271 * Layout/floats_50_100_nested.html: Added.
272 * Layout/resources/floats.css: Added.
277 * Layout/resources/floats.js: Added.
280 * resources/runner.js:
281 (PerfTestRunner.resetRandomSeed):
282 (PerfTestRunner.random):
284 Moved the Math.random to runner.js to be used by all tests.
285 Added resetRandomSeed to bring the randomizer back to initial seed.
286 It is useful to get the same results at every run and minimize the
287 differences between runs.
289 2012-03-14 Sheriff Bot <webkit.review.bot@gmail.com>
291 Unreviewed, rolling out r110559.
292 http://trac.webkit.org/changeset/110559
293 https://bugs.webkit.org/show_bug.cgi?id=81142
295 Broke Dromaeo tests (Requested by rniwa on #webkit).
297 * Dromaeo/resources/dromaeorunner.js:
300 2012-03-13 Kentaro Hara <haraken@chromium.org>
302 Dromaeo perf-tests results are wrong
303 https://bugs.webkit.org/show_bug.cgi?id=80974
305 Reviewed by Hajime Morita.
307 Dromaeo perf-tests had reported the sum of runs/seconds as "ms".
308 This patch fixes them to report the execution time per run.
310 At present, they report "0.0ms" for "stdev". This is because
311 dromaeorunner.js can just know stdev of "runs/seconds"
312 and cannot calculate stdev of "ms" from that. We can fix it later.
314 * Dromaeo/resources/dromaeorunner.js:
317 2012-03-12 Ilya Tikhonovsky <loislo@chromium.org>
319 Web Inspector: chromium: increase heap snapshot performance coverage.
320 https://bugs.webkit.org/show_bug.cgi?id=80829
322 Reviewed by Yury Semikhatsky.
324 * inspector/detailed-heapshots-smoke-test.html:
325 * inspector/performance-test.js:
326 (initialize_TimeTracker.InspectorTest.measureFunction):
328 2012-03-06 Kentaro Hara <haraken@chromium.org>
330 [Perf tests] Reduce the number of loops in dom-attributes.html
331 https://bugs.webkit.org/show_bug.cgi?id=80077
333 Reviewed by Ryosuke Niwa.
335 dom-attributes.html takes 100~ seconds in the perf bots. This patch reduces
336 the time by reducing the number of loops.
338 This is just a temporary fix. After more detailed investigation, I will reduce
339 the number of tests in dom-attributes.html, and revert back the number of loops
340 to guarantee the reliability of the perf test results.
342 * Bindings/dom-attributes.html:
344 2012-03-06 Ilya Tikhonovsky <loislo@chromium.org>
346 Web Inspector: Heap Snapshot test: split overal time metric into separate metrics.
347 https://bugs.webkit.org/show_bug.cgi?id=80409
349 Reviewed by Yury Semikhatsky.
351 * inspector/detailed-heapshots-smoke-test.html:
353 2012-03-05 Ilya Tikhonovsky <loislo@chromium.org>
355 Web Inspector: [chromium] introduce HeapSnapshot performance test.
356 https://bugs.webkit.org/show_bug.cgi?id=80280
358 Reviewed by Pavel Feldman.
360 * inspector/detailed-heapshots-smoke-test.html: Added.
362 2012-03-01 Ryosuke Niwa <rniwa@webkit.org>
364 DOM tests take too long to run
365 https://bugs.webkit.org/show_bug.cgi?id=80082
367 Reviewed by Eric Seidel.
369 Reduce benchmark.timeToRun from 500ms to 100ms. Doesn't seem to affect test results much
370 (except DOM/DOMTable.html) but significantly reduces the runtime of tests.
372 * DOM/resources/dom-perf.js:
373 (BenchmarkSuite.prototype.RunSingle):
375 2012-02-26 Kentaro Hara <haraken@chromium.org>
377 [Performance Tests] [Chromium] Bindings/dom-attributes.html is timing out
378 https://bugs.webkit.org/show_bug.cgi?id=79593
380 Reviewed by Adam Barth.
382 This patch halves the execution time of Bindings/dom-attributes.html
383 in order to avoid timeout in Chromium. The reason for the timeout is that
384 V8 DOM bindings are too much slower than JSC bindings.
385 I am a bit afraid that this patch will reduce the accuracy of the
386 perf test results, but it would make sense to reduce the execution time
387 until we fix the performance issue in V8 DOM bindings.
389 * Bindings/dom-attributes.html:
391 2012-02-24 Ryosuke Niwa <rniwa@webkit.org>
393 Rename dom*_*attributes.html to dom*-*attributes.html to follow the WebKit convention.
395 * Bindings/dom-attributes.html: Copied from PerformanceTests/Bindings/dom_attributes.html.
396 * Bindings/dom_attributes.html: Removed.
398 2012-02-24 Kentaro Hara <haraken@chromium.org>
400 Unreviewed, rolling out r108477.
401 http://trac.webkit.org/changeset/108477
402 https://bugs.webkit.org/show_bug.cgi?id=79209
404 The perf tests committed in r108748 covers the perf tests
405 committed in r108477. So I'll roll out r108477.
407 * Bindings/dom_attributes_id_getter.html: Removed.
408 * Bindings/dom_attributes_id_setter.html: Removed.
409 * Bindings/resources/dom_attributes_common.js: Removed.
411 2012-02-24 Kentaro Hara <haraken@chromium.org>
413 Add performance tests for DOM attribute getters and setters
414 https://bugs.webkit.org/show_bug.cgi?id=79208
416 Reviewed by Ryosuke Niwa.
418 This patch adds performance micro-benchmarks for DOM attribute
419 getters and setters. We selected DOM attributes from HTMLElement,
420 Element and Node which will most impact on the DOM performance
421 in the real Web and which have different call-paths from another
424 The perf test result in my local Chromium/Linux environment is as follows:
425 median= 14967.0 ms, stdev= 85.2385476178 ms, min= 14861.0 ms, max= 15155.0 ms
427 If we run the test with DumpRenderTree, we can get the following test results:
428 Info: [HTMLElement.id] avg=65.76ms, median=65.00ms, stdev=2.14ms, min=63, max=70
429 Info: [HTMLElement.title] avg=64.05ms, median=63.00ms, stdev=1.50ms, min=63, max=67
430 Info: [HTMLElement.lang] avg=64.19ms, median=63.00ms, stdev=1.82ms, min=62, max=67
431 Info: [HTMLElement.dir] avg=64.10ms, median=63.00ms, stdev=1.72ms, min=62, max=68
432 Info: [HTMLElement.className] avg=63.33ms, median=63.00ms, stdev=0.89ms, min=63, max=67
433 Info: [HTMLElement.classList] avg=1946.00ms, median=1945.00ms, stdev=38.22ms, min=1921, max=2110
434 Info: [HTMLElement.tabIndex] avg=83.52ms, median=80.00ms, stdev=6.00ms, min=79, max=94
435 Info: [HTMLElement.draggable] avg=78.14ms, median=81.00ms, stdev=3.51ms, min=74, max=82
436 Info: [HTMLElement.webkitdropzone] avg=64.33ms, median=63.00ms, stdev=1.98ms, min=63, max=68
437 Info: [HTMLElement.hidden] avg=65.57ms, median=64.00ms, stdev=3.27ms, min=63, max=71
438 Info: [HTMLElement.accessKey] avg=64.43ms, median=63.00ms, stdev=2.11ms, min=62, max=68
439 Info: [HTMLElement.children] avg=130.76ms, median=128.00ms, stdev=9.75ms, min=109, max=143
440 Info: [HTMLElement.isContentEditable] avg=74.29ms, median=75.00ms, stdev=2.00ms, min=71, max=77
441 Info: [HTMLElement.spellcheck] avg=79.52ms, median=80.00ms, stdev=2.52ms, min=76, max=82
442 Info: [HTMLElement.innerHTML] avg=279.05ms, median=279.00ms, stdev=1.96ms, min=276, max=283
443 Info: [HTMLElement.innerText] avg=204.14ms, median=203.00ms, stdev=2.95ms, min=200, max=210
444 Info: [HTMLElement.outerHTML] avg=1544.10ms, median=1546.00ms, stdev=15.56ms, min=1514, max=1568
445 Info: [HTMLElement.outerText] avg=216.05ms, median=207.00ms, stdev=18.19ms, min=201, max=247
446 Info: [HTMLElement.contentEditable] avg=334.24ms, median=323.00ms, stdev=36.06ms, min=318, max=446
447 Info: [HTMLElement.id="foo"] avg=53.19ms, median=53.00ms, stdev=1.76ms, min=52, max=58
448 Info: [HTMLElement.title="foo"] avg=63.14ms, median=63.00ms, stdev=0.35ms, min=63, max=64
449 Info: [HTMLElement.lang="foo"] avg=60.86ms, median=61.00ms, stdev=0.56ms, min=60, max=62
450 Info: [HTMLElement.dir="foo"] avg=53.57ms, median=54.00ms, stdev=0.58ms, min=53, max=55
451 Info: [HTMLElement.className="foo"] avg=64.52ms, median=64.00ms, stdev=0.91ms, min=63, max=66
452 Info: [HTMLElement.tabIndex="foo"] avg=367.86ms, median=369.00ms, stdev=8.06ms, min=352, max=380
453 Info: [HTMLElement.draggable="foo"] avg=79.43ms, median=79.00ms, stdev=0.58ms, min=79, max=81
454 Info: [HTMLElement.webkitdropzone="foo"] avg=62.14ms, median=62.00ms, stdev=0.35ms, min=62, max=63
455 Info: [HTMLElement.hidden="foo"] avg=61.67ms, median=62.00ms, stdev=0.71ms, min=61, max=64
456 Info: [HTMLElement.accessKey="foo"] avg=61.86ms, median=62.00ms, stdev=0.56ms, min=61, max=63
457 Info: [HTMLElement.spellcheck="foo"] avg=79.57ms, median=80.00ms, stdev=0.58ms, min=78, max=80
458 Info: [HTMLElement.innerHTML="foo"] avg=1176.67ms, median=1169.00ms, stdev=26.60ms, min=1146, max=1246
459 Info: [HTMLElement.innerText="foo"] avg=51.62ms, median=52.00ms, stdev=0.72ms, min=50, max=53
460 Info: [Element.tagName] avg=79.52ms, median=80.00ms, stdev=1.05ms, min=78, max=81
461 Info: [Element.style] avg=126.19ms, median=126.00ms, stdev=10.40ms, min=104, max=161
462 Info: [Element.offsetLeft] avg=98.95ms, median=104.00ms, stdev=4.01ms, min=100, max=99
463 Info: [Element.clientLeft] avg=98.33ms, median=102.00ms, stdev=2.59ms, min=100, max=99
464 Info: [Element.scrollLeft] avg=103.29ms, median=96.00ms, stdev=15.63ms, min=100, max=97
465 Info: [Element.dataset] avg=2448.62ms, median=2441.00ms, stdev=20.43ms, min=2426, max=2503
466 Info: [Element.firstElementChild] avg=58.71ms, median=58.00ms, stdev=2.37ms, min=57, max=65
467 Info: [Element.lastElementChild] avg=56.33ms, median=55.00ms, stdev=1.83ms, min=54, max=59
468 Info: [Element.previousElementSibling] avg=52.95ms, median=52.00ms, stdev=1.70ms, min=52, max=57
469 Info: [Element.nextElementSibling] avg=58.48ms, median=58.00ms, stdev=1.79ms, min=57, max=63
470 Info: [Element.childElementCount] avg=64.57ms, median=64.00ms, stdev=1.81ms, min=63, max=71
471 Info: [Element.onload] avg=98.38ms, median=98.00ms, stdev=0.49ms, min=98, max=99
472 Info: [Element.scrollLeft="foo"] avg=95.24ms, median=95.00ms, stdev=0.92ms, min=94, max=98
473 Info: [Element.onload="foo"] avg=67.14ms, median=67.00ms, stdev=0.56ms, min=66, max=68
474 Info: [Node.nodeName] avg=76.29ms, median=76.00ms, stdev=0.63ms, min=75, max=77
475 Info: [Node.nodeType] avg=53.05ms, median=52.00ms, stdev=2.61ms, min=52, max=61
476 Info: [Node.parentNode] avg=53.52ms, median=53.00ms, stdev=1.22ms, min=52, max=56
477 Info: [Node.childNodes] avg=118.33ms, median=123.00ms, stdev=8.85ms, min=107, max=129
478 Info: [Node.firstChild] avg=53.62ms, median=53.00ms, stdev=1.13ms, min=51, max=55
479 Info: [Node.lastChild] avg=53.14ms, median=53.00ms, stdev=1.21ms, min=52, max=55
480 Info: [Node.previousSibling] avg=51.86ms, median=51.00ms, stdev=1.55ms, min=50, max=54
481 Info: [Node.nextSibling] avg=52.86ms, median=54.00ms, stdev=1.81ms, min=50, max=55
482 Info: [Node.attributes] avg=2027.71ms, median=2026.00ms, stdev=10.48ms, min=2010, max=2051
483 Info: [Node.ownerDocument] avg=152.14ms, median=152.00ms, stdev=1.73ms, min=149, max=155
484 Info: [Node.namespaceURI] avg=60.86ms, median=59.00ms, stdev=3.85ms, min=56, max=66
485 Info: [Node.localName] avg=60.00ms, median=59.00ms, stdev=2.71ms, min=57, max=66
486 Info: [Node.baseURI] avg=671.10ms, median=668.00ms, stdev=10.66ms, min=659, max=706
487 Info: [Node.parentElement] avg=55.05ms, median=56.00ms, stdev=2.15ms, min=52, max=58
488 Info: [Node.nodeValue] avg=61.24ms, median=60.00ms, stdev=2.56ms, min=59, max=68
489 Info: [Node.prefix] avg=60.90ms, median=58.00ms, stdev=4.26ms, min=57, max=68
490 Info: [Node.textContent] avg=149.71ms, median=149.00ms, stdev=1.12ms, min=148, max=152
491 Info: [Node.nodeValue="foo"] avg=23.62ms, median=23.00ms, stdev=0.72ms, min=23, max=25
492 Info: [Node.prefix="foo"] avg=49.57ms, median=49.00ms, stdev=0.73ms, min=49, max=51
493 Info: [Node.textContent="foo"] avg=145.81ms, median=140.00ms, stdev=17.43ms, min=138, max=199
495 * Bindings/dom_attributes.html: Added.
496 * resources/runner.js:
497 (PerfTestRunner.info):
499 2012-02-22 Kentaro Hara <haraken@chromium.org>
501 Add performance tests for the Element.id getter and setter
502 https://bugs.webkit.org/show_bug.cgi?id=79209
504 Reviewed by Adam Barth.
506 This patch adds performance tests for the Element.id getter and setter.
508 The results of 10 runs in my local Chromium/Linux are as follows:
510 dom_attributes_id_getter.html:
511 median= 92.0 ms, stdev= 1.65151445649 ms, min= 89.0 ms, max= 96.0 ms
512 median= 87.5 ms, stdev= 1.84390889146 ms, min= 85.0 ms, max= 92.0 ms
513 median= 94.0 ms, stdev= 1.46543508898 ms, min= 90.0 ms, max= 95.0 ms
514 median= 86.0 ms, stdev= 1.66958078571 ms, min= 84.0 ms, max= 91.0 ms
515 median= 94.0 ms, stdev= 2.25610283454 ms, min= 103.0 ms, max= 98.0 ms
516 median= 86.0 ms, stdev= 1.49666295471 ms, min= 84.0 ms, max= 91.0 ms
517 median= 86.0 ms, stdev= 1.5321553446 ms, min= 84.0 ms, max= 90.0 ms
518 median= 86.0 ms, stdev= 2.20227155455 ms, min= 84.0 ms, max= 94.0 ms
519 median= 96.0 ms, stdev= 1.74570902501 ms, min= 101.0 ms, max= 99.0 ms
520 median= 86.0 ms, stdev= 1.63935963108 ms, min= 84.0 ms, max= 90.0 ms
521 median= 94.0 ms, stdev= 1.49248115566 ms, min= 90.0 ms, max= 95.0 ms
522 median= 88.0 ms, stdev= 5.20192272146 ms, min= 84.0 ms, max= 98.0 ms
523 median= 86.0 ms, stdev= 1.41067359797 ms, min= 84.0 ms, max= 89.0 ms
524 median= 86.0 ms, stdev= 1.48660687473 ms, min= 84.0 ms, max= 89.0 ms
525 median= 94.0 ms, stdev= 1.58113883008 ms, min= 93.0 ms, max= 97.0 ms
526 median= 86.0 ms, stdev= 1.95959179423 ms, min= 84.0 ms, max= 93.0 ms
527 median= 86.0 ms, stdev= 1.8547236991 ms, min= 84.0 ms, max= 92.0 ms
528 median= 86.0 ms, stdev= 1.39283882772 ms, min= 84.0 ms, max= 89.0 ms
529 median= 88.0 ms, stdev= 1.48660687473 ms, min= 85.0 ms, max= 90.0 ms
530 median= 86.5 ms, stdev= 2.3 ms, min= 84.0 ms, max= 93.0 ms
532 dom_attributes_id_setter.html:
533 median= 123.0 ms, stdev= 2.06397674406 ms, min= 119.0 ms, max= 128.0 ms
534 median= 119.0 ms, stdev= 1.92028643697 ms, min= 117.0 ms, max= 123.0 ms
535 median= 121.0 ms, stdev= 1.8781639971 ms, min= 118.0 ms, max= 123.0 ms
536 median= 123.0 ms, stdev= 2.21585198062 ms, min= 119.0 ms, max= 130.0 ms
537 median= 124.5 ms, stdev= 2.36378933071 ms, min= 119.0 ms, max= 129.0 ms
538 median= 122.0 ms, stdev= 2.4474476501 ms, min= 118.0 ms, max= 128.0 ms
539 median= 123.0 ms, stdev= 1.76351920885 ms, min= 118.0 ms, max= 125.0 ms
540 median= 119.0 ms, stdev= 1.79652442232 ms, min= 117.0 ms, max= 125.0 ms
541 median= 121.0 ms, stdev= 1.49916643506 ms, min= 119.0 ms, max= 123.0 ms
542 median= 119.5 ms, stdev= 1.85135085816 ms, min= 117.0 ms, max= 125.0 ms
543 median= 124.0 ms, stdev= 1.43090880213 ms, min= 120.0 ms, max= 124.0 ms
544 median= 122.0 ms, stdev= 1.45859521458 ms, min= 118.0 ms, max= 123.0 ms
545 median= 123.0 ms, stdev= 1.50332963784 ms, min= 120.0 ms, max= 124.0 ms
546 median= 123.0 ms, stdev= 1.3638181697 ms, min= 120.0 ms, max= 125.0 ms
547 median= 119.0 ms, stdev= 1.43527000944 ms, min= 117.0 ms, max= 121.0 ms
548 median= 122.5 ms, stdev= 1.71682847134 ms, min= 118.0 ms, max= 124.0 ms
549 median= 121.0 ms, stdev= 1.44481832768 ms, min= 118.0 ms, max= 123.0 ms
550 median= 120.0 ms, stdev= 1.40978721799 ms, min= 117.0 ms, max= 122.0 ms
551 median= 122.0 ms, stdev= 1.68522995464 ms, min= 119.0 ms, max= 125.0 ms
552 median= 122.0 ms, stdev= 1.55804364509 ms, min= 118.0 ms, max= 123.0 ms
555 * Bindings/dom_attributes_id_getter.html: Added.
556 * Bindings/dom_attributes_id_setter.html: Added.
557 * Bindings/resources/dom_attributes_common.js: Added.
559 2012-02-16 Alexis Menard <alexis.menard@openbossa.org>
561 Add a perf test for the CSS parser.
562 https://bugs.webkit.org/show_bug.cgi?id=78114
564 Reviewed by Ryosuke Niwa.
566 Add a perf test for the CSS parser. It load a big CSS chunk
567 which contains some snippets of the YUI library from Yahoo!.
569 * Parser/css-parser-yui.html: Added.
571 2012-02-08 Hajime Morrita <morrita@chromium.org>
573 [PerformanceTests] sunspider-crypto-md5.html and sunspider-crypto-sha1.html are timing out on cr-mac perf bot
574 https://bugs.webkit.org/show_bug.cgi?id=78174
576 Reviewed by Ryosuke Niwa.
578 Pulled back removed files.
580 * Dromaeo/resources/dromaeo/web/tests/sunspider-crypto-md5.html: Added.
581 * Dromaeo/resources/dromaeo/web/tests/sunspider-crypto-sha1.html: Added.
583 2012-02-02 Hajime Morrita <morrita@chromium.org>
585 [PerformanceTests] Each Dromaeo test needs its landing html.
586 https://bugs.webkit.org/show_bug.cgi?id=77504
588 Reviewed by Ryosuke Niwa.
590 - Added landing pages for each test which are listed in MANIFEST.json
591 - Removed some tests which depends on the library whose license is incompatible to WebKit.
592 - Added local copy of corresponding library. And replace the references to the remote sources
594 - Removed old library files under Dromaeo/resources/dromaeo/web/lib/.
595 - Skipped Sunsupier and v8 test. Such JS centric test should have its own test instead of
596 running as a part of Dromaeo.
598 * Dromaeo/cssquery-dojo.html: Added.
599 * Dromaeo/cssquery-jquery.html: Added.
600 * Dromaeo/cssquery-prototype.html: Added.
601 * Dromaeo/dom-attr.html: Added.
602 * Dromaeo/dom-modify.html: Added.
603 * Dromaeo/dom-traverse.html: Added.
604 * Dromaeo/dromaeo-3d-cube.html: Added.
605 * Dromaeo/dromaeo-core-eval.html: Added.
606 * Dromaeo/dromaeo-object-array.html: Added.
607 * Dromaeo/dromaeo-object-regexp.html: Added.
608 * Dromaeo/dromaeo-object-string.html: Added.
609 * Dromaeo/dromaeo-string-base64.html: Added.
610 * Dromaeo/jslib-attr-jquery.html: Added.
611 * Dromaeo/jslib-attr-prototype.html: Added.
612 * Dromaeo/jslib-event-jquery.html: Added.
613 * Dromaeo/jslib-event-prototype.html: Added.
614 * Dromaeo/jslib-modify-jquery.html: Added.
615 * Dromaeo/jslib-modify-prototype.html: Added.
616 * Dromaeo/jslib-style-jquery.html: Added.
617 * Dromaeo/jslib-style-prototype.html: Added.
618 * Dromaeo/jslib-traverse-jquery.html: Added.
619 * Dromaeo/jslib-traverse-prototype.html: Added.
620 * Dromaeo/resources/dromaeo/web/lib/dojo.js: Removed.
621 * Dromaeo/resources/dromaeo/web/lib/dojo-1.6.1.js: Added.
622 * Dromaeo/resources/dromaeo/web/lib/jquery.js: Removed.
623 * Dromaeo/resources/dromaeo/web/lib/jquery-1.6.4.js: Added.
624 * Dromaeo/resources/dromaeo/web/lib/mootools.js: Removed.
625 * Dromaeo/resources/dromaeo/web/lib/prototype.js: Removed.
626 * Dromaeo/resources/dromaeo/web/lib/prototype-1.7.js: Added.
627 * Dromaeo/resources/dromaeo/web/tests/cssquery-dojo.html:
628 * Dromaeo/resources/dromaeo/web/tests/cssquery-jquery.html:
629 * Dromaeo/resources/dromaeo/web/tests/cssquery-mootools.html: Removed.
630 * Dromaeo/resources/dromaeo/web/tests/cssquery-prototype.html:
631 * Dromaeo/resources/dromaeo/web/tests/jslib-attr-jquery.html:
632 * Dromaeo/resources/dromaeo/web/tests/jslib-attr-prototype.html:
633 * Dromaeo/resources/dromaeo/web/tests/jslib-event-jquery.html:
634 * Dromaeo/resources/dromaeo/web/tests/jslib-event-prototype.html:
635 * Dromaeo/resources/dromaeo/web/tests/jslib-modify-jquery.html:
636 * Dromaeo/resources/dromaeo/web/tests/jslib-modify-prototype.html:
637 * Dromaeo/resources/dromaeo/web/tests/jslib-style-jquery.html:
638 * Dromaeo/resources/dromaeo/web/tests/jslib-style-prototype.html:
639 * Dromaeo/resources/dromaeo/web/tests/jslib-traverse-jquery.html:
640 * Dromaeo/resources/dromaeo/web/tests/jslib-traverse-prototype.html:
641 * Dromaeo/sunspider-3d-morph.html: Added.
642 * Dromaeo/sunspider-3d-raytrace.html: Added.
643 * Dromaeo/sunspider-access-binary-trees.html: Added.
644 * Dromaeo/sunspider-access-fannkuch.html: Added.
645 * Dromaeo/sunspider-access-nbody.html: Added.
646 * Dromaeo/sunspider-access-nsieve.html: Added.
647 * Dromaeo/sunspider-bitops-3bit-bits-in-byte.html: Added.
648 * Dromaeo/sunspider-bitops-bits-in-byte.html: Added.
649 * Dromaeo/sunspider-bitops-bitwise-and.html: Added.
650 * Dromaeo/sunspider-bitops-nsieve-bits.html: Added.
651 * Dromaeo/sunspider-controlflow-recursive.html: Added.
652 * Dromaeo/sunspider-crypto-aes.html: Added.
653 * Dromaeo/sunspider-crypto-md5.html: Added.
654 * Dromaeo/sunspider-crypto-sha1.html: Added.
655 * Dromaeo/sunspider-date-format-tofte.html: Added.
656 * Dromaeo/sunspider-date-format-xparb.html: Added.
657 * Dromaeo/sunspider-math-cordic.html: Added.
658 * Dromaeo/sunspider-math-partial-sums.html: Added.
659 * Dromaeo/sunspider-math-spectral-norm.html: Added.
660 * Dromaeo/sunspider-regexp-dna.html: Added.
661 * Dromaeo/sunspider-string-fasta.html: Added.
662 * Dromaeo/sunspider-string-tagcloud.html: Added.
663 * Dromaeo/sunspider-string-unpack-code.html: Added.
664 * Dromaeo/sunspider-string-validate-input.html: Added.
665 * Dromaeo/v8-crypto.html: Added.
666 * Dromaeo/v8-deltablue.html: Added.
667 * Dromaeo/v8-earley-boyer.html: Added.
668 * Dromaeo/v8-raytrace.html: Added.
669 * Dromaeo/v8-richards.html: Added.
672 2012-02-02 Sheriff Bot <webkit.review.bot@gmail.com>
674 Unreviewed, rolling out r106543.
675 http://trac.webkit.org/changeset/106543
676 https://bugs.webkit.org/show_bug.cgi?id=77671
678 Made tests less stable (Requested by rniwa on #webkit).
680 * resources/init.html: Removed.
682 2012-02-02 Ryosuke Niwa <rniwa@webkit.org>
684 [PerformanceTests] tests have dependencies
685 https://bugs.webkit.org/show_bug.cgi?id=77506
687 Reviewed by Hajime Morita.
689 * resources/init.html: Added.
691 2012-02-01 Ryosuke Niwa <rniwa@webkit.org>
693 Fix after r106386. The empty anchor element was generating an erroneous whitespace.
695 * Bindings/event-target-wrapper.html:
697 2012-02-01 Ryosuke Niwa <rniwa@webkit.org>
699 Another fix after r106379.
701 * Parser/html5-full-render.html:
703 2012-01-31 Hajime Morrita <morrita@chromium.org>
705 Import Dromaeo to WebKit repository.
706 https://bugs.webkit.org/show_bug.cgi?id=77328
708 Reviewed by Ryosuke Niwa.
710 Imported a modified version of Dromaeo which is able to
713 The imported version originally came from:
714 https://github.com/omo/dromaeo/commit/c942a1452109cdd5f759b3c4aee8d68d490d44a2
716 * Dromaeo/resources/dromaeo/web/application.css: Added.
717 * Dromaeo/resources/dromaeo/web/favicon.ico: Added.
718 * Dromaeo/resources/dromaeo/web/favicon.png: Added.
719 * Dromaeo/resources/dromaeo/web/htmlrunner.js: Added.
720 * Dromaeo/resources/dromaeo/web/ie.css: Added.
721 * Dromaeo/resources/dromaeo/web/images/bg.png: Added.
722 * Dromaeo/resources/dromaeo/web/images/clouds.png: Added.
723 * Dromaeo/resources/dromaeo/web/images/clouds2.png: Added.
724 * Dromaeo/resources/dromaeo/web/images/comets.png: Added.
725 * Dromaeo/resources/dromaeo/web/images/dino1.png: Added.
726 * Dromaeo/resources/dromaeo/web/images/dino2.png: Added.
727 * Dromaeo/resources/dromaeo/web/images/dino3.png: Added.
728 * Dromaeo/resources/dromaeo/web/images/dino4.png: Added.
729 * Dromaeo/resources/dromaeo/web/images/dino5.png: Added.
730 * Dromaeo/resources/dromaeo/web/images/dino6.png: Added.
731 * Dromaeo/resources/dromaeo/web/images/dino7.png: Added.
732 * Dromaeo/resources/dromaeo/web/images/dino8.png: Added.
733 * Dromaeo/resources/dromaeo/web/images/left.png: Added.
734 * Dromaeo/resources/dromaeo/web/images/logo.png: Added.
735 * Dromaeo/resources/dromaeo/web/images/logo2.png: Added.
736 * Dromaeo/resources/dromaeo/web/images/logo3.png: Added.
737 * Dromaeo/resources/dromaeo/web/images/right.png: Added.
738 * Dromaeo/resources/dromaeo/web/images/top.png: Added.
739 * Dromaeo/resources/dromaeo/web/images/water.png: Added.
740 * Dromaeo/resources/dromaeo/web/index.html: Added.
741 * Dromaeo/resources/dromaeo/web/jquery.js: Added.
742 * Dromaeo/resources/dromaeo/web/lib/dojo.js: Added.
743 * Dromaeo/resources/dromaeo/web/lib/jquery.js: Added.
744 * Dromaeo/resources/dromaeo/web/lib/mootools.js: Added.
745 * Dromaeo/resources/dromaeo/web/lib/prototype.js: Added.
746 * Dromaeo/resources/dromaeo/web/pngfix.js: Added.
747 * Dromaeo/resources/dromaeo/web/reset.css: Added.
748 * Dromaeo/resources/dromaeo/web/test-head.html: Added.
749 * Dromaeo/resources/dromaeo/web/test-head.js: Added.
750 * Dromaeo/resources/dromaeo/web/test-tail.html: Added.
751 * Dromaeo/resources/dromaeo/web/test-tail.js: Added.
752 * Dromaeo/resources/dromaeo/web/tests/MANIFEST.json: Added.
753 * Dromaeo/resources/dromaeo/web/tests/cssquery-dojo.html: Added.
754 * Dromaeo/resources/dromaeo/web/tests/cssquery-jquery.html: Added.
755 * Dromaeo/resources/dromaeo/web/tests/cssquery-mootools.html: Added.
756 * Dromaeo/resources/dromaeo/web/tests/cssquery-prototype.html: Added.
757 * Dromaeo/resources/dromaeo/web/tests/cssquery-yui.html: Added.
758 * Dromaeo/resources/dromaeo/web/tests/dom-attr.html: Added.
759 * Dromaeo/resources/dromaeo/web/tests/dom-modify.html: Added.
760 * Dromaeo/resources/dromaeo/web/tests/dom-query.html: Added.
761 * Dromaeo/resources/dromaeo/web/tests/dom-traverse.html: Added.
762 * Dromaeo/resources/dromaeo/web/tests/dromaeo-3d-cube.html: Added.
763 * Dromaeo/resources/dromaeo/web/tests/dromaeo-core-eval.html: Added.
764 * Dromaeo/resources/dromaeo/web/tests/dromaeo-object-array.html: Added.
765 * Dromaeo/resources/dromaeo/web/tests/dromaeo-object-regexp.html: Added.
766 * Dromaeo/resources/dromaeo/web/tests/dromaeo-object-string.html: Added.
767 * Dromaeo/resources/dromaeo/web/tests/dromaeo-string-base64.html: Added.
768 * Dromaeo/resources/dromaeo/web/tests/jslib-attr-jquery.html: Added.
769 * Dromaeo/resources/dromaeo/web/tests/jslib-attr-prototype.html: Added.
770 * Dromaeo/resources/dromaeo/web/tests/jslib-event-jquery.html: Added.
771 * Dromaeo/resources/dromaeo/web/tests/jslib-event-prototype.html: Added.
772 * Dromaeo/resources/dromaeo/web/tests/jslib-modify-jquery.html: Added.
773 * Dromaeo/resources/dromaeo/web/tests/jslib-modify-prototype.html: Added.
774 * Dromaeo/resources/dromaeo/web/tests/jslib-style-jquery.html: Added.
775 * Dromaeo/resources/dromaeo/web/tests/jslib-style-prototype.html: Added.
776 * Dromaeo/resources/dromaeo/web/tests/jslib-traverse-jquery.html: Added.
777 * Dromaeo/resources/dromaeo/web/tests/jslib-traverse-prototype.html: Added.
778 * Dromaeo/resources/dromaeo/web/tests/sunspider-3d-morph.html: Added.
779 * Dromaeo/resources/dromaeo/web/tests/sunspider-3d-raytrace.html: Added.
780 * Dromaeo/resources/dromaeo/web/tests/sunspider-access-binary-trees.html: Added.
781 * Dromaeo/resources/dromaeo/web/tests/sunspider-access-fannkuch.html: Added.
782 * Dromaeo/resources/dromaeo/web/tests/sunspider-access-nbody.html: Added.
783 * Dromaeo/resources/dromaeo/web/tests/sunspider-access-nsieve.html: Added.
784 * Dromaeo/resources/dromaeo/web/tests/sunspider-bitops-3bit-bits-in-byte.html: Added.
785 * Dromaeo/resources/dromaeo/web/tests/sunspider-bitops-bits-in-byte.html: Added.
786 * Dromaeo/resources/dromaeo/web/tests/sunspider-bitops-bitwise-and.html: Added.
787 * Dromaeo/resources/dromaeo/web/tests/sunspider-bitops-nsieve-bits.html: Added.
788 * Dromaeo/resources/dromaeo/web/tests/sunspider-controlflow-recursive.html: Added.
789 * Dromaeo/resources/dromaeo/web/tests/sunspider-crypto-aes.html: Added.
790 * Dromaeo/resources/dromaeo/web/tests/sunspider-crypto-md5.html: Added.
791 * Dromaeo/resources/dromaeo/web/tests/sunspider-crypto-sha1.html: Added.
792 * Dromaeo/resources/dromaeo/web/tests/sunspider-date-format-tofte.html: Added.
793 * Dromaeo/resources/dromaeo/web/tests/sunspider-date-format-xparb.html: Added.
794 * Dromaeo/resources/dromaeo/web/tests/sunspider-math-cordic.html: Added.
795 * Dromaeo/resources/dromaeo/web/tests/sunspider-math-partial-sums.html: Added.
796 * Dromaeo/resources/dromaeo/web/tests/sunspider-math-spectral-norm.html: Added.
797 * Dromaeo/resources/dromaeo/web/tests/sunspider-regexp-dna.html: Added.
798 * Dromaeo/resources/dromaeo/web/tests/sunspider-string-fasta.html: Added.
799 * Dromaeo/resources/dromaeo/web/tests/sunspider-string-tagcloud.html: Added.
800 * Dromaeo/resources/dromaeo/web/tests/sunspider-string-unpack-code.html: Added.
801 * Dromaeo/resources/dromaeo/web/tests/sunspider-string-validate-input.html: Added.
802 * Dromaeo/resources/dromaeo/web/tests/v8-crypto.html: Added.
803 * Dromaeo/resources/dromaeo/web/tests/v8-deltablue.html: Added.
804 * Dromaeo/resources/dromaeo/web/tests/v8-earley-boyer.html: Added.
805 * Dromaeo/resources/dromaeo/web/tests/v8-raytrace.html: Added.
806 * Dromaeo/resources/dromaeo/web/tests/v8-richards.html: Added.
807 * Dromaeo/resources/dromaeo/web/tests/72px.png: Added.
808 * Dromaeo/resources/dromaeo/web/web-style.css: Added.
809 * Dromaeo/resources/dromaeo/web/webrunner.js: Added.
810 * Skipped: Unskip the dromaeo driver.
812 2012-01-31 Ryosuke Niwa <rniwa@webkit.org>
814 Fix Parser/html5-full-render.html after r106379.
816 * Parser/html5-full-render.html:
818 2012-01-31 Ryosuke Niwa <rniwa@webkit.org>
820 PerfTestRunner should automatically create pre#log
821 https://bugs.webkit.org/show_bug.cgi?id=77469
823 Reviewed by Tony Chang.
825 Automatically generate <pre id="log"></pre> if there isn't one.
827 * Bindings/event-target-wrapper.html:
828 * DOM/Accessors.html:
829 * DOM/CloneNodes.html:
830 * DOM/CreateNodes.html:
831 * DOM/DOMDivWalk.html:
835 * DOM/GetElement.html:
838 * Dromaeo/dom-query.html:
839 * Dromaeo/resources/dromaeorunner.js:
840 * Parser/html-parser.html:
841 * Parser/html5-full-render.html:
842 * Parser/simple-url.html:
843 * Parser/tiny-innerHTML.html:
844 * Parser/url-parser.html:
845 * Parser/xml-parser.html:
846 * resources/runner.js:
847 (PerfTestRunner.log):
848 (PerfTestRunner.printStatistics):
850 2012-01-31 Ryosuke Niwa <rniwa@webkit.org>
852 runner.js in performance tests should define a class
853 https://bugs.webkit.org/show_bug.cgi?id=77074
855 Reviewed by Eric Seidel.
857 Wrap all functions in runner.js by PerfTestRunner and update tests that runner.js accordingly.
858 Also replace compute* functions in runner.js by more robust code from dom-perf.js.
860 * Bindings/event-target-wrapper.html:
862 * DOM/resources/dom-perf.js:
863 (BenchmarkSuite.prototype.RunSingle):
865 * Mutation/append-child-deep.html:
866 * Mutation/append-child.html:
867 * Mutation/inner-html.html:
868 * Mutation/remove-child-deep.html:
869 * Mutation/remove-child.html:
870 * Parser/html-parser.html:
871 * Parser/html5-full-render.html:
872 * Parser/simple-url.html:
873 * Parser/tiny-innerHTML.html:
874 * Parser/url-parser.html:
875 * Parser/xml-parser.html:
876 * resources/runner.js:
877 (PerfTestRunner.log):
878 (PerfTestRunner.logInfo):
879 (PerfTestRunner.loadFile):
880 (PerfTestRunner.computeStatistics):
881 (PerfTestRunner.logStatistics):
882 (PerfTestRunner._runLoop.else):
883 (PerfTestRunner._runLoop):
884 (PerfTestRunner._runner):
886 2012-01-31 Hajime Morrita <morrita@chromium.org>
888 [PerformanceTests] Add landing html for Dromaeo dom-query test
889 https://bugs.webkit.org/show_bug.cgi?id=77329
891 Reviewed by Ryosuke Niwa.
893 Added a "landing html" which includes actual dromaemo page and
894 send messages to interact with it. The landing html also dumps the
895 score in run-perf-tests friendly format.
897 This test isn't enabled until Dromaemo itself is available for run-perf-tests.
898 It will happen in a separate change.
900 * Dromaeo/dom-query.html: Added.
901 * Dromaeo/resources/dromaeorunner.js: Added.
902 * Skipped: Skipping this for now.
904 2012-01-30 Ryosuke Niwa <rniwa@webkit.org>
906 Skip inspector tests since they have been timing out.
910 2012-01-29 Ryosuke Niwa <rniwa@webkit.org>
912 DOM/DOMDivWalk.html result is unreliable
913 https://bugs.webkit.org/show_bug.cgi?id=77313
915 Reviewed by Adam Barth.
917 Trigger garbage collection manually between test runs to avoid GC
918 to occur in the middle of runs.
920 * DOM/resources/dom-perf.js:
921 (BenchmarkSuite.prototype.RunSingle):
922 * resources/runner.js:
927 2012-01-26 Ryosuke Niwa <rniwa@webkit.org>
929 Import Chromium's dom_perf test
930 https://bugs.webkit.org/show_bug.cgi?id=77175
932 Reviewed by Adam Barth.
936 Note resources/dom/suites.js isn't used by any html file yet but it will be used by Chromium port
937 once its perf bots start pulling test files from WebKit repository instead of Google's internal repository.
940 * DOM/Accessors.html: Added.
941 * DOM/CloneNodes.html: Added.
942 * DOM/CreateNodes.html: Added.
943 * DOM/DOMDivWalk.html: Added.
944 * DOM/DOMTable.html: Added.
945 * DOM/DOMWalk.html: Added.
946 * DOM/Events.html: Added.
947 * DOM/GetElement.html: Added.
948 * DOM/GridSort.html: Added.
949 * DOM/Template.html: Added.
950 * DOM/resources: Added.
951 * DOM/resources/dom-perf.js: Added.
952 * DOM/resources/dom-perf: Added.
953 * DOM/resources/dom-perf/accessors.js: Added.
954 * DOM/resources/dom-perf/clonenodes.js: Added.
955 * DOM/resources/dom-perf/createnodes.js: Added.
956 * DOM/resources/dom-perf/domdivwalk.js: Added.
957 * DOM/resources/dom-perf/domtable.js: Added.
958 * DOM/resources/dom-perf/domwalk.js: Added.
959 * DOM/resources/dom-perf/events.js: Added.
960 * DOM/resources/dom-perf/getelement.js: Added.
961 * DOM/resources/dom-perf/gridsort.js: Added.
962 * DOM/resources/dom-perf/suites.js: Added.
963 * DOM/resources/dom-perf/template.js: Added.
964 * resources/runner.js:
966 2012-01-25 Ryosuke Niwa <rniwa@webkit.org>
968 html5-full-render.html fails due to a log
969 https://bugs.webkit.org/show_bug.cgi?id=77046
971 Reviewed by Adam Barth.
973 Replace the call to log() in html5-full-render.html by a call to newly added logInfo(),
974 which doesn't print anything inside DRT.
976 * Parser/html5-full-render.html:
977 * resources/runner.js:
980 2012-01-19 Adam Barth <abarth@webkit.org>
982 PerformanceTests's runner.js shouldn't be Parser-specific
983 https://bugs.webkit.org/show_bug.cgi?id=76670
985 Reviewed by Ryosuke Niwa.
987 This runner script is used by a bunch of difference performance tests.
988 It shouldn't be in the Parser directory anymore.
990 * Bindings/event-target-wrapper.html:
991 * Mutation/append-child-deep.html:
992 * Mutation/append-child.html:
993 * Mutation/inner-html.html:
994 * Mutation/remove-child-deep.html:
995 * Mutation/remove-child.html:
996 * Parser/html-parser.html:
997 * Parser/html5-full-render.html:
998 * Parser/resources/runner.js: Removed.
999 * Parser/simple-url.html:
1000 * Parser/tiny-innerHTML.html:
1001 * Parser/url-parser.html:
1002 * Parser/xml-parser.html:
1004 * resources/runner.js: Copied from PerformanceTests/Parser/resources/runner.js.
1006 2012-01-19 Ryosuke Niwa <rniwa@webkit.org>
1008 Some perf tests time out when ran by run-perf-tests
1009 https://bugs.webkit.org/show_bug.cgi?id=76612
1011 Reviewed by Dirk Pranke and Eric Seidel.
1013 Replace all images in html5.html by geenbox.png to avoid accessing whatwg.org when
1014 running the parser tests. Also call dumpAsText, waitUntilDone, and notifyDone automatically
1015 inside runner.js to avoid having to call them in individual tests.
1017 * Bindings/event-target-wrapper.html: Removed calls to layoutTestController methods since
1018 they are now called by runner.js automatically.
1019 * Parser/resources/greenbox.png: Copied from LayoutTests/fast/css/resources/greenbox.png.
1020 * Parser/resources/html5.html:
1021 * Parser/resources/runner.js:
1024 2012-01-18 Ryosuke Niwa <rniwa@webkit.org>
1026 run-perf-tests should support Skipped list
1027 https://bugs.webkit.org/show_bug.cgi?id=76594
1029 Reviewed by Adam Barth.
1031 Add Skipped list to be used by run-perf-tests as it can only runs tests in
1032 Bindings, Parser, and inspector at the moment.
1036 2012-01-12 Ilya Tikhonovsky <loislo@chromium.org>
1038 Web Inspector: performance: restore 'log 300 messages into console' test.
1039 https://bugs.webkit.org/show_bug.cgi?id=76170
1041 It was removed in order of transition from layout tests to perf tests.
1043 Reviewed by Yury Semikhatsky.
1045 * inspector/console-300-lines.html: Added.
1047 2012-01-12 Ilya Tikhonovsky <loislo@chromium.org>
1049 Web Inspector: performance tests: fix memory leak in first-open-resources test.
1050 https://bugs.webkit.org/show_bug.cgi?id=76049
1052 first-open-resources doesn't reset resource panel properly after test run.
1054 Reviewed by Yury Semikhatsky.
1056 * inspector/first-open-resources.html:
1058 2012-01-10 Ilya Tikhonovsky <loislo@chromium.org>
1060 Unreviewed. WebInspector: Remove unnecessary logging from the test.
1062 * inspector/first-open-resources.html:
1064 2012-01-10 Ilya Tikhonovsky <loislo@chromium.org>
1066 Unreviewed. Restore test that was removed during migration from LayoutTests folder.
1068 * inspector/first-open-resources.html: Added.
1070 2012-01-09 Ilya Tikhonovsky <loislo@chromium.org>
1072 Unreviewed test fix after r103683.
1074 * inspector/first-open-scripts.html:
1075 * inspector/show-panel.html:
1077 2012-01-03 Adam Barth <abarth@webkit.org>
1079 html-parser.html takes too long to run
1080 https://bugs.webkit.org/show_bug.cgi?id=75515
1082 Reviewed by Eric Seidel.
1084 In working on runner.js, we introduced a factor of 10 increase to the
1085 running time of this benchmark. This patch dials down the number of
1086 iterations to something more user-friendly.
1088 * Parser/html-parser.html:
1090 2011-12-18 Ilya Tikhonovsky <loislo@chromium.org>
1092 Web Inspector: move heap data stats to separate tab.
1093 https://bugs.webkit.org/show_bug.cgi?id=74704
1095 Reviewed by Pavel Feldman.
1097 * inspector/performance-test.js:
1098 (initialize_TimeTracker.InspectorTest.runPerformanceTest.Timer.prototype._dump):
1099 (initialize_TimeTracker.InspectorTest.runPerformanceTest):
1101 2011-12-01 Ilya Tikhonovsky <loislo@chromium.org>
1103 Web Inspector: chromium: move and adapt Inspector's performance tests for running with run-inspector-perf-tests.py.
1104 https://bugs.webkit.org/show_bug.cgi?id=72260
1106 Reviewed by Pavel Feldman.
1108 * inspector/first-open-elements.html: Renamed from LayoutTests/inspector/performance/resources/first-open-elements.html.
1109 * inspector/first-open-scripts.html: Renamed from LayoutTests/inspector/performance/resources/first-open-scripts.html.
1110 * inspector/inspector-startup-time.html: Renamed from LayoutTests/inspector/performance/resources/inspector-startup-time.html.
1111 * inspector/network-append-30-requests.html: Renamed from LayoutTests/inspector/performance/resources/network-append-30-requests.html.
1112 * inspector/performance-test.js: Renamed from LayoutTests/inspector/performance/resources/performance-test.js.
1113 (initialize_TimeTracker.InspectorTest.runPerformanceTest.Timer):
1114 (initialize_TimeTracker.InspectorTest.runPerformanceTest.Timer.prototype.start):
1115 (initialize_TimeTracker.InspectorTest.runPerformanceTest.Timer.prototype.finish):
1116 (initialize_TimeTracker.InspectorTest.runPerformanceTest.Timer.prototype._getJSHeapSize):
1117 (initialize_TimeTracker.InspectorTest.runPerformanceTest.Timer.prototype.done):
1118 (initialize_TimeTracker.InspectorTest.runPerformanceTest.Timer.prototype._runTest):
1119 (initialize_TimeTracker.InspectorTest.runPerformanceTest.Timer.prototype._dump):
1120 (initialize_TimeTracker.InspectorTest.runPerformanceTest):
1121 (initialize_TimeTracker.InspectorTest.mark):
1122 * inspector/show-panel.html: Renamed from LayoutTests/inspector/performance/resources/show-panel.html.
1124 2011-11-09 Adam Klein <adamk@chromium.org>
1126 [MutationObservers] Microbenchmarks for appendChild, removeChild, and innerHTML
1127 https://bugs.webkit.org/show_bug.cgi?id=71939
1129 Reviewed by Ojan Vafai.
1131 These benchmarks time both the DOM mutations themselves and the time taken
1132 to call the MutationCallback. This measurement is achieved by
1133 executing the code entirely within the MutationCallback itself.
1135 * Mutation/append-child-deep.html: Added. Covers appendChild in a 200-node-deep tree with subtree observation.
1136 * Mutation/append-child.html: Added. Covers appendChild in a flat tree.
1137 * Mutation/inner-html.html: Added. Covers innerHTML adding and removing many nodes at a time.
1138 * Mutation/remove-child-deep.html: Added. Covers removeChild in a 200-node-deep tree with subtree observation.
1139 * Mutation/remove-child.html: Added. Covers removeChild in a flat tree.
1141 2011-10-25 Adam Barth <abarth@webkit.org>
1143 EventTargetFactory.in is not sorted
1144 https://bugs.webkit.org/show_bug.cgi?id=70855
1146 Reviewed by Eric Seidel.
1148 Add a microbenchmark for wrapping event target.
1151 * Bindings/event-target-wrapper.html: Added.
1152 * Parser/resources/runner.js:
1154 - Let the user of the harness get a callback when the test is done.
1156 2011-10-04 Eric Seidel <eric@webkit.org>
1158 Update html5-full-render.html to load the HTML5 spec incrementally, closer to how the browser would
1159 https://bugs.webkit.org/show_bug.cgi?id=69374
1163 Per https://bugs.webkit.org/show_bug.cgi?id=69374#c7
1164 updating the chunksize to be a bit smaller now that the total
1165 size of the html5 spec is smaller than when I wrote the test.
1167 This should increase the prevalence of style resolution in the
1168 sample time, which more closely matches instrument samples
1169 taken when loading the full page in Safari.
1171 * Parser/html5-full-render.html:
1173 2011-10-04 Eric Seidel <eric@webkit.org>
1175 Update html5-full-render.html to load the HTML5 spec incrementally, closer to how the browser would
1176 https://bugs.webkit.org/show_bug.cgi?id=69374
1178 Reviewed by James Robinson.
1180 This should finally be able to provide us with a repeatable metric
1181 for how fast we're currently able to load the HTML5 spec.
1182 There are a variety of interesting functions which show up in this
1183 sample, including of course style resolution.
1185 * Parser/html5-full-render.html:
1187 2011-10-04 Eric Seidel <eric@webkit.org>
1189 Update our copy of the HTML5 spec used for performance testing to match the latest version
1190 https://bugs.webkit.org/show_bug.cgi?id=69364
1192 Unreviewed. The patch is too large to post, so landing this unreviewed. :(
1194 The copy of the html5 spec we were using for testing was over a year old
1195 and didn't have any of the subresources with it (we were only using it
1196 as an HTML parsing benchmark). I'm about to use it for testing
1197 the full load/render time of the benchmark, so I've updated to the latest
1198 version of the spec (now 8mb instead of 5mb) and inlined two of the
1199 CSS files. (Inlining the CSS was necessary to make my testing consistent
1200 as there seems to be a race with some timer fired after CSS load.)
1202 Increasing from 5mb to 8mb showed a similar 30% slowdown in our parser
1203 benchmarks as expected.
1205 * Parser/resources/html5.html:
1207 2011-10-04 Eric Seidel <eric@webkit.org>
1209 Add loopsPerRun option to Parser performance test runner
1210 https://bugs.webkit.org/show_bug.cgi?id=69363
1212 Reviewed by Antti Koivisto.
1214 Add loopsPerRun option and abstract out runLoop function (to make the UI more responsive).
1215 No change in behavior in any of the tests.
1217 * Parser/resources/runner.js:
1222 2011-10-03 Eric Seidel <eric@webkit.org>
1224 Add a microbenchmark for a full-page render of the HTML5 spec
1225 https://bugs.webkit.org/show_bug.cgi?id=69285
1227 Reviewed by Adam Barth.
1229 This was designed to be a test for https://bugs.webkit.org/show_bug.cgi?id=68944
1230 But it seems that by far our dominating cost for the HTML5 benchmark is
1231 time spent laying out lines (which isn't actually that surprising).
1233 I'm adding the performance test for posterity.
1235 * Parser/html-parser.html:
1236 - Removed use of "about:blank" which abarth says is a no-op. Made comment more accurate.
1237 * Parser/html5-full-render.html: Copied from PerformanceTests/Parser/html-parser.html.
1239 2011-10-03 Eric Seidel <eric@webkit.org>
1241 PerformanceTests/Parser/html-parser is only testing parsing of the head element
1242 https://bugs.webkit.org/show_bug.cgi?id=69283
1244 Reviewed by Adam Barth.
1246 While investigating https://bugs.webkit.org/show_bug.cgi?id=68944
1247 I found that the html-parser benchmark was only parsing up to the
1248 first script tag per loop! We've fixed this by adding the sandbox
1249 tag which will deny all external loads and allow the parser to
1250 synchronously continue parsing the entire document to completion
1251 (as we had expected it was doing).
1253 This changes the profile somewhat. Line number counting is much
1254 hotter, since we're actually accounting for the parse of the entire
1255 document in our sample.
1257 Total sample time only about doubles, from 1800ms to 3800ms on my machine
1258 which is less than I would have expected.
1260 * Parser/html-parser.html:
1262 2011-08-09 Alexandru Chiculita <achicu@adobe.com>
1264 Fixing 65868 REGRESSION(r92610) caused by 65668 - Optimize floating elements lookup
1265 https://bugs.webkit.org/show_bug.cgi?id=65871
1267 Reviewed by Dave Hyatt.
1269 * Layout/floats.html: Added the nested divs, so that we can test the propagation impact of the floats tree.
1271 2011-08-08 Sheriff Bot <webkit.review.bot@gmail.com>
1273 Unreviewed, rolling out r92610.
1274 http://trac.webkit.org/changeset/92610
1275 https://bugs.webkit.org/show_bug.cgi?id=65868
1277 Caused assertion failures when running fast/multicol tests
1278 (Requested by andersca on #webkit).
1280 * Layout/floats.html:
1282 2011-08-08 Alexandru Chiculita <achicu@adobe.com>
1284 Optimize floating elements lookup
1285 https://bugs.webkit.org/show_bug.cgi?id=65668
1287 Reviewed by David Hyatt.
1289 * Layout/floats.html: Added the nested divs, so that we can test the propagation impact of the floats tree.
1291 2011-08-04 Alexandru Chiculita <achicu@adobe.com>
1293 Add a performance test for floating elements layout algorithm
1294 https://bugs.webkit.org/show_bug.cgi?id=65741
1296 The test creating lots of small floats and randomly changes
1297 the width of one element at a time. It measures how often it can do that.
1299 Reviewed by Adam Barth.
1301 * Layout/floats.html: Added.
1303 2011-05-30 Daniel Bates <dbates@webkit.org>
1305 Reviewed by Adam Barth.
1307 Rename XSSFilter to XSSAuditor
1308 https://bugs.webkit.org/show_bug.cgi?id=61718
1310 Currently we use the names XSSFilter and XSSAuditor throughout the project.
1311 Instead, we should choose one name for consistency.
1313 No functionality was changed. So, no new tests.
1315 * XSSAuditor: Copied from PerformanceTests/XSSFilter.
1316 * XSSFilter: Removed.
1317 * XSSFilter/large-post-many-events.html: Removed.
1318 * XSSFilter/large-post-many-inline-scripts-and-events.html: Removed.
1319 * XSSFilter/resources: Removed.
1320 * XSSFilter/resources/target-for-large-post-many-inline-scripts-and-events.html: Removed.
1322 2011-03-25 Leo Yang <leo.yang@torchmobile.com.cn>
1324 Reviewed by Dirk Schulze.
1326 SVG <use> element performance improvement
1327 https://bugs.webkit.org/show_bug.cgi?id=57077
1329 Add a manual test case which is from
1330 http://upload.wikimedia.org/wikipedia/commons/4/4e/Sierpinski_carpet_6.svg
1331 for svg <use> element performance test.
1333 * PageLoad/svg/files/Sierpinski_carpet_6.svg: Added.
1334 * PageLoad/svg/svg.pltsuite:
1336 2011-02-05 Eric Seidel <eric@webkit.org>
1338 Reviewed by Adam Barth.
1340 Add performance tests for URL parsing
1341 https://bugs.webkit.org/show_bug.cgi?id=53845
1343 The final-url-en URL corpus is from:
1344 http://corpus.leeds.ac.uk/internet.html
1346 There are also other language corpuses which we may want to use in the future.
1348 The usage instructions were as follows:
1349 "URL lists and other resources: you can freely use them in your research
1350 provided that you supply a link to this website: http://corpus.leeds.ac.uk/."
1353 * Parser/simple-url.html: Added.
1358 Opera: 2830ms (no, that is not a typo)
1359 * Parser/url-parser.html: Added.
1363 Opera: 1383ms (again, not a typo)
1364 * Parser/resources/final-url-en: Added.
1366 2011-02-03 Adam Barth <abarth@webkit.org>
1368 Reviewed by Daniel Bates.
1370 Add another XSSFilter PerformanceTest
1371 https://bugs.webkit.org/show_bug.cgi?id=53750
1373 This PerformanceTest tests the case that was slow in
1374 https://bugs.webkit.org/show_bug.cgi?id=49845
1376 * XSSFilter/large-post-many-inline-scripts-and-events.html: Added.
1377 * XSSFilter/resources: Added.
1378 * XSSFilter/resources/target-for-large-post-many-inline-scripts-and-events.html: Added.
1380 2011-02-03 Adam Barth <abarth@webkit.org>
1382 Reviewed by Eric Seidel.
1384 Add PerformanceTest for XSSFilter
1385 https://bugs.webkit.org/show_bug.cgi?id=53741
1387 This performance tests covers the case of a large POST data and many
1388 small event handlers.
1391 * XSSFilter/large-post-many-events.html: Added.
1393 2011-02-02 Adam Barth <abarth@webkit.org>
1395 Rubber-stamped by Eric Seidel.
1397 Merge PerformanceTests/Parser/ChangeLog and
1398 PerformanceTests/PageLoad/ChangeLog into PerformanceTests/ChangeLog.
1400 It's silly to have ChangeLogs for each of these directories separately.
1401 I've left SunSpider with its own ChangeLog because it's more of an
1406 2011-02-02 Eric Seidel <eric@webkit.org>
1408 Unreviewed. Just fixing an exception seen in Firefox.
1410 HTML5 TreeBuilder regressed a Peacekeeper DOM test by 40%
1411 https://bugs.webkit.org/show_bug.cgi?id=48719
1413 Make the benchmarks work in Firefox/Opera.
1415 * resources/runner.js:
1418 2011-01-27 Eric Seidel <eric@webkit.org>
1420 Reviewed by Darin Adler.
1422 HTML5 TreeBuilder regressed a Peacekeeper DOM test by 40%
1423 https://bugs.webkit.org/show_bug.cgi?id=48719
1425 It's unclear exactly what the Peacekeeper benchmark is testing,
1426 because I haven't found a way to run it myself.
1428 However, I constructed a benchmark which shows at least one possible slow point.
1429 The HTML5 spec talks about creating a new document for every time we use
1430 the fragment parsing algorithm. Document() it turns out, it a huge bloated
1431 mess, and the constructor and destructor do a huge amount of work.
1433 * benchmarks/parser/tiny-innerHTML.html: Added.
1435 2011-01-29 Sheriff Bot <webkit.review.bot@gmail.com>
1437 Unreviewed, rolling out r77050.
1438 http://trac.webkit.org/changeset/77050
1439 https://bugs.webkit.org/show_bug.cgi?id=53371
1441 Caused a crash in Chromium's test_shell_tests (Requested by
1444 * resources/performance-test.js: Removed.
1445 * tiny-innerHTML.html: Removed.
1447 2011-01-28 Eric Seidel <eric@webkit.org>
1449 Reviewed by Darin Adler.
1451 HTML5 TreeBuilder regressed a Peacekeeper DOM test by 40%
1452 https://bugs.webkit.org/show_bug.cgi?id=48719
1454 It's unclear exactly what the Peacekeeper benchmark is testing,
1455 because I haven't found a way to run it myself.
1457 However, I constructed a benchmark which shows at least one possible slow point.
1458 The HTML5 spec talks about creating a new document for every time we use
1459 the fragment parsing algorithm. Document() it turns out, it a huge bloated
1460 mess, and the constructor and destructor do a huge amount of work.
1461 To avoid constructing (or destructing) documents for each innerHTML call,
1462 this patch adds a shared dummy document used by all innerHTML calls.
1464 * benchmarks/parser/tiny-innerHTML.html: Added.
1466 2010-12-31 Adam Barth <abarth@webkit.org>
1468 Rubber-stamped by Eric Seidel.
1470 Move HTML and XML parser benchmarks into PerformanceTests/Parser
1471 https://bugs.webkit.org/show_bug.cgi?id=51772
1473 Add a ChangeLog for tracking changes to the Parser PerformanceTest.
1477 2010-12-31 Adam Barth <abarth@webkit.org>
1479 Rubber-stamped by Eric Seidel.
1481 Move PageLoadTests to PerformanceTests/PageLoad
1482 https://bugs.webkit.org/show_bug.cgi?id=51771
1484 Update URLs to point to the new directory name.
1488 2006-12-26 Eric Seidel <eric@webkit.org>
1492 * svg/svg.pltsuite: re-enable word-iso.svg after fixing http://bugs.webkit.org/show_bug.cgi?id=11987
1494 2006-12-26 Eric Seidel <eric@webkit.org>
1496 Reviewed by bradee-oh.
1498 Add new PageLoadTests directory (this one)
1499 Add LICENSES file to explain where each SVG came from.
1502 * svg/LICENSES: Added.
1503 * svg/files/33041-Samurai.svg: Added.
1504 * svg/files/42470-flower_from_my_garden_v2.svg: Added.
1505 * svg/files/Harvey_Rayner.svg: Added.
1506 * svg/files/az-lizard_benji_park_01.svg: Added.
1507 * svg/files/bamboo_01.svg: Added.
1508 * svg/files/cacuts_01.svg: Added.
1509 * svg/files/cowboy.svg: Added.
1510 * svg/files/crawfish2_ganson.svg: Added.
1511 * svg/files/deb9frac1.svg: Added.
1512 * svg/files/food_leif_lodahl_01.svg: Added.
1513 * svg/files/france.svg: Added.
1514 * svg/files/francobollo_gnome_ezechi_02.svg: Added.
1515 * svg/files/gearflowers.svg: Added.
1516 * svg/files/hereGear4.svg: Added.
1517 * svg/files/mtsthelens.svg: Added.
1518 * svg/files/mtsthelens0.jpg: Added.
1519 * svg/files/world-iso.svg: Added.
1520 * svg/files/worldcup.svg: Added.
1521 * svg/svg.pltsuite: Added.