PerformanceTests/ChangeLog

   1 2015-12-01  Simon Fraser  <simon.fraser@apple.com>
   2
   3         Add a basic compositing Animometer test
   4         https://bugs.webkit.org/show_bug.cgi?id=151724
   5
   6         Reviewed by Dean Jackson.
   7
   8         Add a "bouncing particles" test that moves composited layers around, optionally with a filter.
   9
  10         This is added under a new "Miscellaneous" category.
  11
  12         Remove the test templates category from the UI.
  13
  14         * Animometer/runner/resources/tests.js:
  15         * Animometer/tests/bouncing-particles/resources/bouncing-css-shapes.js:
  16         (BouncingCssShape.prototype.animate):
  17         * Animometer/tests/misc/compositing-transforms.html: Added.
  18         * Animometer/tests/misc/resources/compositing-transforms.js: Added.
  19         (BouncingCompositedImage):
  20         (BouncingCompositedImage.prototype._move):
  21         (BouncingCompositedImage.prototype.animate):
  22         (CompositingTransformsStage):
  23         (CompositingTransformsStage.prototype.createParticle):
  24         (CompositingTransformsStage.prototype.particleWillBeRemoved):
  25         (CompositedTransformsBenchmark):
  26         (CompositedTransformsBenchmark.prototype.createStage):
  27         (window.benchmarkClient.create):
  28
  29 2015-11-30  Said Abou-Hallawa  <sabouhallawa@apple.com>
  30
  31         Fix the graphics benchmark complexity bounds adjustment
  32         https://bugs.webkit.org/show_bug.cgi?id=151670
  33
  34         Reviewed by Simon Fraser.
  35
  36         Make sure the graphics benchmark complexity bounds adjustment is applied
  37         to the absolute lower bound.
  38
  39         * Animometer/tests/resources/math.js:
  40         (PIDController.prototype._saturate):
  41
  42 2015-11-30  Said Abou-Hallawa  <sabouhallawa@apple.com>
  43
  44         Add an option to select the results form the graphics benchmark
  45         https://bugs.webkit.org/show_bug.cgi?id=151666
  46
  47         Reviewed by Ryosuke Niwa.
  48
  49         We need an easy way to select the graphics benchmark results table such
  50         that when it is copied to the clipboard, rich text format is set to the
  51         clipboard.
  52
  53         * Animometer/runner/animometer.html: Add a new button to select the results table or JSON.
  54
  55         * Animometer/runner/resources/animometer.js:
  56         (window.sectionsManager._sectionDataElement): Selects the container <data> element.
  57         (window.sectionsManager._sectionDataDivElement): Replace a literal string with a string table entry.
  58         (window.sectionsManager.showTestName): Replace a literal string with a string table entry.
  59         (window.sectionsManager.selectData): Selects the container <data> element in a selection.
  60         (window.sectionsManager.selectDataContents): Select the contents of container <data> element in a selection.
  61         (window.benchmarkController.selectResults): Selects the results table.
  62         (window.benchmarkController.showJSON): Function rename.
  63         (window.benchmarkController.selectJSON): Selects the contents of the results JSON.
  64         (window.benchmarkController.showJson): Deleted.
  65
  66 2015-11-20  Simon Fraser  <simon.fraser@apple.com>
  67
  68         Animometer: graphs should not do interpolation
  69         https://bugs.webkit.org/show_bug.cgi?id=151526
  70
  71         Reviewed by Simon Fraser.
  72
  73         Having the graphs do interpolation is misleading, because you can't see the actual data.
  74
  75         Also remove "shape-rendering: crispEdges;" so the lines get antialiased.
  76
  77         * Animometer/runner/resources/animometer.css:
  78         (section#test-graph > data > svg): Deleted.
  79         * Animometer/runner/resources/graph.js:
  80         (graph): Deleted.
  81
  82 2015-11-19  Said Abou-Hallawa  <sabouhallawa@apple.com>
  83
  84         Calculate the graphics benchmark test gain adaptively
  85         https://bugs.webkit.org/show_bug.cgi?id=151208
  86
  87         Reviewed by Darin Adler.
  88
  89         We need to calculate the gain of the graphics benchmark tests adaptively
  90         and get rid of the gain and limits parameters we have to choose manually
  91         for every test. We are going to use the classic Ziegler–Nichols method for
  92         calculating the gain and integral and derivative times. We are going to
  93         try moving on a cubic curve during the manual stage from y0 to reach ysp.
  94         We also going to use a saturation actuator to ensure the system does not
  95         fluctuate.
  96
  97         * Animometer/resources/extensions.js:
  98         (ResultsTable.prototype._isNoisyMeasurement): Fix a parameter name.
  99         (ResultsTable.prototype._isNoisyTest): Since score is a member of testResults, we need to limit our search to frame rate and complexity.
 100         (ResultsTable.prototype._showTest): Pass the correct parameter to _isNoisyMeasurement().
 101
 102         * Animometer/resources/strings.js: Fix the indentation and name and value of a string.
 103
 104         * Animometer/runner/resources/tests.js: Remove all the manual gains and limits parameters which had to be passed to every test.
 105
 106         * Animometer/tests/resources/main.js:
 107         (BenchmarkState.prototype.currentStage): Fix an enum name.
 108         (Benchmark): Get rid of manual gain and limits.
 109         (Benchmark.prototype.update): Simplify the calculation by having all the times in ms.
 110
 111         * Animometer/tests/resources/math.js:
 112         (PIDController): Get rid of the manual gain and limits and the magic numbers for Ti and Td.
 113         (PIDController.prototype._yPosition): Tells whether the test current output is moving towards the set-point or away from it.
 114         (PIDController.prototype._distanceUltimate): Calculates the ultimate distance from y0 after time t using a cubic formula.
 115         (PIDController.prototype._distance): Calculates the distance of y relative to y0.
 116         (PIDController.prototype._gainIncrement): Decides how much the proportional gain should be increased during the manual gain stage.
 117         (PIDController.prototype._updateStage): Updates the stage of the controller based on its current stage and the system output.
 118         (PIDController.prototype._tuneP): Tunes the system before calculating the PID controller gains.
 119         (PIDController.prototype._tunePID): PID tuning function.
 120         (PIDController.prototype._tune):
 121         (PIDController.prototype._saturate):
 122         (PIDController.prototype.tune): Manages calculating the controller parameters. It then returns a PID tuning value.
 123         (PIDController.prototype._sat): Deleted. We may need to return it back but the limits have to be calculated adaptively not manually.
 124
 125 2015-11-17  Said Abou-Hallawa  <sabouhallawa@apple.com>
 126
 127         Reorganize the graphics benchmark string table
 128         https://bugs.webkit.org/show_bug.cgi?id=151334
 129
 130         Reviewed by Simon Fraser.
 131
 132         Make the graphics benchmark string table be an object of sub-objects. Each
 133         sub-object represents an associative array, the key is the string name and
 134         the value is the string data.
 135
 136         * Animometer/resources/extensions.js:
 137         (ResultsDashboard.prototype.toJSON):
 138         (ResultsTable.prototype._showGraph):
 139         (ResultsTable.prototype._showJSON):
 140         (ResultsTable.prototype._isNoisyMeasurement):
 141         (ResultsTable.prototype._isNoisyTest):
 142         (ResultsTable.prototype._showTest):
 143         (ResultsTable.prototype._showSuite):
 144         (ResultsTable.prototype._showIteration):
 145         * Animometer/resources/sampler.js:
 146         (Sampler.prototype.toJSON):
 147         * Animometer/resources/strings.js:
 148         * Animometer/runner/resources/animometer.js:
 149         (window.benchmarkRunnerClient.didFinishLastIteration):
 150         (window.suitesManager.updateLocalStorageFromJSON):
 151         (window.benchmarkController.showResults):
 152         (window.benchmarkController.showJson):
 153         (window.benchmarkController.showTestGraph):
 154         (window.benchmarkController.showTestJSON):
 155         * Animometer/runner/resources/tests.js:
 156         * Animometer/tests/resources/main.js:
 157
 158 2015-11-17  Said Abou-Hallawa  <sabouhallawa@apple.com>
 159
 160         Disable flattening the stage iframe of the graphics benchmark when running on iOS
 161         https://bugs.webkit.org/show_bug.cgi?id=151361
 162
 163         Reviewed by Simon Fraser.
 164
 165         Use fixed size for stage iframe of the graphics benchmark to disable
 166         flattening the iframe while animating the particles. Also ensure the
 167         bouncing particles do not go outside the iframe's boundaries.
 168
 169         * Animometer/runner/resources/animometer.css:
 170         (section#running > #running-test > iframe):
 171         (@media screen and (min-device-width: 1800px)):
 172         * Animometer/tests/bouncing-particles/resources/bouncing-particles.js:
 173         (BouncingParticle.prototype.animate):
 174
 175 2015-11-17  Said Abou-Hallawa  <sabouhallawa@apple.com>
 176
 177         Use the media queries to dynamically set the stage for the graphics benchmark
 178         https://bugs.webkit.org/show_bug.cgi?id=151327
 179
 180         Reviewed by Simon Fraser.
 181
 182         Clean setting the benchmark css rules by using the media queries. Accessing
 183         document.stylesheets.cssRules seems to be unreliable. Fix the test harness
 184         load event listener invocation. And also remove the options for normalizing
 185         the stage resolution for retina display.
 186
 187         * Animometer/resources/extensions.js:
 188         (window.DocumentExtension.insertCssRuleAfter): Deleted.
 189         * Animometer/runner/animometer.html:
 190         * Animometer/runner/resources/animometer.css:
 191         (@media screen and (min-device-width: 1800px)):
 192         * Animometer/runner/resources/animometer.js:
 193         (window.sectionsManager.setupRunningSectionStyle):
 194         (window.benchmarkController.initialize):
 195         (window.sectionsManager.setupSectionStyle): Deleted.
 196         * Animometer/tests/bouncing-particles/resources/bouncing-particles.js:
 197         (BouncingParticlesStage):
 198         * Animometer/tests/text/layering-text.html:
 199         * Animometer/tests/text/resources/layering-text.js:
 200         (LayeringTextStage):
 201         (LayeringTextStage.prototype._setFontSize): Deleted.
 202
 203 2015-11-16  Said Abou-Hallawa  <sabouhallawa@apple.com>
 204
 205         Remove the option for animating using setInterval from the graphics benchmark
 206         https://bugs.webkit.org/show_bug.cgi?id=151283
 207
 208         Reviewed by Darin Adler.
 209
 210         Get rid of the option to run animation using setInterval().
 211
 212         * Animometer/tests/resources/main.js:
 213         (Animator.prototype.animate):
 214         (Benchmark):
 215         (Benchmark.prototype.start):
 216         (Animator.prototype.start): Deleted.
 217
 218 2015-11-16  Said Abou-Hallawa  <sabouhallawa@apple.com>
 219
 220         Highlight the alarming test results in the graphics benchmark results page
 221         https://bugs.webkit.org/show_bug.cgi?id=151286
 222
 223         Reviewed by Simon Fraser.
 224
 225         When showing the results of a test in the graphics benchmark the following
 226         criteria is going to be applied:
 227
 228         1. If the standard deviation of the test complexity or the frame rate is
 229            equal to or more than 10%, the standard deviation and the test name
 230            will be displayed in red.
 231         2. If the average frame rate is not in the range = [(desired_frame_rate - 2)
 232            .. (desired_frame_rate + 2)], the average frame rate and the test name will
 233            be displayed in red.
 234
 235         * Animometer/resources/extensions.js:
 236         (ResultsTable.prototype._showHeaderRow):
 237         (ResultsTable.prototype._showHeader):
 238         (ResultsTable.prototype._showEmptyCell):
 239         (ResultsTable.prototype._showText):
 240         (ResultsTable.prototype._showFixedNumber):
 241         (ResultsTable.prototype.):
 242         (ResultsTable.prototype._showGraph):
 243         (ResultsTable.prototype._showJSON):
 244         (ResultsTable.prototype._isAlarmingMeasurement):
 245         (ResultsTable.prototype._isAlarmingTestResults):
 246         (ResultsTable.prototype._showEmptyCells):
 247         (ResultsTable.prototype._showEmptyRow):
 248         (ResultsTable.prototype._showTest):
 249         (ResultsTable.prototype._showSuite):
 250         (ResultsTable.prototype._showIteration):
 251         (ResultsTable.prototype.showRecord):
 252         (ResultsTable.prototype.showIterations):
 253         (ResultsTable.prototype._showEmpty): Deleted.
 254         * Animometer/runner/resources/animometer.js:
 255         (window.benchmarkRunnerClient.didFinishLastIteration):
 256         * Animometer/tests/resources/stage.js:
 257         (StageBenchmark.prototype.showResults):
 258
 259 2015-11-16  Said Abou-Hallawa  <sabouhallawa@apple.com>
 260
 261         Clean referencing the options object in the graphics benchmark
 262         https://bugs.webkit.org/show_bug.cgi?id=151284
 263
 264         Reviewed by Simon Fraser.
 265
 266         Get rid of the Benchmark.options member and rely only on the private member
 267         Benchmark._options. The animator need to have its own options member instead
 268         of accessing it from its reference to Benchmark object.
 269
 270         * Animometer/tests/bouncing-particles/resources/bouncing-canvas-particles.js:
 271         (BouncingCanvasParticlesAnimator):
 272         (BouncingCanvasParticlesBenchmark.prototype.createAnimator):
 273         * Animometer/tests/bouncing-particles/resources/bouncing-particles.js:
 274         (BouncingParticle.prototype.animate):
 275         (BouncingParticlesAnimator):
 276         (BouncingParticlesBenchmark.prototype.createAnimator):
 277         * Animometer/tests/examples/resources/canvas-electrons.js:
 278         (CanvasElectronsStage.prototype.animate):
 279         (CanvasElectronsAnimator):
 280         (CanvasElectronsBenchmark.prototype.createAnimator):
 281         (window.benchmarkClient.create):
 282         * Animometer/tests/examples/resources/canvas-stars.js:
 283         (CanvasStarsStage.prototype.animate):
 284         (CanvasStarsAnimator):
 285         (CanvasStarsBenchmark.prototype.createAnimator):
 286         (window.benchmarkClient.create):
 287         * Animometer/tests/resources/main.js:
 288         (BenchmarkState.prototype.currentProgress):
 289         (Animator):
 290         (Animator.prototype.animate):
 291         (Benchmark):
 292         (Benchmark.prototype.update):
 293         * Animometer/tests/resources/stage.js:
 294         (Stage.prototype.clear):
 295         (StageAnimator):
 296         (StageBenchmark.prototype.createAnimator):
 297         (StageBenchmark.prototype.tune):
 298         (StageBenchmark.prototype.showResults):
 299         * Animometer/tests/simple/resources/simple-canvas.js:
 300         (SimpleCanvasStage.prototype.animate):
 301         (SimpleCanvasAnimator):
 302         (SimpleCanvasAnimator.prototype.animate):
 303         (SimpleCanvasBenchmark.prototype.createAnimator):
 304         * Animometer/tests/template/resources/template-canvas.js:
 305         (TemplateCanvasStage.prototype.animate):
 306         (TemplateCanvasBenchmark.prototype.createAnimator):
 307         (window.benchmarkClient.create):
 308
 309 2015-11-13  Said Abou-Hallawa  <sabouhallawa@apple.com>
 310
 311         Eliminate a request for layout every time an item is added to the stage of the graphics benchmark
 312         https://bugs.webkit.org/show_bug.cgi?id=151289
 313
 314         Reviewed by Simon Fraser.
 315
 316         Cache the stage size when it is created instead of requesting every time
 317         an object is added via clientWidth and clientHeight.
 318
 319         * Animometer/resources/extensions.js:
 320         (Insets.elementPadding):
 321         * Animometer/tests/resources/stage.js:
 322         (Stage):
 323         (Stage.prototype.get size):
 324
 325 2015-11-06  Said Abou-Hallawa  <sabouhallawa@apple.com>
 326
 327         Initialize the graphics benchmark's Kalman filter with estimated 60 FPS
 328         https://bugs.webkit.org/show_bug.cgi?id=150965
 329
 330         Reviewed by Darin Adler.
 331
 332         This should give the benchmark more accurate reading at warmup time. And
 333         hence we can safely reduce the test running time to be 10 seconds.
 334
 335         * Animometer/runner/animometer.html:
 336         Add "defer" back when loading resources/animometer.js since this script
 337         depends on many other scripts and we need to wait till the page is parsed.
 338         Also change the default test interval to be 10 seconds.
 339
 340         * Animometer/runner/resources/graph.js:
 341         (graph): Make the test results curves smoother.
 342
 343         * Animometer/tests/resources/main.js:
 344         (Animator): Initialize the Kalman filter with 60 FPS which should be true
 345         if the test page is empty.
 346
 347         (Animator.prototype.animate):
 348         * Animometer/tests/resources/math.js:
 349         (KalmanEstimator): Fix the initial value of _vecX_est.
 350             _vecX_est[0] = current FPS (= 60FPS when the test page is empty)
 351             _vecX_est[1] = first time derivative of FPS (=0; FPS has been constant).
 352             _vecX_est[2] = second time derivative of FPS (=0; since _vecX_est[1]=0).
 353         (KalmanEstimator.prototype.estimate): Add some comments.
 354
 355 2015-11-04  Said Abou-Hallawa  <sabouhallawa@apple.com>
 356
 357         Remove "defer" from the scripts' references in the graphics benchmark home page
 358         https://bugs.webkit.org/show_bug.cgi?id=150915
 359
 360         Reviewed by Simon Fraser.
 361
 362         It causes the benchmark to be very flakey.
 363
 364         * Animometer/runner/animometer.html:
 365
 366 2015-11-01  Said Abou-Hallawa  <sabouhallawa@apple,com>
 367
 368         Add an option to make the graphics benchmark runs a specific test with fixed complexity
 369         https://bugs.webkit.org/show_bug.cgi?id=150529
 370
 371         Reviewed by Darin Adler.
 372
 373         Beside each test in the suites tree, we are going to show the complexity
 374         arithmetic mean of the of the last run in an edit control. Based on a
 375         new option these edit controls will all be visible or hidden. If they are
 376         visible their values can be changed. The benchmark runner if it run in
 377         the non-adaptive mode will set the complexity of the test to the passed
 378         value and will not change it ever. The animator will animate the test and
 379         frame rate will also be measured.
 380
 381         * Animometer/runner/animometer.html: Add a new option for the non-adaptive mode.
 382
 383         * Animometer/runner/resources/animometer.css:
 384         (section#home input[type="number"]): Define the width of all the edit control in the <home> section.
 385         (section#home > suites input[type="number"]): The edit controls in the <suites> box will be right aligned and hidden by default.
 386         (section#home > suites input[type="number"].selected): When the class "selected" is added, the edit controls will be visible.
 387         (section#home > options > label > input[type="number"]): Deleted.
 388
 389         * Animometer/runner/resources/animometer.js:
 390         (window.benchmarkRunnerClient.didFinishLastIteration): Update the local storage with the results of each test.
 391         (window.optionsManager._adaptiveTestElement): Returns the checkbox for setting the adaptive test option.
 392         (window.suitesManager._editElement):  Returns the edit element associated with each test element in the suites tree.
 393         (window.suitesManager._editsElements): Returns a list of all the elements in the <suites> box.
 394         (window.suitesManager._localStorageNameForTest): Change this function to take strings.
 395         (window.suitesManager._createTestElement): Adds an edit control beside each test.
 396         (window.suitesManager.updateEditsElementsState): Adds/Removes the 'selected' class to/from all the tests edit elements.
 397         (window.suitesManager.updateUIFromLocalStorage): Reads the edit control value from the local storage.
 398         (window.suitesManager.updateLocalStorageFromUI): Saves the edit control value to the local storage.
 399         (window.suitesManager.updateLocalStorageFromJSON): Saves the last run results to the local storage.
 400         (window.benchmarkController.initialize): Shows/Hides the test edit controls based on the adaptive test option.
 401         (window.benchmarkController.onChangeAdaptiveTestCheckbox): An onchange event handler for the adaptive test checkbox.
 402
 403         * Animometer/tests/resources/main.js:
 404         (Benchmark.prototype.update): Fix the complexity of the test if the running mode is non-adaptive test and desired complexity is not zero.
 405         (window.runBenchmark): Add the test complexity as a new benchmark option.
 406
 407 2015-11-01  Said Abou-Hallawa  <sabouhallawa@apple,com>
 408
 409         Make the size of the benchmark canvas adaptive to the screen size and screen resolution
 410         https://bugs.webkit.org/show_bug.cgi?id=150530
 411
 412         Reviewed by Darin Adler.
 413
 414         We want to set the size of the benchmark stage dynamically such that it
 415         depends on the screen resolution and the device scale factor. This patch
 416         does more than that because the home page css was not done properly. To
 417         use the flex box layout, the animometer.css has to be rewritten almost from
 418         scratch. The suites tree has to be rewritten also because it was not collapsing
 419         and with the flex box layout it was going outside of the window area. The
 420         options handling and the local storage handling had to be rewritten to
 421         allow more flexibility with this patch and the future patches. The code
 422         in animometer.js was reorganized into objects to allow distributing the code
 423         nicely among separate entities.
 424
 425         * Animometer/resources/extensions.js:
 426         (Point.elementClientSize): Returns the client size of an HTMLElement as a Point object.
 427         (Insets.prototype.get width): Follow the function opening brace style guidelines.
 428         (Insets.prototype.get height):
 429         (Insets.prototype.get size): Returns the size of an Insets as a Point object.
 430
 431         (window.DocumentExtension): Provides document helper functions. It should be assailable from the runner and the tests.
 432         (window.DocumentExtension.createElement): Creates an HTMLElement given its name, attributes and parentElement.
 433         (window.DocumentExtension.createSvgElement): Creates an SVGElement given its name, attributes and parentElement (moved from utilities.js).
 434         (window.DocumentExtension.insertCssRuleAfter): Inserts a CSS rule after an exiting rule given its text.
 435
 436         (ResultsTable.prototype._showHeader): Use DocumentExtension functions.
 437         (ResultsTable.prototype._showGraph): Use DocumentExtension functions and create a real button for "Graph..." option.
 438         (ResultsTable.prototype._showJSON): Use DocumentExtension functions and create a real button for "JSON..." option.
 439         (Options): Deleted.
 440
 441         * Animometer/runner/animometer.html: Restructure the page to use the flex box layout.
 442
 443         * Animometer/runner/resources/animometer.css:
 444         (html,body):
 445         (button):
 446
 447         (button.large-button):The large button appears in the animometer.html.
 448         (button.large-button:active):
 449         (button.large-button:disabled):
 450
 451         (button.small-button): The small button appears in the results table.
 452         (button.small-button:active):
 453
 454         (.tree): The tree class is used to list the suites and their tests.
 455         (.tree .expand-button): This button expands a tree element.
 456         (.tree .expand-button ~ ul): Hide the children (<ul>...</ul>) of a parent node by default.
 457         (.tree .expand-button:checked ~ ul): Show the children of a parent node only when checked.
 458         (.tree ul): Hide the list bullets.
 459         (.tree li): Indent every node in the tree relative to its parent.
 460         (.tree ul li): Indent all the non top level nodes only (the tests nodes in our case).
 461         (.tree > li:last-child): Do not indent the bottom of the last child node.
 462         (.tree-label): Style for all the labels in the tree.
 463         (label.tree-label): Style for the labels in the top level only (the suites nodes in our case).
 464         (label.tree-label:before): Style the unchecked case of the expand-button.
 465         (:checked ~ label.tree-label:before): Style the checked case of the expand-button.
 466
 467         (table.results-table): The results table appears while running the test and at the end.
 468         (.results-table td):
 469         (.results-table th):
 470
 471         (div.results-json): The JSON div appears per test or for the whole run.
 472
 473         (main): This is the flex box container.
 474
 475         (section): A section is displayed exclusively inside the <main>. It is hidden by default.
 476         (section.selected): When it is selected, its layout is flex layout.
 477         (section > footer): The header or the footer of a section should not take more than 15% of the container.
 478
 479         (section#home): The home section has <suites> and <options> parts to be laid out in the middle.
 480         (section#home > options):
 481         (section#home > suites): The <suites> should not take more than 40% of the width.
 482         (section#home > options > label): The benchmark title.
 483         (section#home > header > h2): The benchmark title.
 484         (section#home > options > label > input[type="number"]): Sets the width of the option edit control.
 485
 486         (section#running): The running section contain the runner <iframe> which takes the whole area of the <main>.
 487         (section#running > #running-test): This is the <iframe> container.
 488         (section#running > #running-test > iframe): The <iframe> is created by the runner for each test.
 489         (section#running > #progress): This is the progress bar.
 490         (section#running > #progress > #progress-completed): This is another element which grows while the runner is progressing.
 491         (section#running > #record): This the container of the record results table which is shown while running a test.
 492
 493         (section#results):
 494         (section#json):
 495         (section#test-json):
 496         (section#test-graph): All these sections have the same layout. A <data> element is laid out between <header> and <footer>.
 497
 498         (section#results > data):
 499         (section#json > data):
 500         (section#test-json > data):
 501         (section#test-graph > data): The <data> element should take 70% of the <section>.
 502
 503         (section#test-graph > data > svg):
 504         (.axis line):
 505         (.left-samples): These styles are for the d3 graph.
 506
 507         (section#test-json > data): This is the style of the JSON <data> element.
 508
 509         (iframe): Deleted.
 510         (label, p): Deleted.
 511         (section > p): Deleted.
 512         (section#home > p): Deleted.
 513         (section#home > p:first-child): Deleted.
 514         (#testContainer): Deleted.
 515         (section#running #progress-completed): Deleted.
 516         (section#results > table): Deleted.
 517         (section#results > table td, th): Deleted.
 518         (section#results > table tr.alt, td): Deleted.
 519         (section#results > table th): Deleted.
 520         (section#json > textarea): Deleted.
 521         (.options): Deleted.
 522         (.options p): Deleted.
 523         (#suites ul): Deleted.
 524         (#suites ul ul): Deleted.
 525         (#suites ul ul input, #suites ul ul label): Deleted.
 526         (#suites.showTests ul ul): Deleted.
 527         (.column): Deleted.
 528         (input[type="number"]): Deleted.
 529         (.buttons): Deleted.
 530         (.small-button): Deleted.
 531         (#graphContainer): Deleted.
 532         (.right-samples): Deleted.
 533         (.sample-time): Deleted.
 534         (.left-mean): Deleted.
 535         (.right-mean): Deleted.
 536
 537         * Animometer/runner/resources/animometer.js:
 538         (window.benchmarkRunnerClient.initialize): Initialize the client object with the options and the suites.
 539         (window.benchmarkRunnerClient.willStartFirstIteration): Use new css selectors for results and the record table.
 540         (window.benchmarkRunnerClient.didFinishLastIteration): Move the code which sets the JSON text to sectionsManager.showJSON().
 541
 542         (window.sectionsManager): Responsible of managing the <section>s elements inside animometer.html.
 543         (window.sectionsManager._sectionHeaderH1Element): Return the <h1> inside the <header> of a given section.
 544         (window.sectionsManager._sectionDataDivElement): Return the <div> inside the <data> of a given section.
 545         (window.sectionsManager.showScore): Show the score of the last benchmark run.
 546         (window.sectionsManager.showTestName): Show the test name for detailed results <section>.
 547         (window.sectionsManager.showJSON): Shows the JSON text of the last benchmark or for a specific test.
 548         (window.sectionsManager.showSection): Shows a specific <section> in the <main> container.
 549         (window.sectionsManager.setupSectionStyle): Sets css attributes for all the <section>s.
 550         (window.sectionsManager.setupRunningSectionStyle): Sets the css attributes for the running <section> only.
 551
 552         (window.optionsManager): Responsible of managing the user options and streaming them to/form the localStorage.
 553         (window.optionsManager._optionsElements): Returns the children <input> elements of the <options>.
 554         (window.optionsManager.updateUIFromLocalStorage): Restore the values of the <options> UI elements from the local storage.
 555         (window.optionsManager.updateLocalStorageFromUI): Saves the values of the <options> UI elements to the local storage.
 556
 557         (window.suitesManager): Responsible of managing the user suites and streaming them to/form the localStorage.
 558         (window.suitesManager._treeElement): Returns the suites tree container element.
 559         (window.suitesManager._suitesElements): Returns a list of the suites elements.
 560         (window.suitesManager._checkboxElement): Returns the checkbox element of a given suite.
 561         (window.suitesManager._localStorageNameForTest): Generates a string for the tuple <suite, test> to be saved in the localStorage.
 562         (window.suitesManager._updateSuiteCheckboxState): Updates the state of a suite checkbox from the state of its tests' checkboxes.
 563         (window.suitesManager._updateStartButtonState): Updates the state of the start button from the state of the suites' checkboxes.
 564         (window.suitesManager._onChangeSuiteCheckbox): Called when a suite checkbox is clicked.
 565         (window.suitesManager._onChangeTestCheckbox): Called when a test checkbox is clicked.
 566         (window.suitesManager._createSuiteElement): Creates suite node in the suites tree.
 567         (window.suitesManager._createTestElement): Creates test node in the suites tree.
 568         (window.suitesManager.createElements): Creates the suites tree dynamically from the array Suites.
 569         (window.suitesManager.updateUIFromLocalStorage): Restore the values of the <suites> UI elements from the local storage.
 570         (window.suitesManager.updateLocalStorageFromUI): aves the values of the <suites> UI elements to the local storage.
 571
 572         (window.benchmarkController): This is the UI controller of the animometer.html page.
 573         (window.benchmarkController.initialize): Called when the animometer.html page is loaded.
 574         (window.benchmarkController._runBenchmark): Starts a benchmark run.
 575         (window.benchmarkController.startTest): Called when the "Start Test" button is clicked.
 576         (window.benchmarkController.showResults): Called at the end of the test to show the final results.
 577         (window.benchmarkController.showJson): Called from the results page to show the JSON of the last benchmark run.
 578         (window.benchmarkController.showTestGraph): Called from the results the table to show a graph for the samples of a specific test.
 579         (window.benchmarkController.showTestJSON): Called from the results the table to show a JSON for the samples of a specific test.
 580
 581         (showSection): Deleted.
 582         (startTest): Deleted.
 583         (showResults): Deleted.
 584         (showJson): Deleted.
 585         (showTestGraph): Deleted.
 586         (showTestJSON): Deleted.
 587         (initialize.toggleTestsCheckbox.onchange): Deleted.
 588         (initialize): Deleted.
 589         (updateSuiteSelection): Deleted.
 590         (updateTestSelection): Deleted.
 591         (updateSuiteCheckbox): Deleted.
 592         (localStorageNameForTest): Deleted.
 593         (populateSettings.): Deleted.
 594         (populateSettings): Deleted.
 595
 596         * Animometer/runner/resources/benchmark-runner.js:
 597         (BenchmarkRunner): Pass the frameContainer element to the BenchmarkRunner.
 598         (BenchmarkRunner.prototype._appendFrame): Remove unused parameter unwanted styling code.
 599         (BenchmarkRunner.prototype.runMultipleIterations):  Use the this._client.iterationCount instead of passing it as a parameter also.
 600
 601         * Animometer/runner/resources/graph.js:
 602         (graph): Calculate the size of the chart from the container element.
 603
 604         * Animometer/tests/bouncing-particles/resources/bouncing-svg-images.js:
 605         (BouncingSvgImage):
 606         * Animometer/tests/bouncing-particles/resources/bouncing-svg-particles.js:
 607         (BouncingSvgParticlesStage.prototype._createDefs):
 608         (BouncingSvgParticlesStage.prototype._createClipStar):
 609         * Animometer/tests/bouncing-particles/resources/bouncing-svg-shapes.js:
 610         (BouncingSvgShape.prototype._createShape):
 611         (BouncingSvgShapesStage.prototype.createGradient):
 612         Call DocumentExtension.createSvgElement() instead of calling Utilities.createSvgElement().
 613
 614         * Animometer/tests/resources/main.js:
 615         (Animator.prototype.animate):
 616         (Benchmark):
 617         (Benchmark.prototype.update):
 618         * Animometer/tests/resources/stage.js:
 619         (StageBenchmark.prototype.showResults):
 620         Rename the options to match the <input> ids in animometer.html.
 621
 622         * Animometer/tests/resources/utilities.js:
 623         (window.Utilities.createSvgElement): Deleted.
 624
 625         * Animometer/tests/text/layering-text.html:
 626         * Animometer/tests/text/resources/layering-text.js:
 627         (LayeringTextStage):
 628         (LayeringTextStage.prototype._setFontSize): Sets the size of the text dynamically such that they all fit in one stage.
 629
 630 2015-10-29  Simon Fraser  <simon.fraser@apple.com>
 631
 632         Animometer computes frame rate incorrectly
 633         https://bugs.webkit.org/show_bug.cgi?id=150698
 634
 635         Reviewed by Tim Horton.
 636
 637         The existing code incremented this._frameCount after checking against this._dropFrameCount.
 638         This has the effect of setting this._measureTimeOffset one frame too late, so
 639         we were measuring only two frames, not three, and thus computing an incorrect fps.
 640
 641         * Animometer/tests/resources/main.js:
 642         (Animator.prototype.animate):
 643
 644 2015-10-27  Jon Lee  <jonlee@apple.com>
 645
 646         Add an option to make the graphics benchmark runs a specific test
 647         https://bugs.webkit.org/show_bug.cgi?id=150528
 648         rdar://problem/23246614
 649
 650         Reviewed by Zalan Bujtas.
 651
 652         Add a checkbox that lets the user list all of the available tests, and select
 653         the ones to run repeatedly. The test checkboxes will update the state of the suite
 654         checkbox. The selected tests are stored in localStorage to make it easy to do
 655         repeated runs.
 656
 657         * Animometer/runner/animometer.html: Add a checkbox to show individual tests.
 658         Update other markup.
 659         * Animometer/runner/resources/animometer.css: Make the settings area a little wider
 660         to accommodate the longer names of the tests
 661         * Animometer/runner/resources/animometer.js:
 662         (startBenchmark): Change the way that the suites are fed into the benchmark
 663         runner. Go through each of the suites and their tests, and create a new Suite
 664         with just the enabled tests. While enumerating store the enabled tests into
 665         localStorage.
 666         (initialize): Initialization routine (taking over populateSettings). When the
 667         checkbox for showing tests is toggled, add or remove a class on #suites to show
 668         the individual tests.
 669         (updateSuiteSelection): Called whenever the user toggles the checkbox for a suite.
 670         Either select all or none of the tests.
 671         (updateTestSelection): Called whenever the user toggles the checkbox for a test.
 672         (updateSuiteCheckbox): Update the state of the test's suite's checkbox to
 673         indeterminate if there is at least one enabled test, unchecked if none are selected,
 674         and checked if all are selected.
 675         (localStorageNameForTest): Helper function to get the name of the test to use as
 676         a key to localStorage.
 677         (populateSettings): Add the tests for each suite into an inner list.
 678
 679 2015-10-26  Said Abou-Hallawa  <sabouhallawa@apple.com>
 680
 681         Add an option to output the results of the graphics benchmark in JSON format
 682         https://bugs.webkit.org/show_bug.cgi?id=150484
 683         <rdar://problem/23243721>
 684
 685         Reviewed by Darin Adler.
 686
 687         * Animometer/resources/extensions.js:
 688         (ResultsDashboard): A new class to hold the iterations results.
 689         (ResultsDashboard.prototype.push): Appends an iteration results;
 690         (ResultsDashboard.prototype.toJSON): Converts the iterations results to JSON format.
 691
 692         (RecordTable.prototype.clear): Clears the results table.
 693         (RecordTable.prototype._showTitles): Shows the header titles and appends the sub-titles to a queue.
 694         (RecordTable.prototype._showHeader): Shows the table header titles.
 695         (RecordTable.prototype._showEmpty): Shows an empty table cell.
 696         (RecordTable.prototype._showValue): Shows a number value in the results table.
 697         (RecordTable.prototype._showSamples): Shows a button for the sampled data graph.
 698         (RecordTable.prototype._showTest): Shows the results of a single test.
 699         (RecordTable.prototype._showSuite): Shows the results of a single suite.
 700         (RecordTable.prototype.showRecord): Shows a single iteration for a single test.
 701         (RecordTable.prototype.showIterations): Shows the results of all the suites of the iterations.
 702
 703         (ResultsTable): RecordTable was renamed to ResultsTable.
 704         (ResultsTable.prototype.clear): Clears the table element.
 705         (ResultsTable.prototype._showHeaderRow): Shows a row in the results table header.
 706         (ResultsTable.prototype._showHeader): Shows the results table header.
 707         (ResultsTable.prototype._showEmpty): Shows an empty table cell.
 708         (ResultsTable.prototype._showText): Shows a string in a new table cell.
 709         (ResultsTable.prototype._showFixedNumber): Shows a number in a new table cell.
 710         (ResultsTable.prototype._showGraph): Shows a button for the sampled data graph.
 711         (ResultsTable.prototype._showJSON): Shows a button for the sampled data JSON.
 712         (ResultsTable.prototype._showTest): Shows the results of a single test.
 713         (ResultsTable.prototype._showSuite): Shows the results of a single suite.
 714         (ResultsTable.prototype._showIteration): Shows the results of a single iteration.
 715         (ResultsTable.prototype.showRecord): Shows a single iteration for a single test.
 716         (ResultsTable.prototype.showIterations): Shows all the results.
 717         (RecordTable): Deleted.
 718         (RecordTable.prototype.clear): Deleted.
 719         (RecordTable.prototype._showTitles): Deleted.
 720         (RecordTable.prototype._showHeader): Deleted.
 721         (RecordTable.prototype._showEmpty): Deleted.
 722         (RecordTable.prototype._showValue): Deleted.
 723         (RecordTable.prototype._showSamples): Deleted.
 724         (RecordTable.prototype._showTest): Deleted.
 725         (RecordTable.prototype._showSuite): Deleted.
 726         (RecordTable.prototype.showRecord): Deleted.
 727         (RecordTable.prototype.showIterations): Deleted.
 728
 729         * Animometer/resources/sampler.js:
 730         (Sampler.prototype.startSampling): Use forEach.
 731         (Sampler.prototype.sample): Use forEach.
 732         (Sampler.prototype.toJSON): Converts the sampler data to JSON format.
 733
 734         * Animometer/resources/strings.js: Added.
 735         This new file will be used to associate the strings used by the benchmark
 736         with IDs. A string can be changed in one place without having to change
 737         all the instances of this string in multiple files. There two groups of
 738         strings in this file. The first one is used by the UI elements and the second
 739         group is used when constructing the results JSON.
 740
 741         * Animometer/runner/animometer.html:
 742         * Animometer/runner/resources/animometer.css:
 743
 744         * Animometer/runner/resources/animometer.js:
 745         (window.benchmarkRunnerClient.willAddTestFrame):
 746         (window.benchmarkRunnerClient.willStartFirstIteration):
 747         (window.benchmarkRunnerClient.didRunSuites):
 748         (window.benchmarkRunnerClient.didFinishLastIteration):
 749         Make benchmarkRunnerClient uses ResultsDashboard instead of _iterationsSamplers
 750         Get the JSON from ResultsDashboard.toJSON() and pass it to ResultsTable.showIterations().
 751         Also set the textContent of the "#json" textarea with the results JSON.
 752
 753         (showResults): Delete unneeded code.
 754         (showJson): Shows the "json" section.
 755         (showTestGraph): Rename showGraph() to be showTestGraph().
 756         (showTestJSON): Shows the JSON of a single testResults.
 757         (showGraph): Deleted.
 758
 759         * Animometer/runner/resources/tests.js:
 760         Use the string table instead of putting literal strings.
 761
 762         * Animometer/tests/resources/stage.js:
 763         (StageBenchmark.prototype.showResults):
 764         Fix the parameters which are passed to RecordTable.showRecord().
 765
 766         * Animometer/tests/bouncing-particles/bouncing-canvas-images.html:
 767         * Animometer/tests/bouncing-particles/bouncing-canvas-shapes.html:
 768         * Animometer/tests/bouncing-particles/bouncing-css-images.html:
 769         * Animometer/tests/bouncing-particles/bouncing-css-shapes.html:
 770         * Animometer/tests/bouncing-particles/bouncing-svg-images.html:
 771         * Animometer/tests/bouncing-particles/bouncing-svg-shapes.html:
 772         * Animometer/tests/examples/canvas-electrons.html:
 773         * Animometer/tests/examples/canvas-stars.html:
 774         * Animometer/tests/simple/simple-canvas-paths.html:
 775         * Animometer/tests/template/template-canvas.html:
 776         * Animometer/tests/template/template-css.html:
 777         * Animometer/tests/template/template-svg.html:
 778         * Animometer/tests/text/layering-text.html:
 779         Include the new strings.js file in all the test files.
 780
 781 2015-10-12  Jon Lee  <jonlee@apple.com>
 782
 783         Add canvas line dash test
 784         https://bugs.webkit.org/show_bug.cgi?id=150078
 785         <rdar://problem/23082347>
 786
 787         Reviewed by Dean Jackson.
 788
 789         * Animometer/runner/resources/tests.js: Add line dash test.
 790         * Animometer/tests/simple/resources/simple-canvas-paths.js:
 791         (CanvasLineDashStage): Create a new stage with a default dash pattern and stroke style.
 792         Maintain a step which will animate the dash.
 793         (CanvasLineDashStage.prototype.animate): Render the line path with the dash. Increment
 794         the dash offset to animate.
 795         (CanvasPathBenchmark.prototype.createStage): Add the test.
 796
 797 2015-10-12  Jon Lee  <jonlee@apple.com>
 798
 799         Add canvas line path tests
 800         https://bugs.webkit.org/show_bug.cgi?id=150076
 801         <rdar://problem/23082285>
 802
 803         Reviewed by Dean Jackson.
 804
 805         * Animometer/runner/resources/tests.js: Add new line path tests, with different
 806         line joins.
 807         * Animometer/tests/simple/resources/simple-canvas-paths.js:
 808         (CanvasLinePathStage): The stage is the same as the SimpleCanvasPathStrokeStage
 809         but sets the lineJoin on the context.
 810         (CanvasPathBenchmark.prototype.createStage): Add the tests.
 811
 812 2015-10-12  Jon Lee  <jonlee@apple.com>
 813
 814         Add missing paint objects for arc and arcTo fills
 815         https://bugs.webkit.org/show_bug.cgi?id=150075
 816         <rdar://problem/23082233>
 817
 818         Reviewed by Dean Jackson.
 819
 820         * Animometer/tests/simple/resources/simple-canvas-paths.js: Add missing paint objects
 821         for arcTo and arc segment fills.
 822         (CanvasArcToSegmentFill):
 823         (CanvasArcToSegmentFill.prototype.draw):
 824         (CanvasArcSegmentFill):
 825         (CanvasArcSegmentFill.prototype.draw):
 826
 827 2015-10-12  Jon Lee  <jonlee@apple.com>
 828
 829         Add canvas line segment tests
 830         https://bugs.webkit.org/show_bug.cgi?id=150073
 831         <rdar://problem/23082138>
 832
 833         Reviewed by Dean Jackson.
 834
 835         * Animometer/runner/resources/tests.js: Add new line segment tests, with different
 836         line caps.
 837         * Animometer/tests/simple/resources/simple-canvas-paths.js:
 838         (CanvasLineSegment): Add new line segment paint object.
 839         (CanvasLineSegmentStage): Create a new stage that sets the lineCap.
 840
 841 2015-10-12  Jon Lee  <jonlee@apple.com>
 842
 843         Add canvas path fill tests
 844         https://bugs.webkit.org/show_bug.cgi?id=150071
 845         <rdar://problem/23082001>
 846
 847         Reviewed by Dean Jackson.
 848
 849         * Animometer/runner/resources/tests.js: Add new pathTypes for path fills.
 850         * Animometer/tests/simple/resources/simple-canvas-paths.js:
 851         (CanvasLinePoint): Add basic point for a line, and call lineTo.
 852         (SimpleCanvasPathFillStage): Add a new stage similar to SimpleCanvasPathStrokeStage.
 853         (CanvasPathBenchmark.prototype.createStage): Add the tests.
 854
 855 2015-10-12  Jon Lee  <jonlee@apple.com>
 856
 857         Add canvas path tests
 858         https://bugs.webkit.org/show_bug.cgi?id=150067
 859         rdar://problem/23081463
 860
 861         Reviewed by Dean Jackson.
 862
 863         * Animometer/runner/resources/tests.js: Add a quadratic and bezier path test.
 864
 865         * Animometer/tests/simple/resources/simple-canvas.js:
 866         (SimpleCanvasStage.prototype.tune): This kind of test joins all of the segments
 867         into one long path, and tries to render that one path. Random points make it
 868         difficult to tell what is going on, so add a parameter to the constructor to
 869         confine the area where the random coordinates can land. The more complicated the
 870         case is, the larger an area the path will cover. Add an artificial minimum so
 871         that the first 200 points aren't confined to a space that is too small.
 872
 873         * Animometer/tests/simple/resources/simple-canvas-paths.js:
 874         (SimpleCanvasPathStrokeStage): Add a new kind of stage that inherits from
 875         SimpleCanvasStage. Each time the frame animates a random line width and stroke
 876         color are chosen. The path setup is done outside of each paint object.
 877         (CanvasQuadraticPoint): This point just calls quadraticCurveTo.
 878         (CanvasPathBenchmark.prototype.createStage): Add the tests.
 879
 880 2015-10-12  Jon Lee  <jonlee@apple.com>
 881
 882         Add basic canvas tests
 883         https://bugs.webkit.org/show_bug.cgi?id=150066
 884         rdar://problem/23081143
 885
 886         Reviewed by Dean Jackson.
 887
 888         This adds a new test suite that will cover all of the path-based canvas calls.
 889         The patch will be divided up to cover tests with similar techniques.
 890
 891         The simplest version uses a SimpleCanvasStage.
 892
 893         * Animometer/runner/resources/tests.js: Add tests for quadratic, bezier, arcTo,
 894         arc, and rect segments. Also include arcTo, arc, and rect fills.
 895         * Animometer/tests/resources/stage.js:
 896         (Stage.prototype.randomBool): Added for counterclockwise property for arc segments.
 897         (Stage.prototype.randomInt): Fix how values are rounded, used by randomBool. It should
 898         round instead of flooring everything.
 899         * Animometer/tests/simple/resources/simple-canvas.js: Added. Defines common classes
 900         used by all simple canvas tests. The page reads best bottom to top.
 901         (SimpleCanvasStage): Basic stage. Pass a canvasObject which will be used to create new
 902         objects as needed in tune().
 903         (SimpleCanvasStage.prototype.tune): Modeled on other tests. Adds and removed objects
 904         as specified by the provided |count|.
 905         (SimpleCanvasStage.prototype.animate): Iterate over all the objects and ask them to draw.
 906         There is no "animating" of the objects; they will just paint statically on the canvas.
 907         (SimpleCanvasAnimator): Basic animator clears the canvas prior to painting.
 908         (SimpleCanvasBenchmark): Hard-code the feedback loop parameters instead of including
 909         them in the query parameters to the test URLs.
 910         (SimpleCanvasBenchmark.prototype.createAnimator):
 911         * Animometer/tests/simple/simple-canvas-paths.html: Added.
 912
 913         * Animometer/tests/simple/resources/simple-canvas-paths.js: Added. There is no "animating"
 914         of these objects--they just paint statically on the canvas.
 915         (CanvasQuadraticSegment): Paint a quadratic segment stroke.
 916         (CanvasBezierSegment): Paint a bezier segment stroke.
 917         (CanvasArcToSegment): Paint an arcTo stroke.
 918         (CanvasArcSegment): Paint an arc stroke.
 919         (CanvasRect): Paint a rect.
 920         (CanvasRectFill): Paint a filled rect.
 921
 922         (CanvasPathBenchmark):
 923         (CanvasPathBenchmark.prototype.createStage): Look for the pathType and create the
 924         stage using the right paint object.
 925         (window.benchmarkClient.create):
 926
 927 2015-10-12  Jon Lee  <jonlee@apple.com>
 928
 929         Refactor tune() to pass in an integer-based count
 930         https://bugs.webkit.org/show_bug.cgi?id=150060
 931         <rdar://problem/23079425>
 932
 933         Reviewed by Dean Jackson.
 934
 935         All of the tune functions do an initial step of flooring the
 936         # of painting objects to add or remove. Factor that out since
 937         the complexity of all of these tests is always expressed in terms
 938         of countable items.
 939
 940         * Animometer/tests/resources/main.js:
 941         (Benchmark.prototype.update): Update the tuneValue.
 942
 943         * Animometer/tests/bouncing-particles/resources/bouncing-particles.js:
 944         (BouncingParticlesStage.prototype.tune): Remove the count adjustment.
 945         * Animometer/tests/examples/resources/canvas-electrons.js:
 946         (CanvasElectronsStage.prototype.tune): Ditto.
 947         * Animometer/tests/examples/resources/canvas-stars.js:
 948         (CanvasStarsStage.prototype.tune): Ditto.
 949         * Animometer/tests/text/resources/layering-text.js:
 950         (LayeringTextStage.prototype.tune): Ditto.
 951
 952 2015-10-12  Jon Lee  <jonlee@apple.com>
 953
 954         Store test-interval in localStorage
 955         https://bugs.webkit.org/show_bug.cgi?id=150055
 956         <rdar://problem/23078879>
 957
 958         Reviewed by Dean Jackson.
 959
 960         * Animometer/runner/resources/animometer.js:
 961         (populateSettings): Keep track of the specified test interval in localStorage
 962         to make it easy to repeat a test suite.
 963
 964 2015-10-12  Jon Lee  <jonlee@apple.com>
 965
 966         Remove "../tests/" from the URLs of all tests
 967         https://bugs.webkit.org/show_bug.cgi?id=150054
 968         <rdar://problem/23078784>
 969
 970         Reviewed by Dean Jackson.
 971
 972         Presumably all tests will be running from the tests/ directory,
 973         so we don't have to specify it in all of the test URLs.
 974
 975         * Animometer/runner/resources/benchmark-runner.js:
 976         (BenchmarkRunnerState.prototype.prepareCurrentTest): Prepend
 977         "../tests/" to all tests.
 978         * Animometer/runner/resources/tests.js: Remove "../tests/" from
 979         all URLs.
 980
 981 2015-10-12  Jon Lee  <jonlee@apple.com>
 982
 983         Refactor test suites to a separate class.
 984         https://bugs.webkit.org/show_bug.cgi?id=150053
 985         <rdar://problem/23078645>
 986
 987         Reviewed by Dean Jackson.
 988
 989         Create a Suite class to refactor out prepare() and run().
 990         Generate the checkboxes representing the suites using Suites
 991         instead of maintaining a separate list. Also, save the
 992         selections out to localStorage.
 993
 994         * Animometer/runner/animometer.html: Remove the explicitly listed
 995         suites. These will be generated from Suites instead.
 996         * Animometer/runner/resources/animometer.js:
 997         (populateSettings): Iterate through Suites, and create the
 998         label and checkbox. Attach the Suite object to the checkbox so
 999         when the benchmark is started, we get direct access. Initialize
1000         the checkmark based on its value in localStorage. Set this to
1001         run when DOMContentLoaded is dispatched.
1002         (startBenchmark): Grab all of the checkboxes, inspect their
1003         values, add it to enabledSuites if selected. Remember whether
1004         the suite was enabled in localStorage, so that it's easy to do
1005         repeated runs.
1006         * Animometer/runner/resources/tests.js:
1007         (Suite): Create a new Suite class. Refactor out prepare() and
1008         run(), since all of them have the same implementation. Populate
1009         Suites with Suite instances instead of generic objects.
1010
1011 2015-10-12  Jon Lee  <jonlee@apple.com>
1012
1013         Update graph styles for legibility.
1014         https://bugs.webkit.org/show_bug.cgi?id=150052
1015         <rdar://problem/23078503>
1016
1017         Reviewed by Dean Jackson.
1018
1019         * Animometer/runner/resources/animometer.css: Update colors and
1020         stroke thicknesses to make the graphs easier to read.
1021         (.smaple-time): Correct to .sample-time
1022         * Animometer/runner/resources/graph.js:
1023         (graph): Ditto.
1024
1025 2015-10-12  Jon Lee  <jonlee@apple.com>
1026
1027         Update graph styles for legibility.
1028         https://bugs.webkit.org/show_bug.cgi?id=150052
1029         <rdar://problem/23078503>
1030
1031         Reviewed by Dean Jackson.
1032
1033         * Animometer/runner/resources/animometer.css: Update colors and
1034         stroke thicknesses to make the graphs easier to read.
1035         (.smaple-time): Correct to .sample-time
1036         * Animometer/runner/resources/graph.js:
1037         (graph): Ditto.
1038
1039 2015-10-12  Filip Pizlo  <fpizlo@apple.com>
1040
1041         Unreviewed, revert an unintended commit.
1042
1043         * JetStream/Octane2/crypto.js:
1044         (montRevert):
1045         (montReduce):
1046
1047 2015-10-05  Said Abou-Hallawa  <sabouhallawa@apple.com>
1048
1049         Add a graphics benchmark
1050         https://bugs.webkit.org/show_bug.cgi?id=149053
1051         <rdar://problem/18984169>
1052
1053         Reviewed by Dean Jackson.
1054
1055         Instead of measuring the FPS of the animation, this benchmark measures the
1056         test complexity when rendering at a set-point FPS which should be lower
1057         than 60 FPS. This benchmark tries to stay at the set-point FPS by using
1058         a closed loop control system PID function. The gain of the system is passed
1059         as a parameter when running the test. Measuring the FPS faithfully results
1060         very fluctuating values. A Kalman filter is used to give a better estimate
1061         for the current FPS.
1062
1063         The animation of the tests is done manually. requestAnimationFrame() is
1064         called with a callback. Inside this callback, the test is animating by
1065         changing the positions of the elements inside the page. The test complexity
1066         may change also if the current FPS is not equal to the desired FPS.
1067
1068         In this patch, the benchmark and the tests are included. The shared code
1069         and the tests runner are included in separate patches.
1070
1071         * Animometer/runner/animometer.html:
1072         * Animometer/runner/resources/animometer.js:
1073         Add two new examples for more complex animation techniques.
1074         Add an option to show/hide the test running results which is off by default.
1075
1076         * Animometer/runner/resources/tests.js: Added.
1077         (suiteFromName): Returns a suite given its name.
1078         (testFromName): Returns a test given its suite and name.
1079
1080         * Animometer/tests: Added.
1081         This directory includes all the test suites to be run by the benchmark.
1082         runner. All the tests should try to run on three stages: CSS, canvas and
1083         SVG.
1084
1085         * Animometer/tests/bouncing-particles: Added.
1086         * Animometer/tests/bouncing-particles/resources: Added.
1087         The bouncing particles test is an example of a simple animation technique.
1088
1089         * Animometer/tests/bouncing-particles/bouncing-canvas-images.html: Added.
1090         * Animometer/tests/bouncing-particles/bouncing-canvas-shapes.html: Added.
1091         * Animometer/tests/bouncing-particles/bouncing-css-images.html: Added.
1092         * Animometer/tests/bouncing-particles/bouncing-css-shapes.html: Added.
1093         * Animometer/tests/bouncing-particles/bouncing-svg-images.html: Added.
1094         * Animometer/tests/bouncing-particles/bouncing-svg-shapes.html: Added.
1095         Bouncing particles test pages.
1096
1097         * Animometer/tests/bouncing-particles/resources/bouncing-particles.js: Added.
1098         (BouncingParticle): Base class for a bouncing particle.
1099         (BouncingParticle.prototype.center): Returns the center point or the particle.
1100         (BouncingParticle.prototype.animate): Moves the particle based on its current position, angle and velocity.
1101
1102         (BouncingParticlesAnimator): A sub class of Animator.
1103
1104         (BouncingParticlesStage): Represents the container of all the bouncing particles.
1105         (BouncingParticlesStage.prototype.parseShapeParamters): Gets the shape parameters for shape animating tests.
1106         (BouncingParticlesStage.prototype.randomRotater): Creates a rotater for the particles.
1107         (BouncingParticlesStage.prototype.animate): Animates all the particles.
1108         (BouncingParticlesStage.prototype.tune): Changes the test by adding or removing particles.
1109
1110         (BouncingParticlesBenchmark): Runs the benchmark for bouncing particles test.
1111         (BouncingParticlesBenchmark.prototype.createAnimator): Creates an animator of type BouncingParticlesAnimator.
1112
1113         * Animometer/tests/bouncing-particles/resources/bouncing-css-shapes.js: Added.
1114         (BouncingCssShape): A sub class of BouncingParticle for animating CSS shapes.
1115         (BouncingCssShape.prototype._createSpan): Creates a <span> element and takes the shape and clipping classes into consideration.
1116         (BouncingCssShape.prototype._move): Moves the particle to a new location. Apply transform since it does not require layout.
1117         (BouncingCssShape.prototype.animate): Rotates and moves the shape to a new location.
1118
1119         (BouncingCssShapesStage): A sub class of BouncingParticlesStage for animating CSS shapes.
1120         (BouncingCssShapesStage.prototype.createParticle): Creates a particle of type BouncingCssShape.
1121         (BouncingCssShapesStage.prototype.particleWillBeRemoved): Removes the corresponding element form the parent children list.
1122
1123         (BouncingCssShapesBenchmark): A sub class of BouncingParticlesBenchmark for animating CSS shapes.
1124         (BouncingCssShapesBenchmark.prototype.createStage): Creates a stage of type BouncingCssShapesStage.
1125         (window.benchmarkClient.create): Creates a benchmark of type BouncingCssShapesBenchmark.
1126
1127         * Animometer/tests/bouncing-particles/resources/bouncing-css-images.js: Added.
1128         (BouncingCssImage): A sub class of BouncingParticle for animating CSS images.
1129         (BouncingCssImage.prototype._move): Move the particle to a new location. Apply transform since it does not require layout.
1130         (BouncingCssImage.prototype.animate): Rotates and moves the shape to a new location.
1131
1132         (BouncingCssImagesStage): A sub class of BouncingParticlesStage for animating CSS images.
1133         (BouncingCssImagesStage.prototype.createParticle): Creates a particle of type BouncingCssImage.
1134         (BouncingCssImagesStage.prototype.particleWillBeRemoved): Removes the corresponding element form the parent children list.
1135
1136         (BouncingCssImagesBenchmark): A sub class of BouncingParticlesBenchmark for animating CSS images.
1137         (BouncingCssImagesBenchmark.prototype.createStage): Creates a stage of type BouncingCssImagesStage.
1138         (window.benchmarkClient.create): Creates a benchmark of type BouncingCssImagesBenchmark.
1139
1140         * Animometer/tests/bouncing-particles/resources/bouncing-canvas-particles.js: Added.
1141         (BouncingCanvasParticle): A base sub-class of BouncingParticle for animating canvas particles.
1142         (BouncingCanvasParticle.prototype._applyRotation): Apply the particle rotation-around-center transform to the canvas context.
1143         (BouncingCanvasParticle.prototype._applyClipping): Apply the particle clipping to the canvas context.
1144         (BouncingCanvasParticle.prototype._draw): A non-implemented version of the drawing function.
1145         (BouncingCanvasParticle.prototype.animate): Carries out all the steps to redraw the canvas particle.
1146
1147         (BouncingCanvasParticlesStage): A base sub-class of BouncingParticlesStage for animating canvas particles.
1148
1149         (BouncingCanvasParticlesAnimator): A concrete sub-class of BouncingParticlesAnimator for animating canvas particles.
1150         (BouncingCanvasParticlesAnimator.prototype.animate): Overrides the base class method to clear the canvas before redrawing the stage.
1151
1152         (BouncingCanvasParticlesBenchmark): A base sub-class of StageBenchmark for animating canvas particles.
1153         (BouncingCanvasParticlesBenchmark.prototype.createAnimator): Creates the canvas particles animator.
1154
1155         * Animometer/tests/bouncing-particles/resources/bouncing-canvas-shapes.js: Added.
1156         (BouncingCanvasShape): A concrete sub-class of BouncingCanvasParticle for animating canvas shapes.
1157         (BouncingCanvasShape.prototype._applyFill): Sets the fillStyle in the canvas context.
1158         (BouncingCanvasShape.prototype._drawShape): Carries out the actual drawing.
1159         (BouncingCanvasShape.prototype._draw): Carries out all the steps to draw the shape.
1160
1161         (BouncingCanvasShapesStage): A concrete sub-class of BouncingCanvasParticle for animating canvas shapes.
1162         (BouncingCanvasShapesStage.prototype.createParticle): Creates a particle of type BouncingCanvasShape.
1163
1164         (BouncingCanvasShapesBenchmark): A concrete sub-class of BouncingCanvasParticlesBenchmark for animating canvas shapes.
1165         (BouncingCanvasShapesBenchmark.prototype.createStage): Creates a stage of type BouncingCanvasShapesStage.
1166         (window.benchmarkClient.create): Creates a benchmark of type BouncingCanvasShapesBenchmark.
1167
1168         * Animometer/tests/bouncing-particles/resources/bouncing-canvas-images.js: Added.
1169         (BouncingCanvasImage): A concrete sub-class of BouncingCanvasParticle for animating canvas images.
1170         (BouncingCanvasImage.prototype._draw): Draws an image on the context of a canvas.
1171
1172         (BouncingCanvasImagesStage): A concrete sub-class of BouncingCanvasParticlesBenchmark for animating canvas images.
1173         (BouncingCanvasImagesStage.prototype.createParticle): Creates a particle of type BouncingCanvasImage.
1174
1175         (BouncingCanvasImagesBenchmark): A concrete sub-class of BouncingCanvasParticlesBenchmark for animating canvas images.
1176         (BouncingCanvasImagesBenchmark.prototype.createStage): Creates a stage of type BouncingCanvasImagesStage.
1177         (window.benchmarkClient.create): Creates a benchmark of type BouncingCanvasImagesBenchmark.
1178
1179         * Animometer/tests/bouncing-particles/resources/bouncing-svg-particles.js: Added.
1180         (BouncingSvgParticle): A base sub-class of BouncingParticle for animating SVG particles.
1181         (BouncingSvgParticle.prototype._applyClipping): Apply the particle clipping by setting the 'clip-path' attribute of the SVGElement.
1182         (BouncingSvgParticle.prototype._move): Moves the particle to a new location. Apply transform since it does not require layout.
1183         (BouncingSvgParticle.prototype.animate): Rotates and moves the shape to a new location.
1184         (BouncingSvgParticlesStage): A sub class of BouncingParticlesStage for animating SVGElements.
1185         (BouncingSvgParticlesStage.prototype._createDefs): Creates an SVGDefsElement.
1186         (BouncingSvgParticlesStage.prototype._ensureDefsIsCreated): Ensures there is only one SVGDefsElement is created.
1187         (BouncingSvgParticlesStage.prototype._createClipStar): Creates an SVGClipPathElement and sets its 'd' attribute to a star like shape.
1188         (BouncingSvgParticlesStage.prototype.ensureClipStarIsCreated): Ensure there is only one star SVGClipPathElement is created.
1189         (BouncingSvgParticlesStage.prototype.particleWillBeRemoved): Remove the corresponding element form the parent children list.
1190
1191         * Animometer/tests/bouncing-particles/resources/bouncing-svg-shapes.js: Added.
1192         (BouncingSvgShape): A concrete sub-class of BouncingSVGParticle for animating SVG shapes.
1193         (BouncingSvgShape.prototype._createShape): Creates an SVG shape.
1194         (BouncingSvgShape.prototype._applyFill): Applies the selected fill style to the SVG shape.
1195
1196         (BouncingSvgShapesStage): A concrete sub-class of BouncingSvgParticlesStage for animating SVG shapes.
1197         (BouncingSvgShapesStage.prototype.createGradient): Creates an SVGLinearGradientElement.
1198         (BouncingSvgShapesStage.prototype.createParticle): Creates a particle of type BouncingSvgShape.
1199         (BouncingSvgShapesStage.prototype.particleWillBeRemoved): Ensures the attached SVGLinearGradientElement is removed from the SVGDefsElement.
1200
1201         (BouncingSvgShapesBenchmark): A concrete sub-class of BouncingParticlesBenchmark for animating SVG images.
1202         (BouncingSvgShapesBenchmark.prototype.createStage): Creates a stage of type BouncingSvgShapesStage.
1203         (window.benchmarkClient.create): Creates a benchmark of type BouncingSvgShapesBenchmark.
1204
1205         * Animometer/tests/bouncing-particles/resources/bouncing-svg-images.js: Added.
1206         (BouncingSvgImage): A concrete sub-class of BouncingSVGParticle for animating SVG images.
1207
1208         (BouncingSvgImagesStage): A concrete sub-class of BouncingSVGParticlesBenchmark for animating SVG images.
1209         (BouncingSvgImagesStage.prototype.createParticle): Creates a particle of type BouncingSvgImage.
1210
1211         (BouncingSvgImagesBenchmark): A concrete sub-class of BouncingParticlesBenchmark for animating SVG images.
1212         (BouncingSvgImagesBenchmark.prototype.createStage): Creates a stage of type BouncingSvgImagesStage.
1213         (window.benchmarkClient.create): Creates a benchmark of type BouncingSvgImagesBenchmark.
1214
1215         * Animometer/tests/examples: Added.
1216         * Animometer/tests/examples/canvas-electrons.html: Added.
1217         * Animometer/tests/examples/canvas-stars.html: Added.
1218         Examples test pages.
1219
1220         * Animometer/tests/examples/resources: Added.
1221         * Animometer/tests/examples/resources/canvas-electrons.js: Added.
1222         (CanvasElectron): An object which draws and animate a electron object on a canvas stage.
1223         (CanvasElectron.prototype._draw): Draws the electron object.
1224         (CanvasElectron.prototype.animate): Animates the electron object.
1225
1226         (CanvasElectronsStage): A concrete sub-class of Stage for animating electrons.
1227         (CanvasElectronsStage.prototype.tune): Changes the test by adding or removing elements.
1228         (CanvasElectronsStage.prototype.animate): Animates the test elements.
1229
1230         (CanvasElectronsAnimator): A concrete sub-class of StageAnimator for animating canvas electrons.
1231         (CanvasElectronsAnimator.prototype.animate): Overrides the base class method to clear the canvas before redrawing the stage.
1232
1233         (CanvasElectronsBenchmark): A concrete sub-class of StageBenchmark for animating electrons.
1234         (CanvasElectronsBenchmark.prototype.createStage): Creates a stage of CanvasElectronsStage.
1235         (CanvasElectronsBenchmark.prototype.createAnimator): Creates an animator of type CanvasElectronsAnimator.
1236         (window.benchmarkClient.create): Creates a benchmark of type CanvasElectronsBenchmark.
1237
1238         * Animometer/tests/examples/resources/canvas-stars.js: Added.
1239         (CanvasStar): An object which draws and animate a star object on a canvas stage.
1240         (CanvasStar.prototype._draw): Draws the star object.
1241         (CanvasStar.prototype.animate): Animates the star object.
1242
1243         (CanvasStarsStage): A concrete sub-class of Stage for animating stars.
1244         (CanvasStarsStage.prototype.tune): Changes the test by adding or removing elements.
1245         (CanvasStarsStage.prototype.animate): Animates the test elements.
1246
1247         (CanvasStarsAnimator): A concrete sub-class of StageAnimator for animating canvas stars.
1248         (CanvasStarsAnimator.prototype.animate): Overrides the base class method to clear the canvas before redrawing the stage.
1249
1250         (CanvasStarsBenchmark): A concrete sub-class of Benchmark for animating stars.
1251         (CanvasStarsBenchmark.prototype.createStage): Creates a stage of CanvasStarsStage.
1252         (CanvasStarsBenchmark.prototype.createAnimator): Creates an animator of type CanvasStarsAnimator.
1253         (window.benchmarkClient.create): Creates a benchmark of type CanvasStarsBenchmark.
1254
1255         * Animometer/tests/resources: Added.
1256         This directory includes the script which is required to run an adaptive
1257         graphics benchmark. From an empty test page, the set of classes in this
1258         directory are responsible for measuring the current frame rate and
1259         changing the test to reach a desired FPS. It keeps asking the test page
1260         to tune itself by a certain value to increase or decrease the frame rate.
1261         It's also responsible for sampling the test state and the corresponding
1262         frame rate.
1263
1264         * Animometer/tests/resources/main.js: Added.
1265         (BenchmarkState): Tracks the state of the benchmark test.
1266         (BenchmarkState.prototype._timeOffset): Returns the timeOffset of a stage.
1267         (BenchmarkState.prototype._message): Returns the message of a stage.
1268         (BenchmarkState.prototype.update): Sets the currentTimeOffset to a new value.
1269         (BenchmarkState.prototype.samplingTimeOffset): Returns the timeOffset of the sampling stage.
1270         (BenchmarkState.prototype.currentStage): Returns the current stage of the benchmark.
1271         (BenchmarkState.prototype.currentMessage): Returns the message of the current stage and timeOffset.
1272         (BenchmarkState.prototype.currentProgress): Returns a percentage of how much the benchmark is running.
1273
1274         (Animator): Manages animating the test.
1275         (Animator.prototype.start): Called if animating using setInterval is requested.
1276         (Animator.prototype.timeDelta): Returns the current timeDelta
1277         (Animator.prototype.animate): Manages the test animation.
1278         (Animator.prototype.animateLoop): Called if animating using requestAnimationFrame is requested.
1279
1280         (Benchmark): Manages running the test benchmark and recording the sampled data.
1281         (Benchmark.prototype.start): Starts the benchmark.
1282         (Benchmark.prototype.update): Called from the animator.animate() to change the complexity of the test.
1283         (Benchmark.prototype.record): Shows the current (not final) results of the benchmark.
1284         (Benchmark.prototype.resolveWhenFinished): Spins until the benchmark is finished and returns its results.
1285         (Benchmark.prototype.run): Starts the test, runs it, waits until it is finished and return its results.
1286         (window.runBenchmark): Called from the benchmark runner through the suite controller run-callback.
1287
1288         * Animometer/tests/resources/math.js: Added.
1289         (Matrix): A matrix object.
1290         (Vector3): A vector of size 3 object.
1291         (Matrix3): A matrix of size 3x3 object.
1292
1293         (PIDController): Closed-loop controller for a set-point y.
1294         (PIDController.prototype._sat): Limits the output to a certain range.
1295         (PIDController.prototype.tune): Given the current output of a system, it produces a new pid value for tuning it.
1296
1297         (KalmanEstimator): Implement Kalman filter to get an estimate for a sampled data point.
1298         (KalmanEstimator.prototype.estimate): Returns an estimate for for a sampled data point.
1299
1300         * Animometer/tests/resources/utilities.js: Added.
1301         (window.Utilities._parse): Given a separator character, it pareses a string to a set of <key, value> pairs.
1302         (window.Utilities.parseParameters): Parses a test parameters.
1303         (window.Utilities.parseArguments): Parses a tag arguments.
1304         (window.Utilities.extendObject): Adds the attributes and their values of an object to another object.
1305         (window.Utilities.copyObject): Copies the attributes and their values of an object to a new object.
1306         (window.Utilities.mergeObjects): Copies the attributes and their values of two objects to a new object.
1307         (window.Utilities.createSvgElement): Creates an SVGElement given its name and its attributes.
1308
1309         * Animometer/tests/resources/stage.css: Added.
1310         * Animometer/tests/resources/stage.js: Added.
1311         (Rotater): Manages rotating an angle within a fixed time interval.
1312         (Rotater.prototype.get interval): Returns the time interval which is required to rotate 360 degrees.
1313         (Rotater.prototype.next): Moves the current time by a delta.
1314         (Rotater.prototype.degree): Returns the current rotating degree.
1315         (Rotater.prototype.rotateZ): Returns CSS formatted transform rotateZ() string for the current degree.
1316         (Rotater.prototype.rotate): Returns SVG formatted transform rotate() string for the current degree.
1317
1318         (Stage): A base class for managing the test complexity and test animation.
1319         (Stage.prototype.get size): Returns the size of the stage excluding the CSS padding.
1320         (Stage.prototype.random): Returns a random float.
1321         (Stage.prototype.randomInt): Returns a random integer.
1322         (Stage.prototype.randomPosition): Returns a random position.
1323         (Stage.prototype.randomSquareSize): Returns a square size.
1324         (Stage.prototype.randomVelocity): Returns a random velocity.
1325         (Stage.prototype.randomAngle): Returns a random angle.
1326         (Stage.prototype.randomColor): Returns a random color not too dark and not too light.
1327         (Stage.prototype.randomRotater): Creates a random rotater. Its velocity depends on choosing a random rotation time interval.
1328         (Stage.prototype.tune): A not-implemented version of this function.
1329         (Stage.prototype.animate): A not-implemented version of this function.
1330         (Stage.prototype.clear): Clears the stage from all its animation elements.
1331
1332         (StageAnimator): A base class for the stage-based animators.
1333         (StageAnimator.prototype.animate): Calls Animator.animate() which updates the test page and then calls Stage.animate() to force redraw.
1334
1335         (StageBenchmark): A base class for the stage-based benchmarks.
1336         (StageBenchmark.prototype.createStage): Creates the default stage.
1337         (StageBenchmark.prototype.createAnimator): Creates the default animator.
1338         (StageBenchmark.prototype.tune): Delegates the call to stage.
1339         (StageBenchmark.prototype.clear): Delegates the call to stage.
1340         (StageBenchmark.prototype.showResults): Shows the results/progress through its recordTable and progressBar.
1341
1342         * Animometer/tests/resources/yin-yang.png: Added.
1343         * Animometer/tests/resources/yin-yang.svg: Added.
1344         These images are shared among all the tests.
1345
1346         * Animometer/tests/template: Added.
1347         * Animometer/tests/template/resources: Added.
1348         This directory includes template tests which do nothing. They can be used
1349         to author new tests. Animated items can be created, moved and redrawn by
1350         removing the TODO comments in the script files and writing actual code.
1351
1352         * Animometer/tests/template/template-css.html: Added.
1353         * Animometer/tests/template/template-canvas.html: Added.
1354         * Animometer/tests/template/template-svg.html: Added.
1355         Template test pages. They can be used as they are. CSS attributes or hidden
1356         elements can be added to these derived test pages if needed.
1357
1358         * Animometer/tests/template/resources/template-css.js: Added.
1359
1360         (TemplateCssStage): A stage to create and animate HTMLElements.
1361         (TemplateCssStage.prototype.tune): Changes the test by adding or removing elements.
1362         (TemplateCssStage.prototype.animate): Animates the test elements.
1363         (TemplateCssBenchmark):
1364         (TemplateCssBenchmark.prototype.createStage): Creates the test stage.
1365         (window.benchmarkClient.create): Creates a benchmark of type TemplateCssBenchmark.
1366
1367         * Animometer/tests/template/resources/template-canvas.js: Added.
1368         (TemplateCanvasObject):
1369         (TemplateCanvasObject.prototype._draw): Draws the objects on the canvas context.
1370         (TemplateCanvasObject.prototype.animate): Moves and redraws the object.
1371         (TemplateCanvasStage): A stage to create and animate drawing elements.
1372         (TemplateCanvasStage.prototype.tune): hanges the test by adding or removing elements.
1373         (TemplateCanvasStage.prototype.animate):  Animates the test elements.
1374         (TemplateCanvasAnimator.prototype.animate): Starts the animation every frame.
1375         (TemplateCanvasBenchmark):
1376         (TemplateCanvasBenchmark.prototype.createStage): Creates a stage of type TemplateCanvasStage.
1377         (TemplateCanvasBenchmark.prototype.createAnimator): Creates a animator of type TemplateCanvasAnimator.
1378         (window.benchmarkClient.create): Creates a benchmark of type TemplateCanvasBenchmark.
1379
1380         * Animometer/tests/template/resources/template-svg.js: Added.
1381         (TemplateSvgStage): A stage to create and animate SVGElements.
1382         (TemplateSvgStage.prototype.tune): Changes the test by adding or removing elements.
1383         (TemplateSvgStage.prototype.animate): Animates the test elements.
1384         (TemplateSvgBenchmark.prototype.createStage): Creates a stage of type TemplateSvgStage.
1385         (window.benchmarkClient.create): Creates a benchmark of type TemplateSvgBenchmark.
1386
1387         * Animometer/tests/text: Added.
1388         * Animometer/tests/text/resources: Added.
1389         This directory includes the text animating tests which currently runs
1390         on CSS stage only.
1391
1392         * Animometer/tests/text/layering-text.html: Added.
1393         Text test page.
1394
1395         * Animometer/tests/text/resources/layering-text.js: Added.
1396         (LayeringTextStage): Represents the container of all the stacked text layers.
1397         (LayeringTextStage.parseTextItem): Parses a textItem which may be an opening tag, a closing tag or a self-closing tag.
1398         (LayeringTextStage.isOpeningTextItem): Returns true if the textItem is an opening tag e.g. '<ol>'.
1399         (LayeringTextStage.isClosingTextItem): Returns true if  the textItem is an closing tag e.g. '</ol>.
1400         (LayeringTextStage.textItemsFlags.LayeringTextStage.textItems.map): Calculates and stores isOpening and isClosing flags for each textItem.
1401         (LayeringTextStage.isColorableTextItem): Returns true if the textItem is self-closing tag e.g. '<p>...</p>'.
1402         (LayeringTextStage.isInsertableTextItem): Returns true if the textItems causes a new element to be added to the text layers.
1403         (LayeringTextStage.colorableTextItems.LayeringTextStage.textItemsFlags.filter): Number of colorable textItems.
1404         (LayeringTextStage.insertableTextItems.LayeringTextStage.textItemsFlags.filter): Number of insertable textItems.
1405         (LayeringTextStage.colorIndexToTextElementIndex): Maps from colorIndex [0..colorableTextItems-1] to textElementIndex [0..insertableTextItems-1].
1406         (LayeringTextStage.prototype._nextTextItem): Moves the _textItemIndex one step forward in a loop [0..LayeringTextStage.textItems.length-1].
1407         (LayeringTextStage.prototype._previousTextItem): Moves the _textItemIndex one step backward in a loop.
1408         (LayeringTextStage.prototype._pushTextElement): Creates a new textItemElement and adds it to the topmost container <div>.
1409         (LayeringTextStage.prototype._popTextElement): Removes the last textItemElement from the topmost container <div>.
1410         (LayeringTextStage.prototype._colorTextItem): Changes the background color of a single colorable textElement. The index advances in a circle [0..colorableTextItems-1].
1411         (LayeringTextStage.prototype.animate): Changes the background color and the text color of the textElements such that a redraw is enforced.
1412         (LayeringTextStage.prototype.tune): Adds or removes textElements to the stage.
1413
1414         (LayeringTextBenchmark): Runs the benchmark for the layering text test.
1415         (LayeringTextBenchmark.prototype.createStage): Creates a stage of type LayeringTextStage.
1416         (window.benchmarkClient.create): Creates a benchmark of type LayeringTextBenchmark.
1417
1418 2015-10-02  Said Abou-Hallawa  <sabouhallawa@apple.com>
1419
1420         Add shared code for a new a graphics benchmark
1421         https://bugs.webkit.org/show_bug.cgi?id=149691
1422
1423         Reviewed by Ryosuke Niwa.
1424
1425         This set of classes will be shared and used by the tests and the runner
1426         of a new graphics benchmark.
1427
1428         * Animometer/resources: Added.
1429         * Animometer/resources/algorithm.js: Added.
1430         (Array.prototype.swap): Swaps two elements in an array.
1431         (Heap): Binary Min/Max Heap object
1432         (Heap.prototype._parentIndex): Given the child node index, it returns the parent index.
1433         (Heap.prototype._leftIndex): Given the parent node index, it returns the left node index.
1434         (Heap.prototype._rightIndex): Given the parent node index, it returns the right node index.
1435         (Heap.prototype._childIndex): Given the parent node index, it returns the child index that may violate the heap property.
1436         (Heap.prototype.init): Initializes the heap state.
1437         (Heap.prototype.top): Returns the value stored at the top of the heap.
1438         (Heap.prototype.push): Pushes a new node at the top of the heap.
1439         (Heap.prototype.pop): Extracts the top node of the heap.
1440         (Heap.prototype._bubble): Fixes the heap property by moving upward.
1441         (Heap.prototype._sink): Fixes the heap property by moving downward.
1442         (Heap.prototype.str): Prints the nodes of the heap to a string.
1443         (Heap.prototype.values): Returns the last "size" heap elements values.
1444
1445         (Algorithm.createMinHeap): Creates a size-bounded min-heap object.
1446         (Algorithm.createMaxHeap): Creates a size-bounded max-heap object.
1447
1448         * Animometer/resources/extensions.js: Added.
1449         (Point): Point object but can be used as size also.
1450         (Point.pointOnCircle): Given, the radius of the circle and the angle of the point, it returns a point object.
1451         (Point.pointOnEllipse): Given, the radiuses of the ellipse and the angle of the point, it returns a point object.
1452         (Point.prototype.get width): Should be called when the point is used as size.
1453         (Point.prototype.get height): Should be called when the point is used as size.
1454         (Point.prototype.get center): Should be called when the point is used as size.
1455         (Point.prototype.add): Returns a new point = this + other.
1456         (Point.prototype.subtract): Returns a new point = this - other.
1457         (Point.prototype.multiply): Returns a new point = this * other.
1458         (Point.prototype.move): Moves the point in a given direction, velocity, time period.
1459
1460         (Insets): Represents borders of a container.
1461         (Insets.prototype.get width): Returns left + right.
1462         (Insets.prototype.get height): Returns top + bottom.
1463
1464         (SimplePromise):
1465         (SimplePromise.prototype.then):
1466         (SimplePromise.prototype.resolve):
1467         Moved from Animometer/runner/resources/benchmark-runner.js since tests also need it.
1468
1469         (Options): Benchmark running options as they are set by the user.
1470
1471         (ProgressBar): Manages a progress bar element. The progress bar is divided into equal length ranges.
1472         (ProgressBar.prototype._progressToPercent): Converts the progress into a percentage.
1473         (ProgressBar.prototype.incRange): Moves to the next range (a range is the running time of a single test).
1474         (ProgressBar.prototype.setPos): Draws the current progress in the current range.
1475
1476         (RecordTable): Shows the results of running a benchmark in a tabular form.
1477         (RecordTable.prototype.clear): Clears the results table.
1478         (RecordTable.prototype._showTitles): Shows the header titles and appends the sub-titles to a queue.
1479         (RecordTable.prototype._showHeader): Shows the table header titles.
1480         (RecordTable.prototype._showEmpty): Shows an empty table cell.
1481         (RecordTable.prototype._showValue): Shows a number value in the results table.
1482         (RecordTable.prototype._showSamples): Shows a button for the sampled data graph.
1483         (RecordTable.prototype._showTest): Shows the results of a single test.
1484         (RecordTable.prototype._showSuite): Shows the results of a single suite.
1485         (RecordTable.prototype.showRecord): Shows a single iteration for a single test.
1486         (RecordTable.prototype.showIterations): Shows the results of all the suites of the iterations.
1487
1488         * Animometer/resources/sampler.js: Added.
1489         (Statistics.sampleMean): Returns the sample mean.
1490         (Statistics.unbiasedSampleStandardDeviation): Returns the unbiased sample variance (i.e. with Bessel's correction)
1491         (Statistics.geometricMean): Returns the geometric mean.
1492
1493         (Experiment): Represents a sampling experiment.
1494         (Experiment.prototype._init): Called when the object is created and when startSampling() is called.
1495         (Experiment.prototype.startSampling): Called after warmup period. Restarts collecting sampled data points.
1496         (Experiment.prototype.sample): Add a new data point.
1497         (Experiment.prototype.mean): Returns the sample mean for the current sampled data points.
1498         (Experiment.prototype.standardDeviation): Returns the sample standard deviation for the current sampled data points.
1499         (Experiment.prototype.percentage): Returns the percentage of the standard deviation divided to the mean.
1500         (Experiment.prototype.confidenceIntervalDelta): Calculates the confidence delta for the current sampled data given a confidence level.
1501         (Experiment.prototype.concern): Returns the average of the worst given percentage from the sampled data.
1502         (Experiment.prototype.score): Returns a score for the sampled data. It is the geometric mean of sampleMean and concern.
1503
1504         (Sampler): Represents a compound experiment. It manages sampling multiple data points at the same time offset.
1505         (Sampler.prototype.startSampling): Called after warming up period. Restarts collecting sampled data points.
1506         (Sampler.prototype.sample): Add a new data vector at a given time offset.
1507
1508 2015-10-02  Said Abou-Hallawa  <sabouhallawa@apple.com>
1509
1510         Add the test runner for a new a graphics benchmark
1511         https://bugs.webkit.org/show_bug.cgi?id=149683
1512
1513         Reviewed by Ryosuke Niwa.
1514
1515         The test runner collects the selected test suites and the running options
1516         from its home page. It loops through all the tests, runs them and collects
1517         their running results. At the end, it shows summary results and a final
1518         score. It can also show a chart for a test sampled data.
1519
1520         * Animometer: Added.
1521         * Animometer/runner: Added.
1522         * Animometer/runner/resources: Added.
1523
1524         * Animometer/runner/animometer.html: Added.
1525         * Animometer/runner/resources/animometer.css: Added.
1526         The benchmark runner page and css.
1527
1528         * Animometer/runner/resources/animometer.js: Added.
1529         (window.benchmarkRunnerClient.willAddTestFrame): Called after the test <iframe> is created.
1530         (window.benchmarkRunnerClient.didRunTest): Called after running a test is finished.
1531         (window.benchmarkRunnerClient.willStartFirstIteration): Called at the beginning before running any test.
1532         (window.benchmarkRunnerClient.didRunSuites): Called after running all tests of a suite.
1533         (window.benchmarkRunnerClient.didFinishLastIteration): Called after running the last test.
1534
1535         (showSection): Shows a section in the animometer.html page.
1536         (startTest): Called when the "Start Test" button is clicked.
1537         (showResults): Called after finishing all the tests.
1538         (showGraph): Called when "Click..." button in the "Samples" column of the results table is clicked
1539
1540         * Animometer/runner/resources/benchmark-runner.js: Copied from PerformanceTests/Speedometer/resources/benchmark-runner.js.
1541         (BenchmarkRunnerState): Tracks the current running <suite, test>
1542         (BenchmarkRunnerState.prototype.currentSuite): Returns the current running suite.
1543         (BenchmarkRunnerState.prototype.currentTest): Returns the current running test.
1544         (BenchmarkRunnerState.prototype.isFirstTest): Returns true if we are running the first test in the current suite.
1545         (BenchmarkRunnerState.prototype.next): Advances to the next test.
1546         (BenchmarkRunnerState.prototype.prepareCurrentTest): Creates a new <iframe> and waits for it to load a test.
1547
1548         (BenchmarkRunner): Manages running the tests and communicating with the benchmarkRunnerClient.
1549         (BenchmarkRunner.prototype.waitForElement): Waits for an element to be created.
1550         (BenchmarkRunner.prototype._appendFrame): Creates a new <iframe> element.
1551         (BenchmarkRunner.prototype._removeFrame): Removed the current <iframe> element.
1552         (BenchmarkRunner.prototype._runTestAndRecordResults): Runs the current test and saves its results.
1553         (BenchmarkRunner.prototype.step): Either runs the current test if there is or start a new iteration.
1554         (BenchmarkRunner.prototype.runAllSteps): Loops to run all the tests and move to the next iteration.
1555         (this._runNextIteration): Starts a new iteration or show the results.
1556         (BenchmarkRunner.prototype.runMultipleIterations): Loops to run all the iterations and show the results
1557         (BenchmarkRunner.prototype._finalize): Finalizes the current iteration and starts a new one.
1558
1559         (SimplePromise): Deleted.
1560         (SimplePromise.prototype.then): Deleted.
1561         (SimplePromise.prototype.resolve): Deleted.
1562         (BenchmarkTestStep): Deleted.
1563         (Fibonacci): Deleted.
1564         SimplePromise was moved t Animometer/resources/extensions.js because it is used by the runner and the tests.
1565
1566         (BenchmarkRunner.prototype._waitAndWarmUp): Deleted.
1567         (BenchmarkRunner.prototype._runTest): Deleted.
1568         (BenchmarkState.prototype.currentSuite): Deleted.
1569         (BenchmarkState.prototype.currentTest): Deleted.
1570         (BenchmarkState.prototype.next): Deleted.
1571         (BenchmarkState.prototype.isFirstTest): Deleted.
1572         (BenchmarkState.prototype.prepareCurrentSuite): Deleted.
1573         BenchmarkState was renamed to BenchmarkRunnerState to not be confused with the tests BenchmarkState.
1574
1575         * Animometer/runner/resources/d3.min.js: Copied from Websites/perf.webkit.org/public/v2/js/d3/d3.min.js.
1576         Needed for drawing charts for the sampled scores and frame rates.
1577
1578         * Animometer/runner/resources/graph.js: Added.
1579         (graph): Draws a chart for a test sampled data. It shows two y-axes: one for the animated items and the second for FPS.
1580
1581         * Skipped: Skip the Animometer benchmark for now.
1582
1583 2015-08-27  Csaba Osztrogonác  <ossy@webkit.org>
1584
1585         [EFL] REGRESSION(r188793): It made 200 layout tests and Bindings/event-target-wrapper.html performance test fail
1586         https://bugs.webkit.org/show_bug.cgi?id=148470
1587
1588         Unreviewed gardening, skip the hanging test to make the performance bot work.
1589
1590         * Skipped:
1591
1592 2015-08-17  Chris Dumez  <cdumez@apple.com>
1593
1594         Add performance tests for traversal of collections returned by getElementsByClassName() / getElementsByTagName()
1595         https://bugs.webkit.org/show_bug.cgi?id=148080
1596
1597         Reviewed by Antti Koivisto.
1598
1599         Add performance tests for traversal of *uncached* collections returned
1600         by getElementsByClassName() / getElementsByTagName(). These methods
1601         will soon be updated to return an HTMLCollection instead of a
1602         NodeList and we need to make sure we don't regress performance in the
1603         process.
1604
1605         * DOM/get-elements-by-class-name-traversal-uncached.html: Added.
1606         * DOM/get-elements-by-tag-name-traversal-uncached.html: Added.
1607
1608 2015-08-14  Chris Dumez  <cdumez@apple.com>
1609
1610         Add performance tests for NodeList and HTMLCollection traversal
1611         https://bugs.webkit.org/show_bug.cgi?id=148043
1612
1613         Reviewed by Gavin Barraclough.
1614
1615         Add performance tests for NodeList and HTMLCollection traversal.
1616         Ideally, those 2 tests should be as fast. However, due to inefficiencies
1617         in our HTMLCollection bindings code, the HTMLCollection tests is ~30%
1618         slower. This will be addressed in the near future.
1619
1620         * Bindings/childNodes-traversal.html: Added.
1621         * Bindings/children-traversal.html: Added.
1622
1623 2015-08-05  Myles C. Maxfield  <mmaxfield@apple.com>
1624
1625         Add a second font-fallback performance test
1626         https://bugs.webkit.org/show_bug.cgi?id=147692
1627
1628         Reviewed by Ryosuke Niwa.
1629
1630         This test is smaller, but has more realistic content. Also, it uses the "lang" attribute.
1631
1632         * Layout/font-fallback-2.html: Added.
1633         * Layout/resources/font-fallback-2.html: Added.
1634
1635 2015-07-13  Filip Pizlo  <fpizlo@apple.com>
1636
1637         Update JetStream version number to 1.1.
1638
1639         Rubber stamped by Ryosuke Niwa.
1640
1641         * JetStream/create.rb:
1642
1643 2015-06-30  Filip Pizlo  <fpizlo@apple.com>
1644
1645         Update the JetStream documentation to reflect the recent changes
1646         https://bugs.webkit.org/show_bug.cgi?id=146474
1647
1648         Reviewed by Geoffrey Garen.
1649
1650         * JetStream/create.rb: Bump the version.
1651         * JetStream/in-depth-TEMPLATE.html: Add cdjs documentation. Remove cordic documentation. Change documentation for splay and mandreel.
1652
1653 2015-06-26  Filip Pizlo  <fpizlo@apple.com>
1654
1655         [JetStream] Raise the percentile of mandreel-latency and splay-latency
1656         https://bugs.webkit.org/show_bug.cgi?id=146378
1657
1658         Reviewed by Mark Lam.
1659
1660         The current percentile is 95%.  When I looked at the sample lists in our GC, it was
1661         clear that the worst 5% samples completely amortize our GC pauses.  Our GC pauses can
1662         be quite bad.  Clearly, splay-latency is meant to test whether we have an incremental
1663         GC that ensures that you don't have bad worst-case pauses.  But 95% is too small,
1664         because it doesn't really capture those pauses.  Raising the percentile to above 99%
1665         appears to do the trick.  99.5% or more seems like a good bet.  The trade-off there is
1666         just that if we set it too high, then we won't have enough statistics.  Doing this very
1667         clearly rewards GCs that are incremental, and punishes GCs that aren't (like ours).
1668         That's what we want, since in the future we want to use this test to guide any
1669         improvements to the worst-case performance of our GC.
1670
1671         The way that the percentile is selected will also affect mandreel-latency.  That's a
1672         good thing, because 95% is probably too low for that test as well.  That test ends up
1673         with >10k samples.  The goal of using 95% in the first place was to get enough samples
1674         to have a stable average.  But if we have >10k samples, we can push that percentile up
1675         much higher and still get good statistics while achieving the effect we want - i.e.
1676         getting the worst case.
1677
1678         I don't think that we need to do the same thing for cdjs.  That test only takes 200
1679         samples, so 95% means we report the average of the worst 10 samples.  That's probably
1680         good enough.
1681
1682         * JetStream/Octane2/base.js: Raise the percentile as described above.
1683         (BenchmarkSuite.prototype.RunSingleBenchmark):
1684         * JetStream/Reference.js: Tweak the reference times to bring the latency tests closer to 100ish on my machine.
1685         * JetStream/create.rb: Bump the version.
1686
1687 2015-06-19  Filip Pizlo  <fpizlo@apple.com>
1688
1689         Run CDjs as part of JSC stress testing
1690         https://bugs.webkit.org/show_bug.cgi?id=146174
1691
1692         Reviewed by Geoffrey Garen.
1693
1694         * JetStream/cdjs/cdjs-tests.yaml: Added. This tells JSC stress tests what tests to run. It uses new syntax ("tests" being a list) that I add in this change.
1695         * JetStream/cdjs/main.js: Mark this as a slow test.
1696         * JetStream/create.rb: Don't copy the JSC stress tests artifacts into the JetStream bundle.
1697
1698 2015-06-19  Filip Pizlo  <fpizlo@apple.com>
1699
1700         Unreviewed, fix a small indentation goof.
1701
1702         * JetStream/cdjs/motion.js:
1703         (Motion.prototype.findIntersection):
1704
1705 2015-06-19  Filip Pizlo  <fpizlo@apple.com>
1706
1707         JetStream should include a JavaScript version of the CDx real-time benchmark
1708         https://bugs.webkit.org/show_bug.cgi?id=146156
1709
1710         Reviewed by Geoffrey Garen.
1711
1712         This adds a JavaScript port of the CDx real-time benchmark to JetStream, and retires
1713         the cordic test because it was previously the smallest and probably least interesting.
1714
1715         The new test, "cdjs", is mostly a faithful rewrite of the Java code into JavaScript.
1716         I got the Java code from https://www.cs.purdue.edu/sss/projects/cdx/.
1717
1718         There are some differences:
1719
1720         - It uses RedBlackTree's for all sets and maps rather than hashtables. This is clearly
1721           more in the spirit of real-time than the CDx benchmark. FWIW, CDx used to use trees
1722           and I don't know why that changed in the latest version.
1723
1724         - CDjs doesn't attempt to avoid memory allocations, unlike the real-time Java version.
1725           I wrote the code that I wanted to write for aesthetics, rather than the code that I
1726           would have written if I tried to write the fastest code possible. Again, I believe
1727           that this is in the spirit of CDj - it's meant to test what would happen if you wrote
1728           real-timey stuff in a high level language and actually took advantage of that
1729           language to be more productive.
1730
1731         The test score reflects the average latency of the worst 10 samples out of 200 samples.
1732         The simulation uses 1000 aircraft, flying along paths that result in some detected
1733         collisions every once in a while. The benchmark validates its results by checking the
1734         total number of collisions detected.
1735
1736         Apart from the integration into the JetStream harness, the CDjs directory contains a
1737         fully self-contained benchmark that could be run either in the jsc shell or in browser.
1738
1739         This new code uses the same 3-clause BSD license as the Purdue code, and gives
1740         attribution to Purdue in almost all files. I believe that is appropriate since I wrote
1741         most of the JS files by looking at the Purdue Java code and trascribing to JavaScript.
1742         In some cases, I even copy-pasted the Java code, like the complicated math for
1743         four-dimensional intersections and voxel hashing.
1744
1745         * JetStream/CDjsSetup.js: Added.
1746         * JetStream/Octane2Setup.js:
1747         * JetStream/Reference.js:
1748         * JetStream/cdjs: Added.
1749         * JetStream/cdjs/benchmark.js: Added.
1750         (benchmark):
1751         * JetStream/cdjs/call_sign.js: Added.
1752         (CallSign):
1753         (CallSign.prototype.compareTo):
1754         (CallSign.prototype.toString):
1755         * JetStream/cdjs/collision.js: Added.
1756         (Collision):
1757         (Collision.prototype.toString):
1758         * JetStream/cdjs/collision_detector.js: Added.
1759         (CollisionDetector):
1760         (CollisionDetector.prototype.handleNewFrame.get for):
1761         (CollisionDetector.prototype.handleNewFrame):
1762         * JetStream/cdjs/constants.js: Added.
1763         * JetStream/cdjs/main.html: Added.
1764         * JetStream/cdjs/main.js: Added.
1765         * JetStream/cdjs/motion.js: Added.
1766         (Motion):
1767         (Motion.prototype.toString):
1768         (Motion.prototype.delta):
1769         (Motion.prototype.findIntersection):
1770         * JetStream/cdjs/motion_test.js: Added.
1771         (checkDoesIntersect):
1772         (checkDoesNotIntersect):
1773         (makeMotion):
1774         * JetStream/cdjs/red_black_tree.js: Added.
1775         (RedBlackTree):
1776         (RedBlackTree.):
1777         * JetStream/cdjs/red_black_tree_test.js: Added.
1778         (test):
1779         (test.):
1780         * JetStream/cdjs/reduce_collision_set.js: Added.
1781         (drawMotionOnVoxelMap):
1782         (drawMotionOnVoxelMap.):
1783         (.get reduceCollisionSet):
1784         * JetStream/cdjs/reduce_collision_set_test.js: Added.
1785         (makeMotion):
1786         (keys):
1787         (test):
1788         * JetStream/cdjs/simulator.js: Added.
1789         (Simulator):
1790         (Simulator.prototype.simulate):
1791         * JetStream/cdjs/util.js: Added.
1792         (compareNumbers):
1793         (averageAbovePercentile):
1794         (currentTime):
1795         (else.currentTime):
1796         * JetStream/cdjs/vector_2d.js: Added.
1797         (Vector2D):
1798         (Vector2D.prototype.plus):
1799         (Vector2D.prototype.minus):
1800         (Vector2D.prototype.toString):
1801         (Vector2D.prototype.compareTo):
1802         * JetStream/cdjs/vector_3d.js: Added.
1803         (Vector3D):
1804         (Vector3D.prototype.plus):
1805         (Vector3D.prototype.minus):
1806         (Vector3D.prototype.dot):
1807         (Vector3D.prototype.squaredMagnitude):
1808         (Vector3D.prototype.magnitude):
1809         (Vector3D.prototype.times):
1810         (Vector3D.prototype.as2D):
1811         (Vector3D.prototype.toString):
1812         * JetStream/create.rb:
1813         * JetStream/index-TEMPLATE.html:
1814         * JetStream/sunspider/cordic.js: Removed.
1815
1816 2015-06-17  Javier Fernandez  <jfernandez@igalia.com>
1817
1818         [CSS Grid Layout] We should add performance tests for stretching logic
1819         https://bugs.webkit.org/show_bug.cgi?id=146063
1820
1821         Reviewed by Sergio Villar Senin.
1822
1823         Added a new performance test for Grid Layout to ensure there are no
1824         regressions in the stretching alignment logic.
1825
1826         * Layout/fixed-grid-lots-of-stretched-data.html: Added.
1827
1828 2015-06-17  Javier Fernandez  <jfernandez@igalia.com>
1829
1830         [CSS Grid Layout] Performance tests are using the old syntax
1831         https://bugs.webkit.org/show_bug.cgi?id=146061
1832
1833         Reviewed by Sergio Villar Senin.
1834
1835         Adapted tests to the new grid tracks definition syntax.
1836
1837         * Layout/auto-grid-lots-of-data.html:
1838         * Layout/fixed-grid-lots-of-data.html:
1839
1840 2015-06-08  Filip Pizlo  <fpizlo@apple.com>
1841
1842         JetStream should have a more rational story for jitter-oriented latency tests
1843         https://bugs.webkit.org/show_bug.cgi?id=145762
1844
1845         Reviewed by Geoffrey Garen.
1846
1847         JetStream has some latency tests that are meant to measure jitter.  Prior to this change, they
1848         did this by computing the RMS.  But the RMS is a pretty bad metric.  The thing that it rewards
1849         isn't really the thing that you'd want your browser to do.  These RMS-based tests involve taking
1850         the geomean of the RMS of some samples and the sample average.  The lower the geomean, the better
1851         (in the JetStream harness we then invert the scores so that higher is better, but let's ignore
1852         that for this discussion and assume that lower is better).  Here's an example of how this can go
1853         bad.  A browser that always computes a task in some horribly long time (say, 1000ms) but never
1854         varies that time will perform better than a browser that usually computes the task super quickly
1855         (say, 10ms) and sometimes just a little bit less quickly (say, 15ms).  The former browser will
1856         have an RMS of 0 and an average of 1000.  The latter will have a RMS somewhere around 3.5 and an
1857         average of 12.5 (assuming equal probability of 10ms and 15ms).  The geomean of (0, 1000) is 0.
1858         The geomean of (3.5, 12.5) is 6.6.  Lower is better, so the former browser scores higher - even
1859         though it's obviously never better to have a browser always complete a task in 1000ms when a
1860         different browser can do it in 15ms in the worst case.
1861
1862         JetStream should not have this pathology.  The right way of avoiding it is to replace RMS with
1863         some other metric of how bad things get.  A good metric is the average of the worst percentile.
1864         The worst 1% or the worst 5% would be good things to average.  This will catch cases where the VM
1865         jittered due to JIT or GC, but it never have the pathology that we end up giving the better score
1866         to a VM whose best case is worst than another VM's worst case.
1867
1868         For now, this change uses the highest samples above the 95% percentile. I'm not yet sure if that
1869         is the best thing - it might include too many scores that are around the best-case performance -
1870         but it's certainly better than RMS and it might be good enough to keep. But because of that
1871         uncertainty, I'm setting the version to be "1.1-alpha1" to indicate that we aren't ready to
1872         release this yet.
1873
1874         * JetStream/Octane2/base.js:
1875         (.this.Setup.setup.setup):
1876         (.this.TearDown.tearDown.tearDown):
1877         (BenchmarkSuite.GeometricMeanTime):
1878         (BenchmarkSuite.AverageAbovePercentile):
1879         (BenchmarkSuite.GeometricMeanLatency):
1880         (BenchmarkSuite.prototype.NotifyStep):
1881         (BenchmarkSuite.prototype.RunSingleBenchmark):
1882         * JetStream/Octane2/mandreel.js:
1883         (setupMandreel):
1884         (updateMandreelStats):
1885         (startMandreelTimer):
1886         (latencyMandreel):
1887         (tearDownMandreel):
1888         (RMSMandreel): Deleted.
1889         * JetStream/Octane2/splay.js:
1890         (GenerateKey):
1891         (SplayUpdateStats):
1892         (InsertNewNode):
1893         (SplayTearDown):
1894         (SplayRMS): Deleted.
1895         * JetStream/create.rb:
1896
1897 2015-06-03  Zalan Bujtas  <zalan@apple.com>
1898
1899         Skip Dromaeo/jslib-modify-prototype.html for now.
1900
1901         Unreviewed gardening.
1902
1903         * Skipped:
1904
1905 2015-05-04  Filip Pizlo  <fpizlo@apple.com>
1906
1907         Large array shouldn't be slow
1908         https://bugs.webkit.org/show_bug.cgi?id=144617
1909
1910         Reviewed by Geoffrey Garen.
1911
1912         Add the hash-map benchmark to LongSpider. LongSpider was already not a perfect match of
1913         SunSpider. It's not an official benchmark. It contains benchmarks that are relatively
1914         long-running. So, hash-map sort of belongs here.
1915
1916         * LongSpider/hash-map.js: Added.
1917         (HashMap):
1918         (HashMap.):
1919         (.get var):
1920
1921 2015-05-01  Dewei Zhu  <dewei_zhu@apple.com>
1922
1923         Fix typo bug in Speedometer/resources/main.js
1924         https://bugs.webkit.org/show_bug.cgi?id=144504
1925
1926         Reviewed by Ryosuke Niwa.
1927
1928         * Speedometer/resources/main.js: Fix typo.
1929         (window.benchmarkClient.totalTimeInDisplayUnit):
1930
1931 2015-04-21  Ryosuke Niwa  <rniwa@webkit.org>
1932
1933         Add JetStream to PerformanceTests
1934         https://bugs.webkit.org/show_bug.cgi?id=144024
1935
1936         Rubber-stamped by Filip Pizlo.
1937
1938         * JetStream: Added.
1939         * JetStream/JetStream-Logo.png: Added.
1940         * JetStream/JetStream-Logo@2x.png: Added.
1941         * JetStream/JetStream.css: Added.
1942         * JetStream/JetStreamDriver.js: Added.
1943         * JetStream/LICENSE.txt: Added.
1944         * JetStream/LLVM-test-suite-LICENSE.txt: Added.
1945         * JetStream/Octane: Added.
1946         * JetStream/Octane/base.js: Added.
1947         * JetStream/Octane/code-load.js: Added.
1948         * JetStream/Octane2: Added.
1949         * JetStream/Octane2/base.js: Added.
1950         * JetStream/Octane2/box2d.js: Added.
1951         * JetStream/Octane2/code-load.js: Added.
1952         * JetStream/Octane2/crypto.js: Added.
1953         * JetStream/Octane2/deltablue.js: Added.
1954         * JetStream/Octane2/earley-boyer.js: Added.
1955         * JetStream/Octane2/gbemu-part1.js: Added.
1956         * JetStream/Octane2/gbemu-part2.js: Added.
1957         * JetStream/Octane2/mandreel.js: Added.
1958         * JetStream/Octane2/navier-stokes.js: Added.
1959         * JetStream/Octane2/pdfjs.js: Added.
1960         * JetStream/Octane2/raytrace.js: Added.
1961         * JetStream/Octane2/regexp.js: Added.
1962         * JetStream/Octane2/richards.js: Added.
1963         * JetStream/Octane2/run.js: Added.
1964         * JetStream/Octane2/splay.js: Added.
1965         * JetStream/Octane2/typescript-compiler.js: Added.
1966         * JetStream/Octane2/typescript-input.js: Added.
1967         * JetStream/Octane2/typescript.js: Added.
1968         * JetStream/Octane2/zlib-data.js: Added.
1969         * JetStream/Octane2/zlib.js: Added.
1970         * JetStream/Octane2Setup.js: Added.
1971         * JetStream/OctaneSetup.js: Added.
1972         * JetStream/README: Added.
1973         * JetStream/Reference.js: Added.
1974         * JetStream/SimpleSetup.js: Added.
1975         * JetStream/SunSpiderSetup.js: Added.
1976         * JetStream/Swoosh.png: Added.
1977         * JetStream/Swoosh@2x.png: Added.
1978         * JetStream/TestingSetup.js: Added.
1979         * JetStream/create.rb: Added.
1980         * JetStream/docs: Added.
1981         * JetStream/docs/JetStreamBlogPost.html: Added.
1982         * JetStream/in-depth-TEMPLATE.html: Added.
1983         * JetStream/index-TEMPLATE.html: Added.
1984         * JetStream/simple: Added.
1985         * JetStream/simple/bigfib.cpp: Added.
1986         * JetStream/simple/bigfib.cpp.js: Added.
1987         * JetStream/simple/container.cpp: Added.
1988         * JetStream/simple/container.cpp.js: Added.
1989         * JetStream/simple/dry.c: Added.
1990         * JetStream/simple/dry.c.js: Added.
1991         * JetStream/simple/float-mm.c: Added.
1992         * JetStream/simple/float-mm.c.js: Added.
1993         * JetStream/simple/gcc-loops.cpp: Added.
1994         * JetStream/simple/gcc-loops.cpp.js: Added.
1995         * JetStream/simple/hash-map.js: Added.
1996         * JetStream/simple/n-body.c: Added.
1997         * JetStream/simple/n-body.c.js: Added.
1998         * JetStream/simple/quicksort.c: Added.
1999         * JetStream/simple/quicksort.c.js: Added.
2000         * JetStream/simple/towers.c: Added.
2001         * JetStream/simple/towers.c.js: Added.
2002         * JetStream/sunspider: Added.
2003         * JetStream/sunspider/3d-cube.js: Added.
2004         * JetStream/sunspider/3d-raytrace.js: Added.
2005         * JetStream/sunspider/base64.js: Added.
2006         * JetStream/sunspider/cordic.js: Added.
2007         * JetStream/sunspider/crypto-aes.js: Added.
2008         * JetStream/sunspider/crypto-md5.js: Added.
2009         * JetStream/sunspider/crypto-sha1.js: Added.
2010         * JetStream/sunspider/date-format-tofte.js: Added.
2011         * JetStream/sunspider/date-format-xparb.js: Added.
2012         * JetStream/sunspider/n-body.js: Added.
2013         * JetStream/sunspider/regex-dna.js: Added.
2014         * JetStream/sunspider/tagcloud.js: Added.
2015
2016 2015-04-14  Said Abou-Hallawa  <sabouhallawa@apple.com>
2017
2018         textPath layout performance improvement.
2019         https://bugs.webkit.org/show_bug.cgi?id=141570.
2020
2021         Reviewed by Darin Adler.
2022
2023         Cut down the time spent in traversing the path for text by 50%. Instead
2024         of traversing the path twice at a certain length: one time for the position
2025         and the second time for the angle, we can merge these two passes into one.
2026
2027         * SVG/TextOnPathSimple.html: Added.
2028         * SVG/resources/TextOnPathSimple.svg: Added.
2029
2030 2015-04-13  Zalan Bujtas  <zalan@apple.com>
2031
2032         Clear up the test content when test is done.
2033
2034         Unreviewed fix.
2035
2036         * Layout/simple-line-layout-innertext.html:
2037
2038 2015-04-09  Zalan Bujtas  <zalan@apple.com>
2039
2040         Simple line layout(regression): Calling innerText on RenderFlow with multiple children is slow.
2041         https://bugs.webkit.org/show_bug.cgi?id=143554
2042
2043         Reviewed by Antti Koivisto.
2044
2045         Initialize render flow's segments only when the render flow changes in TextIterator.
2046         The included performance test shows 6x speedup. (from ~10 runs/sec to ~60 runs/sec)
2047
2048         * Layout/simple-line-layout-innertext.html: Added.
2049
2050 2015-03-09  Chris Dumez  <cdumez@apple.com>
2051
2052         [CG] Have Canvas use the IOSurfacePool
2053         https://bugs.webkit.org/show_bug.cgi?id=142417
2054         <rdar://problem/20044440>
2055
2056         Reviewed by Darin Adler.
2057
2058         Lower the number of different canvas sizes from 1000 to 100 so that
2059         the test does not require such a huge cache size. With 100, we now
2060         get over 90% cache hit rate with the default IOSurfacePool size.
2061
2062         * Canvas/reuse.html:
2063
2064 2015-01-28  Said Abou-Hallawa  <sabouhallawa@apple.com>
2065
2066         Poor performance on IE's Chalkboard benchmark.
2067         https://bugs.webkit.org/show_bug.cgi?id=140753.
2068
2069         Reviewed by Zalan Bujtas.
2070
2071         * SVG/UnderTheSeeBenchmark.html: Added
2072         * SVG/WorldcupBenchmark.html: Added.
2073         * SVG/resources/RenderAnimator.css: Added.
2074         * SVG/resources/RenderAnimator.js: Added.
2075         These are benchmarks for the SVG rendering. Mainly we want to measure how fast
2076         the SVG rendering will be when only a small part of it is drawn.
2077
2078 2015-01-21  Geoffrey Garen  <ggaren@apple.com>
2079
2080         bmalloc: support aligned allocation
2081         https://bugs.webkit.org/show_bug.cgi?id=140732
2082
2083         Reviewed by Andreas Kling.
2084
2085         * MallocBench/MallocBench.xcodeproj/project.pbxproj:
2086         * MallocBench/MallocBench/Benchmark.cpp:
2087         * MallocBench/MallocBench/memalign.cpp:
2088         (test):
2089         (benchmark_memalign): Added a test for specific interesting memalign values.
2090
2091         * MallocBench/MallocBench/stress_aligned.cpp: Added.
2092         (benchmark_stress_aligned):
2093         * MallocBench/MallocBench/stress_aligned.h: Added. Added a stress test
2094         for arbitrary memalign values.
2095
2096 2015-01-16  Geoffrey Garen  <ggaren@apple.com>
2097
2098         bmalloc: added the tiniest bit of testing for aligned allocation
2099         https://bugs.webkit.org/show_bug.cgi?id=140573
2100
2101         Reviewed by Andreas Kling.
2102
2103         Just good enoug to catch two bugs in a preliminary implementation.
2104
2105         * MallocBench/MallocBench.xcodeproj/project.pbxproj:
2106         * MallocBench/MallocBench/Benchmark.cpp:
2107         * MallocBench/MallocBench/mbmalloc.cpp:
2108         * MallocBench/MallocBench/mbmalloc.h:
2109         * MallocBench/MallocBench/memalign.cpp: Added.
2110         (benchmark_memalign):
2111         * MallocBench/MallocBench/memalign.h: Added.
2112
2113 2014-12-09  Myles C. Maxfield  <mmaxfield@apple.com>
2114
2115         Add performance test related to font fallback
2116         https://bugs.webkit.org/show_bug.cgi?id=139332
2117
2118         Reviewed by Simon Fraser.
2119
2120         * Layout/font-fallback.html: Added.
2121         * Layout/resources/font-fallback.html: Added.
2122
2123 2014-12-08  Dean Jackson  <dino@apple.com>
2124
2125         [Apple] Use Accelerate framework to speed-up FEGaussianBlur
2126         https://bugs.webkit.org/show_bug.cgi?id=139310
2127
2128         Reviewed by Simon Fraser.
2129
2130         Add an interactive performance test that measures the speed of a set
2131         of blur operations on a generated images.
2132
2133         * Interactive/blur-filter-timing.html: Added.
2134
2135 2014-11-13  Zalan Bujtas  <zalan@apple.com>
2136
2137         Simple line layout: Add performance test case to measure line layout speed of monolithic text content.
2138         https://bugs.webkit.org/show_bug.cgi?id=138699
2139
2140         Reviewed by Antti Koivisto.
2141
2142         * Layout/line-layout-long-long-text.html: Added.
2143
2144 2014-10-22  Zalan Bujtas  <zalan@apple.com>
2145
2146         Speed up line parsing for simple line layout (part I)
2147         https://bugs.webkit.org/show_bug.cgi?id=137275
2148
2149         Reviewed by Antti Koivisto.
2150
2151         Extend simple line layout performance test with a few more cases.
2152         Now we've got:
2153         <div center
2154         <div right
2155         <div justify
2156         <div white-space: pre (new)
2157         <div overflow-wrap: break-word (new)
2158         <pre
2159         <pre white-space: pre-wrap
2160         <pre white-space: pre-line (new)
2161         <pre white-space: nowrap (new)
2162         <pre white-space: pre-wrap overflow-wrap: break-word
2163         <div + embedded <span etc.
2164         <div + br
2165
2166         * Layout/line-layout-simple.html:
2167
2168 2014-10-15  Andrei Bucur  <abucur@adobe.com>
2169
2170         [Multicol] Start adding performance tests for the multi-column implementation
2171         https://bugs.webkit.org/show_bug.cgi?id=137687
2172
2173         Reviewed by Mihnea Ovidenie.
2174
2175         This patch creates a Multicol folder inside the Layout performance tests suite. It adds only two tests
2176         as described below.
2177
2178         The tests are skipped until the implementation stabilizes.
2179
2180         * Layout/Multicol/MulticolManyColumns.html: Added.
2181         This test verifies the performance of the multi-column implementation with two nested multi-column
2182         containers, the first having 20 columns and the second 10 columns.
2183
2184         * Layout/Multicol/MulticolNested.html: Added.
2185         This test verifies the performance of nesting multi-column containers in the presence
2186         of floats.
2187
2188         * Layout/Multicol/resources/multicol-content-many-columns.html: Added.
2189         * Layout/Multicol/resources/multicol-content-nested.html: Added.
2190         * Skipped: Skip the Multicol folder for now.
2191
2192 2014-09-29  Filip Pizlo  <fpizlo@apple.com>
2193
2194         It should be fun and easy to run every possible JavaScript benchmark from the command line
2195         https://bugs.webkit.org/show_bug.cgi?id=137245
2196
2197         Reviewed by Oliver Hunt.
2198
2199         This adds the scaffolding for running Octane version 2 inside run-jsc-benchmarks.
2200         In the future we should just land Octane2 in this directory, and run-jsc-benchmarks
2201         should be changed to point directly at this directory instead of requiring the
2202         Octane path to be configured as part of the configuration file.
2203
2204         * Octane: Added.
2205         * Octane/wrappers: Added.
2206         * Octane/wrappers/jsc-box2d.js: Added.
2207         (jscSetUp):
2208         (jscTearDown):
2209         (jscRun):
2210         * Octane/wrappers/jsc-boyer.js: Added.
2211         (jscSetUp):
2212         (jscTearDown):
2213         (jscRun):
2214         * Octane/wrappers/jsc-closure.js: Added.
2215         (jscSetUp):
2216         (jscTearDown):
2217         (jscRun):
2218         * Octane/wrappers/jsc-decrypt.js: Added.
2219         (jscSetUp):
2220         (jscTearDown):
2221         (jscRun):
2222         * Octane/wrappers/jsc-deltablue.js: Added.
2223         (jscSetUp):
2224         (jscTearDown):
2225         (jscRun):
2226         * Octane/wrappers/jsc-earley.js: Added.
2227         (jscSetUp):
2228         (jscTearDown):
2229         (jscRun):
2230         * Octane/wrappers/jsc-encrypt.js: Added.
2231         (jscSetUp):
2232         (jscTearDown):
2233         (jscRun):
2234         * Octane/wrappers/jsc-gbemu.js: Added.
2235         (jscSetUp):
2236         (jscTearDown):
2237         (jscRun):
2238         * Octane/wrappers/jsc-jquery.js: Added.
2239         (jscSetUp):
2240         (jscTearDown):
2241         (jscRun):
2242         * Octane/wrappers/jsc-mandreel.js: Added.
2243         (jscSetUp):
2244         (jscTearDown):
2245         (jscRun):
2246         * Octane/wrappers/jsc-navier-stokes.js: Added.
2247         (jscSetUp):
2248         (jscTearDown):
2249         (jscRun):
2250         * Octane/wrappers/jsc-pdfjs.js: Added.
2251         (jscSetUp.PdfJS_window.console.log):
2252         (jscSetUp):
2253         (jscTearDown):
2254         (jscRun):
2255         * Octane/wrappers/jsc-raytrace.js: Added.
2256         (jscSetUp):
2257         (jscTearDown):
2258         (jscRun):
2259         * Octane/wrappers/jsc-regexp.js: Added.
2260         (jscSetUp):
2261         (jscTearDown):
2262         (jscRun):
2263         * Octane/wrappers/jsc-richards.js: Added.
2264         (jscSetUp):
2265         (jscTearDown):
2266         (jscRun):
2267         * Octane/wrappers/jsc-splay.js: Added.
2268         (jscSetUp):
2269         (jscTearDown):
2270         (jscRun):
2271         * Octane/wrappers/jsc-typescript.js: Added.
2272         (jscSetUp):
2273         (jscTearDown):
2274         (jscRun):
2275         * Octane/wrappers/jsc-zlib.js: Added.
2276         (jscSetUp):
2277         (jscTearDown):
2278         (jscRun):
2279
2280 2014-09-28  Sungmann Cho  <sungmann.cho@navercorp.com>
2281
2282         Fix some minor typos: psuedo -> pseudo
2283         https://bugs.webkit.org/show_bug.cgi?id=137192
2284
2285         Reviewed by Alexey Proskuryakov.
2286
2287         * Speedometer/resources/todomvc/architecture-examples/emberjs/bower_components/handlebars/handlebars.js:
2288
2289 2014-09-11  Geoffrey Garen  <ggaren@apple.com>
2290
2291         Some MallocBench refinements
2292         https://bugs.webkit.org/show_bug.cgi?id=136750
2293
2294         Reviewed by Sam Weinig.
2295
2296         * MallocBench/MallocBench/Interpreter.cpp:
2297         (Interpreter::run): Allow for null entries in the object list so that
2298         we can test in modes that exclude large or small allocations.
2299
2300         * MallocBench/MallocBench/churn.cpp:
2301         (benchmark_churn):
2302         * MallocBench/MallocBench/flickr.cpp:
2303         (benchmark_flickr):
2304         * MallocBench/MallocBench/fragment.cpp:
2305         (benchmark_fragment_iterate):
2306         * MallocBench/MallocBench/list.cpp:
2307         (benchmark_list_allocate):
2308         * MallocBench/MallocBench/reddit.cpp:
2309         (benchmark_reddit): Updated test runtimes to weight them more equally,
2310         for the sake of arithmetic mean.
2311
2312         * MallocBench/MallocBench/stress.cpp:
2313         (Object::Object):
2314         (allocate):
2315         (deallocate):
2316         (benchmark_stress): Verify the contents of memory as we go. Also,
2317         force scavenging each time through the loop to test the scavenging path.
2318
2319         * MallocBench/MallocBench/theverge.cpp:
2320         (benchmark_theverge):
2321         * MallocBench/MallocBench/tree.cpp:
2322         (benchmark_tree_churn): Re-weighted, as above.
2323
2324 2014-09-08  Myles C. Maxfield  <mmaxfield@apple.com>
2325
2326         PerformanceTests/SVG/SVG-Text.html has unparsable output
2327         https://bugs.webkit.org/show_bug.cgi?id=136648
2328
2329         Reviewed by Gavin Barraclough.
2330
2331         I need to clean up the arbitrary text on the page before telling
2332         the test runner infrastructure that the test is complete.
2333
2334         * SVG/SVG-Text.html:
2335
2336 2014-09-05  Myles C. Maxfield  <mmaxfield@apple.com>
2337
2338         Laying out a TextRun using an SVG font is O(n^2)
2339         https://bugs.webkit.org/show_bug.cgi?id=136584
2340
2341         Reviewed by Andreas Kling.
2342
2343         Time how long it takes to lay out and render some text using an SVG font.
2344
2345         * SVG/SVG-Text.html: Added.
2346         * SVG/resources/graffiti.svg: Added.
2347
2348 2014-09-02  Geoffrey Garen  <ggaren@apple.com>
2349
2350         MallocBench should have a stress test for correctness
2351         https://bugs.webkit.org/show_bug.cgi?id=136468
2352
2353         Reviewed by Andreas Kling.
2354
2355         Added a stress test that allocates randomized sizes of randomized
2356         lifetimes in randomized order.
2357
2358         This version of the test reproduces the EWS crash seen in bmalloc
2359         (<https://bugs.webkit.org/show_bug.cgi?id=132629>).
2360
2361         * MallocBench/MallocBench.xcodeproj/project.pbxproj:
2362         * MallocBench/MallocBench/Benchmark.cpp: Sort!
2363         * MallocBench/MallocBench/stress.cpp: Added.
2364         (Object::Object):
2365         (SizeStream::SizeStream):
2366         (SizeStream::next):
2367         (benchmark_stress): Usually, we random(0). Surprisingly, though, only
2368         random(1) reproduces the bug I was looking for.
2369         * MallocBench/MallocBench/stress.h: Added.
2370
2371 2014-06-02  Ryosuke Niwa  <rniwa@webkit.org>
2372
2373         Rename DoYouEvenBench 0.17 to Speedometer 1.0 and add a new look.
2374         https://bugs.webkit.org/show_bug.cgi?id=133455
2375
2376         Reviewed by Timothy Hatcher.
2377
2378         * Speedometer/: Renamed from DoYouEvenBench.
2379         * Skipped: Updated the path for InteractiveRunner.html
2380
2381 2014-06-02  Ryosuke Niwa  <rniwa@webkit.org>
2382
2383         Rename DoYouEvenBench 0.17 to Speedometer 1.0 and add a new look.
2384         https://bugs.webkit.org/show_bug.cgi?id=133455
2385
2386         Reviewed by Timothy Hatcher.
2387
2388         Renamed the benchmark to Speedometer and added the new look designed by Timothy Hatcher.
2389
2390         Also changed the unit of measurements from milliseconds to runs-per-minute averaged over the number
2391         of the benchmark suites (7 for 1.0). You can divide 420000 by the old benchmark score (in milliseconds)
2392         to get the new value for the set of tests that are enabled by default in 1.0. You can continue to see
2393         results in milliseconds on Full.html#ms.
2394
2395         * DoYouEvenBench/Full.html: Added a bunch of sections and the description of the benchmark.
2396
2397         * DoYouEvenBench/resources/benchmark-report.js: Remove the newly added content when ran inside a DRT or
2398         WTR so that run-perf-tests wouldn't error.
2399         * DoYouEvenBench/resources/benchmark-runner.js:
2400         (BenchmarkRunner.prototype._appendFrame): Call a newly added willAddTestFrame callback when it exists.
2401
2402         * DoYouEvenBench/resources/gauge.png: Added.
2403         * DoYouEvenBench/resources/gauge@2x.png: Added.
2404         * DoYouEvenBench/resources/logo.png: Added.
2405         * DoYouEvenBench/resources/logo@2x.png: Added.
2406         * DoYouEvenBench/resources/main.css: Replaced the style.
2407
2408         * DoYouEvenBench/resources/main.js:
2409         (window.benchmarkClient.willAddTestFrame): Place the iframe right where #testContainer is shown.
2410         (window.benchmarkClient.willRunTest): Show the name of the suite (e.g. EmberJS-TodoMVC) to run next.
2411         (window.benchmarkClient.didRunSuites):
2412         (window.benchmarkClient.willStartFirstIteration): Initialize _timeValues and _finishedTestCount now that
2413         we have an UI to run the benchmark multiple times without reloading the page.
2414         (window.benchmarkClient.didFinishLastIteration): Split into smaller pieces.
2415         (window.benchmarkClient._computeResults): Computes the mean and the statistics for the given time values,
2416         and also format them in a human readable form.
2417         (window.benchmarkClient._computeResults.totalTimeInDisplayUnit): Converts ms to runs/min.
2418         (window.benchmarkClient._computeResults.sigFigFromPercentDelta): Given a percentage error (e.g. 1%),
2419         returns the number of significant digits required for the mean.
2420         (window.benchmarkClient._computeResults.toSigFigPrecision): Calls toPrecision with the specified precision
2421         constrained to be at least the number of non-decimal digits and at most 6.
2422         (window.benchmarkClient._addDetailedResultsRow): Renamed from _addResult. It now takes the table to which
2423         to add a row and the iteration number.
2424         (window.benchmarkClient._updateGaugeNeedle): Added. Controls the angle of the speed indicator.
2425         (window.benchmarkClient._populateDetailedResults): Added.
2426         (window.benchmarkClient.prepareUI): Added. It adds an event listener to show a specified section when
2427         the push state of the document changes, and shows a warning sign when the view port size is too small.
2428         We do this inside a callback to avoid running it inside DRT / WTR.
2429         (startBenchmark):
2430         (showSection): Added.
2431         (startTest): Added.
2432         (showResultsSummary): Added.
2433         (showResultDetails): Added.
2434         (showAbout): Added.
2435
2436 2014-06-01  Ryosuke Niwa  <rniwa@webkit.org>
2437
2438         DYEBench: Move test states into benchmarkClient and remove the closure
2439         https://bugs.webkit.org/show_bug.cgi?id=133438
2440
2441         Reviewed by Benjamin Poulain.
2442
2443         Moved all local variables in the closure wrapping benchmarkClient onto the object itself
2444         and removed the closure to improve the readability of the code.
2445
2446         * DoYouEvenBench/Full.html:
2447         * DoYouEvenBench/resources/main.js:
2448         (window.benchmarkClient.willRunTest):
2449         (window.benchmarkClient.didRunTest):
2450         (window.benchmarkClient.didRunSuites):
2451         (window.benchmarkClient.willStartFirstIteration):
2452         (window.benchmarkClient.didFinishLastIteration):
2453         (window.benchmarkClient._addResult): Moved.
2454         (.): Deleted.
2455
2456 2014-06-01  Ryosuke Niwa  <rniwa@webkit.org>
2457
2458         DYEBench: Split stylesheets and scripts in Full.html into separate files
2459         https://bugs.webkit.org/show_bug.cgi?id=133437
2460
2461         Reviewed by Benjamin Poulain.
2462
2463         Extracted main.js and main.css.
2464
2465         Also fixed a bug in startBenchmark that disabled suites were counted towards the total number of tests.
2466
2467         * DoYouEvenBench/Full.html:
2468         * DoYouEvenBench/resources/main.css: Added.
2469         * DoYouEvenBench/resources/main.js: Added.
2470         (.addResult):
2471         (window.benchmarkClient):
2472         (startBenchmark): Renamed from startTest.
2473
2474 2014-06-01  Ryosuke Niwa  <rniwa@webkit.org>
2475
2476         DYEBench: CSS parser warning at line 106 of base.css
2477         https://bugs.webkit.org/show_bug.cgi?id=133433
2478
2479         Reviewed by Maciej Stachowiak.
2480
2481         Removed the old filter CSS property for Internet Explorer. The latest Internet Explorer supports -ms-linear-gradient
2482         on background CSS property anyways.
2483
2484         It's interesting that some of the tests only have -webkit- prefixes. Perhaps we should update those subtests.
2485
2486         * DoYouEvenBench/Full.html:
2487         * DoYouEvenBench/resources/todomvc/architecture-examples/angularjs/bower_components/todomvc-common/base.css:
2488         (#header:before):
2489         * DoYouEvenBench/resources/todomvc/architecture-examples/backbone/bower_components/todomvc-common/base.css:
2490         (#header:before):
2491         * DoYouEvenBench/resources/todomvc/architecture-examples/emberjs/bower_components/todomvc-common/base.css:
2492         (#header:before):
2493         * DoYouEvenBench/resources/todomvc/architecture-examples/jquery/bower_components/todomvc-common/base.css:
2494         (#header:before):
2495         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/todomvc-common/base.css:
2496         (#header:before):
2497         * DoYouEvenBench/resources/todomvc/labs/architecture-examples/react/bower_components/todomvc-common/base.css:
2498         (#header:before):
2499         * DoYouEvenBench/resources/todomvc/vanilla-examples/vanillajs/bower_components/todomvc-common/base.css:
2500         (#header:before):
2501
2502 2014-05-31  Ryosuke Niwa  <rniwa@webkit.org>
2503
2504         DYEBench: Ember.js assertion hit at line 20593
2505         https://bugs.webkit.org/show_bug.cgi?id=133431
2506
2507         Reviewed by Darin Adler.
2508
2509         The assertion was hit because ToDoMVC includes jQuery 2.1 and Ember.js 1.3.1 only recognizes jQuery 2.0.
2510         Port the assertion from Ember.js 1.5.1 to suppress the assertion.
2511
2512         We should update the entire Ember.js at some point but this would do the job for now.
2513
2514         * DoYouEvenBench/Full.html:
2515         * DoYouEvenBench/resources/todomvc/architecture-examples/emberjs/bower_components/ember/ember.js:
2516
2517 2014-05-31  Ryosuke Niwa  <rniwa@webkit.org>
2518
2519         DYEBench: Prevent frame flattening on iOS
2520         https://bugs.webkit.org/show_bug.cgi?id=133428
2521
2522         Reviewed by Andreas Kling.
2523
2524         Prevent frame flattening on iOS by setting scrolling=no.
2525
2526         * DoYouEvenBench/Full.html:
2527         * DoYouEvenBench/resources/benchmark-runner.js:
2528         (BenchmarkRunner.prototype._appendFrame):
2529
2530 2014-05-30  Ryosuke Niwa  <rniwa@webkit.org>
2531
2532         DYEBench spits out 404 errors for learn.json
2533         https://bugs.webkit.org/show_bug.cgi?id=133416
2534
2535         Reviewed by Oliver Hunt.
2536
2537         Add an empty learn.json file so that it won't cause a 404 error when hosted on a http server.
2538
2539         Bumped the version number to 0.12.
2540
2541         * DoYouEvenBench/Full.html:
2542         * DoYouEvenBench/resources/todomvc/learn.json:
2543
2544 2014-05-23  Geoffrey Garen  <ggaren@apple.com>
2545
2546         Performance testing, diamond-square terrain generation + canvas
2547         https://bugs.webkit.org/show_bug.cgi?id=133054
2548
2549         Reviewed by Ryosuke Niwa.
2550
2551         This test was written by Hunter Loftis. It originally appeared on his
2552         blog @ <http://www.playfuljs.com/realistic-terrain-in-130-lines/>.
2553
2554         I did a bit of editing for format and benchmark suitability.
2555
2556         * Canvas/terrain.html: Added.
2557
2558 2014-05-13  Ryosuke Niwa  <rniwa@webkit.org>
2559
2560         DYEBench should run 20 iterations in browser
2561         https://bugs.webkit.org/show_bug.cgi?id=132795
2562
2563         Reviewed by Gavin Barraclough.
2564
2565         Right now, run-perf-tests runs BYEBench 4 times with different instances of DRT/WTR to get
2566         a more stable time and account for differences in the runtime environment, particularly,
2567         ASLR (Address Space Layout Randomization).
2568
2569         While we can't account for the latter effect when the benchmark is ran inside a browser,
2570         we can at least run 20 iterations to get a more stable (but perhaps biased by ALSR) number.
2571
2572         While the sample size of 20 is statistically unsound to compute the arithmetic mean from,
2573         it's MUCH better than the current sample size of 5.
2574
2575         * DoYouEvenBench/Full.html:
2576         (benchmarkClient.iterationCount): Set the default iteration count to 20.
2577         (startTest): Use benchmarkClient.iterationCount as the iteration count.
2578         * DoYouEvenBench/resources/benchmark-report.js:
2579         (benchmarkClient.iterationCount): Continue to use the old iteration count of 5 when ran
2580         inside run-perf-tests.
2581
2582 2014-05-09  Ryosuke Niwa  <rniwa@webkit.org>
2583
2584         DYEBench should show 95th percentile right next to the mean with ±
2585         https://bugs.webkit.org/show_bug.cgi?id=132729
2586
2587         Reviewed by Darin Adler.
2588
2589         Before this patch, Full.html showed the 95th percentile delta for the arthemtic mean in a separate row
2590         but this was confusing for some people. Show it right next to mean in the same row separated by ±.
2591
2592         * DoYouEvenBench/Full.html:
2593
2594 2014-05-08  Ryosuke Niwa  <rniwa@webkit.org>
2595
2596         DYEBench should use TodoMVC to test FlightJS for consistency
2597         https://bugs.webkit.org/show_bug.cgi?id=132727
2598
2599         Reviewed by Andreas Kling.
2600
2601         Add a test suite for the FlightJS version of TodoMVC, and disable FlightJS-MailClient by default.
2602
2603         I initially intended to include a wider variety of demo apps in DYEBench
2604         but that's not happening any time soon so let us use TodoMVC for all frameworks for now.
2605
2606         We can add more demo apps in v2.
2607
2608         * DoYouEvenBench/Full.html: Increment the version to 0.10.
2609         * DoYouEvenBench/InteractiveRunner.html: Don't check disabled suites by default.
2610         * DoYouEvenBench/resources/tests.js:
2611         * DoYouEvenBench/resources/todomvc/dependency-examples: Added.
2612         * DoYouEvenBench/resources/todomvc/dependency-examples/flight: Added.
2613         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/.gitignore: Added.
2614         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/.jshintrc: Added.
2615         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app: Added.
2616         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/js: Added.
2617         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/js/app.js: Added.
2618         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/js/data: Added.
2619         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/js/data/stats.js: Added.
2620         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/js/data/todos.js: Added.
2621         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/js/main.js: Added.
2622         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/js/store.js: Added.
2623         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/js/ui: Added.
2624         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/js/ui/main_selector.js: Added.
2625         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/js/ui/new_item.js: Added.
2626         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/js/ui/stats.js: Added.
2627         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/js/ui/todo_list.js: Added.
2628         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/js/ui/toggle_all.js: Added.
2629         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/js/ui/with_filters.js: Added.
2630         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/js/utils.js: Added.
2631         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/templates: Added.
2632         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/templates/stats.html: Added.
2633         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/app/templates/todo.html: Added.
2634         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower.json: Added.
2635         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components: Added.
2636         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/depot: Added.
2637         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/depot/depot.js: Added.
2638         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/es5-shim: Added.
2639         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/es5-shim/es5-sham.js: Added.
2640         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/es5-shim/es5-shim.js: Added.
2641         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/flight: Added.
2642         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/flight/lib: Added.
2643         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/flight/lib/advice.js: Added.
2644         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/flight/lib/base.js: Added.
2645         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/flight/lib/component.js: Added.
2646         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/flight/lib/compose.js: Added.
2647         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/flight/lib/debug.js: Added.
2648         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/flight/lib/index.js: Added.
2649         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/flight/lib/logger.js: Added.
2650         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/flight/lib/registry.js: Added.
2651         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/flight/lib/utils.js: Added.
2652         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/jquery: Added.
2653         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/jquery/jquery.js: Added.
2654         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/requirejs: Added.
2655         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/requirejs-text: Added.
2656         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/requirejs-text/text.js: Added.
2657         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/requirejs/require.js: Added.
2658         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/todomvc-common: Added.
2659         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/todomvc-common/base.css: Added.
2660         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/todomvc-common/base.js: Added.
2661         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/bower_components/todomvc-common/bg.png: Added.
2662         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/index.html: Added.
2663         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/karma.conf.js: Added.
2664         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/package.json: Added.
2665         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/readme.md: Added.
2666         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/test: Added.
2667         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/test/.jshintrc: Added.
2668         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/test/fixture: Added.
2669         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/test/fixture/footer.html: Added.
2670         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/test/fixture/new_todo.html: Added.
2671         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/test/fixture/toggle_all.html: Added.
2672         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/test/mock: Added.
2673         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/test/mock/datastore.js: Added.
2674         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/test/spec: Added.
2675         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/test/spec/data: Added.
2676         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/test/spec/data/stats_spec.js: Added.
2677         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/test/spec/data/todos_spec.js: Added.
2678         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/test/spec/ui: Added.
2679         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/test/spec/ui/new_item_spec.js: Added.
2680         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/test/spec/ui/stats_spec.js: Added.
2681         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/test/spec/ui/toggle_all_spec.js: Added.
2682         * DoYouEvenBench/resources/todomvc/dependency-examples/flight/test/test-main.js: Added.
2683
2684 2014-05-07  Manuel Rego Casasnovas  <rego@igalia.com>
2685
2686         [CSS Grid Layout] Remove runtime feature
2687         https://bugs.webkit.org/show_bug.cgi?id=132382
2688
2689         Reviewed by Benjamin Poulain.
2690
2691         Remove set of WebKitCSSGridLayoutEnabled preference.
2692
2693         * Layout/auto-grid-lots-of-data.html:
2694         * Layout/fixed-grid-lots-of-data.html:
2695
2696 2014-05-06  Radu Stavila  <stavila@adobe.com>
2697
2698         [CSSRegions] Enabled regions performance tests by default
2699         https://bugs.webkit.org/show_bug.cgi?id=128244
2700
2701         Reviewed by Andreas Kling.
2702
2703         Enabled regions performance tests.
2704
2705         * Skipped:
2706
2707 2014-04-25  Andreas Kling  <akling@apple.com>
2708
2709         Bump jQuery to same version that dromaeo.com uses.
2710
2711         Rubber-stamped by Ryosuke Niwa.
2712
2713         * Dromaeo/resources/dromaeo/web/lib/jquery-1.10.2.min.js: Added.
2714         * Dromaeo/resources/dromaeo/web/tests/cssquery-jquery.html:
2715         * Dromaeo/resources/dromaeo/web/tests/jslib-attr-jquery.html:
2716         * Dromaeo/resources/dromaeo/web/tests/jslib-event-jquery.html:
2717         * Dromaeo/resources/dromaeo/web/tests/jslib-modify-jquery.html:
2718         * Dromaeo/resources/dromaeo/web/tests/jslib-style-jquery.html:
2719         * Dromaeo/resources/dromaeo/web/tests/jslib-traverse-jquery.html:
2720
2721 2014-04-18  Geoffrey Garen  <ggaren@apple.com>
2722
2723         Added some more Membuster recordings to MallocBench
2724         https://bugs.webkit.org/show_bug.cgi?id=131862
2725
2726         Reviewed by Sam Weinig.
2727
2728         * MallocBench/MallocBench/Benchmark.cpp:
2729         (Benchmark::Benchmark):
2730         (Benchmark::run):
2731         * MallocBench/MallocBench/Benchmark.h:
2732         * MallocBench/MallocBench/CommandLine.cpp:
2733         * MallocBench/MallocBench/CommandLine.h:
2734         (CommandLine::runs): Added a --runs option, so we can specify zero runs
2735         for memory warning benchmarks. Those benchmarks want zero runs so that
2736         they can perform a single warmup, which does not free all allocated
2737         objects, and then see how far back to 0MB they can get. Running multiple
2738         times would accumulate leaks, which is not representative of the
2739         simulated scenario.
2740
2741         * MallocBench/MallocBench/Interpreter.cpp:
2742         (Interpreter::Interpreter):
2743         (Interpreter::run):
2744         * MallocBench/MallocBench/Interpreter.h: Support not deallocating all
2745         objects allocated during the recording, so we can do low memory warning
2746         memory use measurements, as above.
2747
2748         * MallocBench/MallocBench/flickr.cpp:
2749         (benchmark_flickr_memory_warning):
2750         * MallocBench/MallocBench/main.cpp:
2751         (main):
2752         * MallocBench/MallocBench/reddit.cpp:
2753         (benchmark_reddit_memory_warning):
2754         * MallocBench/MallocBench/theverge.cpp:
2755         (benchmark_theverge_memory_warning): Adopt the API above.
2756
2757         * MallocBench/run-malloc-benchmarks: I took a first pass at listing all
2758         available benchmarks here. Then I commented out the benchmarks that
2759         probably aren't reasonable to run by default.
2760
2761 2014-04-18  Geoffrey Garen  <ggaren@apple.com>
2762
2763         MallocBench: removed the --measure-heap option
2764         https://bugs.webkit.org/show_bug.cgi?id=131854
2765
2766         Reviewed by Sam Weinig.
2767
2768         As of <https://bugs.webkit.org/show_bug.cgi?id=131661>, measuring the
2769         heap is fast, so there's no reason to disable it.
2770
2771         * MallocBench/MallocBench/Benchmark.cpp:
2772         (Benchmark::Benchmark):
2773         (Benchmark::run):
2774         (Benchmark::printReport):
2775         * MallocBench/MallocBench/Benchmark.h:
2776         * MallocBench/MallocBench/CommandLine.cpp:
2777         (CommandLine::printUsage):
2778         * MallocBench/MallocBench/CommandLine.h:
2779         (CommandLine::heapSize):
2780         (CommandLine::measureHeap): Deleted.
2781         * MallocBench/MallocBench/main.cpp:
2782         (main):
2783
2784 2014-04-16  Alexandru Chiculita  <achicu@adobe.com>
2785
2786         Improve performance of the RenderLayerCompositor::OverlapMap
2787         https://bugs.webkit.org/show_bug.cgi?id=115063
2788
2789         Reviewed by Simon Fraser.
2790
2791         Testing the performance of computing the overlap of 5000 layers.
2792
2793         * Layout/layers_overlap_2d.html: Added. Using non-composited layers, to check
2794         that the performance on the non-composited path is not changing with this patch.
2795         * Layout/layers_overlap_3d.html: Added. Records the time to do the layout of 5000
2796         non-overlapping 3D layers.
2797
2798 2014-04-15  Zoltan Horvath  <zoltan@webkit.org>
2799
2800         [CSS Shapes] Linking stylesheet instead of inline style definition has ruined ShapesRegions test
2801         https://bugs.webkit.org/show_bug.cgi?id=131572
2802
2803         Reviewed by Rob Buis.
2804
2805         In r167022 I moved the common CSS selectors into RegionsShapes.css, then I linked it into the perf test
2806         files, but the measurement results dropped down from about 400ms to 10ms. I realized it's caused by the
2807         linked css rule, so I've put the selectors back into every test case, which fixes the test measurements.
2808
2809         * Layout/Shapes/resources/RegionsShapes.css: Removed.
2810         * Layout/Shapes/resources/RegionsShapesContent.html:
2811         * Layout/Shapes/resources/RegionsShapesContentNoRegionsWidth400.html:
2812         * Layout/Shapes/resources/RegionsShapesContentNoRegionsWidth600.html:
2813         * Layout/Shapes/resources/RegionsShapesContentNoRegionsWidth800.html:
2814         * Layout/Shapes/resources/RegionsShapesContentNoShapes.html:
2815
2816 2014-04-14  Geoffrey Garen  <ggaren@apple.com>
2817
2818         MallocBench should scavenge explicitly instead of waiting
2819         https://bugs.webkit.org/show_bug.cgi?id=131661
2820
2821         Reviewed by Andreas Kling.
2822
2823         * MallocBench/MallocBench.xcodeproj/project.pbxproj: Don't build mbmalloc
2824         by default because it will overwrite any other mbmalloc you're working
2825         with in the WebKitBuild directory.
2826
2827         * MallocBench/MallocBench/Benchmark.cpp:
2828         (Benchmark::run): Scavenge explicitly instead of waiting. This is faster,
2829         and it's the only way to get FastMalloc to scavenge. (That's a bug in
2830         FastMalloc, but we don't want it to interfere with broader testing.)
2831
2832         * MallocBench/MallocBench/mbmalloc.cpp:
2833         * MallocBench/MallocBench/mbmalloc.h: Added a scavenge implementation
2834         for system malloc.
2835
2836 2014-04-14  Geoffrey Garen  <ggaren@apple.com>
2837
2838         A few MallocBench record/replay fixes
2839         https://bugs.webkit.org/show_bug.cgi?id=131627
2840
2841         Reviewed by Andreas Kling.
2842
2843         * MallocBench/MallocBench/Interpreter.cpp:
2844         (Interpreter::run): Accept 0-sized allocations without asserting because
2845         WebKit does that sometimes.
2846
2847         * MallocBench/MallocBench/flickr.ops:
2848         * MallocBench/MallocBench/flickr_memory_warning.ops:
2849         * MallocBench/MallocBench/reddit.ops:
2850         * MallocBench/MallocBench/reddit_memory_warning.ops:
2851         * MallocBench/MallocBench/theverge.ops:
2852         * MallocBench/MallocBench/theverge_memory_warning.ops: Updated these
2853         recordings because a bug in the recording mechanism caused one out of
2854         every few thousand slot values to be bogus.
2855
2856 2014-04-13  Geoffrey Garen  <ggaren@apple.com>
2857
2858         Added some website recordings to MallocBench -- taken from Membuster
2859         https://bugs.webkit.org/show_bug.cgi?id=131601
2860
2861         Reviewed by Ryosuke Niwa.
2862
2863         Added flickr, reddit, and theverge -- each recorded from Membuster's
2864         cache, with and without sending Safari a low memory warning.
2865
2866         * MallocBench/MallocBench.xcodeproj/project.pbxproj:
2867         * MallocBench/MallocBench/Benchmark.cpp:
2868         * MallocBench/MallocBench/flickr.cpp: Added.
2869         (benchmark_flickr):
2870         (benchmark_flickr_memory_warning):
2871         * MallocBench/MallocBench/flickr.h: Added.
2872         * MallocBench/MallocBench/flickr.ops: Added.
2873         * MallocBench/MallocBench/flickr_memory_warning.ops: Added.
2874         * MallocBench/MallocBench/reddit.cpp: Added.
2875         (benchmark_reddit):
2876         (benchmark_reddit_memory_warning):
2877         * MallocBench/MallocBench/reddit.h: Added.
2878         * MallocBench/MallocBench/reddit.ops: Added.
2879         * MallocBench/MallocBench/reddit_memory_warning.ops: Added.
2880         * MallocBench/MallocBench/theverge.cpp: Added.
2881         (benchmark_theverge):
2882         (benchmark_theverge_memory_warning):
2883         * MallocBench/MallocBench/theverge.h: Added.
2884         * MallocBench/MallocBench/theverge.ops: Added.
2885         * MallocBench/MallocBench/theverge_memory_warning.ops: Added.
2886
2887 2014-04-13  Geoffrey Garen  <ggaren@apple.com>
2888
2889         MallocBench record/replay should support realloc
2890         https://bugs.webkit.org/show_bug.cgi?id=131598
2891
2892         Reviewed by Ryosuke Niwa.
2893
2894         * MallocBench/MallocBench.xcodeproj/project.pbxproj: Fixed some linkage
2895         issues that caused us not to fully link to system malloc in the default
2896         case. Also marked mbmalloc.dylib as required so the error message will
2897         be clearer if we mess up.
2898
2899         * MallocBench/MallocBench/Interpreter.cpp:
2900         (Interpreter::run):
2901         * MallocBench/MallocBench/Interpreter.h: Added the realloc case, and
2902         upgraded one-letter names to full words.
2903
2904 2014-04-11  Dirk Schulze  <krit@webkit.org>
2905
2906         Optimize Canvas fill and drawImage with SourceIn, DestinationIn, SourceOut, and DestinationAtop using transparencyLayer.
2907         https://bugs.webkit.org/show_bug.cgi?id=79659
2908
2909         Reviewed by Andreas Kling.
2910
2911         Add performance tests for real this time.
2912
2913         * Canvas/compositing-drawimage.html: Added.
2914         * Canvas/compositing-fillRect.html: Added.
2915
2916
2917 2014-04-11  Dirk Schulze  <krit@webkit.org>
2918
2919         Optimize Canvas fill and drawImage with SourceIn, DestinationIn, SourceOut, and DestinationAtop using transparencyLayer.
2920         https://bugs.webkit.org/show_bug.cgi?id=79659
2921
2922         Reviewed by Andreas Kling.
2923
2924         Add performance tests for fillRect() and drawImage() on composited contexts.
2925
2926         * Canvas/compositing-drawimage.html: Added.
2927         * Canvas/compositing-fillRect.html: Added.
2928
2929 2014-04-09  Zoltan Horvath  <zoltan@webkit.org>
2930
2931         [CSS Shapes] Add no shapes version of RegionsShapes performance test
2932         https://bugs.webkit.org/show_bug.cgi?id=131455
2933
2934         Reviewed by Ryosuke Niwa.
2935
2936         This is a no shapes version of the RegionsShapes performance test. All the content
2937         will wrap around the floating containers. This way we can compare the runtime/memory
2938         usage of the RegionsShapes test with/without shapes. The test is skipped by default.
2939
2940         * Layout/Shapes/RegionsShapesNoShapes.html: Added.
2941         * Layout/Shapes/resources/RegionsShapesContentNoShapes.html: Added.
2942
2943 2014-04-09  Zoltan Horvath  <zoltan@webkit.org>
2944
2945         [CSS Shapes] Add no regions version of RegionsShapes performance test
2946         https://bugs.webkit.org/show_bug.cgi?id=131442
2947
2948         Reviewed by Ryosuke Niwa.
2949
2950         We would like have a no regions version for RegionsShapes performance test. The new
2951         test produces similar layout to RegionsShapes.html without using regions. It is helpful
2952         for us to do further comparisons when necessary. This test is skipped by default.
2953
2954         * Layout/Shapes/RegionsShapesNoRegions.html: Added.
2955         * Layout/Shapes/resources/RegionsShapes.css: Added.
2956         (html, body):
2957         (.shape):
2958         (#circleShape):
2959         (#imageShape):
2960         (#insetShape):
2961         (#roundedInsetShape):
2962         (#triangleLeft):
2963         (#triangleRight):
2964         (#selfIntersectingStar):
2965         (#region1):
2966         (#region2):
2967         (#region3):
2968         * Layout/Shapes/resources/RegionsShapesContent.html:
2969         * Layout/Shapes/resources/RegionsShapesContentNoRegionsWidth400.html: Added.
2970         * Layout/Shapes/resources/RegionsShapesContentNoRegionsWidth600.html: Added.
2971         * Layout/Shapes/resources/RegionsShapesContentNoRegionsWidth800.html: Added.
2972
2973 2014-04-02  Geoffrey Garen  <ggaren@apple.com>
2974
2975         Unreviewed.
2976
2977         Try to ignore some Xcode shmutz in MallocBench.
2978
2979         * MallocBench/MallocBench.xcodeproj: Added property svn:ignore.
2980
2981 2014-04-02  Geoffrey Garen  <ggaren@apple.com>
2982
2983         Let's benchmark malloc
2984         https://bugs.webkit.org/show_bug.cgi?id=131118
2985
2986         Reviewed by Mark Hahnenberg.
2987
2988         I want to replace fastMalloc with something faster (fasterMalloc?).
2989         I wrote these benchmarks to test / drive development.
2990
2991         * MallocBench: Added.
2992         * MallocBench/MallocBench: Added.
2993         * MallocBench/MallocBench.xcodeproj: Added.
2994         * MallocBench/MallocBench.xcodeproj/project.pbxproj: Added.
2995         * MallocBench/MallocBench/Benchmark.cpp: Added.
2996         (allocateHeap):
2997         (deallocateHeap):
2998         (Benchmark::Benchmark):
2999         (Benchmark::printBenchmarks):
3000         (Benchmark::runOnce):
3001         (Benchmark::run):
3002         (Benchmark::printReport):
3003         (Benchmark::currentTimeMS):
3004         (Benchmark::currentMemoryBytes):
3005         * MallocBench/MallocBench/Benchmark.h: Added.
3006         (Benchmark::Memory::Memory):
3007         (Benchmark::Memory::operator-):
3008         (Benchmark::isValid):
3009         * MallocBench/MallocBench/CPUCount.cpp: Added.
3010         (cpuCount):
3011         * MallocBench/MallocBench/CPUCount.h: Added.
3012         * MallocBench/MallocBench/CommandLine.cpp: Added.
3013         (CommandLine::printUsage):
3014         * MallocBench/MallocBench/CommandLine.h: Added.
3015         (CommandLine::isValid):
3016         (CommandLine::benchmarkName):
3017         (CommandLine::isParallel):
3018         (CommandLine::heapSize):
3019         (CommandLine::measureHeap):
3020         * MallocBench/MallocBench/Interpreter.cpp: Added.
3021         (Interpreter::Interpreter):
3022         (Interpreter::~Interpreter):
3023         (Interpreter::run):
3024         * MallocBench/MallocBench/Interpreter.h: Added.
3025         * MallocBench/MallocBench/balloon.cpp: Added.
3026         (benchmark_balloon):
3027         * MallocBench/MallocBench/balloon.h: Added.
3028         * MallocBench/MallocBench/big.cpp: Added.
3029         (benchmark_big):
3030         * MallocBench/MallocBench/big.h: Added.
3031         * MallocBench/MallocBench/churn.cpp: Added.
3032         (HeapDouble::operator new):
3033         (HeapDouble::operator delete):
3034         (HeapDouble::HeapDouble):
3035         (HeapDouble::operator+=):
3036         (benchmark_churn):
3037         * MallocBench/MallocBench/churn.h: Added.
3038         * MallocBench/MallocBench/crash.ops: Added.
3039         * MallocBench/MallocBench/facebook.cpp: Added.
3040         (benchmark_facebook):
3041         * MallocBench/MallocBench/facebook.h: Added.
3042         * MallocBench/MallocBench/facebook.ops: Added.
3043         * MallocBench/MallocBench/fragment.cpp: Added.
3044         (validate):
3045         (benchmark_fragment):
3046         (benchmark_fragment_iterate):
3047         * MallocBench/MallocBench/fragment.h: Added.
3048         * MallocBench/MallocBench/list.cpp: Added.
3049         (benchmark_list_allocate):
3050         (benchmark_list_traverse):
3051         * MallocBench/MallocBench/list.h: Added.
3052         * MallocBench/MallocBench/main.cpp: Added.
3053         (main):
3054         * MallocBench/MallocBench/mbmalloc.cpp: Added.
3055         * MallocBench/MallocBench/mbmalloc.h: Added.
3056         * MallocBench/MallocBench/medium.cpp: Added.
3057         (benchmark_medium):
3058         * MallocBench/MallocBench/medium.h: Added.
3059         * MallocBench/MallocBench/message.cpp: Added.
3060         (benchmark_message_one):
3061         (benchmark_message_many):
3062         * MallocBench/MallocBench/message.h: Added.
3063         * MallocBench/MallocBench/realloc.cpp: Added.
3064         (benchmark_realloc):
3065         * MallocBench/MallocBench/realloc.h: Added.
3066         * MallocBench/MallocBench/tree.cpp: Added.
3067         (benchmark_tree_allocate):
3068         (benchmark_tree_traverse):
3069         (benchmark_tree_churn):
3070         * MallocBench/MallocBench/tree.h: Added.
3071         * MallocBench/run-malloc-benchmarks: Added.
3072
3073 2014-03-29  Mark Lam  <mark.lam@apple.com>
3074
3075         LongSpider 3d-morph result check is inappropriate.
3076         <https://webkit.org/b/130928>
3077
3078         Reviewed by Filip Pizlo.
3079
3080         The LongSpider 3d-morph component expected result check is incorrect.
3081         The existing test checks if the leading digit of a sum starts with "-1".
3082         However, it turned out that the expected sum is in the order of
3083         -1.8735013540549517e-16 (i.e. very close to 0).  With small errors in
3084         the terms of the sum adding up, it is very easy for the resultant sum
3085         to fluctuate.  There is no guarantee that the resultant sum's most
3086         significant digit will start with -1 either.
3087
3088         The fix is to do a tolerance check on all the terms of the sum as well
3089         as the total sum value instead.  The tolerance should be more lenient
3090         for the sum which accumulates error from the individual terms, then for
3091         individual terms.
3092
3093         * LongSpider/3d-morph.js:
3094         (expect):
3095
3096 2014-03-28  Zoltan Horvath  <zoltan@webkit.org>
3097
3098         [CSS Shapes] Add performance tests for Shapes with Regions
3099         https://bugs.webkit.org/show_bug.cgi?id=129624
3100
3101         Reviewed by Ryosuke Niwa.
3102
3103         This tests introduces a real-life like page, which contains different types of shapes within
3104         shape-outsides. The content flows through regions, which use media queries. The performance test
3105         loads the actual Shapes-Regions test case into iframes with different page sizes (thus the layout
3106         triggers the media queries as well), and measures its load time.
3107
3108         * Layout/RegionsShapes.html: Added.
3109         * Layout/Shapes/resources/RegionsShapesContent.html: Added.
3110
3111 2014-03-20  Zoltan Horvath  <zoltan@webkit.org>
3112
3113         Add option for hiding Confidence Interval Delta on the performance tests results page
3114         https://bugs.webkit.org/show_bug.cgi?id=130483
3115
3116         Reviewed by Ryosuke Niwa.
3117
3118         I've found it useful to hide the confidence interval delta from the results table
3119         sometimes, for example on copying data, or for a clearer look. This patch introduces
3120         a new button for it on the local results page.
3121
3122         * resources/results-template.html:
3123
3124 2014-03-20  Laszlo Vidacs  <lvidacs.u-szeged@partner.samsung.com>
3125
3126         Optimize RenderTable::colToEffCol() for tables without colspans
3127         https://bugs.webkit.org/show_bug.cgi?id=129298
3128
3129         Reviewed by Simon Fraser.
3130
3131         Create an alternative fast path to RenderTable colToEffCol() and effColToCol()
3132         when there is no colspan or colspan does not exceed the width of table.
3133         Blink merge https://codereview.chromium.org/154243002 by rhogan
3134
3135         * Layout/large-table-with-collapsed-borders-and-colspans-wider-than-table.html: Added.
3136         * Layout/large-table-with-collapsed-borders-and-colspans.html: Added.
3137         * Layout/large-table-with-collapsed-borders-and-no-colspans.html: Added.
3138         * Layout/resources/large-table-with-collapsed-borders.css: Added.
3139         * Layout/resources/large-table-with-collapsed-borders.js: Added.
3140
3141 2014-03-14  Maciej Stachowiak  <mjs@apple.com>
3142
3143         Replace "Apple Computer, Inc." with "Apple Inc." in copyright headers
3144         https://bugs.webkit.org/show_bug.cgi?id=130276
3145         <rdar://problem/16266927>
3146
3147         Reviewed by Simon Fraser.
3148
3149         * Dromaeo/resources/dromaeo/web/tests/sunspider-3d-raytrace.html:
3150         * Dromaeo/resources/dromaeo/web/tests/sunspider-bitops-bitwise-and.html:
3151         * Dromaeo/resources/dromaeo/web/tests/sunspider-math-cordic.html:
3152         * Dromaeo/resources/dromaeo/web/tests/sunspider-string-tagcloud.html:
3153         * LongSpider/3d-morph.js:
3154         * LongSpider/3d-raytrace.js:
3155         * LongSpider/math-cordic.js:
3156         * LongSpider/string-tagcloud.js:
3157         * Parser/resources/html5-8266.html:
3158         * Parser/resources/html5.html:
3159
3160 2014-03-10  Zoltan Horvath  <zoltan@webkit.org>
3161
3162         [CSS Shapes] Add performance tests for SVG shape with shape-margin
3163         https://bugs.webkit.org/show_bug.cgi?id=129930
3164
3165         Reviewed by Ryosuke Niwa.
3166
3167         The test is skipped by default.
3168
3169         * Layout/Shapes/ShapeOutsideSVGWithMargin.html: Added.
3170         * Layout/Shapes/resources/shape.svg: Added.
3171
3172 2014-02-19  Zoltan Horvath  <zoltan@webkit.org>
3173
3174         [CSS Shapes] Add performance test for stacked floats with shape-outsides
3175         https://bugs.webkit.org/show_bug.cgi?id=128821
3176
3177         Reviewed by Brent Fulgham.
3178
3179         This tests generate stacked floats content with shape-outsides.
3180         The test is skipped by default.
3181
3182         * Layout/Shapes/ShapeOutsideStackedPolygons.html: Added.
3183
3184 2014-02-15  Zoltan Horvath  <zoltan@webkit.org>
3185
3186         [CSS Shapes] Add performance test for raster shape with shape-margin
3187         https://bugs.webkit.org/show_bug.cgi?id=128770
3188
3189         Reviewed by Ryosuke Niwa.
3190
3191         This patch introduces a new performance test for image valued shapes,
3192         where shape-margin is applied on the shape.
3193         The test is skipped by default.
3194
3195         * Layout/Shapes/ShapeOutsideRasterWithMargin.html: Added.
3196
3197 2014-02-14  Ryosuke Niwa  <rniwa@webkit.org>
3198
3199         Improve the appearance of DYEBench
3200         https://bugs.webkit.org/show_bug.cgi?id=128866
3201
3202         Reviewed by Antti Koivisto.
3203
3204         Add a div that shows progress during the test. Also show 95th percentile,
3205         and use a table instead of pre to show results.
3206
3207         * DoYouEvenBench/Full.html:
3208         (.addResult): Added. Shows results in a table.
3209         (benchmarkClient.willRunTest): Added to show the progress bar.
3210         (benchmarkClient.didRunTest):
3211         (benchmarkClient.didRunSuites):
3212         (benchmarkClient.didFinishLastIteration): Compute 95th percentile using Statistics.js
3213
3214         * DoYouEvenBench/resources/benchmark-runner.js:
3215         (BenchmarkRunner.prototype._appendFrame): Fix the bug where marginLeft and marginTop
3216         weren't correctly parsed. We were treating top as left and bottom as top somehow.
3217         (BenchmarkRunner.prototype._runTestAndRecordResults): Fixed a typo.
3218
3219 2014-02-13  Zoltan Horvath  <zoltan@webkit.org>
3220
3221         [CSS Shapes] Add performance test for complex polygon with shape-margin
3222         https://bugs.webkit.org/show_bug.cgi?id=128769
3223
3224         Reviewed by Ryosuke Niwa.
3225
3226         This patch modifies the logic of createShapeOutsideTest to accept multiple
3227         CSS properties from the test. The patch adds performance test for complex
3228         polygon shape (self intersecting at multiple places) case, moreover we
3229         apply shape-margin on the polygon also.
3230
3231         * Layout/Shapes/ShapeOutsideContentBox.html:
3232         * Layout/Shapes/ShapeOutsideInset.html:
3233         * Layout/Shapes/ShapeOutsidePolygonWithMargin.html: Added.
3234         * Layout/Shapes/ShapeOutsideRaster.html:
3235         * Layout/Shapes/ShapeOutsideSimplePolygon.html:
3236         * Layout/Shapes/resources/shapes.js:
3237
3238 2014-02-13  Zoltan Horvath  <zoltan@webkit.org>
3239
3240         [CSS Shapes] Add performance test for raster shape
3241         https://bugs.webkit.org/show_bug.cgi?id=128746
3242
3243         Reviewed by Ryosuke Niwa.
3244
3245         This patch adds performance testing for image valued shape-outside.
3246         The test is skipped by default for now.
3247
3248         * Layout/Shapes/ShapeOutsideRaster.html: Added.
3249         * Layout/Shapes/resources/shape.gif: Added.
3250
3251 2014-02-10  Zoltan Horvath  <zoltan@webkit.org>
3252
3253         [CSS Shapes] Add initial performance tests for polygon shape
3254         https://bugs.webkit.org/show_bug.cgi?id=128554
3255
3256         Reviewed by Ryosuke Niwa.
3257
3258         This patch adds performance testing for simple polygon shape-outside.
3259         The Shapes performance tests directory is skipped by default.
3260
3261         * Layout/Shapes/ShapeOutsideSimplePolygon.html: Added.
3262
3263 2014-02-07  Zoltan Horvath  <zoltan@webkit.org>
3264
3265         [CSS Shapes] Add initial performance tests for inset shape
3266         https://bugs.webkit.org/show_bug.cgi?id=128378
3267
3268         Reviewed by Ryosuke Niwa.
3269
3270         * Layout/Shapes/ShapeOutsideContentBox.html: Move js to shapes.js.
3271         * Layout/Shapes/ShapeOutsideInset.html: Added.
3272         * Layout/Shapes/resources/shapes.js: Added.
3273         (.):
3274
3275 2014-02-04  Ryosuke Niwa  <rniwa@webkit.org>
3276
3277         Undelete the "build" directory erroneously removed in r163427.
3278
3279         * DoYouEvenBench/resources/todomvc/labs/architecture-examples/react/bower_components/director/build:
3280
3281 2014-02-04  Ryosuke Niwa  <rniwa@webkit.org>