PerformanceTests/SunSpider/ChangeLog

   1 2012-08-02  Filip Pizlo  <fpizlo@apple.com>
   2
   3         Unreviewed, revert debugging stuff I landed in http://trac.webkit.org/changeset/124557
   4         by accident.
   5
   6         * tests/v8-v6/v8-crypto.js:
   7         (am1):
   8         (am2):
   9         (am3):
  10         (am4):
  11         (bnpCopyTo):
  12         (bnpFromString):
  13         (bnpClamp):
  14
  15 2012-03-11  Maciej Stachowiak  <mjs@apple.com>
  16
  17         Add --instruments option to sunspider to profile with Instruments
  18         https://bugs.webkit.org/show_bug.cgi?id=80783
  19
  20         Reviewed by Filip Pizlo.
  21
  22         * resources/TimeProfile20us.tracetemplate: Added.
  23         * sunspider:
  24         (runTestsOnce):
  25
  26 2011-11-15  Andy Wingo  <wingo@igalia.com>
  27
  28         Extend sunspider driver to be able to run kraken
  29         https://bugs.webkit.org/show_bug.cgi?id=71799
  30
  31         Reviewed by Filip Pizlo.
  32
  33         * resources/sunspider-standalone-driver.js: Try to load a -data
  34         file.  If that succeeds, we have a kraken-like test, so we time
  35         the test using `load'.  Otherwise fall back to using `run'.
  36
  37 2011-08-11  Mark Rowe  <mrowe@apple.com>
  38
  39         Fix sunspider-compare-results to default to the same suite version as the sunspider script.
  40
  41         Rubber-stamped by Maciej Stachowiak.
  42
  43         * sunspider-compare-results:
  44
  45 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
  46
  47         Update SunSpider versioning to 1.0
  48         https://bugs.webkit.org/show_bug.cgi?id=63870
  49
  50         Reviewed by Dan Bernstein.
  51
  52         * hosted/sunspider.html:
  53         * hosted/versions.html:
  54         * resources/driver-TEMPLATE.html:
  55         * resources/results-TEMPLATE.html:
  56         * sunspider:
  57
  58 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
  59
  60         Sunspider 0.9.1 harness doesn't actually close() its test documents
  61         https://bugs.webkit.org/show_bug.cgi?id=47045
  62
  63         Reviewed by Daniel Bates.
  64
  65         * hosted/versions.html:
  66         * resources/driver-TEMPLATE.html:
  67
  68 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
  69
  70         Not Reviewed.
  71
  72         Fix obviou typo in previous commit.
  73
  74         * tests/sunspider-1.0/bitops-bitwise-and.js:
  75
  76 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
  77
  78         Reviewed by Anders Carlsson.
  79
  80         SunSpider: all four bitops benchmarks can be replaced with NOP
  81         https://bugs.webkit.org/show_bug.cgi?id=38446
  82
  83         * tests/sunspider-1.0/bitops-3bit-bits-in-byte.js:
  84         (TimeFunc): Save the result.
  85         * tests/sunspider-1.0/bitops-bits-in-byte.js:
  86         (TimeFunc): Save the result.
  87         * tests/sunspider-1.0/bitops-bitwise-and.js: More explicitly
  88         save the results.
  89         * tests/sunspider-1.0/bitops-nsieve-bits.js:
  90         (sieve): Save the result.
  91
  92 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
  93
  94         SunSpider: string-validate-input.js uses an undeclared variable named 'name', which is a DOM API
  95         https://bugs.webkit.org/show_bug.cgi?id=60937
  96
  97         Reviewed by Dan Bernstein.
  98
  99         * tests/sunspider-1.0/string-validate-input.js:
 100         (doTest): Rename the variable to username
 101
 102 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
 103
 104         Reviewed by Darin Adler.
 105
 106         SunSpider: The main function of math-cordic is dead code
 107         https://bugs.webkit.org/show_bug.cgi?id=63863
 108
 109         Try to prevent math-cordic from being eliminated as dead code or
 110         compiled down to a constant.
 111
 112         * tests/sunspider-1.0/math-cordic.js:
 113         (cordicsincos):
 114         (cordic):
 115
 116 2011-06-30  Maciej Stachowiak  <mjs@apple.com>
 117
 118         Reviewed by Adam Barth.
 119
 120         Create sunspider-1.0 directory in preparation for fixing a bunch of bugs
 121         https://bugs.webkit.org/show_bug.cgi?id=63782
 122
 123         * make-hosted: Learn about the new directory.
 124         * tests/sunspider-1.0: Copied from PerformanceTests/SunSpider/tests/sunspider-0.9.1.
 125
 126 2010-11-29  Geoffrey Garen  <ggaren@apple.com>
 127
 128         Reviewed by Gavin Barraclough.
 129
 130         Improved accuracy of command-line SunSpider.
 131
 132         * resources/sunspider-standalone-driver.js: Use the returned number of
 133         elapsed milliseconds from "run" and "checkSyntax" instead of measuring
 134         ourselves, for slightly more accurate numbers.
 135
 136 2010-09-16  Gavin Barraclough  <barraclough@apple.com>
 137
 138         Reviewed by Mark Rowe.
 139         https://bugs.webkit.org/show_bug.cgi?id=45924
 140
 141         Modify the SunSpider harness to allow a path to be passed to the --suite
 142         argument, supress the normal prepend-"tests/" behaviour for suite names
 143         containing a '/'.
 144
 145         Also wrap the code in an anonymous function to move variables out of global
 146         scope (currently the harness cannot handle running tests the overwrite the
 147         variable 'j').
 148
 149         * resources/sunspider-standalone-driver.js:
 150         * sunspider:
 151
 152 2010-08-27  Michael Saboff  <msaboff@apple.com>
 153
 154         Reviewed by Stephanie Lewis.
 155
 156         Added version 5 and version 6 of V8 tests with modifications similar
 157         to the version 4 tests so they'll work with the SunSpider test harness.
 158         Note that these files are external source and therefore don't conform
 159         to WebKit coding standards.
 160         https://bugs.webkit.org/show_bug.cgi?id=44638
 161
 162         * tests/v8-v5: Added.
 163         * tests/v8-v5/LIST: Added.
 164         * tests/v8-v5/v8-crypto.js: Added.
 165         * tests/v8-v5/v8-deltablue.js: Added.
 166         * tests/v8-v5/v8-earley-boyer.js: Added.
 167         * tests/v8-v5/v8-raytrace.js: Added.
 168         * tests/v8-v5/v8-regexp.js: Added.
 169         * tests/v8-v5/v8-richards.js: Added.
 170         * tests/v8-v5/v8-splay.js: Added.
 171         * tests/v8-v6: Added.
 172         * tests/v8-v6/LIST: Added.
 173         * tests/v8-v6/v8-crypto.js: Added.
 174         * tests/v8-v6/v8-deltablue.js: Added.
 175         * tests/v8-v6/v8-earley-boyer.js: Added.
 176         * tests/v8-v6/v8-raytrace.js: Added.
 177         * tests/v8-v6/v8-regexp.js: Added.
 178         * tests/v8-v6/v8-richards.js: Added.
 179         * tests/v8-v6/v8-splay.js: Added.
 180
 181 2010-07-15  Stephanie Lewis  <slewis@apple.com>
 182
 183         Reviewed by Geoff Garen.
 184
 185         http://bugs.webkit.org/show_bug.cgi?id=42406
 186         Output location of results file.
 187
 188         * sunspider:
 189
 190 2010-05-17  Maciej Stachowiak  <mjs@apple.com>
 191
 192         Reviewed by Mark Rowe.
 193
 194         Browser-hosted version of SunSpider runs tests twice as many times as advertised
 195         https://bugs.webkit.org/show_bug.cgi?id=39201
 196
 197         * make-hosted: Make sure to reset test list after every test suite.
 198
 199 2010-05-07  Adam Roben  <aroben@apple.com>
 200
 201         Fix typo in sunspider-compare-results.js that caused incorrect
 202         two-sample t statistics to be computed
 203
 204         Fixes <http://webkit.org/b/38768> SunSpider computes incorrect
 205         two-sample t statistics
 206
 207         Reviewed by Darin Adler.
 208
 209         * resources/sunspider-compare-results.js:
 210         (sunspiderCompareResults.resultLine): Fixed the calculation of the t
 211         variable to match the definition of a two-sample t statistic. Looks
 212         like this was just a simple typo.
 213
 214 2010-04-05  Darin Adler  <darin@apple.com>
 215
 216         Updated the ignore property for changes to the contents here.
 217
 218         * .: Modified property svn:ignore.
 219
 220 2010-02-20  Maciej Stachowiak  <mjs@apple.com>
 221
 222         Reviewed by Adam Barth.
 223
 224         Add sunspider-0.9.1 to the site in preparation for announcing it.
 225         https://bugs.webkit.org/show_bug.cgi?id=35206
 226
 227         * hosted/sunspider.css: Remove tabs, which I noticed where present while
 228         copying to the WebKitSite directory.
 229
 230 2010-01-11  Oliver Hunt  <oliver@apple.com>
 231
 232         Reviewed by Darin Adler.
 233
 234         Sunspider parse-only tests don't run
 235         https://bugs.webkit.org/show_bug.cgi?id=33489
 236
 237         Fix parse-only test list
 238
 239         * tests/parse-only/LIST:
 240
 241 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
 242
 243         Reviewed by Adele Peterson.
 244
 245         Make SunSpider version more prominent in the title
 246         https://bugs.webkit.org/show_bug.cgi?id=32574
 247
 248         * hosted/sunspider.html:
 249         * hosted/versions.html:
 250         * resources/driver-TEMPLATE.html:
 251         * resources/results-TEMPLATE.html:
 252
 253 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
 254
 255         Reviewed by Darin Adler.
 256
 257         Make SunSpider refuse to compare results across content versions
 258         https://bugs.webkit.org/show_bug.cgi?id=32573
 259
 260         The results URL now includes a version indicator, and compare mode
 261         will refuse to compare between versions.
 262
 263         * resources/driver-TEMPLATE.html:
 264         * resources/results-TEMPLATE.html:
 265
 266 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
 267
 268         Reviewed by Darin Adler.
 269
 270         Some Browser-hosted SunSpider files are not valid HTML5
 271         https://bugs.webkit.org/show_bug.cgi?id=32536
 272
 273         Made various fixes to validate as HTML5 with no warnings (mainly removing bogus
 274         close tags and adding a meta charset declaration).
 275
 276         * hosted/sunspider.html:
 277         * hosted/versions.html:
 278         * resources/TEMPLATE.html:
 279         * resources/driver-TEMPLATE.html:
 280         * resources/results-TEMPLATE.html:
 281
 282 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
 283
 284         Reviewed by Eric Seidel.
 285
 286         Make sunspider-0.9.1 the default content set (both command-line and hosted)
 287         https://bugs.webkit.org/show_bug.cgi?id=32537
 288
 289         * hosted/sunspider.html: Change default suite link.
 290         * sunspider: Change default suite.
 291         * sunspider-compare-results: Likewise.
 292
 293 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
 294
 295         Reviewed by Sam Weinig.
 296
 297         in-browser SunSpider suffers excessive penalty under power management
 298         https://bugs.webkit.org/show_bug.cgi?id=32505
 299
 300         I have made a few changes to address this:
 301
 302         1) Change how browser-hosted SunSpider loads tests - preload the content and write it in with
 303         document.write to reduce triggering of progress UI.
 304         2) Reduce time between tests to 10ms from 500ms, so that power management doesn't keep the CPU
 305         stepped all the way down the whole time.
 306         3) Run the test cycle an extra time for warmup before the runs that count.
 307
 308         * hosted/sunspider-record-result.js: Removed.
 309         * make-hosted:
 310         * resources/TEMPLATE.html:
 311         * resources/driver-TEMPLATE.html:
 312
 313 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
 314
 315         Reviewed by Gavin Barraclough.
 316
 317         SunSpider/tests/string-base64.js does not compute a valid base64 encoded string
 318         https://bugs.webkit.org/show_bug.cgi?id=16806
 319
 320         Based on a patch by Eric Seidel.
 321
 322         Fix the base64 computation to actually compute correct results. The impact on runtime of
 323         the test is pretty small, but noticeable for some browsers. But at least it's not
 324         doing a wrong and meaningless computation any more.
 325
 326         * tests/sunspider-0.9.1/string-base64.js:
 327         ():
 328         (base64ToString):
 329
 330 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
 331
 332         Fixing commit error...
 333
 334         I accidentally committed my last patch in a form that broke Web-hosted SunSpider. Fixing.
 335
 336         * resources/driver-TEMPLATE.html:
 337
 338 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
 339
 340         Reviewed by Sam Weinig.
 341
 342         Use JSON.parse instead of eval for Web-hosted SunSpider results processing
 343         https://bugs.webkit.org/show_bug.cgi?id=32490
 344
 345         * hosted/json2.js: Added. Incorporated from json.org
 346         * resources/driver-TEMPLATE.html: Fix an HTML validation bug I noticed.
 347         * resources/results-TEMPLATE.html: Use JSON.parse instead of eval to process
 348         results.
 349
 350 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
 351
 352         Reviewed by Oliver Hunt.
 353
 354         Enable Web-hosted version of SunSpider to handle multiple versions
 355         https://bugs.webkit.org/show_bug.cgi?id=32478
 356
 357         * make-hosted: Now generate the hosted version to be able to run both the
 358         0.9 and the 0.9.1 test suites.
 359         * hosted: Modified property svn:ignore.
 360         * hosted/sunspider-driver.html: Removed.
 361         * hosted/sunspider-results.html: Removed.
 362         * hosted/sunspider.html:
 363         * hosted/versions.html: Added.
 364         * resources/TEMPLATE.html:
 365         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-driver.html.
 366         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-results.html.
 367
 368 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
 369
 370         Reviewed by Oliver Hunt.
 371
 372         Give command-line sunspider the ability to handle multiple suites and versions
 373         https://bugs.webkit.org/show_bug.cgi?id=32477
 374
 375         Each suite/version's set of tests are now in a separate subdirectory of tests/, with a file named LIST
 376         enumerating the tests. Current suites are:
 377
 378         sunspider-0.9 - riginal SunSpider content
 379         sunspider-0.9.1 - SunSpider suite with a few tests fixed (and a few more to come)
 380         ubench - "ubench" microbenchmark suite
 381         v8-v4 - version 4 of the v8 benchmark
 382         parse-only - some parser tests
 383
 384         Sunspider can now be run with the --suite= parameter to select a
 385         suite. The default is --suite=sunspider-0.9.
 386
 387         * .: Modified property svn:ignore to ignore new results directories.
 388         * make-hosted: Generate based on sunspider-0.9 suite.
 389         * resources/TEMPLATE.html: Fix an HTML compliance problem.
 390         * resources/sunspider-standalone-driver.js: Become aware of suite names.
 391         * sunspider: Modified to handle multiple suites as described above.
 392         * sunspider-compare-results: ditto
 393         * tests/LIST: Moved to tests/sunspider-0.9/ and tests/sunspider-0.9.1/
 394         * tests/LIST-PARSE-ONLY: Moved to parse-only/LIST
 395         * tests/LIST-UBENCH: Removed.
 396         * tests/LIST-V8: Removed.
 397         * tests/3d-cube.js: Moved to tests/sunspider-0.9 and tests/sunspider-0.9.1
 398         * tests/3d-morph.js: ditto
 399         * tests/3d-raytrace.js: ditto
 400         * tests/access-binary-trees.js: ditto
 401         * tests/access-fannkuch.js: ditto
 402         * tests/access-nbody.js: ditto
 403         * tests/access-nsieve.js: ditto
 404         * tests/bitops-3bit-bits-in-byte.js: ditto
 405         * tests/bitops-bits-in-byte.js: ditto
 406         * tests/bitops-bitwise-and.js: ditto
 407         * tests/bitops-nsieve-bits.js: ditto
 408         * tests/controlflow-recursive.js: ditto
 409         * tests/crypto-aes.js: ditto
 410         * tests/crypto-md5.js: ditto
 411         * tests/crypto-sha1.js: ditto
 412         * tests/date-format-tofte.js: ditto
 413         * tests/date-format-xparb.js: ditto
 414         * tests/math-cordic.js: ditto
 415         * tests/math-partial-sums.js: ditto
 416         * tests/math-spectral-norm.js: ditto
 417         * tests/regexp-dna.js: ditto
 418         * tests/string-base64.js: ditto
 419         * tests/string-fasta.js: ditto
 420         * tests/string-tagcloud.js: ditto
 421         * tests/string-unpack-code.js: ditto
 422         * tests/string-validate-input.js: ditto
 423         * tests/sunspider-0.9/: Added
 424         * tests/sunspider-0.9/*.js: Moved from one level up
 425         * tests/sunspider-0.9.1: Added.
 426         * tests/sunspider-0.9.1/*.js: Moved from one level up.
 427         * tests/v8-crypto.js: Moved to v8-v4/ directory.
 428         * tests/v8-deltablue.js: ditto
 429         * tests/v8-earley-boyer.js: ditto
 430         * tests/v8-raytrace.js: ditto
 431         * tests/v8-regexp.js: ditto
 432         * tests/v8-richards.js: ditto
 433         * tests/v8-splay.js: ditto
 434         * tests/v8-v4: Added.
 435
 436 2009-09-30  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
 437
 438         Reviewed by Darin Adler.
 439
 440         Platform specific null device replaced with a platform independent.
 441         https://bugs.webkit.org/show_bug.cgi?id=29544
 442
 443         * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL.
 444
 445 2009-09-21  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
 446
 447         Reviewed by Maciej Stachowiak.
 448
 449         [Qt] Make sunspider script work on Windows platform.
 450         https://bugs.webkit.org/show_bug.cgi?id=29544
 451
 452         * sunspider:
 453         Using platform specific null device instead of /dev/null.
 454
 455 2009-06-19  Adam Treat  <adam.treat@torchmobile.com>
 456
 457         Reviewed by Oliver Hunt.
 458
 459         https://bugs.webkit.org/show_bug.cgi?id=26540
 460         Currently the SunSpider test driver lacks an option to run a test suite that
 461         will test JavaScriptCore parsing performance only.  This patch adds just such
 462         a test suite and option to SunSpider as well as the jsc test shell.  I've included
 463         three large javascript source files found in the wild: jquery, mootools and prototype.
 464         Combined with the concatenation of all three, these form a new testsuite to measure
 465         and test pure JavaScriptCore parsing performance.
 466
 467         * resources/sunspider-standalone-driver.js:
 468           Load the js with parse-only flag if it is part of the parse-only suite.
 469         * sunspider:
 470           Add the parse-only suite to the list of options.
 471         * sunspider-compare-results:
 472           Add the parse-only suite to the list of options.
 473         * tests/LIST-PARSE-ONLY: Added.
 474         * tests/parse-only/concat-jquery-mootools-prototype.js: Added.
 475           A very large concatenation of the scripts found below.  This js takes ~30ms to parse on my machine.
 476         * tests/parse-only/jquery-1.3.2.js: Added.
 477           Latest version from jquery.com.
 478         * tests/parse-only/mootools-1.2.2-core-nc.js: Added.
 479           Latest version from mootools.net.
 480         * tests/parse-only/prototype-1.6.0.3.js: Added.
 481           Latest version from prototypejs.org.
 482
 483 2009-06-13  Steve Falkenburg  <sfalken@apple.com>
 484
 485         Update V8 benchmark to version 4.
 486
 487         Reviewed by Cameron Zwarich.
 488
 489         * tests/LIST-V8:
 490         * tests/v8-crypto.js:
 491         * tests/v8-deltablue.js:
 492         * tests/v8-earley-boyer.js:
 493         * tests/v8-raytrace.js:
 494         * tests/v8-regexp.js: Added.
 495         * tests/v8-richards.js:
 496         * tests/v8-splay.js: Added.
 497
 498 2009-05-26  Olivier DOLE  <odole@pleyo.com>
 499
 500         Reviewed by Maciej.
 501
 502         Store sunspider test suite results in a specific directory for each
 503         different type of benchmark (sunspider, V8 or ubench).
 504
 505         * sunspider:
 506         * sunspider-compare-results:
 507
 508 2009-05-12  Steve Falkenburg  <sfalken@apple.com>
 509
 510         Build fix.
 511
 512         * SunSpider.make:
 513
 514 2009-05-11  Steve Falkenburg  <sfalken@apple.com>
 515
 516         Include SunSpider tests in production builds.
 517
 518         Reviewed by Adam Roben.
 519
 520         * SunSpider.make: Added.
 521         * xcopy.excludes: Added.
 522
 523 2009-03-04  Oliver Hunt  <oliver@apple.com>
 524
 525         Added a few more tests to ubench
 526
 527         RS=Gavin Barraclough
 528
 529         Adding a couple of test to cover too few and too many arguments.  This
 530         is needed to prevent regressions in all call paths from my current refactoring.
 531
 532         * tests/LIST-UBENCH:
 533         * tests/ubench/function-correct-args.js: Added.
 534         (f):
 535         * tests/ubench/function-excess-args.js: Added.
 536         (f):
 537
 538 2008-10-30  Zoltan Horvath  <Horvath.Zoltan.6@stud.u-szeged.hu>
 539
 540         Fix a bug where when V8's or UBENCH's test suite list file is missing
 541         the error message is suggesting that SunSpider's list file is missing.
 542
 543         Reviewed by Sam Weinig.
 544
 545         * sunspider:
 546         (loadTestsList): Fix the error message to use the right list name.
 547
 548 2008-10-07  David Hyatt  <hyatt@apple.com>
 549
 550         https://bugs.webkit.org/show_bug.cgi?id=18989
 551
 552         Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
 553         we want all browsers to be doing the same thing on the test.
 554
 555         Reviewed by Maciej
 556
 557         * tests/regexp-dna.js:
 558
 559 2008-09-09  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 560
 561         Rubber-stamped by Maciej Stachowiak.
 562
 563         The bleeding edge branch of V8 now supports passing fileanmes after
 564         '-f', so the SunSpider script should be changed to do this again.
 565         This allows all 3 major JavaScript engines to be used with the
 566         unmodified SunSpider script.
 567
 568         * sunspider:
 569
 570 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 571
 572         Reviewed by Maciej Stachowiak.
 573
 574         Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
 575         and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
 576         correct the punctuation in its documentation.
 577
 578         * sunspider:
 579
 580 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 581
 582         Reviewed by Oliver Hunt.
 583
 584         Bug 20616: Incorporate V8 benchmarks in testing
 585         <https://bugs.webkit.org/show_bug.cgi?id=20616>
 586
 587         This is a first attempt at running the V8 benchmarks within SunSpider,
 588         with the --v8 option. The number of iterations is fixed for each
 589         benchmark, and was chosen to make each of the benchmarks run between
 590         500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
 591
 592         * sunspider:
 593         * tests/LIST-V8: Added.
 594         * tests/v8-crypto.js: Added.
 595         * tests/v8-deltablue.js: Added.
 596         * tests/v8-earley-boyer.js: Added.
 597         * tests/v8-raytrace.js: Added.
 598         * tests/v8-richards.js: Added.
 599
 600 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 601
 602         Not reviewed.
 603
 604         Remove a local change that was accidentally committed in r36034.
 605
 606         * resources/sunspider-standalone-driver.js:
 607
 608 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 609
 610         Rubber-stamped by Oliver Hunt.
 611
 612         Make SunSpider work with JavaScript shells that don't take filenames
 613         after a '-f' argument.
 614
 615         * sunspider:
 616
 617 2008-06-07  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 618
 619         Reviewed by Timothy.
 620
 621         Remove the --squirrelfish option from SunSpider, as it is no longer needed.
 622
 623         * sunspider:
 624         * tests/LIST-SQUIRRELFISH: Removed.
 625
 626 2008-06-03  Alexey Proskuryakov  <ap@webkit.org>
 627
 628         Rubber-stamped by Mark Rowe.
 629
 630         Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
 631
 632         * sunspider:
 633
 634 2008-04-15  Maciej Stachowiak  <mjs@apple.com>
 635
 636         Rubber stamped by Oliver.
 637
 638         - add newly working tests to squirrelfish list
 639
 640         * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
 641
 642 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 643
 644         Rubber stamped by Oliver.
 645
 646         - move ubench tests properly.
 647
 648         * tests/ubench: Added.
 649         * tests/ubench/function-closure.js: Added.
 650         * tests/ubench/function-empty.js: Added.
 651         * tests/ubench/function-missing-args.js: Added.
 652         * tests/ubench/function-sum.js: Added.
 653         * tests/ubench/loop-empty-resolve.js: Added.
 654         * tests/ubench/loop-empty.js: Added.
 655         * tests/ubench/loop-sum.js: Added.
 656
 657 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 658
 659         Rubber stamped by Oliver.
 660
 661         * sunspider: Don't force --runs=1 in squirrelfish mode any more.
 662
 663 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 664
 665         Reviewed by Oliver.
 666
 667         - make --squirrelfish mode use the real harness, but a reduced set of tests
 668
 669         Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
 670
 671         * sunspider:
 672         * tests/LIST-SQUIRRELFISH:
 673         * tests/LIST-UBENCH: Added.
 674         * tests/squirrelfish: Moved to tests/ubench
 675
 676 2008-04-14  Geoffrey Garen  <ggaren@apple.com>
 677
 678         Reviewed by Maciej Stachowiak.
 679
 680         Removed an unused test.
 681
 682         * tests/squirrelfish/loop-resolve.js: Removed.
 683
 684 2008-04-10  Maciej Stachowiak  <mjs@apple.com>
 685
 686         Reviewed by Oliver.
 687
 688         Add newly runnable tests to --squirrelfish mode.
 689
 690         * tests/LIST-SQUIRRELFISH:
 691
 692 2008-04-06  Geoffrey Garen  <ggaren@apple.com>
 693
 694         Reviewed by Maciej Stachowiak.
 695
 696         A little more love for --squirrelfish mode:
 697
 698         Fixed a misplaced sort. Results properly sort now.
 699
 700         Added a test list just for squirrelfish, and updated it to include
 701         all currently passing SunSpider tests.
 702
 703         Fixed the pruning regexp to match 3d-morph.js.
 704
 705         * sunspider:
 706
 707 2008-03-26  Geoffrey Garen  <ggaren@apple.com>
 708
 709         Reviewed by Oliver Hunt.
 710
 711         --squirrelfish mode: pared down tests for squirrelfish to chew on.
 712
 713         * sunspider:
 714         * tests/LIST:
 715         * tests/squirrelfish: Added.
 716         * tests/squirrelfish/function-closure.js: Added.
 717         * tests/squirrelfish/function-empty.js: Added.
 718         * tests/squirrelfish/function-missing-args.js: Added.
 719         * tests/squirrelfish/function-sum.js: Added.
 720         * tests/squirrelfish/loop-empty-resolve.js: Added.
 721         * tests/squirrelfish/loop-empty.js: Added.
 722         * tests/squirrelfish/loop-resolve.js: Added.
 723         * tests/squirrelfish/loop-sum.js: Added.
 724
 725 2008-03-21  Alexey Proskuryakov  <ap@webkit.org>
 726
 727         Reviewed by Geoff.
 728
 729         * sunspider: Pause update daemon on Darwin to make results reliable
 730         again (workaround for <rdar://problem/5811127>).
 731
 732 2008-02-07  Eric Seidel  <eric@webkit.org>
 733
 734         Reviewed by Sam.
 735
 736         * sunspider: add an error message when ./tests/LIST is not found
 737
 738 2007-12-29  Alp Toker  <alp@atoker.com>
 739
 740         Fix typo.
 741
 742         * hosted/sunspider.html:
 743
 744 2007-12-29  Alp Toker  <alp@atoker.com>
 745
 746         Reviewed by Maciej.
 747
 748         Provide the current URL in the SunSpider results page. Useful for
 749         copying benchmark results out of browsers without a location bar or
 750         where the location bar can't handle long URLs.
 751
 752         * hosted/sunspider-results.html:
 753
 754 2007-12-20  Eric Seidel  <eric@webkit.org>
 755
 756         Reviewed by mjs.
 757
 758         * sunspider: increase default number of runs for more accurate numbers
 759
 760 2007-12-18  Mark Rowe  <mrowe@apple.com>
 761
 762         Fix typo.
 763
 764         * hosted/sunspider.html:
 765
 766 2007-12-18  Maciej Stachowiak  <mjs@apple.com>
 767
 768         Reviewed by Eric.
 769
 770         - give an extra digit of precision for small differences.
 771
 772         * resources/sunspider-compare-results.js:
 773
 774 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 775
 776         Reviewed by Eric.
 777
 778         - work around IE layout bugs
 779
 780         * hosted/sunspider.css:
 781
 782 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 783
 784         Reviewed by Mark.
 785
 786         - fix compare feature
 787
 788         * hosted/sunspider-results.html:
 789
 790 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 791
 792         Reviewed by Mark.
 793
 794         - Change the format of the output URL to be shorter, to meet IE constraints
 795
 796         * hosted/sunspider-driver.html:
 797         * hosted/sunspider-results.html:
 798
 799 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
 800
 801         Reviewed by Oliver.
 802
 803         - Add some explanatory test and a dumb logo to SunSpider web hosted version
 804
 805         * hosted/sunspider-driver.html:
 806         * hosted/sunspider-results.html:
 807         * hosted/sunspider.css:
 808         * hosted/sunspider.html:
 809
 810 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
 811
 812         Reviewed by Oliver.
 813
 814         - Make the web-hosted version of SunSpider look a little bit less drab.
 815
 816         * hosted/sunspider-driver.html:
 817         * hosted/sunspider-results.html:
 818         * hosted/sunspider.css: Added.
 819         * hosted/sunspider.html:
 820         * resources/TEMPLATE.html:
 821
 822 2007-12-12  Maciej Stachowiak  <mjs@apple.com>
 823
 824         Reviewed by Sam.
 825
 826         - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
 827
 828         A sample of what new-style results would look like:
 829
 830         TEST                   COMPARISON            FROM                 TO             DETAILS
 831         ...
 832         ** TOTAL **:           1.41x as fast     6613.6ms +/- 0.1%   4703.0ms +/- 0.1%     significant
 833         ...
 834             3bit-bits-in-byte: *1.36x as slow*     88.8ms +/- 0.6%    121.1ms +/- 0.6%     significant
 835
 836         * resources/sunspider-compare-results.js:
 837
 838 2007-11-14  Eric Seidel  <eric@webkit.org>
 839
 840         Reviewed by Sam.
 841
 842         * sunspider: add --shark-cache for L2 Cache Miss profiling
 843
 844 2007-11-09  Alexey Proskuryakov  <ap@webkit.org>
 845
 846         Reviewed by Darin Adler.
 847
 848         http://bugs.webkit.org/show_bug.cgi?id=15925
 849         SunSpider should check for Shark being installed
 850
 851         * sunspider: Explicitly test that shark command line tool is installed.
 852
 853 2007-11-04  Darin Adler  <darin@apple.com>
 854
 855         * hosted/sunspider.html: Tweaked formatting a bit.
 856
 857 2007-11-03  Maciej Stachowiak  <mjs@apple.com>
 858
 859         Reviewed by Darin Adler.
 860
 861         - Add compare mode and a description of the benchmark to the hosted version.
 862
 863         * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
 864         * hosted/sunspider.html: Added intro text.
 865         * make-hosted: Copy new file.
 866         * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
 867         a function.
 868         * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
 869         expects.
 870         * sunspider-compare-results: Use sunspider-standalone-compare.js.
 871
 872 2007-11-02  Darin Adler  <darin@apple.com>
 873
 874         * sunspider: Changed "--base" to "--set-baseline".
 875
 876 2007-11-02  Darin Adler  <darin@apple.com>
 877
 878         Reviewed by Maciej.
 879
 880         * sunspider: Added a "--base" option that records the current test as a baseline.
 881         Moved the code to find the newest .mshark file into a function (since I needed to use
 882         it in the other script and I prefer to copy/paste a function).
 883
 884         * sunspider-compare-results: Added logic to compare the baseline with the last
 885         run when you don't pass any parameters.
 886
 887 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
 888
 889         Reviewed by Eric.
 890
 891         - Added list of ECMAScript3 features that SunSpider does not cover currently.
 892
 893         * UNCOVERED: Added.
 894
 895 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
 896
 897         Reviewed by Oliver.
 898
 899         - Give better error messages when sunspider-compare-results fails
 900
 901         * sunspider-compare-results:
 902
 903 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
 904
 905         Reviewed by Darin Adler.
 906
 907         - fix Date tests to work in command-line SpiderMonkey
 908
 909         * tests/date-format-tofte.js:
 910         * tests/date-format-xparb.js:
 911
 912 2007-10-29  Darin Adler  <darin@apple.com>
 913
 914         Reviewed by Maciej.
 915
 916         * sunspider: Added --shark20 option, to run Shark at its highest sample
 917         resolution instead of its default.
 918
 919 2007-10-28  Adam Roben  <aroben@apple.com>
 920
 921         Fix SunSpider on Windows
 922
 923         Reviewed by Eric.
 924
 925         * sunspider: Don't use colons in filenames.
 926
 927 2007-10-28  Darin Adler  <darin@apple.com>
 928
 929         Reviewed by Adam.
 930
 931         * resources/sunspider-analyze-results.js: Tweak the output format a little.
 932         Change so that when there's only one run we don't write out confidence
 933         intervals at all rather than writing "NaN" over and over again.
 934
 935         * sunspider: Use the time and date as a suffix on the results file, that way
 936         all the results are left behind in the tmp directory. This will make it easy
 937         for us to add features that compare past results in the future. Also rename
 938         the .mshark files using the same scheme.
 939
 940         * sunspider-compare-results: Relax the parsing rules so we can parse the
 941         results file exactly as it's emitted from sunspider.
 942
 943 2007-10-25  Adam Roben  <aroben@apple.com>
 944
 945         Strip carriage returns from results
 946
 947         Carriage returns were screwing up sunspider-compare-results on
 948         Windows.
 949
 950         Rubberstamped by Oliver.
 951
 952         * sunspider:
 953
 954 2007-10-24  Darin Adler  <darin@apple.com>
 955
 956         Reviewed by Eric.
 957
 958         * sunspider: Open the profile in shark after completing a run.
 959         * sunspider-compare-results: Tiny perl tweaks.
 960
 961 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
 962
 963         Reviewed by Darin Adler.
 964
 965         - Don't hardcode my path to testkjs
 966
 967         * sunspider-compare-results:
 968
 969 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
 970
 971         Reviewed by Darin Adler.
 972
 973         - Add a compare script to compare results, and improve formatting of standard results a bit.
 974
 975         * resources/sunspider-analyze-results.js:
 976         * resources/sunspider-compare-results.js: Added.
 977         * sunspider-compare-results: Added.
 978
 979 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
 980
 981         Reviewed by Darin Adler.
 982
 983         * resources/sunspider-analyze-results.js: Do the error range
 984         properly, using the t-distribution instead of 1.96 (which was
 985         based on the normal distribution).
 986
 987         * sunspider: Print results in a way that will be friendlier to the
 988         soon-to-come compare mode.
 989
 990 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
 991
 992         Reviewed by Review.
 993
 994         - add more tests (probably the final set for now)
 995
 996         Already balanced. Added date, regexp, control flow, and a few
 997         more string and object/array access tests.
 998
 999         * tests/LIST:
1000         * tests/access-fannkuch.js: Added.
1001         * tests/access-nbody.js: Added.
1002         * tests/controlflow-recursive.js: Added.
1003         * tests/date-format-tofte.js: Added.
1004         * tests/date-format-xparb.js: Added.
1005         * tests/regexp-dna.js: Added.
1006         * tests/string-validate-input.js: Added.
1007
1008 2007-10-21  Eric Seidel  <eric@webkit.org>
1009
1010         Reviewed by mjs.
1011
1012         * sunspider: make --shark only sample from testkjs
1013
1014 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
1015
1016         Rubber stamped by Eric.
1017
1018         - added crypto tests (already balanced)
1019
1020         * tests/LIST:
1021         * tests/crypto-aes.js: Added.
1022         * tests/crypto-md5.js: Added.
1023         * tests/crypto-sha1.js: Added.
1024
1025 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
1026
1027         Reviewed by Adam.
1028
1029         - rebalance new tests
1030
1031         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
1032
1033         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1034
1035         This balances them with the existing tests.
1036
1037         * tests/access-binary-trees.js:
1038         * tests/access-nsieve.js:
1039         * tests/bitops-nsieve-bits.js:
1040         * tests/math-partial-sums.js:
1041         * tests/math-spectral-norm.js:
1042         * tests/string-fasta.js:
1043
1044 2007-10-20  Eric Seidel  <eric@webkit.org>
1045
1046         Reviewed by darin.
1047
1048         Add improved argument handling to sunspider, including
1049         --runs=<number>, --tests=<pattern, --shark, and --help
1050         Also re-factor code into subroutines
1051
1052         * sunspider: improved argument handling
1053
1054 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1055
1056         Reviewed by Mark.
1057
1058         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
1059
1060         * TODO:
1061         * tests/LIST:
1062         * tests/access-binary-trees.js: Added.
1063         * tests/access-nsieve.js: Added.
1064         * tests/bitops-nsieve-bits.js: Added.
1065         * tests/math-partial-sums.js: Added.
1066         * tests/math-spectral-norm.js: Added.
1067         * tests/string-fasta.js: Added.
1068
1069 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1070
1071         Reviewed by Darin Adler.
1072
1073         * TODO: Updated to note areas that are now well-covered.
1074
1075         - Change the tests and the driver to avoid leaving large object
1076         graphs hanging around, since that throws off the subsequent tests.
1077
1078         * resources/sunspider-standalone-driver.js:
1079         * tests/3d-cube.js:
1080         * tests/3d-morph.js:
1081         * tests/3d-raytrace.js:
1082         * tests/bitops-bitwise-and.js:
1083         * tests/string-base64.js:
1084         * tests/string-tagcloud.js:
1085
1086 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1087
1088         Reviewed by Nikolas.
1089
1090         - Rebalance test complexity.
1091
1092         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
1093
1094         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1095
1096         However, for some tests, IE7 was a huge outlier compared to other
1097         major browsers. For those tests, I used Firefox 2.0.0.8 on the
1098         same OS and hardware as a normalization basis.
1099
1100         * tests/3d-morph.js:
1101         * tests/3d-raytrace.js:
1102         * tests/bitops-3bit-bits-in-byte.js:
1103         * tests/bitops-bits-in-byte.js:
1104         * tests/bitops-bitwise-and.js:
1105         * tests/math-cordic.js:
1106         * tests/string-base64.js:
1107         * tests/string-tagcloud.js:
1108         * tests/string-unpack-code.js:
1109
1110 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1111
1112         Reviewed by Oliver.
1113
1114         - Fix the browser-hosted driver to be compatible with Safari 2
1115
1116         * hosted/sunspider-driver.html:
1117
1118 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1119
1120         Rubber stamped by Hyatt.
1121
1122         - Add BSD license notice to cordic test, the original author said to do so.
1123
1124         * tests/math-cordic.js:
1125
1126 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1127
1128         Reviewed by Eric.
1129
1130         - Support Windows and Windows browsers.
1131
1132         * hosted/sunspider-results.html: Display results correctly in IE.
1133         * sunspider: tweaks to work on Windows, and with spaces in the path.
1134
1135 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1136
1137         Rubber stamped by Oliver.
1138
1139         * tests/string-tagcloud.js: Remove stray print()
1140
1141 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
1142
1143         Reviewed by Oliver.
1144
1145         Add some string test cases.
1146
1147         * tests/string-base64.js: Added. Does base64 encoding and decoding.
1148         * tests/string-tagcloud.js: Added. Parses a JSON string and
1149         generates tagcloud HTML markup based on the data.
1150         * tests/string-unpack-code.js: Added. Unpack compressed versions of
1151         four of the most popular JavaScript libraries.
1152         * tests/LIST: Added the new tests.
1153
1154 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
1155
1156         Reviewed by Anders.
1157
1158         * TODO: Updated with info on how to do the stats properly.
1159
1160         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
1161         avoid overly slowing down the benchmark.
1162
1163         Added some 3D-related test cases.
1164
1165         * tests/3d-cube.js: Added.
1166         * tests/3d-morph.js: Added.
1167         * tests/3d-raytrace.js: Added.
1168         * tests/LIST:
1169
1170 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
1171
1172         Reviewed by Darin Adler.
1173
1174         - New JavaScript benchmark
1175         http://bugs.webkit.org/show_bug.cgi?id=15515
1176
1177         A start on a new JavaScript benchmark, with standalone and
1178         browser-hosted drivers.
1179
1180         The test content is still incomplete and the drivers could use
1181         some more features but there is enough here to make a good start.
1182
1183         The drivers compute a 95% confidence interval on the mean for the
1184         whole test, each category, and each individual test to make it
1185         easier to tell whether differences are statistically
1186         significant. The confidence interval can be narrowed by running
1187         the test more times.
1188
1189         * TODO: Added. Remaining things that need to be done.
1190         * sunspider: Added. Perl script that acts as the standalone test driver.
1191         * resources/sunspider-standalone-driver.js: Added. JavaScript part
1192         of standalone test driver.
1193         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
1194         analysis code.
1195         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
1196         * make-hosted: Added. Script to generate browser-hosted tests.
1197         * hosted/sunspider.html: Added. Start page for browser-hosted test.
1198         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
1199         * hosted/sunspider-results.html: Added. Results page for browser-hosted
1200         tests.
1201         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
1202         tests.
1203         * tests/LIST: Added. List of tests to use.
1204         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
1205         * tests/bitops-bits-in-byte.js: Added. Ditto.
1206         * tests/bitops-bitwise-and.js: Added. Ditto.
1207         * tests/math-cordic.js: Added. Ditto.
1208