PerformanceTests/SunSpider/ChangeLog

   1 2013-05-03  Cosmin Truta  <ctruta@blackberry.com>
   2
   3         SunSpider 1.0: 3d-morph: use epsilon to check result
   4         https://bugs.webkit.org/show_bug.cgi?id=115553
   5
   6         Reviewed by George Staikos.
   7
   8         SunSpider/3d-morph should be more lenient in validating its results, since they depend on Math.sin, which isn't formally specified.
   9
  10         * tests/sunspider-1.0/3d-morph.js:
  11
  12 2013-04-19  Filip Pizlo  <fpizlo@apple.com>
  13
  14         SunSpider/string-tagcloud should be more lenient in validating its results, since they depend on Math.log, which isn't formally specified
  15         https://bugs.webkit.org/show_bug.cgi?id=114895
  16
  17         Reviewed by Michael Saboff.
  18
  19         * tests/sunspider-1.0/string-tagcloud.js:
  20
  21 2013-04-18  Filip Pizlo  <fpizlo@apple.com>
  22
  23         Whenever it is cheap and non-invasive, SunSpider tests should validate their results to ensure that the browser runs them correctly
  24         https://bugs.webkit.org/show_bug.cgi?id=114852
  25
  26         Reviewed by Geoffrey Garen.
  27
  28         This adds low-overhead checking of the results of each SunSpider tests. This is not
  29         meant to be an exhaustive test that everything was executed correctly, but rather a
  30         simple sanity check that will catch glaring mistakes. The philosophy here is that we're
  31         not trying to prevent all forms of cheating, or that we're trying to prove the
  32         browser's correctness. Moreover, these checks are meant to incur minimal overhead;
  33         they currently clock in at <2% slow-down in SunSpider 1.0.
  34
  35         The test expectations were generated using the LLInt on command-line, and I've verified
  36         that Firefox 20, Chrome 26, IE 10, Safari 6, and ToT with all of the JITs agree. Note
  37         that some tests cannot be precisely validated because they use Math functions, which
  38         ECMAScript chooses to not formally specify - those functions like sin() and friends are
  39         allowed to return implementation-dependent results. Also some tests cannot be validated
  40         at all because their behavior is either intentionally random or is timezone-dependent.
  41         But 23 out of 26 tests now have some kind of validation.
  42
  43         I've updated the harnesses to show erroneous runs when displaying results.
  44
  45         * resources/TEMPLATE.html:
  46         * resources/driver-TEMPLATE.html:
  47         * resources/sunspider-analyze-results.js:
  48         (formatResult):
  49         (resultLine):
  50         (printOutput):
  51         * resources/sunspider-compare-results.js:
  52         (.formatMean):
  53         (.resultLine):
  54         (.printOutput):
  55         (sunspiderCompareResults):
  56         * resources/sunspider-standalone-driver.js:
  57         * tests/sunspider-1.0/3d-cube.js:
  58         (Init):
  59         * tests/sunspider-1.0/3d-morph.js:
  60         * tests/sunspider-1.0/3d-raytrace.js:
  61         * tests/sunspider-1.0/access-binary-trees.js:
  62         * tests/sunspider-1.0/access-fannkuch.js:
  63         * tests/sunspider-1.0/access-nbody.js:
  64         * tests/sunspider-1.0/access-nsieve.js:
  65         (sieve):
  66         * tests/sunspider-1.0/bitops-3bit-bits-in-byte.js:
  67         * tests/sunspider-1.0/bitops-bits-in-byte.js:
  68         * tests/sunspider-1.0/bitops-bitwise-and.js:
  69         * tests/sunspider-1.0/bitops-nsieve-bits.js:
  70         * tests/sunspider-1.0/controlflow-recursive.js:
  71         * tests/sunspider-1.0/crypto-aes.js:
  72         * tests/sunspider-1.0/crypto-md5.js:
  73         * tests/sunspider-1.0/crypto-sha1.js:
  74         * tests/sunspider-1.0/date-format-tofte.js:
  75         * tests/sunspider-1.0/date-format-xparb.js:
  76         * tests/sunspider-1.0/math-cordic.js:
  77         * tests/sunspider-1.0/math-partial-sums.js:
  78         (partial):
  79         * tests/sunspider-1.0/math-spectral-norm.js:
  80         * tests/sunspider-1.0/regexp-dna.js:
  81         * tests/sunspider-1.0/string-base64.js:
  82         * tests/sunspider-1.0/string-fasta.js:
  83         (fastaRepeat):
  84         (fastaRandom):
  85         * tests/sunspider-1.0/string-tagcloud.js:
  86         * tests/sunspider-1.0/string-unpack-code.js:
  87         * tests/sunspider-1.0/string-validate-input.js:
  88
  89 2013-04-11  Filip Pizlo  <fpizlo@apple.com>
  90
  91         Get rid of the 10ms delay between test executions
  92         https://bugs.webkit.org/show_bug.cgi?id=114458
  93         <rdar://problem/13631112>
  94
  95         Reviewed by Darin Adler and Geoffrey Garen.
  96
  97         More details on this in the bug. Long story short, I don't know why the 10ms delay is
  98         there, and it appears to be the root of some noisyness and unreliability in the results.
  99         Removing it makes results more consistent, which is a good thing.
 100
 101         * resources/driver-TEMPLATE.html:
 102
 103 2013-01-16  Eric Seidel  <eric@webkit.org>
 104
 105         Remove --shark* support from sunspider/run-sunspider now that Shark is dead
 106         https://bugs.webkit.org/show_bug.cgi?id=99512
 107
 108         Reviewed by Darin Adler.
 109
 110         I tried to use --instruments, but that also seems broken (in the same way before/after this patch).
 111
 112         * sunspider:
 113         (runTestsOnce):
 114
 115 2012-08-02  Filip Pizlo  <fpizlo@apple.com>
 116
 117         Unreviewed, revert debugging stuff I landed in http://trac.webkit.org/changeset/124557
 118         by accident.
 119
 120         * tests/v8-v6/v8-crypto.js:
 121         (am1):
 122         (am2):
 123         (am3):
 124         (am4):
 125         (bnpCopyTo):
 126         (bnpFromString):
 127         (bnpClamp):
 128
 129 2012-03-11  Maciej Stachowiak  <mjs@apple.com>
 130
 131         Add --instruments option to sunspider to profile with Instruments
 132         https://bugs.webkit.org/show_bug.cgi?id=80783
 133
 134         Reviewed by Filip Pizlo.
 135
 136         * resources/TimeProfile20us.tracetemplate: Added.
 137         * sunspider:
 138         (runTestsOnce):
 139
 140 2011-11-15  Andy Wingo  <wingo@igalia.com>
 141
 142         Extend sunspider driver to be able to run kraken
 143         https://bugs.webkit.org/show_bug.cgi?id=71799
 144
 145         Reviewed by Filip Pizlo.
 146
 147         * resources/sunspider-standalone-driver.js: Try to load a -data
 148         file.  If that succeeds, we have a kraken-like test, so we time
 149         the test using `load'.  Otherwise fall back to using `run'.
 150
 151 2011-08-11  Mark Rowe  <mrowe@apple.com>
 152
 153         Fix sunspider-compare-results to default to the same suite version as the sunspider script.
 154
 155         Rubber-stamped by Maciej Stachowiak.
 156
 157         * sunspider-compare-results:
 158
 159 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
 160
 161         Update SunSpider versioning to 1.0
 162         https://bugs.webkit.org/show_bug.cgi?id=63870
 163
 164         Reviewed by Dan Bernstein.
 165
 166         * hosted/sunspider.html:
 167         * hosted/versions.html:
 168         * resources/driver-TEMPLATE.html:
 169         * resources/results-TEMPLATE.html:
 170         * sunspider:
 171
 172 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
 173
 174         Sunspider 0.9.1 harness doesn't actually close() its test documents
 175         https://bugs.webkit.org/show_bug.cgi?id=47045
 176
 177         Reviewed by Daniel Bates.
 178
 179         * hosted/versions.html:
 180         * resources/driver-TEMPLATE.html:
 181
 182 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
 183
 184         Not Reviewed.
 185
 186         Fix obviou typo in previous commit.
 187
 188         * tests/sunspider-1.0/bitops-bitwise-and.js:
 189
 190 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
 191
 192         Reviewed by Anders Carlsson.
 193
 194         SunSpider: all four bitops benchmarks can be replaced with NOP
 195         https://bugs.webkit.org/show_bug.cgi?id=38446
 196
 197         * tests/sunspider-1.0/bitops-3bit-bits-in-byte.js:
 198         (TimeFunc): Save the result.
 199         * tests/sunspider-1.0/bitops-bits-in-byte.js:
 200         (TimeFunc): Save the result.
 201         * tests/sunspider-1.0/bitops-bitwise-and.js: More explicitly
 202         save the results.
 203         * tests/sunspider-1.0/bitops-nsieve-bits.js:
 204         (sieve): Save the result.
 205
 206 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
 207
 208         SunSpider: string-validate-input.js uses an undeclared variable named 'name', which is a DOM API
 209         https://bugs.webkit.org/show_bug.cgi?id=60937
 210
 211         Reviewed by Dan Bernstein.
 212
 213         * tests/sunspider-1.0/string-validate-input.js:
 214         (doTest): Rename the variable to username
 215
 216 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
 217
 218         Reviewed by Darin Adler.
 219
 220         SunSpider: The main function of math-cordic is dead code
 221         https://bugs.webkit.org/show_bug.cgi?id=63863
 222
 223         Try to prevent math-cordic from being eliminated as dead code or
 224         compiled down to a constant.
 225
 226         * tests/sunspider-1.0/math-cordic.js:
 227         (cordicsincos):
 228         (cordic):
 229
 230 2011-06-30  Maciej Stachowiak  <mjs@apple.com>
 231
 232         Reviewed by Adam Barth.
 233
 234         Create sunspider-1.0 directory in preparation for fixing a bunch of bugs
 235         https://bugs.webkit.org/show_bug.cgi?id=63782
 236
 237         * make-hosted: Learn about the new directory.
 238         * tests/sunspider-1.0: Copied from PerformanceTests/SunSpider/tests/sunspider-0.9.1.
 239
 240 2010-11-29  Geoffrey Garen  <ggaren@apple.com>
 241
 242         Reviewed by Gavin Barraclough.
 243
 244         Improved accuracy of command-line SunSpider.
 245
 246         * resources/sunspider-standalone-driver.js: Use the returned number of
 247         elapsed milliseconds from "run" and "checkSyntax" instead of measuring
 248         ourselves, for slightly more accurate numbers.
 249
 250 2010-09-16  Gavin Barraclough  <barraclough@apple.com>
 251
 252         Reviewed by Mark Rowe.
 253         https://bugs.webkit.org/show_bug.cgi?id=45924
 254
 255         Modify the SunSpider harness to allow a path to be passed to the --suite
 256         argument, supress the normal prepend-"tests/" behaviour for suite names
 257         containing a '/'.
 258
 259         Also wrap the code in an anonymous function to move variables out of global
 260         scope (currently the harness cannot handle running tests the overwrite the
 261         variable 'j').
 262
 263         * resources/sunspider-standalone-driver.js:
 264         * sunspider:
 265
 266 2010-08-27  Michael Saboff  <msaboff@apple.com>
 267
 268         Reviewed by Stephanie Lewis.
 269
 270         Added version 5 and version 6 of V8 tests with modifications similar
 271         to the version 4 tests so they'll work with the SunSpider test harness.
 272         Note that these files are external source and therefore don't conform
 273         to WebKit coding standards.
 274         https://bugs.webkit.org/show_bug.cgi?id=44638
 275
 276         * tests/v8-v5: Added.
 277         * tests/v8-v5/LIST: Added.
 278         * tests/v8-v5/v8-crypto.js: Added.
 279         * tests/v8-v5/v8-deltablue.js: Added.
 280         * tests/v8-v5/v8-earley-boyer.js: Added.
 281         * tests/v8-v5/v8-raytrace.js: Added.
 282         * tests/v8-v5/v8-regexp.js: Added.
 283         * tests/v8-v5/v8-richards.js: Added.
 284         * tests/v8-v5/v8-splay.js: Added.
 285         * tests/v8-v6: Added.
 286         * tests/v8-v6/LIST: Added.
 287         * tests/v8-v6/v8-crypto.js: Added.
 288         * tests/v8-v6/v8-deltablue.js: Added.
 289         * tests/v8-v6/v8-earley-boyer.js: Added.
 290         * tests/v8-v6/v8-raytrace.js: Added.
 291         * tests/v8-v6/v8-regexp.js: Added.
 292         * tests/v8-v6/v8-richards.js: Added.
 293         * tests/v8-v6/v8-splay.js: Added.
 294
 295 2010-07-15  Stephanie Lewis  <slewis@apple.com>
 296
 297         Reviewed by Geoff Garen.
 298
 299         http://bugs.webkit.org/show_bug.cgi?id=42406
 300         Output location of results file.
 301
 302         * sunspider:
 303
 304 2010-05-17  Maciej Stachowiak  <mjs@apple.com>
 305
 306         Reviewed by Mark Rowe.
 307
 308         Browser-hosted version of SunSpider runs tests twice as many times as advertised
 309         https://bugs.webkit.org/show_bug.cgi?id=39201
 310
 311         * make-hosted: Make sure to reset test list after every test suite.
 312
 313 2010-05-07  Adam Roben  <aroben@apple.com>
 314
 315         Fix typo in sunspider-compare-results.js that caused incorrect
 316         two-sample t statistics to be computed
 317
 318         Fixes <http://webkit.org/b/38768> SunSpider computes incorrect
 319         two-sample t statistics
 320
 321         Reviewed by Darin Adler.
 322
 323         * resources/sunspider-compare-results.js:
 324         (sunspiderCompareResults.resultLine): Fixed the calculation of the t
 325         variable to match the definition of a two-sample t statistic. Looks
 326         like this was just a simple typo.
 327
 328 2010-04-05  Darin Adler  <darin@apple.com>
 329
 330         Updated the ignore property for changes to the contents here.
 331
 332         * .: Modified property svn:ignore.
 333
 334 2010-02-20  Maciej Stachowiak  <mjs@apple.com>
 335
 336         Reviewed by Adam Barth.
 337
 338         Add sunspider-0.9.1 to the site in preparation for announcing it.
 339         https://bugs.webkit.org/show_bug.cgi?id=35206
 340
 341         * hosted/sunspider.css: Remove tabs, which I noticed where present while
 342         copying to the WebKitSite directory.
 343
 344 2010-01-11  Oliver Hunt  <oliver@apple.com>
 345
 346         Reviewed by Darin Adler.
 347
 348         Sunspider parse-only tests don't run
 349         https://bugs.webkit.org/show_bug.cgi?id=33489
 350
 351         Fix parse-only test list
 352
 353         * tests/parse-only/LIST:
 354
 355 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
 356
 357         Reviewed by Adele Peterson.
 358
 359         Make SunSpider version more prominent in the title
 360         https://bugs.webkit.org/show_bug.cgi?id=32574
 361
 362         * hosted/sunspider.html:
 363         * hosted/versions.html:
 364         * resources/driver-TEMPLATE.html:
 365         * resources/results-TEMPLATE.html:
 366
 367 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
 368
 369         Reviewed by Darin Adler.
 370
 371         Make SunSpider refuse to compare results across content versions
 372         https://bugs.webkit.org/show_bug.cgi?id=32573
 373
 374         The results URL now includes a version indicator, and compare mode
 375         will refuse to compare between versions.
 376
 377         * resources/driver-TEMPLATE.html:
 378         * resources/results-TEMPLATE.html:
 379
 380 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
 381
 382         Reviewed by Darin Adler.
 383
 384         Some Browser-hosted SunSpider files are not valid HTML5
 385         https://bugs.webkit.org/show_bug.cgi?id=32536
 386
 387         Made various fixes to validate as HTML5 with no warnings (mainly removing bogus
 388         close tags and adding a meta charset declaration).
 389
 390         * hosted/sunspider.html:
 391         * hosted/versions.html:
 392         * resources/TEMPLATE.html:
 393         * resources/driver-TEMPLATE.html:
 394         * resources/results-TEMPLATE.html:
 395
 396 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
 397
 398         Reviewed by Eric Seidel.
 399
 400         Make sunspider-0.9.1 the default content set (both command-line and hosted)
 401         https://bugs.webkit.org/show_bug.cgi?id=32537
 402
 403         * hosted/sunspider.html: Change default suite link.
 404         * sunspider: Change default suite.
 405         * sunspider-compare-results: Likewise.
 406
 407 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
 408
 409         Reviewed by Sam Weinig.
 410
 411         in-browser SunSpider suffers excessive penalty under power management
 412         https://bugs.webkit.org/show_bug.cgi?id=32505
 413
 414         I have made a few changes to address this:
 415
 416         1) Change how browser-hosted SunSpider loads tests - preload the content and write it in with
 417         document.write to reduce triggering of progress UI.
 418         2) Reduce time between tests to 10ms from 500ms, so that power management doesn't keep the CPU
 419         stepped all the way down the whole time.
 420         3) Run the test cycle an extra time for warmup before the runs that count.
 421
 422         * hosted/sunspider-record-result.js: Removed.
 423         * make-hosted:
 424         * resources/TEMPLATE.html:
 425         * resources/driver-TEMPLATE.html:
 426
 427 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
 428
 429         Reviewed by Gavin Barraclough.
 430
 431         SunSpider/tests/string-base64.js does not compute a valid base64 encoded string
 432         https://bugs.webkit.org/show_bug.cgi?id=16806
 433
 434         Based on a patch by Eric Seidel.
 435
 436         Fix the base64 computation to actually compute correct results. The impact on runtime of
 437         the test is pretty small, but noticeable for some browsers. But at least it's not
 438         doing a wrong and meaningless computation any more.
 439
 440         * tests/sunspider-0.9.1/string-base64.js:
 441         ():
 442         (base64ToString):
 443
 444 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
 445
 446         Fixing commit error...
 447
 448         I accidentally committed my last patch in a form that broke Web-hosted SunSpider. Fixing.
 449
 450         * resources/driver-TEMPLATE.html:
 451
 452 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
 453
 454         Reviewed by Sam Weinig.
 455
 456         Use JSON.parse instead of eval for Web-hosted SunSpider results processing
 457         https://bugs.webkit.org/show_bug.cgi?id=32490
 458
 459         * hosted/json2.js: Added. Incorporated from json.org
 460         * resources/driver-TEMPLATE.html: Fix an HTML validation bug I noticed.
 461         * resources/results-TEMPLATE.html: Use JSON.parse instead of eval to process
 462         results.
 463
 464 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
 465
 466         Reviewed by Oliver Hunt.
 467
 468         Enable Web-hosted version of SunSpider to handle multiple versions
 469         https://bugs.webkit.org/show_bug.cgi?id=32478
 470
 471         * make-hosted: Now generate the hosted version to be able to run both the
 472         0.9 and the 0.9.1 test suites.
 473         * hosted: Modified property svn:ignore.
 474         * hosted/sunspider-driver.html: Removed.
 475         * hosted/sunspider-results.html: Removed.
 476         * hosted/sunspider.html:
 477         * hosted/versions.html: Added.
 478         * resources/TEMPLATE.html:
 479         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-driver.html.
 480         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-results.html.
 481
 482 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
 483
 484         Reviewed by Oliver Hunt.
 485
 486         Give command-line sunspider the ability to handle multiple suites and versions
 487         https://bugs.webkit.org/show_bug.cgi?id=32477
 488
 489         Each suite/version's set of tests are now in a separate subdirectory of tests/, with a file named LIST
 490         enumerating the tests. Current suites are:
 491
 492         sunspider-0.9 - riginal SunSpider content
 493         sunspider-0.9.1 - SunSpider suite with a few tests fixed (and a few more to come)
 494         ubench - "ubench" microbenchmark suite
 495         v8-v4 - version 4 of the v8 benchmark
 496         parse-only - some parser tests
 497
 498         Sunspider can now be run with the --suite= parameter to select a
 499         suite. The default is --suite=sunspider-0.9.
 500
 501         * .: Modified property svn:ignore to ignore new results directories.
 502         * make-hosted: Generate based on sunspider-0.9 suite.
 503         * resources/TEMPLATE.html: Fix an HTML compliance problem.
 504         * resources/sunspider-standalone-driver.js: Become aware of suite names.
 505         * sunspider: Modified to handle multiple suites as described above.
 506         * sunspider-compare-results: ditto
 507         * tests/LIST: Moved to tests/sunspider-0.9/ and tests/sunspider-0.9.1/
 508         * tests/LIST-PARSE-ONLY: Moved to parse-only/LIST
 509         * tests/LIST-UBENCH: Removed.
 510         * tests/LIST-V8: Removed.
 511         * tests/3d-cube.js: Moved to tests/sunspider-0.9 and tests/sunspider-0.9.1
 512         * tests/3d-morph.js: ditto
 513         * tests/3d-raytrace.js: ditto
 514         * tests/access-binary-trees.js: ditto
 515         * tests/access-fannkuch.js: ditto
 516         * tests/access-nbody.js: ditto
 517         * tests/access-nsieve.js: ditto
 518         * tests/bitops-3bit-bits-in-byte.js: ditto
 519         * tests/bitops-bits-in-byte.js: ditto
 520         * tests/bitops-bitwise-and.js: ditto
 521         * tests/bitops-nsieve-bits.js: ditto
 522         * tests/controlflow-recursive.js: ditto
 523         * tests/crypto-aes.js: ditto
 524         * tests/crypto-md5.js: ditto
 525         * tests/crypto-sha1.js: ditto
 526         * tests/date-format-tofte.js: ditto
 527         * tests/date-format-xparb.js: ditto
 528         * tests/math-cordic.js: ditto
 529         * tests/math-partial-sums.js: ditto
 530         * tests/math-spectral-norm.js: ditto
 531         * tests/regexp-dna.js: ditto
 532         * tests/string-base64.js: ditto
 533         * tests/string-fasta.js: ditto
 534         * tests/string-tagcloud.js: ditto
 535         * tests/string-unpack-code.js: ditto
 536         * tests/string-validate-input.js: ditto
 537         * tests/sunspider-0.9/: Added
 538         * tests/sunspider-0.9/*.js: Moved from one level up
 539         * tests/sunspider-0.9.1: Added.
 540         * tests/sunspider-0.9.1/*.js: Moved from one level up.
 541         * tests/v8-crypto.js: Moved to v8-v4/ directory.
 542         * tests/v8-deltablue.js: ditto
 543         * tests/v8-earley-boyer.js: ditto
 544         * tests/v8-raytrace.js: ditto
 545         * tests/v8-regexp.js: ditto
 546         * tests/v8-richards.js: ditto
 547         * tests/v8-splay.js: ditto
 548         * tests/v8-v4: Added.
 549
 550 2009-09-30  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
 551
 552         Reviewed by Darin Adler.
 553
 554         Platform specific null device replaced with a platform independent.
 555         https://bugs.webkit.org/show_bug.cgi?id=29544
 556
 557         * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL.
 558
 559 2009-09-21  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
 560
 561         Reviewed by Maciej Stachowiak.
 562
 563         [Qt] Make sunspider script work on Windows platform.
 564         https://bugs.webkit.org/show_bug.cgi?id=29544
 565
 566         * sunspider:
 567         Using platform specific null device instead of /dev/null.
 568
 569 2009-06-19  Adam Treat  <adam.treat@torchmobile.com>
 570
 571         Reviewed by Oliver Hunt.
 572
 573         https://bugs.webkit.org/show_bug.cgi?id=26540
 574         Currently the SunSpider test driver lacks an option to run a test suite that
 575         will test JavaScriptCore parsing performance only.  This patch adds just such
 576         a test suite and option to SunSpider as well as the jsc test shell.  I've included
 577         three large javascript source files found in the wild: jquery, mootools and prototype.
 578         Combined with the concatenation of all three, these form a new testsuite to measure
 579         and test pure JavaScriptCore parsing performance.
 580
 581         * resources/sunspider-standalone-driver.js:
 582           Load the js with parse-only flag if it is part of the parse-only suite.
 583         * sunspider:
 584           Add the parse-only suite to the list of options.
 585         * sunspider-compare-results:
 586           Add the parse-only suite to the list of options.
 587         * tests/LIST-PARSE-ONLY: Added.
 588         * tests/parse-only/concat-jquery-mootools-prototype.js: Added.
 589           A very large concatenation of the scripts found below.  This js takes ~30ms to parse on my machine.
 590         * tests/parse-only/jquery-1.3.2.js: Added.
 591           Latest version from jquery.com.
 592         * tests/parse-only/mootools-1.2.2-core-nc.js: Added.
 593           Latest version from mootools.net.
 594         * tests/parse-only/prototype-1.6.0.3.js: Added.
 595           Latest version from prototypejs.org.
 596
 597 2009-06-13  Steve Falkenburg  <sfalken@apple.com>
 598
 599         Update V8 benchmark to version 4.
 600
 601         Reviewed by Cameron Zwarich.
 602
 603         * tests/LIST-V8:
 604         * tests/v8-crypto.js:
 605         * tests/v8-deltablue.js:
 606         * tests/v8-earley-boyer.js:
 607         * tests/v8-raytrace.js:
 608         * tests/v8-regexp.js: Added.
 609         * tests/v8-richards.js:
 610         * tests/v8-splay.js: Added.
 611
 612 2009-05-26  Olivier DOLE  <odole@pleyo.com>
 613
 614         Reviewed by Maciej.
 615
 616         Store sunspider test suite results in a specific directory for each
 617         different type of benchmark (sunspider, V8 or ubench).
 618
 619         * sunspider:
 620         * sunspider-compare-results:
 621
 622 2009-05-12  Steve Falkenburg  <sfalken@apple.com>
 623
 624         Build fix.
 625
 626         * SunSpider.make:
 627
 628 2009-05-11  Steve Falkenburg  <sfalken@apple.com>
 629
 630         Include SunSpider tests in production builds.
 631
 632         Reviewed by Adam Roben.
 633
 634         * SunSpider.make: Added.
 635         * xcopy.excludes: Added.
 636
 637 2009-03-04  Oliver Hunt  <oliver@apple.com>
 638
 639         Added a few more tests to ubench
 640
 641         RS=Gavin Barraclough
 642
 643         Adding a couple of test to cover too few and too many arguments.  This
 644         is needed to prevent regressions in all call paths from my current refactoring.
 645
 646         * tests/LIST-UBENCH:
 647         * tests/ubench/function-correct-args.js: Added.
 648         (f):
 649         * tests/ubench/function-excess-args.js: Added.
 650         (f):
 651
 652 2008-10-30  Zoltan Horvath  <Horvath.Zoltan.6@stud.u-szeged.hu>
 653
 654         Fix a bug where when V8's or UBENCH's test suite list file is missing
 655         the error message is suggesting that SunSpider's list file is missing.
 656
 657         Reviewed by Sam Weinig.
 658
 659         * sunspider:
 660         (loadTestsList): Fix the error message to use the right list name.
 661
 662 2008-10-07  David Hyatt  <hyatt@apple.com>
 663
 664         https://bugs.webkit.org/show_bug.cgi?id=18989
 665
 666         Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
 667         we want all browsers to be doing the same thing on the test.
 668
 669         Reviewed by Maciej
 670
 671         * tests/regexp-dna.js:
 672
 673 2008-09-09  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 674
 675         Rubber-stamped by Maciej Stachowiak.
 676
 677         The bleeding edge branch of V8 now supports passing fileanmes after
 678         '-f', so the SunSpider script should be changed to do this again.
 679         This allows all 3 major JavaScript engines to be used with the
 680         unmodified SunSpider script.
 681
 682         * sunspider:
 683
 684 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 685
 686         Reviewed by Maciej Stachowiak.
 687
 688         Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
 689         and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
 690         correct the punctuation in its documentation.
 691
 692         * sunspider:
 693
 694 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 695
 696         Reviewed by Oliver Hunt.
 697
 698         Bug 20616: Incorporate V8 benchmarks in testing
 699         <https://bugs.webkit.org/show_bug.cgi?id=20616>
 700
 701         This is a first attempt at running the V8 benchmarks within SunSpider,
 702         with the --v8 option. The number of iterations is fixed for each
 703         benchmark, and was chosen to make each of the benchmarks run between
 704         500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
 705
 706         * sunspider:
 707         * tests/LIST-V8: Added.
 708         * tests/v8-crypto.js: Added.
 709         * tests/v8-deltablue.js: Added.
 710         * tests/v8-earley-boyer.js: Added.
 711         * tests/v8-raytrace.js: Added.
 712         * tests/v8-richards.js: Added.
 713
 714 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 715
 716         Not reviewed.
 717
 718         Remove a local change that was accidentally committed in r36034.
 719
 720         * resources/sunspider-standalone-driver.js:
 721
 722 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 723
 724         Rubber-stamped by Oliver Hunt.
 725
 726         Make SunSpider work with JavaScript shells that don't take filenames
 727         after a '-f' argument.
 728
 729         * sunspider:
 730
 731 2008-06-07  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 732
 733         Reviewed by Timothy.
 734
 735         Remove the --squirrelfish option from SunSpider, as it is no longer needed.
 736
 737         * sunspider:
 738         * tests/LIST-SQUIRRELFISH: Removed.
 739
 740 2008-06-03  Alexey Proskuryakov  <ap@webkit.org>
 741
 742         Rubber-stamped by Mark Rowe.
 743
 744         Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
 745
 746         * sunspider:
 747
 748 2008-04-15  Maciej Stachowiak  <mjs@apple.com>
 749
 750         Rubber stamped by Oliver.
 751
 752         - add newly working tests to squirrelfish list
 753
 754         * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
 755
 756 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 757
 758         Rubber stamped by Oliver.
 759
 760         - move ubench tests properly.
 761
 762         * tests/ubench: Added.
 763         * tests/ubench/function-closure.js: Added.
 764         * tests/ubench/function-empty.js: Added.
 765         * tests/ubench/function-missing-args.js: Added.
 766         * tests/ubench/function-sum.js: Added.
 767         * tests/ubench/loop-empty-resolve.js: Added.
 768         * tests/ubench/loop-empty.js: Added.
 769         * tests/ubench/loop-sum.js: Added.
 770
 771 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 772
 773         Rubber stamped by Oliver.
 774
 775         * sunspider: Don't force --runs=1 in squirrelfish mode any more.
 776
 777 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 778
 779         Reviewed by Oliver.
 780
 781         - make --squirrelfish mode use the real harness, but a reduced set of tests
 782
 783         Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
 784
 785         * sunspider:
 786         * tests/LIST-SQUIRRELFISH:
 787         * tests/LIST-UBENCH: Added.
 788         * tests/squirrelfish: Moved to tests/ubench
 789
 790 2008-04-14  Geoffrey Garen  <ggaren@apple.com>
 791
 792         Reviewed by Maciej Stachowiak.
 793
 794         Removed an unused test.
 795
 796         * tests/squirrelfish/loop-resolve.js: Removed.
 797
 798 2008-04-10  Maciej Stachowiak  <mjs@apple.com>
 799
 800         Reviewed by Oliver.
 801
 802         Add newly runnable tests to --squirrelfish mode.
 803
 804         * tests/LIST-SQUIRRELFISH:
 805
 806 2008-04-06  Geoffrey Garen  <ggaren@apple.com>
 807
 808         Reviewed by Maciej Stachowiak.
 809
 810         A little more love for --squirrelfish mode:
 811
 812         Fixed a misplaced sort. Results properly sort now.
 813
 814         Added a test list just for squirrelfish, and updated it to include
 815         all currently passing SunSpider tests.
 816
 817         Fixed the pruning regexp to match 3d-morph.js.
 818
 819         * sunspider:
 820
 821 2008-03-26  Geoffrey Garen  <ggaren@apple.com>
 822
 823         Reviewed by Oliver Hunt.
 824
 825         --squirrelfish mode: pared down tests for squirrelfish to chew on.
 826
 827         * sunspider:
 828         * tests/LIST:
 829         * tests/squirrelfish: Added.
 830         * tests/squirrelfish/function-closure.js: Added.
 831         * tests/squirrelfish/function-empty.js: Added.
 832         * tests/squirrelfish/function-missing-args.js: Added.
 833         * tests/squirrelfish/function-sum.js: Added.
 834         * tests/squirrelfish/loop-empty-resolve.js: Added.
 835         * tests/squirrelfish/loop-empty.js: Added.
 836         * tests/squirrelfish/loop-resolve.js: Added.
 837         * tests/squirrelfish/loop-sum.js: Added.
 838
 839 2008-03-21  Alexey Proskuryakov  <ap@webkit.org>
 840
 841         Reviewed by Geoff.
 842
 843         * sunspider: Pause update daemon on Darwin to make results reliable
 844         again (workaround for <rdar://problem/5811127>).
 845
 846 2008-02-07  Eric Seidel  <eric@webkit.org>
 847
 848         Reviewed by Sam.
 849
 850         * sunspider: add an error message when ./tests/LIST is not found
 851
 852 2007-12-29  Alp Toker  <alp@atoker.com>
 853
 854         Fix typo.
 855
 856         * hosted/sunspider.html:
 857
 858 2007-12-29  Alp Toker  <alp@atoker.com>
 859
 860         Reviewed by Maciej.
 861
 862         Provide the current URL in the SunSpider results page. Useful for
 863         copying benchmark results out of browsers without a location bar or
 864         where the location bar can't handle long URLs.
 865
 866         * hosted/sunspider-results.html:
 867
 868 2007-12-20  Eric Seidel  <eric@webkit.org>
 869
 870         Reviewed by mjs.
 871
 872         * sunspider: increase default number of runs for more accurate numbers
 873
 874 2007-12-18  Mark Rowe  <mrowe@apple.com>
 875
 876         Fix typo.
 877
 878         * hosted/sunspider.html:
 879
 880 2007-12-18  Maciej Stachowiak  <mjs@apple.com>
 881
 882         Reviewed by Eric.
 883
 884         - give an extra digit of precision for small differences.
 885
 886         * resources/sunspider-compare-results.js:
 887
 888 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 889
 890         Reviewed by Eric.
 891
 892         - work around IE layout bugs
 893
 894         * hosted/sunspider.css:
 895
 896 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 897
 898         Reviewed by Mark.
 899
 900         - fix compare feature
 901
 902         * hosted/sunspider-results.html:
 903
 904 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 905
 906         Reviewed by Mark.
 907
 908         - Change the format of the output URL to be shorter, to meet IE constraints
 909
 910         * hosted/sunspider-driver.html:
 911         * hosted/sunspider-results.html:
 912
 913 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
 914
 915         Reviewed by Oliver.
 916
 917         - Add some explanatory test and a dumb logo to SunSpider web hosted version
 918
 919         * hosted/sunspider-driver.html:
 920         * hosted/sunspider-results.html:
 921         * hosted/sunspider.css:
 922         * hosted/sunspider.html:
 923
 924 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
 925
 926         Reviewed by Oliver.
 927
 928         - Make the web-hosted version of SunSpider look a little bit less drab.
 929
 930         * hosted/sunspider-driver.html:
 931         * hosted/sunspider-results.html:
 932         * hosted/sunspider.css: Added.
 933         * hosted/sunspider.html:
 934         * resources/TEMPLATE.html:
 935
 936 2007-12-12  Maciej Stachowiak  <mjs@apple.com>
 937
 938         Reviewed by Sam.
 939
 940         - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
 941
 942         A sample of what new-style results would look like:
 943
 944         TEST                   COMPARISON            FROM                 TO             DETAILS
 945         ...
 946         ** TOTAL **:           1.41x as fast     6613.6ms +/- 0.1%   4703.0ms +/- 0.1%     significant
 947         ...
 948             3bit-bits-in-byte: *1.36x as slow*     88.8ms +/- 0.6%    121.1ms +/- 0.6%     significant
 949
 950         * resources/sunspider-compare-results.js:
 951
 952 2007-11-14  Eric Seidel  <eric@webkit.org>
 953
 954         Reviewed by Sam.
 955
 956         * sunspider: add --shark-cache for L2 Cache Miss profiling
 957
 958 2007-11-09  Alexey Proskuryakov  <ap@webkit.org>
 959
 960         Reviewed by Darin Adler.
 961
 962         http://bugs.webkit.org/show_bug.cgi?id=15925
 963         SunSpider should check for Shark being installed
 964
 965         * sunspider: Explicitly test that shark command line tool is installed.
 966
 967 2007-11-04  Darin Adler  <darin@apple.com>
 968
 969         * hosted/sunspider.html: Tweaked formatting a bit.
 970
 971 2007-11-03  Maciej Stachowiak  <mjs@apple.com>
 972
 973         Reviewed by Darin Adler.
 974
 975         - Add compare mode and a description of the benchmark to the hosted version.
 976
 977         * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
 978         * hosted/sunspider.html: Added intro text.
 979         * make-hosted: Copy new file.
 980         * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
 981         a function.
 982         * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
 983         expects.
 984         * sunspider-compare-results: Use sunspider-standalone-compare.js.
 985
 986 2007-11-02  Darin Adler  <darin@apple.com>
 987
 988         * sunspider: Changed "--base" to "--set-baseline".
 989
 990 2007-11-02  Darin Adler  <darin@apple.com>
 991
 992         Reviewed by Maciej.
 993
 994         * sunspider: Added a "--base" option that records the current test as a baseline.
 995         Moved the code to find the newest .mshark file into a function (since I needed to use
 996         it in the other script and I prefer to copy/paste a function).
 997
 998         * sunspider-compare-results: Added logic to compare the baseline with the last
 999         run when you don't pass any parameters.
1000
1001 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1002
1003         Reviewed by Eric.
1004
1005         - Added list of ECMAScript3 features that SunSpider does not cover currently.
1006
1007         * UNCOVERED: Added.
1008
1009 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1010
1011         Reviewed by Oliver.
1012
1013         - Give better error messages when sunspider-compare-results fails
1014
1015         * sunspider-compare-results:
1016
1017 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1018
1019         Reviewed by Darin Adler.
1020
1021         - fix Date tests to work in command-line SpiderMonkey
1022
1023         * tests/date-format-tofte.js:
1024         * tests/date-format-xparb.js:
1025
1026 2007-10-29  Darin Adler  <darin@apple.com>
1027
1028         Reviewed by Maciej.
1029
1030         * sunspider: Added --shark20 option, to run Shark at its highest sample
1031         resolution instead of its default.
1032
1033 2007-10-28  Adam Roben  <aroben@apple.com>
1034
1035         Fix SunSpider on Windows
1036
1037         Reviewed by Eric.
1038
1039         * sunspider: Don't use colons in filenames.
1040
1041 2007-10-28  Darin Adler  <darin@apple.com>
1042
1043         Reviewed by Adam.
1044
1045         * resources/sunspider-analyze-results.js: Tweak the output format a little.
1046         Change so that when there's only one run we don't write out confidence
1047         intervals at all rather than writing "NaN" over and over again.
1048
1049         * sunspider: Use the time and date as a suffix on the results file, that way
1050         all the results are left behind in the tmp directory. This will make it easy
1051         for us to add features that compare past results in the future. Also rename
1052         the .mshark files using the same scheme.
1053
1054         * sunspider-compare-results: Relax the parsing rules so we can parse the
1055         results file exactly as it's emitted from sunspider.
1056
1057 2007-10-25  Adam Roben  <aroben@apple.com>
1058
1059         Strip carriage returns from results
1060
1061         Carriage returns were screwing up sunspider-compare-results on
1062         Windows.
1063
1064         Rubberstamped by Oliver.
1065
1066         * sunspider:
1067
1068 2007-10-24  Darin Adler  <darin@apple.com>
1069
1070         Reviewed by Eric.
1071
1072         * sunspider: Open the profile in shark after completing a run.
1073         * sunspider-compare-results: Tiny perl tweaks.
1074
1075 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1076
1077         Reviewed by Darin Adler.
1078
1079         - Don't hardcode my path to testkjs
1080
1081         * sunspider-compare-results:
1082
1083 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1084
1085         Reviewed by Darin Adler.
1086
1087         - Add a compare script to compare results, and improve formatting of standard results a bit.
1088
1089         * resources/sunspider-analyze-results.js:
1090         * resources/sunspider-compare-results.js: Added.
1091         * sunspider-compare-results: Added.
1092
1093 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1094
1095         Reviewed by Darin Adler.
1096
1097         * resources/sunspider-analyze-results.js: Do the error range
1098         properly, using the t-distribution instead of 1.96 (which was
1099         based on the normal distribution).
1100
1101         * sunspider: Print results in a way that will be friendlier to the
1102         soon-to-come compare mode.
1103
1104 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
1105
1106         Reviewed by Review.
1107
1108         - add more tests (probably the final set for now)
1109
1110         Already balanced. Added date, regexp, control flow, and a few
1111         more string and object/array access tests.
1112
1113         * tests/LIST:
1114         * tests/access-fannkuch.js: Added.
1115         * tests/access-nbody.js: Added.
1116         * tests/controlflow-recursive.js: Added.
1117         * tests/date-format-tofte.js: Added.
1118         * tests/date-format-xparb.js: Added.
1119         * tests/regexp-dna.js: Added.
1120         * tests/string-validate-input.js: Added.
1121
1122 2007-10-21  Eric Seidel  <eric@webkit.org>
1123
1124         Reviewed by mjs.
1125
1126         * sunspider: make --shark only sample from testkjs
1127
1128 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
1129
1130         Rubber stamped by Eric.
1131
1132         - added crypto tests (already balanced)
1133
1134         * tests/LIST:
1135         * tests/crypto-aes.js: Added.
1136         * tests/crypto-md5.js: Added.
1137         * tests/crypto-sha1.js: Added.
1138
1139 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
1140
1141         Reviewed by Adam.
1142
1143         - rebalance new tests
1144
1145         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
1146
1147         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1148
1149         This balances them with the existing tests.
1150
1151         * tests/access-binary-trees.js:
1152         * tests/access-nsieve.js:
1153         * tests/bitops-nsieve-bits.js:
1154         * tests/math-partial-sums.js:
1155         * tests/math-spectral-norm.js:
1156         * tests/string-fasta.js:
1157
1158 2007-10-20  Eric Seidel  <eric@webkit.org>
1159
1160         Reviewed by darin.
1161
1162         Add improved argument handling to sunspider, including
1163         --runs=<number>, --tests=<pattern, --shark, and --help
1164         Also re-factor code into subroutines
1165
1166         * sunspider: improved argument handling
1167
1168 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1169
1170         Reviewed by Mark.
1171
1172         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
1173
1174         * TODO:
1175         * tests/LIST:
1176         * tests/access-binary-trees.js: Added.
1177         * tests/access-nsieve.js: Added.
1178         * tests/bitops-nsieve-bits.js: Added.
1179         * tests/math-partial-sums.js: Added.
1180         * tests/math-spectral-norm.js: Added.
1181         * tests/string-fasta.js: Added.
1182
1183 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1184
1185         Reviewed by Darin Adler.
1186
1187         * TODO: Updated to note areas that are now well-covered.
1188
1189         - Change the tests and the driver to avoid leaving large object
1190         graphs hanging around, since that throws off the subsequent tests.
1191
1192         * resources/sunspider-standalone-driver.js:
1193         * tests/3d-cube.js:
1194         * tests/3d-morph.js:
1195         * tests/3d-raytrace.js:
1196         * tests/bitops-bitwise-and.js:
1197         * tests/string-base64.js:
1198         * tests/string-tagcloud.js:
1199
1200 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1201
1202         Reviewed by Nikolas.
1203
1204         - Rebalance test complexity.
1205
1206         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
1207
1208         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1209
1210         However, for some tests, IE7 was a huge outlier compared to other
1211         major browsers. For those tests, I used Firefox 2.0.0.8 on the
1212         same OS and hardware as a normalization basis.
1213
1214         * tests/3d-morph.js:
1215         * tests/3d-raytrace.js:
1216         * tests/bitops-3bit-bits-in-byte.js:
1217         * tests/bitops-bits-in-byte.js:
1218         * tests/bitops-bitwise-and.js:
1219         * tests/math-cordic.js:
1220         * tests/string-base64.js:
1221         * tests/string-tagcloud.js:
1222         * tests/string-unpack-code.js:
1223
1224 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1225
1226         Reviewed by Oliver.
1227
1228         - Fix the browser-hosted driver to be compatible with Safari 2
1229
1230         * hosted/sunspider-driver.html:
1231
1232 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1233
1234         Rubber stamped by Hyatt.
1235
1236         - Add BSD license notice to cordic test, the original author said to do so.
1237
1238         * tests/math-cordic.js:
1239
1240 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1241
1242         Reviewed by Eric.
1243
1244         - Support Windows and Windows browsers.
1245
1246         * hosted/sunspider-results.html: Display results correctly in IE.
1247         * sunspider: tweaks to work on Windows, and with spaces in the path.
1248
1249 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1250
1251         Rubber stamped by Oliver.
1252
1253         * tests/string-tagcloud.js: Remove stray print()
1254
1255 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
1256
1257         Reviewed by Oliver.
1258
1259         Add some string test cases.
1260
1261         * tests/string-base64.js: Added. Does base64 encoding and decoding.
1262         * tests/string-tagcloud.js: Added. Parses a JSON string and
1263         generates tagcloud HTML markup based on the data.
1264         * tests/string-unpack-code.js: Added. Unpack compressed versions of
1265         four of the most popular JavaScript libraries.
1266         * tests/LIST: Added the new tests.
1267
1268 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
1269
1270         Reviewed by Anders.
1271
1272         * TODO: Updated with info on how to do the stats properly.
1273
1274         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
1275         avoid overly slowing down the benchmark.
1276
1277         Added some 3D-related test cases.
1278
1279         * tests/3d-cube.js: Added.
1280         * tests/3d-morph.js: Added.
1281         * tests/3d-raytrace.js: Added.
1282         * tests/LIST:
1283
1284 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
1285
1286         Reviewed by Darin Adler.
1287
1288         - New JavaScript benchmark
1289         http://bugs.webkit.org/show_bug.cgi?id=15515
1290
1291         A start on a new JavaScript benchmark, with standalone and
1292         browser-hosted drivers.
1293
1294         The test content is still incomplete and the drivers could use
1295         some more features but there is enough here to make a good start.
1296
1297         The drivers compute a 95% confidence interval on the mean for the
1298         whole test, each category, and each individual test to make it
1299         easier to tell whether differences are statistically
1300         significant. The confidence interval can be narrowed by running
1301         the test more times.
1302
1303         * TODO: Added. Remaining things that need to be done.
1304         * sunspider: Added. Perl script that acts as the standalone test driver.
1305         * resources/sunspider-standalone-driver.js: Added. JavaScript part
1306         of standalone test driver.
1307         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
1308         analysis code.
1309         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
1310         * make-hosted: Added. Script to generate browser-hosted tests.
1311         * hosted/sunspider.html: Added. Start page for browser-hosted test.
1312         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
1313         * hosted/sunspider-results.html: Added. Results page for browser-hosted
1314         tests.
1315         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
1316         tests.
1317         * tests/LIST: Added. List of tests to use.
1318         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
1319         * tests/bitops-bits-in-byte.js: Added. Ditto.
1320         * tests/bitops-bitwise-and.js: Added. Ditto.
1321         * tests/math-cordic.js: Added. Ditto.
1322