PerformanceTests/SunSpider/ChangeLog

   1 2013-09-26  Geoffrey Garen  <ggaren@apple.com>
   2
   3         Fixed a version number string in SunSpider 1.0.2
   4         https://bugs.webkit.org/show_bug.cgi?id=122004
   5
   6         Reviewed by Gavin Barraclough.
   7
   8         * resources/driver-TEMPLATE.html:
   9         * resources/results-TEMPLATE.html: 1.0.2!
  10
  11 2013-09-26  Geoffrey Garen  <ggaren@apple.com>
  12
  13         Tentative SunSpider 1.0.2
  14         https://bugs.webkit.org/show_bug.cgi?id=122002
  15
  16         Reviewed by Gavin Barraclough.
  17
  18         Be even more aggressive about asking for zero delay between tests by
  19         setting a timeout at the beginning of a test instead of the end. This is
  20         another step toward reducing noise -- particularly noise caused by
  21         power management -- just like the step down from 10ms to 0ms.
  22
  23         Browsers typically put a 4ms floor on timers. The sooner we set
  24         our timer, the sooner it will fire.
  25
  26         * make-hosted:
  27         * resources/driver-TEMPLATE.html: Changed the driver to set the timeout
  28         earlier.
  29         * tests/sunspider-1.0.2: Added. These tests are unchanged from 1.0.1.
  30
  31 2013-09-09  Filip Pizlo  <fpizlo@apple.com>
  32
  33         Stress tests should test the jsc profiler (-p)
  34         https://bugs.webkit.org/show_bug.cgi?id=121043
  35
  36         Reviewed by Mark Hahnenberg.
  37
  38         Add a jsc-stress-test that tries to profile SunSpider.
  39
  40         * profiler-test.yaml: Added.
  41
  42 2013-08-08  Cosmin Truta  <ctruta@blackberry.com>
  43
  44         SunSpider: Move the 3d-morph fix from version 1.0 to version 1.0.1
  45         https://bugs.webkit.org/show_bug.cgi?id=117993
  46
  47         Reviewed by George Staikos.
  48
  49         Bump the SunSpider version to 1.0.1.
  50
  51         Unroll r149548 in order to restore version 1.0 to its original,
  52         and add the 3d-morph fix to version 1.0.1 instead.
  53
  54         * hosted/sunspider.html: Updated to version 1.0.1.
  55         * hosted/versions.html: Updated to version 1.0.1.
  56         * make-hosted: Added support for version 1.0.1.
  57         * resources/driver-TEMPLATE.html: Updated to version 1.0.1.
  58         * resources/results-TEMPLATE.html: Updated to version 1.0.1.
  59         * sunspider: Updated to version 1.0.1.
  60         * sunspider-compare-results: Updated to version 1.0.1.
  61         * tests/sunspider-1.0/3d-morph.js: Rolled back to the original version.
  62         * tests/sunspider-1.0.1/LIST: Added.
  63         * tests/sunspider-1.0.1/3d-cube.js: Added.
  64         * tests/sunspider-1.0.1/3d-morph.js: Added.
  65         * tests/sunspider-1.0.1/3d-raytrace.js: Added.
  66         * tests/sunspider-1.0.1/access-binary-trees.js: Added.
  67         * tests/sunspider-1.0.1/access-fannkuch.js: Added.
  68         * tests/sunspider-1.0.1/access-nbody.js: Added.
  69         * tests/sunspider-1.0.1/access-nsieve.js: Added.
  70         * tests/sunspider-1.0.1/bitops-3bit-bits-in-byte.js: Added.
  71         * tests/sunspider-1.0.1/bitops-bits-in-byte.js: Added.
  72         * tests/sunspider-1.0.1/bitops-bitwise-and.js: Added.
  73         * tests/sunspider-1.0.1/bitops-nsieve-bits.js: Added.
  74         * tests/sunspider-1.0.1/controlflow-recursive.js: Added.
  75         * tests/sunspider-1.0.1/crypto-aes.js: Added.
  76         * tests/sunspider-1.0.1/crypto-md5.js: Added.
  77         * tests/sunspider-1.0.1/crypto-sha1.js: Added.
  78         * tests/sunspider-1.0.1/date-format-tofte.js: Added.
  79         * tests/sunspider-1.0.1/date-format-xparb.js: Added.
  80         * tests/sunspider-1.0.1/math-cordic.js: Added.
  81         * tests/sunspider-1.0.1/math-partial-sums.js: Added.
  82         * tests/sunspider-1.0.1/math-spectral-norm.js: Added.
  83         * tests/sunspider-1.0.1/regexp-dna.js: Added.
  84         * tests/sunspider-1.0.1/string-base64.js: Added.
  85         * tests/sunspider-1.0.1/string-fasta.js: Added.
  86         * tests/sunspider-1.0.1/string-tagcloud.js: Added.
  87         * tests/sunspider-1.0.1/string-unpack-code.js: Added.
  88         * tests/sunspider-1.0.1/string-validate-input.js: Added.
  89
  90 2013-05-03  Cosmin Truta  <ctruta@blackberry.com>
  91
  92         SunSpider 1.0: 3d-morph: use epsilon to check result
  93         https://bugs.webkit.org/show_bug.cgi?id=115553
  94
  95         Reviewed by George Staikos.
  96
  97         SunSpider/3d-morph should be more lenient in validating its results, since they depend on Math.sin, which isn't formally specified.
  98
  99         * tests/sunspider-1.0/3d-morph.js:
 100
 101 2013-04-19  Filip Pizlo  <fpizlo@apple.com>
 102
 103         SunSpider/string-tagcloud should be more lenient in validating its results, since they depend on Math.log, which isn't formally specified
 104         https://bugs.webkit.org/show_bug.cgi?id=114895
 105
 106         Reviewed by Michael Saboff.
 107
 108         * tests/sunspider-1.0/string-tagcloud.js:
 109
 110 2013-04-18  Filip Pizlo  <fpizlo@apple.com>
 111
 112         Whenever it is cheap and non-invasive, SunSpider tests should validate their results to ensure that the browser runs them correctly
 113         https://bugs.webkit.org/show_bug.cgi?id=114852
 114
 115         Reviewed by Geoffrey Garen.
 116
 117         This adds low-overhead checking of the results of each SunSpider tests. This is not
 118         meant to be an exhaustive test that everything was executed correctly, but rather a
 119         simple sanity check that will catch glaring mistakes. The philosophy here is that we're
 120         not trying to prevent all forms of cheating, or that we're trying to prove the
 121         browser's correctness. Moreover, these checks are meant to incur minimal overhead;
 122         they currently clock in at <2% slow-down in SunSpider 1.0.
 123
 124         The test expectations were generated using the LLInt on command-line, and I've verified
 125         that Firefox 20, Chrome 26, IE 10, Safari 6, and ToT with all of the JITs agree. Note
 126         that some tests cannot be precisely validated because they use Math functions, which
 127         ECMAScript chooses to not formally specify - those functions like sin() and friends are
 128         allowed to return implementation-dependent results. Also some tests cannot be validated
 129         at all because their behavior is either intentionally random or is timezone-dependent.
 130         But 23 out of 26 tests now have some kind of validation.
 131
 132         I've updated the harnesses to show erroneous runs when displaying results.
 133
 134         * resources/TEMPLATE.html:
 135         * resources/driver-TEMPLATE.html:
 136         * resources/sunspider-analyze-results.js:
 137         (formatResult):
 138         (resultLine):
 139         (printOutput):
 140         * resources/sunspider-compare-results.js:
 141         (.formatMean):
 142         (.resultLine):
 143         (.printOutput):
 144         (sunspiderCompareResults):
 145         * resources/sunspider-standalone-driver.js:
 146         * tests/sunspider-1.0/3d-cube.js:
 147         (Init):
 148         * tests/sunspider-1.0/3d-morph.js:
 149         * tests/sunspider-1.0/3d-raytrace.js:
 150         * tests/sunspider-1.0/access-binary-trees.js:
 151         * tests/sunspider-1.0/access-fannkuch.js:
 152         * tests/sunspider-1.0/access-nbody.js:
 153         * tests/sunspider-1.0/access-nsieve.js:
 154         (sieve):
 155         * tests/sunspider-1.0/bitops-3bit-bits-in-byte.js:
 156         * tests/sunspider-1.0/bitops-bits-in-byte.js:
 157         * tests/sunspider-1.0/bitops-bitwise-and.js:
 158         * tests/sunspider-1.0/bitops-nsieve-bits.js:
 159         * tests/sunspider-1.0/controlflow-recursive.js:
 160         * tests/sunspider-1.0/crypto-aes.js:
 161         * tests/sunspider-1.0/crypto-md5.js:
 162         * tests/sunspider-1.0/crypto-sha1.js:
 163         * tests/sunspider-1.0/date-format-tofte.js:
 164         * tests/sunspider-1.0/date-format-xparb.js:
 165         * tests/sunspider-1.0/math-cordic.js:
 166         * tests/sunspider-1.0/math-partial-sums.js:
 167         (partial):
 168         * tests/sunspider-1.0/math-spectral-norm.js:
 169         * tests/sunspider-1.0/regexp-dna.js:
 170         * tests/sunspider-1.0/string-base64.js:
 171         * tests/sunspider-1.0/string-fasta.js:
 172         (fastaRepeat):
 173         (fastaRandom):
 174         * tests/sunspider-1.0/string-tagcloud.js:
 175         * tests/sunspider-1.0/string-unpack-code.js:
 176         * tests/sunspider-1.0/string-validate-input.js:
 177
 178 2013-04-11  Filip Pizlo  <fpizlo@apple.com>
 179
 180         Get rid of the 10ms delay between test executions
 181         https://bugs.webkit.org/show_bug.cgi?id=114458
 182         <rdar://problem/13631112>
 183
 184         Reviewed by Darin Adler and Geoffrey Garen.
 185
 186         More details on this in the bug. Long story short, I don't know why the 10ms delay is
 187         there, and it appears to be the root of some noisyness and unreliability in the results.
 188         Removing it makes results more consistent, which is a good thing.
 189
 190         * resources/driver-TEMPLATE.html:
 191
 192 2013-01-16  Eric Seidel  <eric@webkit.org>
 193
 194         Remove --shark* support from sunspider/run-sunspider now that Shark is dead
 195         https://bugs.webkit.org/show_bug.cgi?id=99512
 196
 197         Reviewed by Darin Adler.
 198
 199         I tried to use --instruments, but that also seems broken (in the same way before/after this patch).
 200
 201         * sunspider:
 202         (runTestsOnce):
 203
 204 2012-08-02  Filip Pizlo  <fpizlo@apple.com>
 205
 206         Unreviewed, revert debugging stuff I landed in http://trac.webkit.org/changeset/124557
 207         by accident.
 208
 209         * tests/v8-v6/v8-crypto.js:
 210         (am1):
 211         (am2):
 212         (am3):
 213         (am4):
 214         (bnpCopyTo):
 215         (bnpFromString):
 216         (bnpClamp):
 217
 218 2012-03-11  Maciej Stachowiak  <mjs@apple.com>
 219
 220         Add --instruments option to sunspider to profile with Instruments
 221         https://bugs.webkit.org/show_bug.cgi?id=80783
 222
 223         Reviewed by Filip Pizlo.
 224
 225         * resources/TimeProfile20us.tracetemplate: Added.
 226         * sunspider:
 227         (runTestsOnce):
 228
 229 2011-11-15  Andy Wingo  <wingo@igalia.com>
 230
 231         Extend sunspider driver to be able to run kraken
 232         https://bugs.webkit.org/show_bug.cgi?id=71799
 233
 234         Reviewed by Filip Pizlo.
 235
 236         * resources/sunspider-standalone-driver.js: Try to load a -data
 237         file.  If that succeeds, we have a kraken-like test, so we time
 238         the test using `load'.  Otherwise fall back to using `run'.
 239
 240 2011-08-11  Mark Rowe  <mrowe@apple.com>
 241
 242         Fix sunspider-compare-results to default to the same suite version as the sunspider script.
 243
 244         Rubber-stamped by Maciej Stachowiak.
 245
 246         * sunspider-compare-results:
 247
 248 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
 249
 250         Update SunSpider versioning to 1.0
 251         https://bugs.webkit.org/show_bug.cgi?id=63870
 252
 253         Reviewed by Dan Bernstein.
 254
 255         * hosted/sunspider.html:
 256         * hosted/versions.html:
 257         * resources/driver-TEMPLATE.html:
 258         * resources/results-TEMPLATE.html:
 259         * sunspider:
 260
 261 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
 262
 263         Sunspider 0.9.1 harness doesn't actually close() its test documents
 264         https://bugs.webkit.org/show_bug.cgi?id=47045
 265
 266         Reviewed by Daniel Bates.
 267
 268         * hosted/versions.html:
 269         * resources/driver-TEMPLATE.html:
 270
 271 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
 272
 273         Not Reviewed.
 274
 275         Fix obviou typo in previous commit.
 276
 277         * tests/sunspider-1.0/bitops-bitwise-and.js:
 278
 279 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
 280
 281         Reviewed by Anders Carlsson.
 282
 283         SunSpider: all four bitops benchmarks can be replaced with NOP
 284         https://bugs.webkit.org/show_bug.cgi?id=38446
 285
 286         * tests/sunspider-1.0/bitops-3bit-bits-in-byte.js:
 287         (TimeFunc): Save the result.
 288         * tests/sunspider-1.0/bitops-bits-in-byte.js:
 289         (TimeFunc): Save the result.
 290         * tests/sunspider-1.0/bitops-bitwise-and.js: More explicitly
 291         save the results.
 292         * tests/sunspider-1.0/bitops-nsieve-bits.js:
 293         (sieve): Save the result.
 294
 295 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
 296
 297         SunSpider: string-validate-input.js uses an undeclared variable named 'name', which is a DOM API
 298         https://bugs.webkit.org/show_bug.cgi?id=60937
 299
 300         Reviewed by Dan Bernstein.
 301
 302         * tests/sunspider-1.0/string-validate-input.js:
 303         (doTest): Rename the variable to username
 304
 305 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
 306
 307         Reviewed by Darin Adler.
 308
 309         SunSpider: The main function of math-cordic is dead code
 310         https://bugs.webkit.org/show_bug.cgi?id=63863
 311
 312         Try to prevent math-cordic from being eliminated as dead code or
 313         compiled down to a constant.
 314
 315         * tests/sunspider-1.0/math-cordic.js:
 316         (cordicsincos):
 317         (cordic):
 318
 319 2011-06-30  Maciej Stachowiak  <mjs@apple.com>
 320
 321         Reviewed by Adam Barth.
 322
 323         Create sunspider-1.0 directory in preparation for fixing a bunch of bugs
 324         https://bugs.webkit.org/show_bug.cgi?id=63782
 325
 326         * make-hosted: Learn about the new directory.
 327         * tests/sunspider-1.0: Copied from PerformanceTests/SunSpider/tests/sunspider-0.9.1.
 328
 329 2010-11-29  Geoffrey Garen  <ggaren@apple.com>
 330
 331         Reviewed by Gavin Barraclough.
 332
 333         Improved accuracy of command-line SunSpider.
 334
 335         * resources/sunspider-standalone-driver.js: Use the returned number of
 336         elapsed milliseconds from "run" and "checkSyntax" instead of measuring
 337         ourselves, for slightly more accurate numbers.
 338
 339 2010-09-16  Gavin Barraclough  <barraclough@apple.com>
 340
 341         Reviewed by Mark Rowe.
 342         https://bugs.webkit.org/show_bug.cgi?id=45924
 343
 344         Modify the SunSpider harness to allow a path to be passed to the --suite
 345         argument, supress the normal prepend-"tests/" behaviour for suite names
 346         containing a '/'.
 347
 348         Also wrap the code in an anonymous function to move variables out of global
 349         scope (currently the harness cannot handle running tests the overwrite the
 350         variable 'j').
 351
 352         * resources/sunspider-standalone-driver.js:
 353         * sunspider:
 354
 355 2010-08-27  Michael Saboff  <msaboff@apple.com>
 356
 357         Reviewed by Stephanie Lewis.
 358
 359         Added version 5 and version 6 of V8 tests with modifications similar
 360         to the version 4 tests so they'll work with the SunSpider test harness.
 361         Note that these files are external source and therefore don't conform
 362         to WebKit coding standards.
 363         https://bugs.webkit.org/show_bug.cgi?id=44638
 364
 365         * tests/v8-v5: Added.
 366         * tests/v8-v5/LIST: Added.
 367         * tests/v8-v5/v8-crypto.js: Added.
 368         * tests/v8-v5/v8-deltablue.js: Added.
 369         * tests/v8-v5/v8-earley-boyer.js: Added.
 370         * tests/v8-v5/v8-raytrace.js: Added.
 371         * tests/v8-v5/v8-regexp.js: Added.
 372         * tests/v8-v5/v8-richards.js: Added.
 373         * tests/v8-v5/v8-splay.js: Added.
 374         * tests/v8-v6: Added.
 375         * tests/v8-v6/LIST: Added.
 376         * tests/v8-v6/v8-crypto.js: Added.
 377         * tests/v8-v6/v8-deltablue.js: Added.
 378         * tests/v8-v6/v8-earley-boyer.js: Added.
 379         * tests/v8-v6/v8-raytrace.js: Added.
 380         * tests/v8-v6/v8-regexp.js: Added.
 381         * tests/v8-v6/v8-richards.js: Added.
 382         * tests/v8-v6/v8-splay.js: Added.
 383
 384 2010-07-15  Stephanie Lewis  <slewis@apple.com>
 385
 386         Reviewed by Geoff Garen.
 387
 388         http://bugs.webkit.org/show_bug.cgi?id=42406
 389         Output location of results file.
 390
 391         * sunspider:
 392
 393 2010-05-17  Maciej Stachowiak  <mjs@apple.com>
 394
 395         Reviewed by Mark Rowe.
 396
 397         Browser-hosted version of SunSpider runs tests twice as many times as advertised
 398         https://bugs.webkit.org/show_bug.cgi?id=39201
 399
 400         * make-hosted: Make sure to reset test list after every test suite.
 401
 402 2010-05-07  Adam Roben  <aroben@apple.com>
 403
 404         Fix typo in sunspider-compare-results.js that caused incorrect
 405         two-sample t statistics to be computed
 406
 407         Fixes <http://webkit.org/b/38768> SunSpider computes incorrect
 408         two-sample t statistics
 409
 410         Reviewed by Darin Adler.
 411
 412         * resources/sunspider-compare-results.js:
 413         (sunspiderCompareResults.resultLine): Fixed the calculation of the t
 414         variable to match the definition of a two-sample t statistic. Looks
 415         like this was just a simple typo.
 416
 417 2010-04-05  Darin Adler  <darin@apple.com>
 418
 419         Updated the ignore property for changes to the contents here.
 420
 421         * .: Modified property svn:ignore.
 422
 423 2010-02-20  Maciej Stachowiak  <mjs@apple.com>
 424
 425         Reviewed by Adam Barth.
 426
 427         Add sunspider-0.9.1 to the site in preparation for announcing it.
 428         https://bugs.webkit.org/show_bug.cgi?id=35206
 429
 430         * hosted/sunspider.css: Remove tabs, which I noticed where present while
 431         copying to the WebKitSite directory.
 432
 433 2010-01-11  Oliver Hunt  <oliver@apple.com>
 434
 435         Reviewed by Darin Adler.
 436
 437         Sunspider parse-only tests don't run
 438         https://bugs.webkit.org/show_bug.cgi?id=33489
 439
 440         Fix parse-only test list
 441
 442         * tests/parse-only/LIST:
 443
 444 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
 445
 446         Reviewed by Adele Peterson.
 447
 448         Make SunSpider version more prominent in the title
 449         https://bugs.webkit.org/show_bug.cgi?id=32574
 450
 451         * hosted/sunspider.html:
 452         * hosted/versions.html:
 453         * resources/driver-TEMPLATE.html:
 454         * resources/results-TEMPLATE.html:
 455
 456 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
 457
 458         Reviewed by Darin Adler.
 459
 460         Make SunSpider refuse to compare results across content versions
 461         https://bugs.webkit.org/show_bug.cgi?id=32573
 462
 463         The results URL now includes a version indicator, and compare mode
 464         will refuse to compare between versions.
 465
 466         * resources/driver-TEMPLATE.html:
 467         * resources/results-TEMPLATE.html:
 468
 469 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
 470
 471         Reviewed by Darin Adler.
 472
 473         Some Browser-hosted SunSpider files are not valid HTML5
 474         https://bugs.webkit.org/show_bug.cgi?id=32536
 475
 476         Made various fixes to validate as HTML5 with no warnings (mainly removing bogus
 477         close tags and adding a meta charset declaration).
 478
 479         * hosted/sunspider.html:
 480         * hosted/versions.html:
 481         * resources/TEMPLATE.html:
 482         * resources/driver-TEMPLATE.html:
 483         * resources/results-TEMPLATE.html:
 484
 485 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
 486
 487         Reviewed by Eric Seidel.
 488
 489         Make sunspider-0.9.1 the default content set (both command-line and hosted)
 490         https://bugs.webkit.org/show_bug.cgi?id=32537
 491
 492         * hosted/sunspider.html: Change default suite link.
 493         * sunspider: Change default suite.
 494         * sunspider-compare-results: Likewise.
 495
 496 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
 497
 498         Reviewed by Sam Weinig.
 499
 500         in-browser SunSpider suffers excessive penalty under power management
 501         https://bugs.webkit.org/show_bug.cgi?id=32505
 502
 503         I have made a few changes to address this:
 504
 505         1) Change how browser-hosted SunSpider loads tests - preload the content and write it in with
 506         document.write to reduce triggering of progress UI.
 507         2) Reduce time between tests to 10ms from 500ms, so that power management doesn't keep the CPU
 508         stepped all the way down the whole time.
 509         3) Run the test cycle an extra time for warmup before the runs that count.
 510
 511         * hosted/sunspider-record-result.js: Removed.
 512         * make-hosted:
 513         * resources/TEMPLATE.html:
 514         * resources/driver-TEMPLATE.html:
 515
 516 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
 517
 518         Reviewed by Gavin Barraclough.
 519
 520         SunSpider/tests/string-base64.js does not compute a valid base64 encoded string
 521         https://bugs.webkit.org/show_bug.cgi?id=16806
 522
 523         Based on a patch by Eric Seidel.
 524
 525         Fix the base64 computation to actually compute correct results. The impact on runtime of
 526         the test is pretty small, but noticeable for some browsers. But at least it's not
 527         doing a wrong and meaningless computation any more.
 528
 529         * tests/sunspider-0.9.1/string-base64.js:
 530         ():
 531         (base64ToString):
 532
 533 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
 534
 535         Fixing commit error...
 536
 537         I accidentally committed my last patch in a form that broke Web-hosted SunSpider. Fixing.
 538
 539         * resources/driver-TEMPLATE.html:
 540
 541 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
 542
 543         Reviewed by Sam Weinig.
 544
 545         Use JSON.parse instead of eval for Web-hosted SunSpider results processing
 546         https://bugs.webkit.org/show_bug.cgi?id=32490
 547
 548         * hosted/json2.js: Added. Incorporated from json.org
 549         * resources/driver-TEMPLATE.html: Fix an HTML validation bug I noticed.
 550         * resources/results-TEMPLATE.html: Use JSON.parse instead of eval to process
 551         results.
 552
 553 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
 554
 555         Reviewed by Oliver Hunt.
 556
 557         Enable Web-hosted version of SunSpider to handle multiple versions
 558         https://bugs.webkit.org/show_bug.cgi?id=32478
 559
 560         * make-hosted: Now generate the hosted version to be able to run both the
 561         0.9 and the 0.9.1 test suites.
 562         * hosted: Modified property svn:ignore.
 563         * hosted/sunspider-driver.html: Removed.
 564         * hosted/sunspider-results.html: Removed.
 565         * hosted/sunspider.html:
 566         * hosted/versions.html: Added.
 567         * resources/TEMPLATE.html:
 568         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-driver.html.
 569         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-results.html.
 570
 571 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
 572
 573         Reviewed by Oliver Hunt.
 574
 575         Give command-line sunspider the ability to handle multiple suites and versions
 576         https://bugs.webkit.org/show_bug.cgi?id=32477
 577
 578         Each suite/version's set of tests are now in a separate subdirectory of tests/, with a file named LIST
 579         enumerating the tests. Current suites are:
 580
 581         sunspider-0.9 - riginal SunSpider content
 582         sunspider-0.9.1 - SunSpider suite with a few tests fixed (and a few more to come)
 583         ubench - "ubench" microbenchmark suite
 584         v8-v4 - version 4 of the v8 benchmark
 585         parse-only - some parser tests
 586
 587         Sunspider can now be run with the --suite= parameter to select a
 588         suite. The default is --suite=sunspider-0.9.
 589
 590         * .: Modified property svn:ignore to ignore new results directories.
 591         * make-hosted: Generate based on sunspider-0.9 suite.
 592         * resources/TEMPLATE.html: Fix an HTML compliance problem.
 593         * resources/sunspider-standalone-driver.js: Become aware of suite names.
 594         * sunspider: Modified to handle multiple suites as described above.
 595         * sunspider-compare-results: ditto
 596         * tests/LIST: Moved to tests/sunspider-0.9/ and tests/sunspider-0.9.1/
 597         * tests/LIST-PARSE-ONLY: Moved to parse-only/LIST
 598         * tests/LIST-UBENCH: Removed.
 599         * tests/LIST-V8: Removed.
 600         * tests/3d-cube.js: Moved to tests/sunspider-0.9 and tests/sunspider-0.9.1
 601         * tests/3d-morph.js: ditto
 602         * tests/3d-raytrace.js: ditto
 603         * tests/access-binary-trees.js: ditto
 604         * tests/access-fannkuch.js: ditto
 605         * tests/access-nbody.js: ditto
 606         * tests/access-nsieve.js: ditto
 607         * tests/bitops-3bit-bits-in-byte.js: ditto
 608         * tests/bitops-bits-in-byte.js: ditto
 609         * tests/bitops-bitwise-and.js: ditto
 610         * tests/bitops-nsieve-bits.js: ditto
 611         * tests/controlflow-recursive.js: ditto
 612         * tests/crypto-aes.js: ditto
 613         * tests/crypto-md5.js: ditto
 614         * tests/crypto-sha1.js: ditto
 615         * tests/date-format-tofte.js: ditto
 616         * tests/date-format-xparb.js: ditto
 617         * tests/math-cordic.js: ditto
 618         * tests/math-partial-sums.js: ditto
 619         * tests/math-spectral-norm.js: ditto
 620         * tests/regexp-dna.js: ditto
 621         * tests/string-base64.js: ditto
 622         * tests/string-fasta.js: ditto
 623         * tests/string-tagcloud.js: ditto
 624         * tests/string-unpack-code.js: ditto
 625         * tests/string-validate-input.js: ditto
 626         * tests/sunspider-0.9/: Added
 627         * tests/sunspider-0.9/*.js: Moved from one level up
 628         * tests/sunspider-0.9.1: Added.
 629         * tests/sunspider-0.9.1/*.js: Moved from one level up.
 630         * tests/v8-crypto.js: Moved to v8-v4/ directory.
 631         * tests/v8-deltablue.js: ditto
 632         * tests/v8-earley-boyer.js: ditto
 633         * tests/v8-raytrace.js: ditto
 634         * tests/v8-regexp.js: ditto
 635         * tests/v8-richards.js: ditto
 636         * tests/v8-splay.js: ditto
 637         * tests/v8-v4: Added.
 638
 639 2009-09-30  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
 640
 641         Reviewed by Darin Adler.
 642
 643         Platform specific null device replaced with a platform independent.
 644         https://bugs.webkit.org/show_bug.cgi?id=29544
 645
 646         * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL.
 647
 648 2009-09-21  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
 649
 650         Reviewed by Maciej Stachowiak.
 651
 652         [Qt] Make sunspider script work on Windows platform.
 653         https://bugs.webkit.org/show_bug.cgi?id=29544
 654
 655         * sunspider:
 656         Using platform specific null device instead of /dev/null.
 657
 658 2009-06-19  Adam Treat  <adam.treat@torchmobile.com>
 659
 660         Reviewed by Oliver Hunt.
 661
 662         https://bugs.webkit.org/show_bug.cgi?id=26540
 663         Currently the SunSpider test driver lacks an option to run a test suite that
 664         will test JavaScriptCore parsing performance only.  This patch adds just such
 665         a test suite and option to SunSpider as well as the jsc test shell.  I've included
 666         three large javascript source files found in the wild: jquery, mootools and prototype.
 667         Combined with the concatenation of all three, these form a new testsuite to measure
 668         and test pure JavaScriptCore parsing performance.
 669
 670         * resources/sunspider-standalone-driver.js:
 671           Load the js with parse-only flag if it is part of the parse-only suite.
 672         * sunspider:
 673           Add the parse-only suite to the list of options.
 674         * sunspider-compare-results:
 675           Add the parse-only suite to the list of options.
 676         * tests/LIST-PARSE-ONLY: Added.
 677         * tests/parse-only/concat-jquery-mootools-prototype.js: Added.
 678           A very large concatenation of the scripts found below.  This js takes ~30ms to parse on my machine.
 679         * tests/parse-only/jquery-1.3.2.js: Added.
 680           Latest version from jquery.com.
 681         * tests/parse-only/mootools-1.2.2-core-nc.js: Added.
 682           Latest version from mootools.net.
 683         * tests/parse-only/prototype-1.6.0.3.js: Added.
 684           Latest version from prototypejs.org.
 685
 686 2009-06-13  Steve Falkenburg  <sfalken@apple.com>
 687
 688         Update V8 benchmark to version 4.
 689
 690         Reviewed by Cameron Zwarich.
 691
 692         * tests/LIST-V8:
 693         * tests/v8-crypto.js:
 694         * tests/v8-deltablue.js:
 695         * tests/v8-earley-boyer.js:
 696         * tests/v8-raytrace.js:
 697         * tests/v8-regexp.js: Added.
 698         * tests/v8-richards.js:
 699         * tests/v8-splay.js: Added.
 700
 701 2009-05-26  Olivier DOLE  <odole@pleyo.com>
 702
 703         Reviewed by Maciej.
 704
 705         Store sunspider test suite results in a specific directory for each
 706         different type of benchmark (sunspider, V8 or ubench).
 707
 708         * sunspider:
 709         * sunspider-compare-results:
 710
 711 2009-05-12  Steve Falkenburg  <sfalken@apple.com>
 712
 713         Build fix.
 714
 715         * SunSpider.make:
 716
 717 2009-05-11  Steve Falkenburg  <sfalken@apple.com>
 718
 719         Include SunSpider tests in production builds.
 720
 721         Reviewed by Adam Roben.
 722
 723         * SunSpider.make: Added.
 724         * xcopy.excludes: Added.
 725
 726 2009-03-04  Oliver Hunt  <oliver@apple.com>
 727
 728         Added a few more tests to ubench
 729
 730         RS=Gavin Barraclough
 731
 732         Adding a couple of test to cover too few and too many arguments.  This
 733         is needed to prevent regressions in all call paths from my current refactoring.
 734
 735         * tests/LIST-UBENCH:
 736         * tests/ubench/function-correct-args.js: Added.
 737         (f):
 738         * tests/ubench/function-excess-args.js: Added.
 739         (f):
 740
 741 2008-10-30  Zoltan Horvath  <Horvath.Zoltan.6@stud.u-szeged.hu>
 742
 743         Fix a bug where when V8's or UBENCH's test suite list file is missing
 744         the error message is suggesting that SunSpider's list file is missing.
 745
 746         Reviewed by Sam Weinig.
 747
 748         * sunspider:
 749         (loadTestsList): Fix the error message to use the right list name.
 750
 751 2008-10-07  David Hyatt  <hyatt@apple.com>
 752
 753         https://bugs.webkit.org/show_bug.cgi?id=18989
 754
 755         Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
 756         we want all browsers to be doing the same thing on the test.
 757
 758         Reviewed by Maciej
 759
 760         * tests/regexp-dna.js:
 761
 762 2008-09-09  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 763
 764         Rubber-stamped by Maciej Stachowiak.
 765
 766         The bleeding edge branch of V8 now supports passing fileanmes after
 767         '-f', so the SunSpider script should be changed to do this again.
 768         This allows all 3 major JavaScript engines to be used with the
 769         unmodified SunSpider script.
 770
 771         * sunspider:
 772
 773 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 774
 775         Reviewed by Maciej Stachowiak.
 776
 777         Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
 778         and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
 779         correct the punctuation in its documentation.
 780
 781         * sunspider:
 782
 783 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 784
 785         Reviewed by Oliver Hunt.
 786
 787         Bug 20616: Incorporate V8 benchmarks in testing
 788         <https://bugs.webkit.org/show_bug.cgi?id=20616>
 789
 790         This is a first attempt at running the V8 benchmarks within SunSpider,
 791         with the --v8 option. The number of iterations is fixed for each
 792         benchmark, and was chosen to make each of the benchmarks run between
 793         500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
 794
 795         * sunspider:
 796         * tests/LIST-V8: Added.
 797         * tests/v8-crypto.js: Added.
 798         * tests/v8-deltablue.js: Added.
 799         * tests/v8-earley-boyer.js: Added.
 800         * tests/v8-raytrace.js: Added.
 801         * tests/v8-richards.js: Added.
 802
 803 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 804
 805         Not reviewed.
 806
 807         Remove a local change that was accidentally committed in r36034.
 808
 809         * resources/sunspider-standalone-driver.js:
 810
 811 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 812
 813         Rubber-stamped by Oliver Hunt.
 814
 815         Make SunSpider work with JavaScript shells that don't take filenames
 816         after a '-f' argument.
 817
 818         * sunspider:
 819
 820 2008-06-07  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 821
 822         Reviewed by Timothy.
 823
 824         Remove the --squirrelfish option from SunSpider, as it is no longer needed.
 825
 826         * sunspider:
 827         * tests/LIST-SQUIRRELFISH: Removed.
 828
 829 2008-06-03  Alexey Proskuryakov  <ap@webkit.org>
 830
 831         Rubber-stamped by Mark Rowe.
 832
 833         Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
 834
 835         * sunspider:
 836
 837 2008-04-15  Maciej Stachowiak  <mjs@apple.com>
 838
 839         Rubber stamped by Oliver.
 840
 841         - add newly working tests to squirrelfish list
 842
 843         * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
 844
 845 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 846
 847         Rubber stamped by Oliver.
 848
 849         - move ubench tests properly.
 850
 851         * tests/ubench: Added.
 852         * tests/ubench/function-closure.js: Added.
 853         * tests/ubench/function-empty.js: Added.
 854         * tests/ubench/function-missing-args.js: Added.
 855         * tests/ubench/function-sum.js: Added.
 856         * tests/ubench/loop-empty-resolve.js: Added.
 857         * tests/ubench/loop-empty.js: Added.
 858         * tests/ubench/loop-sum.js: Added.
 859
 860 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 861
 862         Rubber stamped by Oliver.
 863
 864         * sunspider: Don't force --runs=1 in squirrelfish mode any more.
 865
 866 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 867
 868         Reviewed by Oliver.
 869
 870         - make --squirrelfish mode use the real harness, but a reduced set of tests
 871
 872         Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
 873
 874         * sunspider:
 875         * tests/LIST-SQUIRRELFISH:
 876         * tests/LIST-UBENCH: Added.
 877         * tests/squirrelfish: Moved to tests/ubench
 878
 879 2008-04-14  Geoffrey Garen  <ggaren@apple.com>
 880
 881         Reviewed by Maciej Stachowiak.
 882
 883         Removed an unused test.
 884
 885         * tests/squirrelfish/loop-resolve.js: Removed.
 886
 887 2008-04-10  Maciej Stachowiak  <mjs@apple.com>
 888
 889         Reviewed by Oliver.
 890
 891         Add newly runnable tests to --squirrelfish mode.
 892
 893         * tests/LIST-SQUIRRELFISH:
 894
 895 2008-04-06  Geoffrey Garen  <ggaren@apple.com>
 896
 897         Reviewed by Maciej Stachowiak.
 898
 899         A little more love for --squirrelfish mode:
 900
 901         Fixed a misplaced sort. Results properly sort now.
 902
 903         Added a test list just for squirrelfish, and updated it to include
 904         all currently passing SunSpider tests.
 905
 906         Fixed the pruning regexp to match 3d-morph.js.
 907
 908         * sunspider:
 909
 910 2008-03-26  Geoffrey Garen  <ggaren@apple.com>
 911
 912         Reviewed by Oliver Hunt.
 913
 914         --squirrelfish mode: pared down tests for squirrelfish to chew on.
 915
 916         * sunspider:
 917         * tests/LIST:
 918         * tests/squirrelfish: Added.
 919         * tests/squirrelfish/function-closure.js: Added.
 920         * tests/squirrelfish/function-empty.js: Added.
 921         * tests/squirrelfish/function-missing-args.js: Added.
 922         * tests/squirrelfish/function-sum.js: Added.
 923         * tests/squirrelfish/loop-empty-resolve.js: Added.
 924         * tests/squirrelfish/loop-empty.js: Added.
 925         * tests/squirrelfish/loop-resolve.js: Added.
 926         * tests/squirrelfish/loop-sum.js: Added.
 927
 928 2008-03-21  Alexey Proskuryakov  <ap@webkit.org>
 929
 930         Reviewed by Geoff.
 931
 932         * sunspider: Pause update daemon on Darwin to make results reliable
 933         again (workaround for <rdar://problem/5811127>).
 934
 935 2008-02-07  Eric Seidel  <eric@webkit.org>
 936
 937         Reviewed by Sam.
 938
 939         * sunspider: add an error message when ./tests/LIST is not found
 940
 941 2007-12-29  Alp Toker  <alp@atoker.com>
 942
 943         Fix typo.
 944
 945         * hosted/sunspider.html:
 946
 947 2007-12-29  Alp Toker  <alp@atoker.com>
 948
 949         Reviewed by Maciej.
 950
 951         Provide the current URL in the SunSpider results page. Useful for
 952         copying benchmark results out of browsers without a location bar or
 953         where the location bar can't handle long URLs.
 954
 955         * hosted/sunspider-results.html:
 956
 957 2007-12-20  Eric Seidel  <eric@webkit.org>
 958
 959         Reviewed by mjs.
 960
 961         * sunspider: increase default number of runs for more accurate numbers
 962
 963 2007-12-18  Mark Rowe  <mrowe@apple.com>
 964
 965         Fix typo.
 966
 967         * hosted/sunspider.html:
 968
 969 2007-12-18  Maciej Stachowiak  <mjs@apple.com>
 970
 971         Reviewed by Eric.
 972
 973         - give an extra digit of precision for small differences.
 974
 975         * resources/sunspider-compare-results.js:
 976
 977 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 978
 979         Reviewed by Eric.
 980
 981         - work around IE layout bugs
 982
 983         * hosted/sunspider.css:
 984
 985 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 986
 987         Reviewed by Mark.
 988
 989         - fix compare feature
 990
 991         * hosted/sunspider-results.html:
 992
 993 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 994
 995         Reviewed by Mark.
 996
 997         - Change the format of the output URL to be shorter, to meet IE constraints
 998
 999         * hosted/sunspider-driver.html:
1000         * hosted/sunspider-results.html:
1001
1002 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
1003
1004         Reviewed by Oliver.
1005
1006         - Add some explanatory test and a dumb logo to SunSpider web hosted version
1007
1008         * hosted/sunspider-driver.html:
1009         * hosted/sunspider-results.html:
1010         * hosted/sunspider.css:
1011         * hosted/sunspider.html:
1012
1013 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
1014
1015         Reviewed by Oliver.
1016
1017         - Make the web-hosted version of SunSpider look a little bit less drab.
1018
1019         * hosted/sunspider-driver.html:
1020         * hosted/sunspider-results.html:
1021         * hosted/sunspider.css: Added.
1022         * hosted/sunspider.html:
1023         * resources/TEMPLATE.html:
1024
1025 2007-12-12  Maciej Stachowiak  <mjs@apple.com>
1026
1027         Reviewed by Sam.
1028
1029         - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
1030
1031         A sample of what new-style results would look like:
1032
1033         TEST                   COMPARISON            FROM                 TO             DETAILS
1034         ...
1035         ** TOTAL **:           1.41x as fast     6613.6ms +/- 0.1%   4703.0ms +/- 0.1%     significant
1036         ...
1037             3bit-bits-in-byte: *1.36x as slow*     88.8ms +/- 0.6%    121.1ms +/- 0.6%     significant
1038
1039         * resources/sunspider-compare-results.js:
1040
1041 2007-11-14  Eric Seidel  <eric@webkit.org>
1042
1043         Reviewed by Sam.
1044
1045         * sunspider: add --shark-cache for L2 Cache Miss profiling
1046
1047 2007-11-09  Alexey Proskuryakov  <ap@webkit.org>
1048
1049         Reviewed by Darin Adler.
1050
1051         http://bugs.webkit.org/show_bug.cgi?id=15925
1052         SunSpider should check for Shark being installed
1053
1054         * sunspider: Explicitly test that shark command line tool is installed.
1055
1056 2007-11-04  Darin Adler  <darin@apple.com>
1057
1058         * hosted/sunspider.html: Tweaked formatting a bit.
1059
1060 2007-11-03  Maciej Stachowiak  <mjs@apple.com>
1061
1062         Reviewed by Darin Adler.
1063
1064         - Add compare mode and a description of the benchmark to the hosted version.
1065
1066         * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
1067         * hosted/sunspider.html: Added intro text.
1068         * make-hosted: Copy new file.
1069         * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
1070         a function.
1071         * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
1072         expects.
1073         * sunspider-compare-results: Use sunspider-standalone-compare.js.
1074
1075 2007-11-02  Darin Adler  <darin@apple.com>
1076
1077         * sunspider: Changed "--base" to "--set-baseline".
1078
1079 2007-11-02  Darin Adler  <darin@apple.com>
1080
1081         Reviewed by Maciej.
1082
1083         * sunspider: Added a "--base" option that records the current test as a baseline.
1084         Moved the code to find the newest .mshark file into a function (since I needed to use
1085         it in the other script and I prefer to copy/paste a function).
1086
1087         * sunspider-compare-results: Added logic to compare the baseline with the last
1088         run when you don't pass any parameters.
1089
1090 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1091
1092         Reviewed by Eric.
1093
1094         - Added list of ECMAScript3 features that SunSpider does not cover currently.
1095
1096         * UNCOVERED: Added.
1097
1098 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1099
1100         Reviewed by Oliver.
1101
1102         - Give better error messages when sunspider-compare-results fails
1103
1104         * sunspider-compare-results:
1105
1106 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1107
1108         Reviewed by Darin Adler.
1109
1110         - fix Date tests to work in command-line SpiderMonkey
1111
1112         * tests/date-format-tofte.js:
1113         * tests/date-format-xparb.js:
1114
1115 2007-10-29  Darin Adler  <darin@apple.com>
1116
1117         Reviewed by Maciej.
1118
1119         * sunspider: Added --shark20 option, to run Shark at its highest sample
1120         resolution instead of its default.
1121
1122 2007-10-28  Adam Roben  <aroben@apple.com>
1123
1124         Fix SunSpider on Windows
1125
1126         Reviewed by Eric.
1127
1128         * sunspider: Don't use colons in filenames.
1129
1130 2007-10-28  Darin Adler  <darin@apple.com>
1131
1132         Reviewed by Adam.
1133
1134         * resources/sunspider-analyze-results.js: Tweak the output format a little.
1135         Change so that when there's only one run we don't write out confidence
1136         intervals at all rather than writing "NaN" over and over again.
1137
1138         * sunspider: Use the time and date as a suffix on the results file, that way
1139         all the results are left behind in the tmp directory. This will make it easy
1140         for us to add features that compare past results in the future. Also rename
1141         the .mshark files using the same scheme.
1142
1143         * sunspider-compare-results: Relax the parsing rules so we can parse the
1144         results file exactly as it's emitted from sunspider.
1145
1146 2007-10-25  Adam Roben  <aroben@apple.com>
1147
1148         Strip carriage returns from results
1149
1150         Carriage returns were screwing up sunspider-compare-results on
1151         Windows.
1152
1153         Rubberstamped by Oliver.
1154
1155         * sunspider:
1156
1157 2007-10-24  Darin Adler  <darin@apple.com>
1158
1159         Reviewed by Eric.
1160
1161         * sunspider: Open the profile in shark after completing a run.
1162         * sunspider-compare-results: Tiny perl tweaks.
1163
1164 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1165
1166         Reviewed by Darin Adler.
1167
1168         - Don't hardcode my path to testkjs
1169
1170         * sunspider-compare-results:
1171
1172 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1173
1174         Reviewed by Darin Adler.
1175
1176         - Add a compare script to compare results, and improve formatting of standard results a bit.
1177
1178         * resources/sunspider-analyze-results.js:
1179         * resources/sunspider-compare-results.js: Added.
1180         * sunspider-compare-results: Added.
1181
1182 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1183
1184         Reviewed by Darin Adler.
1185
1186         * resources/sunspider-analyze-results.js: Do the error range
1187         properly, using the t-distribution instead of 1.96 (which was
1188         based on the normal distribution).
1189
1190         * sunspider: Print results in a way that will be friendlier to the
1191         soon-to-come compare mode.
1192
1193 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
1194
1195         Reviewed by Review.
1196
1197         - add more tests (probably the final set for now)
1198
1199         Already balanced. Added date, regexp, control flow, and a few
1200         more string and object/array access tests.
1201
1202         * tests/LIST:
1203         * tests/access-fannkuch.js: Added.
1204         * tests/access-nbody.js: Added.
1205         * tests/controlflow-recursive.js: Added.
1206         * tests/date-format-tofte.js: Added.
1207         * tests/date-format-xparb.js: Added.
1208         * tests/regexp-dna.js: Added.
1209         * tests/string-validate-input.js: Added.
1210
1211 2007-10-21  Eric Seidel  <eric@webkit.org>
1212
1213         Reviewed by mjs.
1214
1215         * sunspider: make --shark only sample from testkjs
1216
1217 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
1218
1219         Rubber stamped by Eric.
1220
1221         - added crypto tests (already balanced)
1222
1223         * tests/LIST:
1224         * tests/crypto-aes.js: Added.
1225         * tests/crypto-md5.js: Added.
1226         * tests/crypto-sha1.js: Added.
1227
1228 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
1229
1230         Reviewed by Adam.
1231
1232         - rebalance new tests
1233
1234         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
1235
1236         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1237
1238         This balances them with the existing tests.
1239
1240         * tests/access-binary-trees.js:
1241         * tests/access-nsieve.js:
1242         * tests/bitops-nsieve-bits.js:
1243         * tests/math-partial-sums.js:
1244         * tests/math-spectral-norm.js:
1245         * tests/string-fasta.js:
1246
1247 2007-10-20  Eric Seidel  <eric@webkit.org>
1248
1249         Reviewed by darin.
1250
1251         Add improved argument handling to sunspider, including
1252         --runs=<number>, --tests=<pattern, --shark, and --help
1253         Also re-factor code into subroutines
1254
1255         * sunspider: improved argument handling
1256
1257 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1258
1259         Reviewed by Mark.
1260
1261         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
1262
1263         * TODO:
1264         * tests/LIST:
1265         * tests/access-binary-trees.js: Added.
1266         * tests/access-nsieve.js: Added.
1267         * tests/bitops-nsieve-bits.js: Added.
1268         * tests/math-partial-sums.js: Added.
1269         * tests/math-spectral-norm.js: Added.
1270         * tests/string-fasta.js: Added.
1271
1272 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1273
1274         Reviewed by Darin Adler.
1275
1276         * TODO: Updated to note areas that are now well-covered.
1277
1278         - Change the tests and the driver to avoid leaving large object
1279         graphs hanging around, since that throws off the subsequent tests.
1280
1281         * resources/sunspider-standalone-driver.js:
1282         * tests/3d-cube.js:
1283         * tests/3d-morph.js:
1284         * tests/3d-raytrace.js:
1285         * tests/bitops-bitwise-and.js:
1286         * tests/string-base64.js:
1287         * tests/string-tagcloud.js:
1288
1289 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1290
1291         Reviewed by Nikolas.
1292
1293         - Rebalance test complexity.
1294
1295         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
1296
1297         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1298
1299         However, for some tests, IE7 was a huge outlier compared to other
1300         major browsers. For those tests, I used Firefox 2.0.0.8 on the
1301         same OS and hardware as a normalization basis.
1302
1303         * tests/3d-morph.js:
1304         * tests/3d-raytrace.js:
1305         * tests/bitops-3bit-bits-in-byte.js:
1306         * tests/bitops-bits-in-byte.js:
1307         * tests/bitops-bitwise-and.js:
1308         * tests/math-cordic.js:
1309         * tests/string-base64.js:
1310         * tests/string-tagcloud.js:
1311         * tests/string-unpack-code.js:
1312
1313 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1314
1315         Reviewed by Oliver.
1316
1317         - Fix the browser-hosted driver to be compatible with Safari 2
1318
1319         * hosted/sunspider-driver.html:
1320
1321 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1322
1323         Rubber stamped by Hyatt.
1324
1325         - Add BSD license notice to cordic test, the original author said to do so.
1326
1327         * tests/math-cordic.js:
1328
1329 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1330
1331         Reviewed by Eric.
1332
1333         - Support Windows and Windows browsers.
1334
1335         * hosted/sunspider-results.html: Display results correctly in IE.
1336         * sunspider: tweaks to work on Windows, and with spaces in the path.
1337
1338 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1339
1340         Rubber stamped by Oliver.
1341
1342         * tests/string-tagcloud.js: Remove stray print()
1343
1344 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
1345
1346         Reviewed by Oliver.
1347
1348         Add some string test cases.
1349
1350         * tests/string-base64.js: Added. Does base64 encoding and decoding.
1351         * tests/string-tagcloud.js: Added. Parses a JSON string and
1352         generates tagcloud HTML markup based on the data.
1353         * tests/string-unpack-code.js: Added. Unpack compressed versions of
1354         four of the most popular JavaScript libraries.
1355         * tests/LIST: Added the new tests.
1356
1357 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
1358
1359         Reviewed by Anders.
1360
1361         * TODO: Updated with info on how to do the stats properly.
1362
1363         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
1364         avoid overly slowing down the benchmark.
1365
1366         Added some 3D-related test cases.
1367
1368         * tests/3d-cube.js: Added.
1369         * tests/3d-morph.js: Added.
1370         * tests/3d-raytrace.js: Added.
1371         * tests/LIST:
1372
1373 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
1374
1375         Reviewed by Darin Adler.
1376
1377         - New JavaScript benchmark
1378         http://bugs.webkit.org/show_bug.cgi?id=15515
1379
1380         A start on a new JavaScript benchmark, with standalone and
1381         browser-hosted drivers.
1382
1383         The test content is still incomplete and the drivers could use
1384         some more features but there is enough here to make a good start.
1385
1386         The drivers compute a 95% confidence interval on the mean for the
1387         whole test, each category, and each individual test to make it
1388         easier to tell whether differences are statistically
1389         significant. The confidence interval can be narrowed by running
1390         the test more times.
1391
1392         * TODO: Added. Remaining things that need to be done.
1393         * sunspider: Added. Perl script that acts as the standalone test driver.
1394         * resources/sunspider-standalone-driver.js: Added. JavaScript part
1395         of standalone test driver.
1396         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
1397         analysis code.
1398         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
1399         * make-hosted: Added. Script to generate browser-hosted tests.
1400         * hosted/sunspider.html: Added. Start page for browser-hosted test.
1401         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
1402         * hosted/sunspider-results.html: Added. Results page for browser-hosted
1403         tests.
1404         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
1405         tests.
1406         * tests/LIST: Added. List of tests to use.
1407         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
1408         * tests/bitops-bits-in-byte.js: Added. Ditto.
1409         * tests/bitops-bitwise-and.js: Added. Ditto.
1410         * tests/math-cordic.js: Added. Ditto.
1411