PerformanceTests/SunSpider/ChangeLog

   1 2011-08-11  Mark Rowe  <mrowe@apple.com>
   2
   3         Fix sunspider-compare-results to default to the same suite version as the sunspider script.
   4
   5         Rubber-stamped by Maciej Stachowiak.
   6
   7         * sunspider-compare-results:
   8
   9 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
  10
  11         Update SunSpider versioning to 1.0
  12         https://bugs.webkit.org/show_bug.cgi?id=63870
  13
  14         Reviewed by Dan Bernstein.
  15
  16         * hosted/sunspider.html:
  17         * hosted/versions.html:
  18         * resources/driver-TEMPLATE.html:
  19         * resources/results-TEMPLATE.html:
  20         * sunspider:
  21
  22 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
  23
  24         Sunspider 0.9.1 harness doesn't actually close() its test documents
  25         https://bugs.webkit.org/show_bug.cgi?id=47045
  26
  27         Reviewed by Daniel Bates.
  28
  29         * hosted/versions.html:
  30         * resources/driver-TEMPLATE.html:
  31
  32 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
  33
  34         Not Reviewed.
  35
  36         Fix obviou typo in previous commit.
  37
  38         * tests/sunspider-1.0/bitops-bitwise-and.js:
  39
  40 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
  41
  42         Reviewed by Anders Carlsson.
  43
  44         SunSpider: all four bitops benchmarks can be replaced with NOP
  45         https://bugs.webkit.org/show_bug.cgi?id=38446
  46
  47         * tests/sunspider-1.0/bitops-3bit-bits-in-byte.js:
  48         (TimeFunc): Save the result.
  49         * tests/sunspider-1.0/bitops-bits-in-byte.js:
  50         (TimeFunc): Save the result.
  51         * tests/sunspider-1.0/bitops-bitwise-and.js: More explicitly
  52         save the results.
  53         * tests/sunspider-1.0/bitops-nsieve-bits.js:
  54         (sieve): Save the result.
  55
  56 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
  57
  58         SunSpider: string-validate-input.js uses an undeclared variable named 'name', which is a DOM API
  59         https://bugs.webkit.org/show_bug.cgi?id=60937
  60
  61         Reviewed by Dan Bernstein.
  62
  63         * tests/sunspider-1.0/string-validate-input.js:
  64         (doTest): Rename the variable to username
  65
  66 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
  67
  68         Reviewed by Darin Adler.
  69
  70         SunSpider: The main function of math-cordic is dead code
  71         https://bugs.webkit.org/show_bug.cgi?id=63863
  72
  73         Try to prevent math-cordic from being eliminated as dead code or
  74         compiled down to a constant.
  75
  76         * tests/sunspider-1.0/math-cordic.js:
  77         (cordicsincos):
  78         (cordic):
  79
  80 2011-06-30  Maciej Stachowiak  <mjs@apple.com>
  81
  82         Reviewed by Adam Barth.
  83
  84         Create sunspider-1.0 directory in preparation for fixing a bunch of bugs
  85         https://bugs.webkit.org/show_bug.cgi?id=63782
  86
  87         * make-hosted: Learn about the new directory.
  88         * tests/sunspider-1.0: Copied from PerformanceTests/SunSpider/tests/sunspider-0.9.1.
  89
  90 2010-11-29  Geoffrey Garen  <ggaren@apple.com>
  91
  92         Reviewed by Gavin Barraclough.
  93
  94         Improved accuracy of command-line SunSpider.
  95
  96         * resources/sunspider-standalone-driver.js: Use the returned number of
  97         elapsed milliseconds from "run" and "checkSyntax" instead of measuring
  98         ourselves, for slightly more accurate numbers.
  99
 100 2010-09-16  Gavin Barraclough  <barraclough@apple.com>
 101
 102         Reviewed by Mark Rowe.
 103         https://bugs.webkit.org/show_bug.cgi?id=45924
 104
 105         Modify the SunSpider harness to allow a path to be passed to the --suite
 106         argument, supress the normal prepend-"tests/" behaviour for suite names
 107         containing a '/'.
 108
 109         Also wrap the code in an anonymous function to move variables out of global
 110         scope (currently the harness cannot handle running tests the overwrite the
 111         variable 'j').
 112
 113         * resources/sunspider-standalone-driver.js:
 114         * sunspider:
 115
 116 2010-08-27  Michael Saboff  <msaboff@apple.com>
 117
 118         Reviewed by Stephanie Lewis.
 119
 120         Added version 5 and version 6 of V8 tests with modifications similar
 121         to the version 4 tests so they'll work with the SunSpider test harness.
 122         Note that these files are external source and therefore don't conform
 123         to WebKit coding standards.
 124         https://bugs.webkit.org/show_bug.cgi?id=44638
 125
 126         * tests/v8-v5: Added.
 127         * tests/v8-v5/LIST: Added.
 128         * tests/v8-v5/v8-crypto.js: Added.
 129         * tests/v8-v5/v8-deltablue.js: Added.
 130         * tests/v8-v5/v8-earley-boyer.js: Added.
 131         * tests/v8-v5/v8-raytrace.js: Added.
 132         * tests/v8-v5/v8-regexp.js: Added.
 133         * tests/v8-v5/v8-richards.js: Added.
 134         * tests/v8-v5/v8-splay.js: Added.
 135         * tests/v8-v6: Added.
 136         * tests/v8-v6/LIST: Added.
 137         * tests/v8-v6/v8-crypto.js: Added.
 138         * tests/v8-v6/v8-deltablue.js: Added.
 139         * tests/v8-v6/v8-earley-boyer.js: Added.
 140         * tests/v8-v6/v8-raytrace.js: Added.
 141         * tests/v8-v6/v8-regexp.js: Added.
 142         * tests/v8-v6/v8-richards.js: Added.
 143         * tests/v8-v6/v8-splay.js: Added.
 144
 145 2010-07-15  Stephanie Lewis  <slewis@apple.com>
 146
 147         Reviewed by Geoff Garen.
 148
 149         http://bugs.webkit.org/show_bug.cgi?id=42406
 150         Output location of results file.
 151
 152         * sunspider:
 153
 154 2010-05-17  Maciej Stachowiak  <mjs@apple.com>
 155
 156         Reviewed by Mark Rowe.
 157
 158         Browser-hosted version of SunSpider runs tests twice as many times as advertised
 159         https://bugs.webkit.org/show_bug.cgi?id=39201
 160
 161         * make-hosted: Make sure to reset test list after every test suite.
 162
 163 2010-05-07  Adam Roben  <aroben@apple.com>
 164
 165         Fix typo in sunspider-compare-results.js that caused incorrect
 166         two-sample t statistics to be computed
 167
 168         Fixes <http://webkit.org/b/38768> SunSpider computes incorrect
 169         two-sample t statistics
 170
 171         Reviewed by Darin Adler.
 172
 173         * resources/sunspider-compare-results.js:
 174         (sunspiderCompareResults.resultLine): Fixed the calculation of the t
 175         variable to match the definition of a two-sample t statistic. Looks
 176         like this was just a simple typo.
 177
 178 2010-04-05  Darin Adler  <darin@apple.com>
 179
 180         Updated the ignore property for changes to the contents here.
 181
 182         * .: Modified property svn:ignore.
 183
 184 2010-02-20  Maciej Stachowiak  <mjs@apple.com>
 185
 186         Reviewed by Adam Barth.
 187
 188         Add sunspider-0.9.1 to the site in preparation for announcing it.
 189         https://bugs.webkit.org/show_bug.cgi?id=35206
 190
 191         * hosted/sunspider.css: Remove tabs, which I noticed where present while
 192         copying to the WebKitSite directory.
 193
 194 2010-01-11  Oliver Hunt  <oliver@apple.com>
 195
 196         Reviewed by Darin Adler.
 197
 198         Sunspider parse-only tests don't run
 199         https://bugs.webkit.org/show_bug.cgi?id=33489
 200
 201         Fix parse-only test list
 202
 203         * tests/parse-only/LIST:
 204
 205 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
 206
 207         Reviewed by Adele Peterson.
 208
 209         Make SunSpider version more prominent in the title
 210         https://bugs.webkit.org/show_bug.cgi?id=32574
 211
 212         * hosted/sunspider.html:
 213         * hosted/versions.html:
 214         * resources/driver-TEMPLATE.html:
 215         * resources/results-TEMPLATE.html:
 216
 217 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
 218
 219         Reviewed by Darin Adler.
 220
 221         Make SunSpider refuse to compare results across content versions
 222         https://bugs.webkit.org/show_bug.cgi?id=32573
 223
 224         The results URL now includes a version indicator, and compare mode
 225         will refuse to compare between versions.
 226
 227         * resources/driver-TEMPLATE.html:
 228         * resources/results-TEMPLATE.html:
 229
 230 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
 231
 232         Reviewed by Darin Adler.
 233
 234         Some Browser-hosted SunSpider files are not valid HTML5
 235         https://bugs.webkit.org/show_bug.cgi?id=32536
 236
 237         Made various fixes to validate as HTML5 with no warnings (mainly removing bogus
 238         close tags and adding a meta charset declaration).
 239
 240         * hosted/sunspider.html:
 241         * hosted/versions.html:
 242         * resources/TEMPLATE.html:
 243         * resources/driver-TEMPLATE.html:
 244         * resources/results-TEMPLATE.html:
 245
 246 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
 247
 248         Reviewed by Eric Seidel.
 249
 250         Make sunspider-0.9.1 the default content set (both command-line and hosted)
 251         https://bugs.webkit.org/show_bug.cgi?id=32537
 252
 253         * hosted/sunspider.html: Change default suite link.
 254         * sunspider: Change default suite.
 255         * sunspider-compare-results: Likewise.
 256
 257 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
 258
 259         Reviewed by Sam Weinig.
 260
 261         in-browser SunSpider suffers excessive penalty under power management
 262         https://bugs.webkit.org/show_bug.cgi?id=32505
 263
 264         I have made a few changes to address this:
 265
 266         1) Change how browser-hosted SunSpider loads tests - preload the content and write it in with
 267         document.write to reduce triggering of progress UI.
 268         2) Reduce time between tests to 10ms from 500ms, so that power management doesn't keep the CPU
 269         stepped all the way down the whole time.
 270         3) Run the test cycle an extra time for warmup before the runs that count.
 271
 272         * hosted/sunspider-record-result.js: Removed.
 273         * make-hosted:
 274         * resources/TEMPLATE.html:
 275         * resources/driver-TEMPLATE.html:
 276
 277 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
 278
 279         Reviewed by Gavin Barraclough.
 280
 281         SunSpider/tests/string-base64.js does not compute a valid base64 encoded string
 282         https://bugs.webkit.org/show_bug.cgi?id=16806
 283
 284         Based on a patch by Eric Seidel.
 285
 286         Fix the base64 computation to actually compute correct results. The impact on runtime of
 287         the test is pretty small, but noticeable for some browsers. But at least it's not
 288         doing a wrong and meaningless computation any more.
 289
 290         * tests/sunspider-0.9.1/string-base64.js:
 291         ():
 292         (base64ToString):
 293
 294 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
 295
 296         Fixing commit error...
 297
 298         I accidentally committed my last patch in a form that broke Web-hosted SunSpider. Fixing.
 299
 300         * resources/driver-TEMPLATE.html:
 301
 302 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
 303
 304         Reviewed by Sam Weinig.
 305
 306         Use JSON.parse instead of eval for Web-hosted SunSpider results processing
 307         https://bugs.webkit.org/show_bug.cgi?id=32490
 308
 309         * hosted/json2.js: Added. Incorporated from json.org
 310         * resources/driver-TEMPLATE.html: Fix an HTML validation bug I noticed.
 311         * resources/results-TEMPLATE.html: Use JSON.parse instead of eval to process
 312         results.
 313
 314 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
 315
 316         Reviewed by Oliver Hunt.
 317
 318         Enable Web-hosted version of SunSpider to handle multiple versions
 319         https://bugs.webkit.org/show_bug.cgi?id=32478
 320
 321         * make-hosted: Now generate the hosted version to be able to run both the
 322         0.9 and the 0.9.1 test suites.
 323         * hosted: Modified property svn:ignore.
 324         * hosted/sunspider-driver.html: Removed.
 325         * hosted/sunspider-results.html: Removed.
 326         * hosted/sunspider.html:
 327         * hosted/versions.html: Added.
 328         * resources/TEMPLATE.html:
 329         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-driver.html.
 330         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-results.html.
 331
 332 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
 333
 334         Reviewed by Oliver Hunt.
 335
 336         Give command-line sunspider the ability to handle multiple suites and versions
 337         https://bugs.webkit.org/show_bug.cgi?id=32477
 338
 339         Each suite/version's set of tests are now in a separate subdirectory of tests/, with a file named LIST
 340         enumerating the tests. Current suites are:
 341
 342         sunspider-0.9 - riginal SunSpider content
 343         sunspider-0.9.1 - SunSpider suite with a few tests fixed (and a few more to come)
 344         ubench - "ubench" microbenchmark suite
 345         v8-v4 - version 4 of the v8 benchmark
 346         parse-only - some parser tests
 347
 348         Sunspider can now be run with the --suite= parameter to select a
 349         suite. The default is --suite=sunspider-0.9.
 350
 351         * .: Modified property svn:ignore to ignore new results directories.
 352         * make-hosted: Generate based on sunspider-0.9 suite.
 353         * resources/TEMPLATE.html: Fix an HTML compliance problem.
 354         * resources/sunspider-standalone-driver.js: Become aware of suite names.
 355         * sunspider: Modified to handle multiple suites as described above.
 356         * sunspider-compare-results: ditto
 357         * tests/LIST: Moved to tests/sunspider-0.9/ and tests/sunspider-0.9.1/
 358         * tests/LIST-PARSE-ONLY: Moved to parse-only/LIST
 359         * tests/LIST-UBENCH: Removed.
 360         * tests/LIST-V8: Removed.
 361         * tests/3d-cube.js: Moved to tests/sunspider-0.9 and tests/sunspider-0.9.1
 362         * tests/3d-morph.js: ditto
 363         * tests/3d-raytrace.js: ditto
 364         * tests/access-binary-trees.js: ditto
 365         * tests/access-fannkuch.js: ditto
 366         * tests/access-nbody.js: ditto
 367         * tests/access-nsieve.js: ditto
 368         * tests/bitops-3bit-bits-in-byte.js: ditto
 369         * tests/bitops-bits-in-byte.js: ditto
 370         * tests/bitops-bitwise-and.js: ditto
 371         * tests/bitops-nsieve-bits.js: ditto
 372         * tests/controlflow-recursive.js: ditto
 373         * tests/crypto-aes.js: ditto
 374         * tests/crypto-md5.js: ditto
 375         * tests/crypto-sha1.js: ditto
 376         * tests/date-format-tofte.js: ditto
 377         * tests/date-format-xparb.js: ditto
 378         * tests/math-cordic.js: ditto
 379         * tests/math-partial-sums.js: ditto
 380         * tests/math-spectral-norm.js: ditto
 381         * tests/regexp-dna.js: ditto
 382         * tests/string-base64.js: ditto
 383         * tests/string-fasta.js: ditto
 384         * tests/string-tagcloud.js: ditto
 385         * tests/string-unpack-code.js: ditto
 386         * tests/string-validate-input.js: ditto
 387         * tests/sunspider-0.9/: Added
 388         * tests/sunspider-0.9/*.js: Moved from one level up
 389         * tests/sunspider-0.9.1: Added.
 390         * tests/sunspider-0.9.1/*.js: Moved from one level up.
 391         * tests/v8-crypto.js: Moved to v8-v4/ directory.
 392         * tests/v8-deltablue.js: ditto
 393         * tests/v8-earley-boyer.js: ditto
 394         * tests/v8-raytrace.js: ditto
 395         * tests/v8-regexp.js: ditto
 396         * tests/v8-richards.js: ditto
 397         * tests/v8-splay.js: ditto
 398         * tests/v8-v4: Added.
 399
 400 2009-09-30  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
 401
 402         Reviewed by Darin Adler.
 403
 404         Platform specific null device replaced with a platform independent.
 405         https://bugs.webkit.org/show_bug.cgi?id=29544
 406
 407         * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL.
 408
 409 2009-09-21  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
 410
 411         Reviewed by Maciej Stachowiak.
 412
 413         [Qt] Make sunspider script work on Windows platform.
 414         https://bugs.webkit.org/show_bug.cgi?id=29544
 415
 416         * sunspider:
 417         Using platform specific null device instead of /dev/null.
 418
 419 2009-06-19  Adam Treat  <adam.treat@torchmobile.com>
 420
 421         Reviewed by Oliver Hunt.
 422
 423         https://bugs.webkit.org/show_bug.cgi?id=26540
 424         Currently the SunSpider test driver lacks an option to run a test suite that
 425         will test JavaScriptCore parsing performance only.  This patch adds just such
 426         a test suite and option to SunSpider as well as the jsc test shell.  I've included
 427         three large javascript source files found in the wild: jquery, mootools and prototype.
 428         Combined with the concatenation of all three, these form a new testsuite to measure
 429         and test pure JavaScriptCore parsing performance.
 430
 431         * resources/sunspider-standalone-driver.js:
 432           Load the js with parse-only flag if it is part of the parse-only suite.
 433         * sunspider:
 434           Add the parse-only suite to the list of options.
 435         * sunspider-compare-results:
 436           Add the parse-only suite to the list of options.
 437         * tests/LIST-PARSE-ONLY: Added.
 438         * tests/parse-only/concat-jquery-mootools-prototype.js: Added.
 439           A very large concatenation of the scripts found below.  This js takes ~30ms to parse on my machine.
 440         * tests/parse-only/jquery-1.3.2.js: Added.
 441           Latest version from jquery.com.
 442         * tests/parse-only/mootools-1.2.2-core-nc.js: Added.
 443           Latest version from mootools.net.
 444         * tests/parse-only/prototype-1.6.0.3.js: Added.
 445           Latest version from prototypejs.org.
 446
 447 2009-06-13  Steve Falkenburg  <sfalken@apple.com>
 448
 449         Update V8 benchmark to version 4.
 450
 451         Reviewed by Cameron Zwarich.
 452
 453         * tests/LIST-V8:
 454         * tests/v8-crypto.js:
 455         * tests/v8-deltablue.js:
 456         * tests/v8-earley-boyer.js:
 457         * tests/v8-raytrace.js:
 458         * tests/v8-regexp.js: Added.
 459         * tests/v8-richards.js:
 460         * tests/v8-splay.js: Added.
 461
 462 2009-05-26  Olivier DOLE  <odole@pleyo.com>
 463
 464         Reviewed by Maciej.
 465
 466         Store sunspider test suite results in a specific directory for each
 467         different type of benchmark (sunspider, V8 or ubench).
 468
 469         * sunspider:
 470         * sunspider-compare-results:
 471
 472 2009-05-12  Steve Falkenburg  <sfalken@apple.com>
 473
 474         Build fix.
 475
 476         * SunSpider.make:
 477
 478 2009-05-11  Steve Falkenburg  <sfalken@apple.com>
 479
 480         Include SunSpider tests in production builds.
 481
 482         Reviewed by Adam Roben.
 483
 484         * SunSpider.make: Added.
 485         * xcopy.excludes: Added.
 486
 487 2009-03-04  Oliver Hunt  <oliver@apple.com>
 488
 489         Added a few more tests to ubench
 490
 491         RS=Gavin Barraclough
 492
 493         Adding a couple of test to cover too few and too many arguments.  This
 494         is needed to prevent regressions in all call paths from my current refactoring.
 495
 496         * tests/LIST-UBENCH:
 497         * tests/ubench/function-correct-args.js: Added.
 498         (f):
 499         * tests/ubench/function-excess-args.js: Added.
 500         (f):
 501
 502 2008-10-30  Zoltan Horvath  <Horvath.Zoltan.6@stud.u-szeged.hu>
 503
 504         Fix a bug where when V8's or UBENCH's test suite list file is missing
 505         the error message is suggesting that SunSpider's list file is missing.
 506
 507         Reviewed by Sam Weinig.
 508
 509         * sunspider:
 510         (loadTestsList): Fix the error message to use the right list name.
 511
 512 2008-10-07  David Hyatt  <hyatt@apple.com>
 513
 514         https://bugs.webkit.org/show_bug.cgi?id=18989
 515
 516         Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
 517         we want all browsers to be doing the same thing on the test.
 518
 519         Reviewed by Maciej
 520
 521         * tests/regexp-dna.js:
 522
 523 2008-09-09  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 524
 525         Rubber-stamped by Maciej Stachowiak.
 526
 527         The bleeding edge branch of V8 now supports passing fileanmes after
 528         '-f', so the SunSpider script should be changed to do this again.
 529         This allows all 3 major JavaScript engines to be used with the
 530         unmodified SunSpider script.
 531
 532         * sunspider:
 533
 534 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 535
 536         Reviewed by Maciej Stachowiak.
 537
 538         Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
 539         and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
 540         correct the punctuation in its documentation.
 541
 542         * sunspider:
 543
 544 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 545
 546         Reviewed by Oliver Hunt.
 547
 548         Bug 20616: Incorporate V8 benchmarks in testing
 549         <https://bugs.webkit.org/show_bug.cgi?id=20616>
 550
 551         This is a first attempt at running the V8 benchmarks within SunSpider,
 552         with the --v8 option. The number of iterations is fixed for each
 553         benchmark, and was chosen to make each of the benchmarks run between
 554         500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
 555
 556         * sunspider:
 557         * tests/LIST-V8: Added.
 558         * tests/v8-crypto.js: Added.
 559         * tests/v8-deltablue.js: Added.
 560         * tests/v8-earley-boyer.js: Added.
 561         * tests/v8-raytrace.js: Added.
 562         * tests/v8-richards.js: Added.
 563
 564 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 565
 566         Not reviewed.
 567
 568         Remove a local change that was accidentally committed in r36034.
 569
 570         * resources/sunspider-standalone-driver.js:
 571
 572 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 573
 574         Rubber-stamped by Oliver Hunt.
 575
 576         Make SunSpider work with JavaScript shells that don't take filenames
 577         after a '-f' argument.
 578
 579         * sunspider:
 580
 581 2008-06-07  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 582
 583         Reviewed by Timothy.
 584
 585         Remove the --squirrelfish option from SunSpider, as it is no longer needed.
 586
 587         * sunspider:
 588         * tests/LIST-SQUIRRELFISH: Removed.
 589
 590 2008-06-03  Alexey Proskuryakov  <ap@webkit.org>
 591
 592         Rubber-stamped by Mark Rowe.
 593
 594         Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
 595
 596         * sunspider:
 597
 598 2008-04-15  Maciej Stachowiak  <mjs@apple.com>
 599
 600         Rubber stamped by Oliver.
 601
 602         - add newly working tests to squirrelfish list
 603
 604         * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
 605
 606 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 607
 608         Rubber stamped by Oliver.
 609
 610         - move ubench tests properly.
 611
 612         * tests/ubench: Added.
 613         * tests/ubench/function-closure.js: Added.
 614         * tests/ubench/function-empty.js: Added.
 615         * tests/ubench/function-missing-args.js: Added.
 616         * tests/ubench/function-sum.js: Added.
 617         * tests/ubench/loop-empty-resolve.js: Added.
 618         * tests/ubench/loop-empty.js: Added.
 619         * tests/ubench/loop-sum.js: Added.
 620
 621 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 622
 623         Rubber stamped by Oliver.
 624
 625         * sunspider: Don't force --runs=1 in squirrelfish mode any more.
 626
 627 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 628
 629         Reviewed by Oliver.
 630
 631         - make --squirrelfish mode use the real harness, but a reduced set of tests
 632
 633         Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
 634
 635         * sunspider:
 636         * tests/LIST-SQUIRRELFISH:
 637         * tests/LIST-UBENCH: Added.
 638         * tests/squirrelfish: Moved to tests/ubench
 639
 640 2008-04-14  Geoffrey Garen  <ggaren@apple.com>
 641
 642         Reviewed by Maciej Stachowiak.
 643
 644         Removed an unused test.
 645
 646         * tests/squirrelfish/loop-resolve.js: Removed.
 647
 648 2008-04-10  Maciej Stachowiak  <mjs@apple.com>
 649
 650         Reviewed by Oliver.
 651
 652         Add newly runnable tests to --squirrelfish mode.
 653
 654         * tests/LIST-SQUIRRELFISH:
 655
 656 2008-04-06  Geoffrey Garen  <ggaren@apple.com>
 657
 658         Reviewed by Maciej Stachowiak.
 659
 660         A little more love for --squirrelfish mode:
 661
 662         Fixed a misplaced sort. Results properly sort now.
 663
 664         Added a test list just for squirrelfish, and updated it to include
 665         all currently passing SunSpider tests.
 666
 667         Fixed the pruning regexp to match 3d-morph.js.
 668
 669         * sunspider:
 670
 671 2008-03-26  Geoffrey Garen  <ggaren@apple.com>
 672
 673         Reviewed by Oliver Hunt.
 674
 675         --squirrelfish mode: pared down tests for squirrelfish to chew on.
 676
 677         * sunspider:
 678         * tests/LIST:
 679         * tests/squirrelfish: Added.
 680         * tests/squirrelfish/function-closure.js: Added.
 681         * tests/squirrelfish/function-empty.js: Added.
 682         * tests/squirrelfish/function-missing-args.js: Added.
 683         * tests/squirrelfish/function-sum.js: Added.
 684         * tests/squirrelfish/loop-empty-resolve.js: Added.
 685         * tests/squirrelfish/loop-empty.js: Added.
 686         * tests/squirrelfish/loop-resolve.js: Added.
 687         * tests/squirrelfish/loop-sum.js: Added.
 688
 689 2008-03-21  Alexey Proskuryakov  <ap@webkit.org>
 690
 691         Reviewed by Geoff.
 692
 693         * sunspider: Pause update daemon on Darwin to make results reliable
 694         again (workaround for <rdar://problem/5811127>).
 695
 696 2008-02-07  Eric Seidel  <eric@webkit.org>
 697
 698         Reviewed by Sam.
 699
 700         * sunspider: add an error message when ./tests/LIST is not found
 701
 702 2007-12-29  Alp Toker  <alp@atoker.com>
 703
 704         Fix typo.
 705
 706         * hosted/sunspider.html:
 707
 708 2007-12-29  Alp Toker  <alp@atoker.com>
 709
 710         Reviewed by Maciej.
 711
 712         Provide the current URL in the SunSpider results page. Useful for
 713         copying benchmark results out of browsers without a location bar or
 714         where the location bar can't handle long URLs.
 715
 716         * hosted/sunspider-results.html:
 717
 718 2007-12-20  Eric Seidel  <eric@webkit.org>
 719
 720         Reviewed by mjs.
 721
 722         * sunspider: increase default number of runs for more accurate numbers
 723
 724 2007-12-18  Mark Rowe  <mrowe@apple.com>
 725
 726         Fix typo.
 727
 728         * hosted/sunspider.html:
 729
 730 2007-12-18  Maciej Stachowiak  <mjs@apple.com>
 731
 732         Reviewed by Eric.
 733
 734         - give an extra digit of precision for small differences.
 735
 736         * resources/sunspider-compare-results.js:
 737
 738 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 739
 740         Reviewed by Eric.
 741
 742         - work around IE layout bugs
 743
 744         * hosted/sunspider.css:
 745
 746 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 747
 748         Reviewed by Mark.
 749
 750         - fix compare feature
 751
 752         * hosted/sunspider-results.html:
 753
 754 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 755
 756         Reviewed by Mark.
 757
 758         - Change the format of the output URL to be shorter, to meet IE constraints
 759
 760         * hosted/sunspider-driver.html:
 761         * hosted/sunspider-results.html:
 762
 763 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
 764
 765         Reviewed by Oliver.
 766
 767         - Add some explanatory test and a dumb logo to SunSpider web hosted version
 768
 769         * hosted/sunspider-driver.html:
 770         * hosted/sunspider-results.html:
 771         * hosted/sunspider.css:
 772         * hosted/sunspider.html:
 773
 774 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
 775
 776         Reviewed by Oliver.
 777
 778         - Make the web-hosted version of SunSpider look a little bit less drab.
 779
 780         * hosted/sunspider-driver.html:
 781         * hosted/sunspider-results.html:
 782         * hosted/sunspider.css: Added.
 783         * hosted/sunspider.html:
 784         * resources/TEMPLATE.html:
 785
 786 2007-12-12  Maciej Stachowiak  <mjs@apple.com>
 787
 788         Reviewed by Sam.
 789
 790         - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
 791
 792         A sample of what new-style results would look like:
 793
 794         TEST                   COMPARISON            FROM                 TO             DETAILS
 795         ...
 796         ** TOTAL **:           1.41x as fast     6613.6ms +/- 0.1%   4703.0ms +/- 0.1%     significant
 797         ...
 798             3bit-bits-in-byte: *1.36x as slow*     88.8ms +/- 0.6%    121.1ms +/- 0.6%     significant
 799
 800         * resources/sunspider-compare-results.js:
 801
 802 2007-11-14  Eric Seidel  <eric@webkit.org>
 803
 804         Reviewed by Sam.
 805
 806         * sunspider: add --shark-cache for L2 Cache Miss profiling
 807
 808 2007-11-09  Alexey Proskuryakov  <ap@webkit.org>
 809
 810         Reviewed by Darin Adler.
 811
 812         http://bugs.webkit.org/show_bug.cgi?id=15925
 813         SunSpider should check for Shark being installed
 814
 815         * sunspider: Explicitly test that shark command line tool is installed.
 816
 817 2007-11-04  Darin Adler  <darin@apple.com>
 818
 819         * hosted/sunspider.html: Tweaked formatting a bit.
 820
 821 2007-11-03  Maciej Stachowiak  <mjs@apple.com>
 822
 823         Reviewed by Darin Adler.
 824
 825         - Add compare mode and a description of the benchmark to the hosted version.
 826
 827         * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
 828         * hosted/sunspider.html: Added intro text.
 829         * make-hosted: Copy new file.
 830         * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
 831         a function.
 832         * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
 833         expects.
 834         * sunspider-compare-results: Use sunspider-standalone-compare.js.
 835
 836 2007-11-02  Darin Adler  <darin@apple.com>
 837
 838         * sunspider: Changed "--base" to "--set-baseline".
 839
 840 2007-11-02  Darin Adler  <darin@apple.com>
 841
 842         Reviewed by Maciej.
 843
 844         * sunspider: Added a "--base" option that records the current test as a baseline.
 845         Moved the code to find the newest .mshark file into a function (since I needed to use
 846         it in the other script and I prefer to copy/paste a function).
 847
 848         * sunspider-compare-results: Added logic to compare the baseline with the last
 849         run when you don't pass any parameters.
 850
 851 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
 852
 853         Reviewed by Eric.
 854
 855         - Added list of ECMAScript3 features that SunSpider does not cover currently.
 856
 857         * UNCOVERED: Added.
 858
 859 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
 860
 861         Reviewed by Oliver.
 862
 863         - Give better error messages when sunspider-compare-results fails
 864
 865         * sunspider-compare-results:
 866
 867 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
 868
 869         Reviewed by Darin Adler.
 870
 871         - fix Date tests to work in command-line SpiderMonkey
 872
 873         * tests/date-format-tofte.js:
 874         * tests/date-format-xparb.js:
 875
 876 2007-10-29  Darin Adler  <darin@apple.com>
 877
 878         Reviewed by Maciej.
 879
 880         * sunspider: Added --shark20 option, to run Shark at its highest sample
 881         resolution instead of its default.
 882
 883 2007-10-28  Adam Roben  <aroben@apple.com>
 884
 885         Fix SunSpider on Windows
 886
 887         Reviewed by Eric.
 888
 889         * sunspider: Don't use colons in filenames.
 890
 891 2007-10-28  Darin Adler  <darin@apple.com>
 892
 893         Reviewed by Adam.
 894
 895         * resources/sunspider-analyze-results.js: Tweak the output format a little.
 896         Change so that when there's only one run we don't write out confidence
 897         intervals at all rather than writing "NaN" over and over again.
 898
 899         * sunspider: Use the time and date as a suffix on the results file, that way
 900         all the results are left behind in the tmp directory. This will make it easy
 901         for us to add features that compare past results in the future. Also rename
 902         the .mshark files using the same scheme.
 903
 904         * sunspider-compare-results: Relax the parsing rules so we can parse the
 905         results file exactly as it's emitted from sunspider.
 906
 907 2007-10-25  Adam Roben  <aroben@apple.com>
 908
 909         Strip carriage returns from results
 910
 911         Carriage returns were screwing up sunspider-compare-results on
 912         Windows.
 913
 914         Rubberstamped by Oliver.
 915
 916         * sunspider:
 917
 918 2007-10-24  Darin Adler  <darin@apple.com>
 919
 920         Reviewed by Eric.
 921
 922         * sunspider: Open the profile in shark after completing a run.
 923         * sunspider-compare-results: Tiny perl tweaks.
 924
 925 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
 926
 927         Reviewed by Darin Adler.
 928
 929         - Don't hardcode my path to testkjs
 930
 931         * sunspider-compare-results:
 932
 933 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
 934
 935         Reviewed by Darin Adler.
 936
 937         - Add a compare script to compare results, and improve formatting of standard results a bit.
 938
 939         * resources/sunspider-analyze-results.js:
 940         * resources/sunspider-compare-results.js: Added.
 941         * sunspider-compare-results: Added.
 942
 943 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
 944
 945         Reviewed by Darin Adler.
 946
 947         * resources/sunspider-analyze-results.js: Do the error range
 948         properly, using the t-distribution instead of 1.96 (which was
 949         based on the normal distribution).
 950
 951         * sunspider: Print results in a way that will be friendlier to the
 952         soon-to-come compare mode.
 953
 954 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
 955
 956         Reviewed by Review.
 957
 958         - add more tests (probably the final set for now)
 959
 960         Already balanced. Added date, regexp, control flow, and a few
 961         more string and object/array access tests.
 962
 963         * tests/LIST:
 964         * tests/access-fannkuch.js: Added.
 965         * tests/access-nbody.js: Added.
 966         * tests/controlflow-recursive.js: Added.
 967         * tests/date-format-tofte.js: Added.
 968         * tests/date-format-xparb.js: Added.
 969         * tests/regexp-dna.js: Added.
 970         * tests/string-validate-input.js: Added.
 971
 972 2007-10-21  Eric Seidel  <eric@webkit.org>
 973
 974         Reviewed by mjs.
 975
 976         * sunspider: make --shark only sample from testkjs
 977
 978 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
 979
 980         Rubber stamped by Eric.
 981
 982         - added crypto tests (already balanced)
 983
 984         * tests/LIST:
 985         * tests/crypto-aes.js: Added.
 986         * tests/crypto-md5.js: Added.
 987         * tests/crypto-sha1.js: Added.
 988
 989 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
 990
 991         Reviewed by Adam.
 992
 993         - rebalance new tests
 994
 995         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
 996
 997         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
 998
 999         This balances them with the existing tests.
1000
1001         * tests/access-binary-trees.js:
1002         * tests/access-nsieve.js:
1003         * tests/bitops-nsieve-bits.js:
1004         * tests/math-partial-sums.js:
1005         * tests/math-spectral-norm.js:
1006         * tests/string-fasta.js:
1007
1008 2007-10-20  Eric Seidel  <eric@webkit.org>
1009
1010         Reviewed by darin.
1011
1012         Add improved argument handling to sunspider, including
1013         --runs=<number>, --tests=<pattern, --shark, and --help
1014         Also re-factor code into subroutines
1015
1016         * sunspider: improved argument handling
1017
1018 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1019
1020         Reviewed by Mark.
1021
1022         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
1023
1024         * TODO:
1025         * tests/LIST:
1026         * tests/access-binary-trees.js: Added.
1027         * tests/access-nsieve.js: Added.
1028         * tests/bitops-nsieve-bits.js: Added.
1029         * tests/math-partial-sums.js: Added.
1030         * tests/math-spectral-norm.js: Added.
1031         * tests/string-fasta.js: Added.
1032
1033 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1034
1035         Reviewed by Darin Adler.
1036
1037         * TODO: Updated to note areas that are now well-covered.
1038
1039         - Change the tests and the driver to avoid leaving large object
1040         graphs hanging around, since that throws off the subsequent tests.
1041
1042         * resources/sunspider-standalone-driver.js:
1043         * tests/3d-cube.js:
1044         * tests/3d-morph.js:
1045         * tests/3d-raytrace.js:
1046         * tests/bitops-bitwise-and.js:
1047         * tests/string-base64.js:
1048         * tests/string-tagcloud.js:
1049
1050 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1051
1052         Reviewed by Nikolas.
1053
1054         - Rebalance test complexity.
1055
1056         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
1057
1058         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1059
1060         However, for some tests, IE7 was a huge outlier compared to other
1061         major browsers. For those tests, I used Firefox 2.0.0.8 on the
1062         same OS and hardware as a normalization basis.
1063
1064         * tests/3d-morph.js:
1065         * tests/3d-raytrace.js:
1066         * tests/bitops-3bit-bits-in-byte.js:
1067         * tests/bitops-bits-in-byte.js:
1068         * tests/bitops-bitwise-and.js:
1069         * tests/math-cordic.js:
1070         * tests/string-base64.js:
1071         * tests/string-tagcloud.js:
1072         * tests/string-unpack-code.js:
1073
1074 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1075
1076         Reviewed by Oliver.
1077
1078         - Fix the browser-hosted driver to be compatible with Safari 2
1079
1080         * hosted/sunspider-driver.html:
1081
1082 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1083
1084         Rubber stamped by Hyatt.
1085
1086         - Add BSD license notice to cordic test, the original author said to do so.
1087
1088         * tests/math-cordic.js:
1089
1090 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1091
1092         Reviewed by Eric.
1093
1094         - Support Windows and Windows browsers.
1095
1096         * hosted/sunspider-results.html: Display results correctly in IE.
1097         * sunspider: tweaks to work on Windows, and with spaces in the path.
1098
1099 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1100
1101         Rubber stamped by Oliver.
1102
1103         * tests/string-tagcloud.js: Remove stray print()
1104
1105 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
1106
1107         Reviewed by Oliver.
1108
1109         Add some string test cases.
1110
1111         * tests/string-base64.js: Added. Does base64 encoding and decoding.
1112         * tests/string-tagcloud.js: Added. Parses a JSON string and
1113         generates tagcloud HTML markup based on the data.
1114         * tests/string-unpack-code.js: Added. Unpack compressed versions of
1115         four of the most popular JavaScript libraries.
1116         * tests/LIST: Added the new tests.
1117
1118 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
1119
1120         Reviewed by Anders.
1121
1122         * TODO: Updated with info on how to do the stats properly.
1123
1124         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
1125         avoid overly slowing down the benchmark.
1126
1127         Added some 3D-related test cases.
1128
1129         * tests/3d-cube.js: Added.
1130         * tests/3d-morph.js: Added.
1131         * tests/3d-raytrace.js: Added.
1132         * tests/LIST:
1133
1134 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
1135
1136         Reviewed by Darin Adler.
1137
1138         - New JavaScript benchmark
1139         http://bugs.webkit.org/show_bug.cgi?id=15515
1140
1141         A start on a new JavaScript benchmark, with standalone and
1142         browser-hosted drivers.
1143
1144         The test content is still incomplete and the drivers could use
1145         some more features but there is enough here to make a good start.
1146
1147         The drivers compute a 95% confidence interval on the mean for the
1148         whole test, each category, and each individual test to make it
1149         easier to tell whether differences are statistically
1150         significant. The confidence interval can be narrowed by running
1151         the test more times.
1152
1153         * TODO: Added. Remaining things that need to be done.
1154         * sunspider: Added. Perl script that acts as the standalone test driver.
1155         * resources/sunspider-standalone-driver.js: Added. JavaScript part
1156         of standalone test driver.
1157         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
1158         analysis code.
1159         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
1160         * make-hosted: Added. Script to generate browser-hosted tests.
1161         * hosted/sunspider.html: Added. Start page for browser-hosted test.
1162         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
1163         * hosted/sunspider-results.html: Added. Results page for browser-hosted
1164         tests.
1165         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
1166         tests.
1167         * tests/LIST: Added. List of tests to use.
1168         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
1169         * tests/bitops-bits-in-byte.js: Added. Ditto.
1170         * tests/bitops-bitwise-and.js: Added. Ditto.
1171         * tests/math-cordic.js: Added. Ditto.
1172