SunSpider/ChangeLog

   1 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
   2
   3         Fixing commit error...
   4
   5         I accidentally committed my last patch in a form that broke Web-hosted SunSpider. Fixing.
   6
   7         * resources/driver-TEMPLATE.html:
   8
   9 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
  10
  11         Reviewed by Sam Weinig.
  12
  13         Use JSON.parse instead of eval for Web-hosted SunSpider results processing
  14         https://bugs.webkit.org/show_bug.cgi?id=32490
  15
  16         * hosted/json2.js: Added. Incorporated from json.org
  17         * resources/driver-TEMPLATE.html: Fix an HTML validation bug I noticed.
  18         * resources/results-TEMPLATE.html: Use JSON.parse instead of eval to process
  19         results.
  20
  21 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
  22
  23         Reviewed by Oliver Hunt.
  24
  25         Enable Web-hosted version of SunSpider to handle multiple versions
  26         https://bugs.webkit.org/show_bug.cgi?id=32478
  27
  28         * make-hosted: Now generate the hosted version to be able to run both the
  29         0.9 and the 0.9.1 test suites.
  30         * hosted: Modified property svn:ignore.
  31         * hosted/sunspider-driver.html: Removed.
  32         * hosted/sunspider-results.html: Removed.
  33         * hosted/sunspider.html:
  34         * hosted/versions.html: Added.
  35         * resources/TEMPLATE.html:
  36         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-driver.html.
  37         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-results.html.
  38
  39 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
  40
  41         Reviewed by Oliver Hunt.
  42
  43         Give command-line sunspider the ability to handle multiple suites and versions
  44         https://bugs.webkit.org/show_bug.cgi?id=32477
  45
  46         Each suite/version's set of tests are now in a separate subdirectory of tests/, with a file named LIST
  47         enumerating the tests. Current suites are:
  48
  49         sunspider-0.9 - riginal SunSpider content
  50         sunspider-0.9.1 - SunSpider suite with a few tests fixed (and a few more to come)
  51         ubench - "ubench" microbenchmark suite
  52         v8-v4 - version 4 of the v8 benchmark
  53         parse-only - some parser tests
  54
  55         Sunspider can now be run with the --suite= parameter to select a
  56         suite. The default is --suite=sunspider-0.9.
  57
  58         * .: Modified property svn:ignore to ignore new results directories.
  59         * make-hosted: Generate based on sunspider-0.9 suite.
  60         * resources/TEMPLATE.html: Fix an HTML compliance problem.
  61         * resources/sunspider-standalone-driver.js: Become aware of suite names.
  62         * sunspider: Modified to handle multiple suites as described above.
  63         * sunspider-compare-results: ditto
  64         * tests/LIST: Moved to tests/sunspider-0.9/ and tests/sunspider-0.9.1/
  65         * tests/LIST-PARSE-ONLY: Moved to parse-only/LIST
  66         * tests/LIST-UBENCH: Removed.
  67         * tests/LIST-V8: Removed.
  68         * tests/3d-cube.js: Moved to tests/sunspider-0.9 and tests/sunspider-0.9.1
  69         * tests/3d-morph.js: ditto
  70         * tests/3d-raytrace.js: ditto
  71         * tests/access-binary-trees.js: ditto
  72         * tests/access-fannkuch.js: ditto
  73         * tests/access-nbody.js: ditto
  74         * tests/access-nsieve.js: ditto
  75         * tests/bitops-3bit-bits-in-byte.js: ditto
  76         * tests/bitops-bits-in-byte.js: ditto
  77         * tests/bitops-bitwise-and.js: ditto
  78         * tests/bitops-nsieve-bits.js: ditto
  79         * tests/controlflow-recursive.js: ditto
  80         * tests/crypto-aes.js: ditto
  81         * tests/crypto-md5.js: ditto
  82         * tests/crypto-sha1.js: ditto
  83         * tests/date-format-tofte.js: ditto
  84         * tests/date-format-xparb.js: ditto
  85         * tests/math-cordic.js: ditto
  86         * tests/math-partial-sums.js: ditto
  87         * tests/math-spectral-norm.js: ditto
  88         * tests/regexp-dna.js: ditto
  89         * tests/string-base64.js: ditto
  90         * tests/string-fasta.js: ditto
  91         * tests/string-tagcloud.js: ditto
  92         * tests/string-unpack-code.js: ditto
  93         * tests/string-validate-input.js: ditto
  94         * tests/sunspider-0.9/: Added
  95         * tests/sunspider-0.9/*.js: Moved from one level up
  96         * tests/sunspider-0.9.1: Added.
  97         * tests/sunspider-0.9.1/*.js: Moved from one level up.
  98         * tests/v8-crypto.js: Moved to v8-v4/ directory.
  99         * tests/v8-deltablue.js: ditto
 100         * tests/v8-earley-boyer.js: ditto
 101         * tests/v8-raytrace.js: ditto
 102         * tests/v8-regexp.js: ditto
 103         * tests/v8-richards.js: ditto
 104         * tests/v8-splay.js: ditto
 105         * tests/v8-v4: Added.
 106
 107 2009-09-30  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
 108
 109         Reviewed by Darin Adler.
 110
 111         Platform specific null device replaced with a platform independent.
 112         https://bugs.webkit.org/show_bug.cgi?id=29544
 113
 114         * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL.
 115
 116 2009-09-21  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
 117
 118         Reviewed by Maciej Stachowiak.
 119
 120         [Qt] Make sunspider script work on Windows platform.
 121         https://bugs.webkit.org/show_bug.cgi?id=29544
 122
 123         * sunspider:
 124         Using platform specific null device instead of /dev/null.
 125
 126 2009-06-19  Adam Treat  <adam.treat@torchmobile.com>
 127
 128         Reviewed by Oliver Hunt.
 129
 130         https://bugs.webkit.org/show_bug.cgi?id=26540
 131         Currently the SunSpider test driver lacks an option to run a test suite that
 132         will test JavaScriptCore parsing performance only.  This patch adds just such
 133         a test suite and option to SunSpider as well as the jsc test shell.  I've included
 134         three large javascript source files found in the wild: jquery, mootools and prototype.
 135         Combined with the concatenation of all three, these form a new testsuite to measure
 136         and test pure JavaScriptCore parsing performance.
 137
 138         * resources/sunspider-standalone-driver.js:
 139           Load the js with parse-only flag if it is part of the parse-only suite.
 140         * sunspider:
 141           Add the parse-only suite to the list of options.
 142         * sunspider-compare-results:
 143           Add the parse-only suite to the list of options.
 144         * tests/LIST-PARSE-ONLY: Added.
 145         * tests/parse-only/concat-jquery-mootools-prototype.js: Added.
 146           A very large concatenation of the scripts found below.  This js takes ~30ms to parse on my machine.
 147         * tests/parse-only/jquery-1.3.2.js: Added.
 148           Latest version from jquery.com.
 149         * tests/parse-only/mootools-1.2.2-core-nc.js: Added.
 150           Latest version from mootools.net.
 151         * tests/parse-only/prototype-1.6.0.3.js: Added.
 152           Latest version from prototypejs.org.
 153
 154 2009-06-13  Steve Falkenburg  <sfalken@apple.com>
 155
 156         Update V8 benchmark to version 4.
 157
 158         Reviewed by Cameron Zwarich.
 159
 160         * tests/LIST-V8:
 161         * tests/v8-crypto.js:
 162         * tests/v8-deltablue.js:
 163         * tests/v8-earley-boyer.js:
 164         * tests/v8-raytrace.js:
 165         * tests/v8-regexp.js: Added.
 166         * tests/v8-richards.js:
 167         * tests/v8-splay.js: Added.
 168
 169 2009-05-26  Olivier DOLE  <odole@pleyo.com>
 170
 171         Reviewed by Maciej.
 172
 173         Store sunspider test suite results in a specific directory for each
 174         different type of benchmark (sunspider, V8 or ubench).
 175
 176         * sunspider:
 177         * sunspider-compare-results:
 178
 179 2009-05-12  Steve Falkenburg  <sfalken@apple.com>
 180
 181         Build fix.
 182
 183         * SunSpider.make:
 184
 185 2009-05-11  Steve Falkenburg  <sfalken@apple.com>
 186
 187         Include SunSpider tests in production builds.
 188
 189         Reviewed by Adam Roben.
 190
 191         * SunSpider.make: Added.
 192         * xcopy.excludes: Added.
 193
 194 2009-03-04  Oliver Hunt  <oliver@apple.com>
 195
 196         Added a few more tests to ubench
 197
 198         RS=Gavin Barraclough
 199
 200         Adding a couple of test to cover too few and too many arguments.  This
 201         is needed to prevent regressions in all call paths from my current refactoring.
 202
 203         * tests/LIST-UBENCH:
 204         * tests/ubench/function-correct-args.js: Added.
 205         (f):
 206         * tests/ubench/function-excess-args.js: Added.
 207         (f):
 208
 209 2008-10-30  Zoltan Horvath  <Horvath.Zoltan.6@stud.u-szeged.hu>
 210
 211         Fix a bug where when V8's or UBENCH's test suite list file is missing
 212         the error message is suggesting that SunSpider's list file is missing.
 213
 214         Reviewed by Sam Weinig.
 215
 216         * sunspider:
 217         (loadTestsList): Fix the error message to use the right list name.
 218
 219 2008-10-07  David Hyatt  <hyatt@apple.com>
 220
 221         https://bugs.webkit.org/show_bug.cgi?id=18989
 222
 223         Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
 224         we want all browsers to be doing the same thing on the test.
 225
 226         Reviewed by Maciej
 227
 228         * tests/regexp-dna.js:
 229
 230 2008-09-09  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 231
 232         Rubber-stamped by Maciej Stachowiak.
 233
 234         The bleeding edge branch of V8 now supports passing fileanmes after
 235         '-f', so the SunSpider script should be changed to do this again.
 236         This allows all 3 major JavaScript engines to be used with the
 237         unmodified SunSpider script.
 238
 239         * sunspider:
 240
 241 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 242
 243         Reviewed by Maciej Stachowiak.
 244
 245         Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
 246         and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
 247         correct the punctuation in its documentation.
 248
 249         * sunspider:
 250
 251 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 252
 253         Reviewed by Oliver Hunt.
 254
 255         Bug 20616: Incorporate V8 benchmarks in testing
 256         <https://bugs.webkit.org/show_bug.cgi?id=20616>
 257
 258         This is a first attempt at running the V8 benchmarks within SunSpider,
 259         with the --v8 option. The number of iterations is fixed for each
 260         benchmark, and was chosen to make each of the benchmarks run between
 261         500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
 262
 263         * sunspider:
 264         * tests/LIST-V8: Added.
 265         * tests/v8-crypto.js: Added.
 266         * tests/v8-deltablue.js: Added.
 267         * tests/v8-earley-boyer.js: Added.
 268         * tests/v8-raytrace.js: Added.
 269         * tests/v8-richards.js: Added.
 270
 271 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 272
 273         Not reviewed.
 274
 275         Remove a local change that was accidentally committed in r36034.
 276
 277         * resources/sunspider-standalone-driver.js:
 278
 279 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 280
 281         Rubber-stamped by Oliver Hunt.
 282
 283         Make SunSpider work with JavaScript shells that don't take filenames
 284         after a '-f' argument.
 285
 286         * sunspider:
 287
 288 2008-06-07  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 289
 290         Reviewed by Timothy.
 291
 292         Remove the --squirrelfish option from SunSpider, as it is no longer needed.
 293
 294         * sunspider:
 295         * tests/LIST-SQUIRRELFISH: Removed.
 296
 297 2008-06-03  Alexey Proskuryakov  <ap@webkit.org>
 298
 299         Rubber-stamped by Mark Rowe.
 300
 301         Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
 302
 303         * sunspider:
 304
 305 2008-04-15  Maciej Stachowiak  <mjs@apple.com>
 306
 307         Rubber stamped by Oliver.
 308
 309         - add newly working tests to squirrelfish list
 310
 311         * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
 312
 313 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 314
 315         Rubber stamped by Oliver.
 316
 317         - move ubench tests properly.
 318
 319         * tests/ubench: Added.
 320         * tests/ubench/function-closure.js: Added.
 321         * tests/ubench/function-empty.js: Added.
 322         * tests/ubench/function-missing-args.js: Added.
 323         * tests/ubench/function-sum.js: Added.
 324         * tests/ubench/loop-empty-resolve.js: Added.
 325         * tests/ubench/loop-empty.js: Added.
 326         * tests/ubench/loop-sum.js: Added.
 327
 328 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 329
 330         Rubber stamped by Oliver.
 331
 332         * sunspider: Don't force --runs=1 in squirrelfish mode any more.
 333
 334 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 335
 336         Reviewed by Oliver.
 337
 338         - make --squirrelfish mode use the real harness, but a reduced set of tests
 339
 340         Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
 341
 342         * sunspider:
 343         * tests/LIST-SQUIRRELFISH:
 344         * tests/LIST-UBENCH: Added.
 345         * tests/squirrelfish: Moved to tests/ubench
 346
 347 2008-04-14  Geoffrey Garen  <ggaren@apple.com>
 348
 349         Reviewed by Maciej Stachowiak.
 350
 351         Removed an unused test.
 352
 353         * tests/squirrelfish/loop-resolve.js: Removed.
 354
 355 2008-04-10  Maciej Stachowiak  <mjs@apple.com>
 356
 357         Reviewed by Oliver.
 358
 359         Add newly runnable tests to --squirrelfish mode.
 360
 361         * tests/LIST-SQUIRRELFISH:
 362
 363 2008-04-06  Geoffrey Garen  <ggaren@apple.com>
 364
 365         Reviewed by Maciej Stachowiak.
 366
 367         A little more love for --squirrelfish mode:
 368
 369         Fixed a misplaced sort. Results properly sort now.
 370
 371         Added a test list just for squirrelfish, and updated it to include
 372         all currently passing SunSpider tests.
 373
 374         Fixed the pruning regexp to match 3d-morph.js.
 375
 376         * sunspider:
 377
 378 2008-03-26  Geoffrey Garen  <ggaren@apple.com>
 379
 380         Reviewed by Oliver Hunt.
 381
 382         --squirrelfish mode: pared down tests for squirrelfish to chew on.
 383
 384         * sunspider:
 385         * tests/LIST:
 386         * tests/squirrelfish: Added.
 387         * tests/squirrelfish/function-closure.js: Added.
 388         * tests/squirrelfish/function-empty.js: Added.
 389         * tests/squirrelfish/function-missing-args.js: Added.
 390         * tests/squirrelfish/function-sum.js: Added.
 391         * tests/squirrelfish/loop-empty-resolve.js: Added.
 392         * tests/squirrelfish/loop-empty.js: Added.
 393         * tests/squirrelfish/loop-resolve.js: Added.
 394         * tests/squirrelfish/loop-sum.js: Added.
 395
 396 2008-03-21  Alexey Proskuryakov  <ap@webkit.org>
 397
 398         Reviewed by Geoff.
 399
 400         * sunspider: Pause update daemon on Darwin to make results reliable
 401         again (workaround for <rdar://problem/5811127>).
 402
 403 2008-02-07  Eric Seidel  <eric@webkit.org>
 404
 405         Reviewed by Sam.
 406
 407         * sunspider: add an error message when ./tests/LIST is not found
 408
 409 2007-12-29  Alp Toker  <alp@atoker.com>
 410
 411         Fix typo.
 412
 413         * hosted/sunspider.html:
 414
 415 2007-12-29  Alp Toker  <alp@atoker.com>
 416
 417         Reviewed by Maciej.
 418
 419         Provide the current URL in the SunSpider results page. Useful for
 420         copying benchmark results out of browsers without a location bar or
 421         where the location bar can't handle long URLs.
 422
 423         * hosted/sunspider-results.html:
 424
 425 2007-12-20  Eric Seidel  <eric@webkit.org>
 426
 427         Reviewed by mjs.
 428
 429         * sunspider: increase default number of runs for more accurate numbers
 430
 431 2007-12-18  Mark Rowe  <mrowe@apple.com>
 432
 433         Fix typo.
 434
 435         * hosted/sunspider.html:
 436
 437 2007-12-18  Maciej Stachowiak  <mjs@apple.com>
 438
 439         Reviewed by Eric.
 440
 441         - give an extra digit of precision for small differences.
 442
 443         * resources/sunspider-compare-results.js:
 444
 445 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 446
 447         Reviewed by Eric.
 448
 449         - work around IE layout bugs
 450
 451         * hosted/sunspider.css:
 452
 453 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 454
 455         Reviewed by Mark.
 456
 457         - fix compare feature
 458
 459         * hosted/sunspider-results.html:
 460
 461 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 462
 463         Reviewed by Mark.
 464
 465         - Change the format of the output URL to be shorter, to meet IE constraints
 466
 467         * hosted/sunspider-driver.html:
 468         * hosted/sunspider-results.html:
 469
 470 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
 471
 472         Reviewed by Oliver.
 473
 474         - Add some explanatory test and a dumb logo to SunSpider web hosted version
 475
 476         * hosted/sunspider-driver.html:
 477         * hosted/sunspider-results.html:
 478         * hosted/sunspider.css:
 479         * hosted/sunspider.html:
 480
 481 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
 482
 483         Reviewed by Oliver.
 484
 485         - Make the web-hosted version of SunSpider look a little bit less drab.
 486
 487         * hosted/sunspider-driver.html:
 488         * hosted/sunspider-results.html:
 489         * hosted/sunspider.css: Added.
 490         * hosted/sunspider.html:
 491         * resources/TEMPLATE.html:
 492
 493 2007-12-12  Maciej Stachowiak  <mjs@apple.com>
 494
 495         Reviewed by Sam.
 496
 497         - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
 498
 499         A sample of what new-style results would look like:
 500
 501         TEST                   COMPARISON            FROM                 TO             DETAILS
 502         ...
 503         ** TOTAL **:           1.41x as fast     6613.6ms +/- 0.1%   4703.0ms +/- 0.1%     significant
 504         ...
 505             3bit-bits-in-byte: *1.36x as slow*     88.8ms +/- 0.6%    121.1ms +/- 0.6%     significant
 506
 507         * resources/sunspider-compare-results.js:
 508
 509 2007-11-14  Eric Seidel  <eric@webkit.org>
 510
 511         Reviewed by Sam.
 512
 513         * sunspider: add --shark-cache for L2 Cache Miss profiling
 514
 515 2007-11-09  Alexey Proskuryakov  <ap@webkit.org>
 516
 517         Reviewed by Darin Adler.
 518
 519         http://bugs.webkit.org/show_bug.cgi?id=15925
 520         SunSpider should check for Shark being installed
 521
 522         * sunspider: Explicitly test that shark command line tool is installed.
 523
 524 2007-11-04  Darin Adler  <darin@apple.com>
 525
 526         * hosted/sunspider.html: Tweaked formatting a bit.
 527
 528 2007-11-03  Maciej Stachowiak  <mjs@apple.com>
 529
 530         Reviewed by Darin Adler.
 531
 532         - Add compare mode and a description of the benchmark to the hosted version.
 533
 534         * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
 535         * hosted/sunspider.html: Added intro text.
 536         * make-hosted: Copy new file.
 537         * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
 538         a function.
 539         * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
 540         expects.
 541         * sunspider-compare-results: Use sunspider-standalone-compare.js.
 542
 543 2007-11-02  Darin Adler  <darin@apple.com>
 544
 545         * sunspider: Changed "--base" to "--set-baseline".
 546
 547 2007-11-02  Darin Adler  <darin@apple.com>
 548
 549         Reviewed by Maciej.
 550
 551         * sunspider: Added a "--base" option that records the current test as a baseline.
 552         Moved the code to find the newest .mshark file into a function (since I needed to use
 553         it in the other script and I prefer to copy/paste a function).
 554
 555         * sunspider-compare-results: Added logic to compare the baseline with the last
 556         run when you don't pass any parameters.
 557
 558 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
 559
 560         Reviewed by Eric.
 561
 562         - Added list of ECMAScript3 features that SunSpider does not cover currently.
 563
 564         * UNCOVERED: Added.
 565
 566 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
 567
 568         Reviewed by Oliver.
 569
 570         - Give better error messages when sunspider-compare-results fails
 571
 572         * sunspider-compare-results:
 573
 574 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
 575
 576         Reviewed by Darin Adler.
 577
 578         - fix Date tests to work in command-line SpiderMonkey
 579
 580         * tests/date-format-tofte.js:
 581         * tests/date-format-xparb.js:
 582
 583 2007-10-29  Darin Adler  <darin@apple.com>
 584
 585         Reviewed by Maciej.
 586
 587         * sunspider: Added --shark20 option, to run Shark at its highest sample
 588         resolution instead of its default.
 589
 590 2007-10-28  Adam Roben  <aroben@apple.com>
 591
 592         Fix SunSpider on Windows
 593
 594         Reviewed by Eric.
 595
 596         * sunspider: Don't use colons in filenames.
 597
 598 2007-10-28  Darin Adler  <darin@apple.com>
 599
 600         Reviewed by Adam.
 601
 602         * resources/sunspider-analyze-results.js: Tweak the output format a little.
 603         Change so that when there's only one run we don't write out confidence
 604         intervals at all rather than writing "NaN" over and over again.
 605
 606         * sunspider: Use the time and date as a suffix on the results file, that way
 607         all the results are left behind in the tmp directory. This will make it easy
 608         for us to add features that compare past results in the future. Also rename
 609         the .mshark files using the same scheme.
 610
 611         * sunspider-compare-results: Relax the parsing rules so we can parse the
 612         results file exactly as it's emitted from sunspider.
 613
 614 2007-10-25  Adam Roben  <aroben@apple.com>
 615
 616         Strip carriage returns from results
 617
 618         Carriage returns were screwing up sunspider-compare-results on
 619         Windows.
 620
 621         Rubberstamped by Oliver.
 622
 623         * sunspider:
 624
 625 2007-10-24  Darin Adler  <darin@apple.com>
 626
 627         Reviewed by Eric.
 628
 629         * sunspider: Open the profile in shark after completing a run.
 630         * sunspider-compare-results: Tiny perl tweaks.
 631
 632 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
 633
 634         Reviewed by Darin Adler.
 635
 636         - Don't hardcode my path to testkjs
 637
 638         * sunspider-compare-results:
 639
 640 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
 641
 642         Reviewed by Darin Adler.
 643
 644         - Add a compare script to compare results, and improve formatting of standard results a bit.
 645
 646         * resources/sunspider-analyze-results.js:
 647         * resources/sunspider-compare-results.js: Added.
 648         * sunspider-compare-results: Added.
 649
 650 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
 651
 652         Reviewed by Darin Adler.
 653
 654         * resources/sunspider-analyze-results.js: Do the error range
 655         properly, using the t-distribution instead of 1.96 (which was
 656         based on the normal distribution).
 657
 658         * sunspider: Print results in a way that will be friendlier to the
 659         soon-to-come compare mode.
 660
 661 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
 662
 663         Reviewed by Review.
 664
 665         - add more tests (probably the final set for now)
 666
 667         Already balanced. Added date, regexp, control flow, and a few
 668         more string and object/array access tests.
 669
 670         * tests/LIST:
 671         * tests/access-fannkuch.js: Added.
 672         * tests/access-nbody.js: Added.
 673         * tests/controlflow-recursive.js: Added.
 674         * tests/date-format-tofte.js: Added.
 675         * tests/date-format-xparb.js: Added.
 676         * tests/regexp-dna.js: Added.
 677         * tests/string-validate-input.js: Added.
 678
 679 2007-10-21  Eric Seidel  <eric@webkit.org>
 680
 681         Reviewed by mjs.
 682
 683         * sunspider: make --shark only sample from testkjs
 684
 685 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
 686
 687         Rubber stamped by Eric.
 688
 689         - added crypto tests (already balanced)
 690
 691         * tests/LIST:
 692         * tests/crypto-aes.js: Added.
 693         * tests/crypto-md5.js: Added.
 694         * tests/crypto-sha1.js: Added.
 695
 696 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
 697
 698         Reviewed by Adam.
 699
 700         - rebalance new tests
 701
 702         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
 703
 704         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
 705
 706         This balances them with the existing tests.
 707
 708         * tests/access-binary-trees.js:
 709         * tests/access-nsieve.js:
 710         * tests/bitops-nsieve-bits.js:
 711         * tests/math-partial-sums.js:
 712         * tests/math-spectral-norm.js:
 713         * tests/string-fasta.js:
 714
 715 2007-10-20  Eric Seidel  <eric@webkit.org>
 716
 717         Reviewed by darin.
 718
 719         Add improved argument handling to sunspider, including
 720         --runs=<number>, --tests=<pattern, --shark, and --help
 721         Also re-factor code into subroutines
 722
 723         * sunspider: improved argument handling
 724
 725 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 726
 727         Reviewed by Mark.
 728
 729         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
 730
 731         * TODO:
 732         * tests/LIST:
 733         * tests/access-binary-trees.js: Added.
 734         * tests/access-nsieve.js: Added.
 735         * tests/bitops-nsieve-bits.js: Added.
 736         * tests/math-partial-sums.js: Added.
 737         * tests/math-spectral-norm.js: Added.
 738         * tests/string-fasta.js: Added.
 739
 740 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 741
 742         Reviewed by Darin Adler.
 743
 744         * TODO: Updated to note areas that are now well-covered.
 745
 746         - Change the tests and the driver to avoid leaving large object
 747         graphs hanging around, since that throws off the subsequent tests.
 748
 749         * resources/sunspider-standalone-driver.js:
 750         * tests/3d-cube.js:
 751         * tests/3d-morph.js:
 752         * tests/3d-raytrace.js:
 753         * tests/bitops-bitwise-and.js:
 754         * tests/string-base64.js:
 755         * tests/string-tagcloud.js:
 756
 757 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 758
 759         Reviewed by Nikolas.
 760
 761         - Rebalance test complexity.
 762
 763         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
 764
 765         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
 766
 767         However, for some tests, IE7 was a huge outlier compared to other
 768         major browsers. For those tests, I used Firefox 2.0.0.8 on the
 769         same OS and hardware as a normalization basis.
 770
 771         * tests/3d-morph.js:
 772         * tests/3d-raytrace.js:
 773         * tests/bitops-3bit-bits-in-byte.js:
 774         * tests/bitops-bits-in-byte.js:
 775         * tests/bitops-bitwise-and.js:
 776         * tests/math-cordic.js:
 777         * tests/string-base64.js:
 778         * tests/string-tagcloud.js:
 779         * tests/string-unpack-code.js:
 780
 781 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 782
 783         Reviewed by Oliver.
 784
 785         - Fix the browser-hosted driver to be compatible with Safari 2
 786
 787         * hosted/sunspider-driver.html:
 788
 789 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 790
 791         Rubber stamped by Hyatt.
 792
 793         - Add BSD license notice to cordic test, the original author said to do so.
 794
 795         * tests/math-cordic.js:
 796
 797 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 798
 799         Reviewed by Eric.
 800
 801         - Support Windows and Windows browsers.
 802
 803         * hosted/sunspider-results.html: Display results correctly in IE.
 804         * sunspider: tweaks to work on Windows, and with spaces in the path.
 805
 806 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 807
 808         Rubber stamped by Oliver.
 809
 810         * tests/string-tagcloud.js: Remove stray print()
 811
 812 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
 813
 814         Reviewed by Oliver.
 815
 816         Add some string test cases.
 817
 818         * tests/string-base64.js: Added. Does base64 encoding and decoding.
 819         * tests/string-tagcloud.js: Added. Parses a JSON string and
 820         generates tagcloud HTML markup based on the data.
 821         * tests/string-unpack-code.js: Added. Unpack compressed versions of
 822         four of the most popular JavaScript libraries.
 823         * tests/LIST: Added the new tests.
 824
 825 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
 826
 827         Reviewed by Anders.
 828
 829         * TODO: Updated with info on how to do the stats properly.
 830
 831         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
 832         avoid overly slowing down the benchmark.
 833
 834         Added some 3D-related test cases.
 835
 836         * tests/3d-cube.js: Added.
 837         * tests/3d-morph.js: Added.
 838         * tests/3d-raytrace.js: Added.
 839         * tests/LIST:
 840
 841 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
 842
 843         Reviewed by Darin Adler.
 844
 845         - New JavaScript benchmark
 846         http://bugs.webkit.org/show_bug.cgi?id=15515
 847
 848         A start on a new JavaScript benchmark, with standalone and
 849         browser-hosted drivers.
 850
 851         The test content is still incomplete and the drivers could use
 852         some more features but there is enough here to make a good start.
 853
 854         The drivers compute a 95% confidence interval on the mean for the
 855         whole test, each category, and each individual test to make it
 856         easier to tell whether differences are statistically
 857         significant. The confidence interval can be narrowed by running
 858         the test more times.
 859
 860         * TODO: Added. Remaining things that need to be done.
 861         * sunspider: Added. Perl script that acts as the standalone test driver.
 862         * resources/sunspider-standalone-driver.js: Added. JavaScript part
 863         of standalone test driver.
 864         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
 865         analysis code.
 866         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
 867         * make-hosted: Added. Script to generate browser-hosted tests.
 868         * hosted/sunspider.html: Added. Start page for browser-hosted test.
 869         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
 870         * hosted/sunspider-results.html: Added. Results page for browser-hosted
 871         tests.
 872         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
 873         tests.
 874         * tests/LIST: Added. List of tests to use.
 875         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
 876         * tests/bitops-bits-in-byte.js: Added. Ditto.
 877         * tests/bitops-bitwise-and.js: Added. Ditto.
 878         * tests/math-cordic.js: Added. Ditto.
 879