SunSpider/ChangeLog

   1 2007-10-20  Eric Seidel  <eric@webkit.org>
   2
   3         Reviewed by darin.
   4
   5         Add improved argument handling to sunspider, including
   6         --runs=<number>, --tests=<pattern, --shark, and --help
   7         Also re-factor code into subroutines
   8
   9         * sunspider: improved argument handling
  10
  11 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
  12
  13         Reviewed by Mark.
  14
  15         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
  16
  17         * TODO:
  18         * tests/LIST:
  19         * tests/access-binary-trees.js: Added.
  20         * tests/access-nsieve.js: Added.
  21         * tests/bitops-nsieve-bits.js: Added.
  22         * tests/math-partial-sums.js: Added.
  23         * tests/math-spectral-norm.js: Added.
  24         * tests/string-fasta.js: Added.
  25
  26 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
  27
  28         Reviewed by Darin.
  29
  30         * TODO: Updated to note areas that are now well-covered.
  31
  32         - Change the tests and the driver to avoid leaving large object
  33         graphs hanging around, since that throws off the subsequent tests.
  34
  35         * resources/sunspider-standalone-driver.js:
  36         * tests/3d-cube.js:
  37         * tests/3d-morph.js:
  38         * tests/3d-raytrace.js:
  39         * tests/bitops-bitwise-and.js:
  40         * tests/string-base64.js:
  41         * tests/string-tagcloud.js:
  42
  43 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
  44
  45         Reviewed by Nikolas.
  46
  47         - Rebalance test complexity.
  48
  49         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
  50
  51         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
  52
  53         However, for some tests, IE7 was a huge outlier compared to other
  54         major browsers. For those tests, I used Firefox 2.0.0.8 on the
  55         same OS and hardware as a normalization basis.
  56
  57         * tests/3d-morph.js:
  58         * tests/3d-raytrace.js:
  59         * tests/bitops-3bit-bits-in-byte.js:
  60         * tests/bitops-bits-in-byte.js:
  61         * tests/bitops-bitwise-and.js:
  62         * tests/math-cordic.js:
  63         * tests/string-base64.js:
  64         * tests/string-tagcloud.js:
  65         * tests/string-unpack-code.js:
  66
  67 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
  68
  69         Reviewed by Oliver.
  70
  71         - Fix the browser-hosted driver to be compatible with Safari 2
  72
  73         * hosted/sunspider-driver.html:
  74
  75 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
  76
  77         Rubber stamped by Hyatt.
  78
  79         - Add BSD license notice to cordic test, the original author said to do so.
  80
  81         * tests/math-cordic.js:
  82
  83 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
  84
  85         Reviewed by Eric.
  86
  87         - Support Windows and Windows browsers.
  88
  89         * hosted/sunspider-results.html: Display results correctly in IE.
  90         * sunspider: tweaks to work on Windows, and with spaces in the path.
  91
  92 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
  93
  94         Rubber stamped by Oliver.
  95
  96         * tests/string-tagcloud.js: Remove stray print()
  97
  98 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
  99
 100         Reviewed by Oliver.
 101
 102         Add some string test cases.
 103
 104         * tests/string-base64.js: Added. Does base64 encoding and decoding.
 105         * tests/string-tagcloud.js: Added. Parses a JSON string and
 106         generates tagcloud HTML markup based on the data.
 107         * tests/string-unpack-code.js: Added. Unpack compressed versions of
 108         four of the most popular JavaScript libraries.
 109         * tests/LIST: Added the new tests.
 110
 111 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
 112
 113         Reviewed by Anders.
 114
 115         * TODO: Updated with info on how to do the stats properly.
 116
 117         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
 118         avoid overly slowing down the benchmark.
 119
 120         Added some 3D-related test cases.
 121
 122         * tests/3d-cube.js: Added.
 123         * tests/3d-morph.js: Added.
 124         * tests/3d-raytrace.js: Added.
 125         * tests/LIST:
 126
 127 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
 128
 129         Reviewed by Darin.
 130
 131         - New JavaScript benchmark
 132         http://bugs.webkit.org/show_bug.cgi?id=15515
 133
 134         A start on a new JavaScript benchmark, with standalone and
 135         browser-hosted drivers.
 136
 137         The test content is still incomplete and the drivers could use
 138         some more features but there is enough here to make a good start.
 139
 140         The drivers compute a 95% confidence interval on the mean for the
 141         whole test, each category, and each individual test to make it
 142         easier to tell whether differences are statistically
 143         significant. The confidence interval can be narrowed by running
 144         the test more times.
 145
 146         * TODO: Added. Remaining things that need to be done.
 147         * sunspider: Added. Perl script that acts as the standalone test driver.
 148         * resources/sunspider-standalone-driver.js: Added. JavaScript part
 149         of standalone test driver.
 150         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
 151         analysis code.
 152         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
 153         * make-hosted: Added. Script to generate browser-hosted tests.
 154         * hosted/sunspider.html: Added. Start page for browser-hosted test.
 155         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
 156         * hosted/sunspider-results.html: Added. Results page for browser-hosted
 157         tests.
 158         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
 159         tests.
 160         * tests/LIST: Added. List of tests to use.
 161         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
 162         * tests/bitops-bits-in-byte.js: Added. Ditto.
 163         * tests/bitops-bitwise-and.js: Added. Ditto.
 164         * tests/math-cordic.js: Added. Ditto.
 165