SunSpider/ChangeLog

   1 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
   2
   3         Reviewed by Darin.
   4
   5         - Add a compare script to compare results, and improve formatting of standard results a bit.
   6
   7         * resources/sunspider-analyze-results.js:
   8         * resources/sunspider-compare-results.js: Added.
   9         * sunspider-compare-results: Added.
  10
  11 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
  12
  13         Reviewed by Darin.
  14
  15         * resources/sunspider-analyze-results.js: Do the error range
  16         properly, using the t-distribution instead of 1.96 (which was
  17         based on the normal distribution).
  18
  19         * sunspider: Print results in a way that will be friendlier to the
  20         soon-to-come compare mode.
  21
  22 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
  23
  24         Reviewed by Review.
  25
  26         - add more tests (probably the final set for now)
  27
  28         Already balanced. Added date, regexp, control flow, and a few
  29         more string and object/array access tests.
  30
  31         * tests/LIST:
  32         * tests/access-fannkuch.js: Added.
  33         * tests/access-nbody.js: Added.
  34         * tests/controlflow-recursive.js: Added.
  35         * tests/date-format-tofte.js: Added.
  36         * tests/date-format-xparb.js: Added.
  37         * tests/regexp-dna.js: Added.
  38         * tests/string-validate-input.js: Added.
  39
  40 2007-10-21  Eric Seidel  <eric@webkit.org>
  41
  42         Reviewed by mjs.
  43
  44         * sunspider: make --shark only sample from testkjs
  45
  46 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
  47
  48         Rubber stamped by Eric.
  49
  50         - added crypto tests (already balanced)
  51
  52         * tests/LIST:
  53         * tests/crypto-aes.js: Added.
  54         * tests/crypto-md5.js: Added.
  55         * tests/crypto-sha1.js: Added.
  56
  57 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
  58
  59         Reviewed by Adam.
  60
  61         - rebalance new tests
  62
  63         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
  64
  65         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
  66
  67         This balances them with the existing tests.
  68
  69         * tests/access-binary-trees.js:
  70         * tests/access-nsieve.js:
  71         * tests/bitops-nsieve-bits.js:
  72         * tests/math-partial-sums.js:
  73         * tests/math-spectral-norm.js:
  74         * tests/string-fasta.js:
  75
  76 2007-10-20  Eric Seidel  <eric@webkit.org>
  77
  78         Reviewed by darin.
  79
  80         Add improved argument handling to sunspider, including
  81         --runs=<number>, --tests=<pattern, --shark, and --help
  82         Also re-factor code into subroutines
  83
  84         * sunspider: improved argument handling
  85
  86 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
  87
  88         Reviewed by Mark.
  89
  90         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
  91
  92         * TODO:
  93         * tests/LIST:
  94         * tests/access-binary-trees.js: Added.
  95         * tests/access-nsieve.js: Added.
  96         * tests/bitops-nsieve-bits.js: Added.
  97         * tests/math-partial-sums.js: Added.
  98         * tests/math-spectral-norm.js: Added.
  99         * tests/string-fasta.js: Added.
 100
 101 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 102
 103         Reviewed by Darin.
 104
 105         * TODO: Updated to note areas that are now well-covered.
 106
 107         - Change the tests and the driver to avoid leaving large object
 108         graphs hanging around, since that throws off the subsequent tests.
 109
 110         * resources/sunspider-standalone-driver.js:
 111         * tests/3d-cube.js:
 112         * tests/3d-morph.js:
 113         * tests/3d-raytrace.js:
 114         * tests/bitops-bitwise-and.js:
 115         * tests/string-base64.js:
 116         * tests/string-tagcloud.js:
 117
 118 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 119
 120         Reviewed by Nikolas.
 121
 122         - Rebalance test complexity.
 123
 124         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
 125
 126         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
 127
 128         However, for some tests, IE7 was a huge outlier compared to other
 129         major browsers. For those tests, I used Firefox 2.0.0.8 on the
 130         same OS and hardware as a normalization basis.
 131
 132         * tests/3d-morph.js:
 133         * tests/3d-raytrace.js:
 134         * tests/bitops-3bit-bits-in-byte.js:
 135         * tests/bitops-bits-in-byte.js:
 136         * tests/bitops-bitwise-and.js:
 137         * tests/math-cordic.js:
 138         * tests/string-base64.js:
 139         * tests/string-tagcloud.js:
 140         * tests/string-unpack-code.js:
 141
 142 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 143
 144         Reviewed by Oliver.
 145
 146         - Fix the browser-hosted driver to be compatible with Safari 2
 147
 148         * hosted/sunspider-driver.html:
 149
 150 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 151
 152         Rubber stamped by Hyatt.
 153
 154         - Add BSD license notice to cordic test, the original author said to do so.
 155
 156         * tests/math-cordic.js:
 157
 158 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 159
 160         Reviewed by Eric.
 161
 162         - Support Windows and Windows browsers.
 163
 164         * hosted/sunspider-results.html: Display results correctly in IE.
 165         * sunspider: tweaks to work on Windows, and with spaces in the path.
 166
 167 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 168
 169         Rubber stamped by Oliver.
 170
 171         * tests/string-tagcloud.js: Remove stray print()
 172
 173 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
 174
 175         Reviewed by Oliver.
 176
 177         Add some string test cases.
 178
 179         * tests/string-base64.js: Added. Does base64 encoding and decoding.
 180         * tests/string-tagcloud.js: Added. Parses a JSON string and
 181         generates tagcloud HTML markup based on the data.
 182         * tests/string-unpack-code.js: Added. Unpack compressed versions of
 183         four of the most popular JavaScript libraries.
 184         * tests/LIST: Added the new tests.
 185
 186 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
 187
 188         Reviewed by Anders.
 189
 190         * TODO: Updated with info on how to do the stats properly.
 191
 192         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
 193         avoid overly slowing down the benchmark.
 194
 195         Added some 3D-related test cases.
 196
 197         * tests/3d-cube.js: Added.
 198         * tests/3d-morph.js: Added.
 199         * tests/3d-raytrace.js: Added.
 200         * tests/LIST:
 201
 202 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
 203
 204         Reviewed by Darin.
 205
 206         - New JavaScript benchmark
 207         http://bugs.webkit.org/show_bug.cgi?id=15515
 208
 209         A start on a new JavaScript benchmark, with standalone and
 210         browser-hosted drivers.
 211
 212         The test content is still incomplete and the drivers could use
 213         some more features but there is enough here to make a good start.
 214
 215         The drivers compute a 95% confidence interval on the mean for the
 216         whole test, each category, and each individual test to make it
 217         easier to tell whether differences are statistically
 218         significant. The confidence interval can be narrowed by running
 219         the test more times.
 220
 221         * TODO: Added. Remaining things that need to be done.
 222         * sunspider: Added. Perl script that acts as the standalone test driver.
 223         * resources/sunspider-standalone-driver.js: Added. JavaScript part
 224         of standalone test driver.
 225         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
 226         analysis code.
 227         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
 228         * make-hosted: Added. Script to generate browser-hosted tests.
 229         * hosted/sunspider.html: Added. Start page for browser-hosted test.
 230         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
 231         * hosted/sunspider-results.html: Added. Results page for browser-hosted
 232         tests.
 233         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
 234         tests.
 235         * tests/LIST: Added. List of tests to use.
 236         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
 237         * tests/bitops-bits-in-byte.js: Added. Ditto.
 238         * tests/bitops-bitwise-and.js: Added. Ditto.
 239         * tests/math-cordic.js: Added. Ditto.
 240