SunSpider/ChangeLog

   1 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
   2
   3         Reviewed by Darin.
   4
   5         - Don't hardcode my path to testkjs
   6
   7         * sunspider-compare-results:
   8
   9 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
  10
  11         Reviewed by Darin.
  12
  13         - Add a compare script to compare results, and improve formatting of standard results a bit.
  14
  15         * resources/sunspider-analyze-results.js:
  16         * resources/sunspider-compare-results.js: Added.
  17         * sunspider-compare-results: Added.
  18
  19 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
  20
  21         Reviewed by Darin.
  22
  23         * resources/sunspider-analyze-results.js: Do the error range
  24         properly, using the t-distribution instead of 1.96 (which was
  25         based on the normal distribution).
  26
  27         * sunspider: Print results in a way that will be friendlier to the
  28         soon-to-come compare mode.
  29
  30 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
  31
  32         Reviewed by Review.
  33
  34         - add more tests (probably the final set for now)
  35
  36         Already balanced. Added date, regexp, control flow, and a few
  37         more string and object/array access tests.
  38
  39         * tests/LIST:
  40         * tests/access-fannkuch.js: Added.
  41         * tests/access-nbody.js: Added.
  42         * tests/controlflow-recursive.js: Added.
  43         * tests/date-format-tofte.js: Added.
  44         * tests/date-format-xparb.js: Added.
  45         * tests/regexp-dna.js: Added.
  46         * tests/string-validate-input.js: Added.
  47
  48 2007-10-21  Eric Seidel  <eric@webkit.org>
  49
  50         Reviewed by mjs.
  51
  52         * sunspider: make --shark only sample from testkjs
  53
  54 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
  55
  56         Rubber stamped by Eric.
  57
  58         - added crypto tests (already balanced)
  59
  60         * tests/LIST:
  61         * tests/crypto-aes.js: Added.
  62         * tests/crypto-md5.js: Added.
  63         * tests/crypto-sha1.js: Added.
  64
  65 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
  66
  67         Reviewed by Adam.
  68
  69         - rebalance new tests
  70
  71         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
  72
  73         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
  74
  75         This balances them with the existing tests.
  76
  77         * tests/access-binary-trees.js:
  78         * tests/access-nsieve.js:
  79         * tests/bitops-nsieve-bits.js:
  80         * tests/math-partial-sums.js:
  81         * tests/math-spectral-norm.js:
  82         * tests/string-fasta.js:
  83
  84 2007-10-20  Eric Seidel  <eric@webkit.org>
  85
  86         Reviewed by darin.
  87
  88         Add improved argument handling to sunspider, including
  89         --runs=<number>, --tests=<pattern, --shark, and --help
  90         Also re-factor code into subroutines
  91
  92         * sunspider: improved argument handling
  93
  94 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
  95
  96         Reviewed by Mark.
  97
  98         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
  99
 100         * TODO:
 101         * tests/LIST:
 102         * tests/access-binary-trees.js: Added.
 103         * tests/access-nsieve.js: Added.
 104         * tests/bitops-nsieve-bits.js: Added.
 105         * tests/math-partial-sums.js: Added.
 106         * tests/math-spectral-norm.js: Added.
 107         * tests/string-fasta.js: Added.
 108
 109 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 110
 111         Reviewed by Darin.
 112
 113         * TODO: Updated to note areas that are now well-covered.
 114
 115         - Change the tests and the driver to avoid leaving large object
 116         graphs hanging around, since that throws off the subsequent tests.
 117
 118         * resources/sunspider-standalone-driver.js:
 119         * tests/3d-cube.js:
 120         * tests/3d-morph.js:
 121         * tests/3d-raytrace.js:
 122         * tests/bitops-bitwise-and.js:
 123         * tests/string-base64.js:
 124         * tests/string-tagcloud.js:
 125
 126 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 127
 128         Reviewed by Nikolas.
 129
 130         - Rebalance test complexity.
 131
 132         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
 133
 134         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
 135
 136         However, for some tests, IE7 was a huge outlier compared to other
 137         major browsers. For those tests, I used Firefox 2.0.0.8 on the
 138         same OS and hardware as a normalization basis.
 139
 140         * tests/3d-morph.js:
 141         * tests/3d-raytrace.js:
 142         * tests/bitops-3bit-bits-in-byte.js:
 143         * tests/bitops-bits-in-byte.js:
 144         * tests/bitops-bitwise-and.js:
 145         * tests/math-cordic.js:
 146         * tests/string-base64.js:
 147         * tests/string-tagcloud.js:
 148         * tests/string-unpack-code.js:
 149
 150 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 151
 152         Reviewed by Oliver.
 153
 154         - Fix the browser-hosted driver to be compatible with Safari 2
 155
 156         * hosted/sunspider-driver.html:
 157
 158 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 159
 160         Rubber stamped by Hyatt.
 161
 162         - Add BSD license notice to cordic test, the original author said to do so.
 163
 164         * tests/math-cordic.js:
 165
 166 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 167
 168         Reviewed by Eric.
 169
 170         - Support Windows and Windows browsers.
 171
 172         * hosted/sunspider-results.html: Display results correctly in IE.
 173         * sunspider: tweaks to work on Windows, and with spaces in the path.
 174
 175 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 176
 177         Rubber stamped by Oliver.
 178
 179         * tests/string-tagcloud.js: Remove stray print()
 180
 181 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
 182
 183         Reviewed by Oliver.
 184
 185         Add some string test cases.
 186
 187         * tests/string-base64.js: Added. Does base64 encoding and decoding.
 188         * tests/string-tagcloud.js: Added. Parses a JSON string and
 189         generates tagcloud HTML markup based on the data.
 190         * tests/string-unpack-code.js: Added. Unpack compressed versions of
 191         four of the most popular JavaScript libraries.
 192         * tests/LIST: Added the new tests.
 193
 194 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
 195
 196         Reviewed by Anders.
 197
 198         * TODO: Updated with info on how to do the stats properly.
 199
 200         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
 201         avoid overly slowing down the benchmark.
 202
 203         Added some 3D-related test cases.
 204
 205         * tests/3d-cube.js: Added.
 206         * tests/3d-morph.js: Added.
 207         * tests/3d-raytrace.js: Added.
 208         * tests/LIST:
 209
 210 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
 211
 212         Reviewed by Darin.
 213
 214         - New JavaScript benchmark
 215         http://bugs.webkit.org/show_bug.cgi?id=15515
 216
 217         A start on a new JavaScript benchmark, with standalone and
 218         browser-hosted drivers.
 219
 220         The test content is still incomplete and the drivers could use
 221         some more features but there is enough here to make a good start.
 222
 223         The drivers compute a 95% confidence interval on the mean for the
 224         whole test, each category, and each individual test to make it
 225         easier to tell whether differences are statistically
 226         significant. The confidence interval can be narrowed by running
 227         the test more times.
 228
 229         * TODO: Added. Remaining things that need to be done.
 230         * sunspider: Added. Perl script that acts as the standalone test driver.
 231         * resources/sunspider-standalone-driver.js: Added. JavaScript part
 232         of standalone test driver.
 233         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
 234         analysis code.
 235         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
 236         * make-hosted: Added. Script to generate browser-hosted tests.
 237         * hosted/sunspider.html: Added. Start page for browser-hosted test.
 238         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
 239         * hosted/sunspider-results.html: Added. Results page for browser-hosted
 240         tests.
 241         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
 242         tests.
 243         * tests/LIST: Added. List of tests to use.
 244         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
 245         * tests/bitops-bits-in-byte.js: Added. Ditto.
 246         * tests/bitops-bitwise-and.js: Added. Ditto.
 247         * tests/math-cordic.js: Added. Ditto.
 248