SunSpider/ChangeLog

   1 2007-10-25  Adam Roben  <aroben@apple.com>
   2
   3         Strip carriage returns from results
   4
   5         Carriage returns were screwing up sunspider-compare-results on
   6         Windows.
   7
   8         Rubberstamped by Oliver.
   9
  10         * sunspider:
  11
  12 2007-10-24  Darin Adler  <darin@apple.com>
  13
  14         Reviewed by Eric.
  15
  16         * sunspider: Open the profile in shark after completing a run.
  17         * sunspider-compare-results: Tiny perl tweaks.
  18
  19 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
  20
  21         Reviewed by Darin.
  22
  23         - Don't hardcode my path to testkjs
  24
  25         * sunspider-compare-results:
  26
  27 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
  28
  29         Reviewed by Darin.
  30
  31         - Add a compare script to compare results, and improve formatting of standard results a bit.
  32
  33         * resources/sunspider-analyze-results.js:
  34         * resources/sunspider-compare-results.js: Added.
  35         * sunspider-compare-results: Added.
  36
  37 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
  38
  39         Reviewed by Darin.
  40
  41         * resources/sunspider-analyze-results.js: Do the error range
  42         properly, using the t-distribution instead of 1.96 (which was
  43         based on the normal distribution).
  44
  45         * sunspider: Print results in a way that will be friendlier to the
  46         soon-to-come compare mode.
  47
  48 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
  49
  50         Reviewed by Review.
  51
  52         - add more tests (probably the final set for now)
  53
  54         Already balanced. Added date, regexp, control flow, and a few
  55         more string and object/array access tests.
  56
  57         * tests/LIST:
  58         * tests/access-fannkuch.js: Added.
  59         * tests/access-nbody.js: Added.
  60         * tests/controlflow-recursive.js: Added.
  61         * tests/date-format-tofte.js: Added.
  62         * tests/date-format-xparb.js: Added.
  63         * tests/regexp-dna.js: Added.
  64         * tests/string-validate-input.js: Added.
  65
  66 2007-10-21  Eric Seidel  <eric@webkit.org>
  67
  68         Reviewed by mjs.
  69
  70         * sunspider: make --shark only sample from testkjs
  71
  72 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
  73
  74         Rubber stamped by Eric.
  75
  76         - added crypto tests (already balanced)
  77
  78         * tests/LIST:
  79         * tests/crypto-aes.js: Added.
  80         * tests/crypto-md5.js: Added.
  81         * tests/crypto-sha1.js: Added.
  82
  83 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
  84
  85         Reviewed by Adam.
  86
  87         - rebalance new tests
  88
  89         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
  90
  91         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
  92
  93         This balances them with the existing tests.
  94
  95         * tests/access-binary-trees.js:
  96         * tests/access-nsieve.js:
  97         * tests/bitops-nsieve-bits.js:
  98         * tests/math-partial-sums.js:
  99         * tests/math-spectral-norm.js:
 100         * tests/string-fasta.js:
 101
 102 2007-10-20  Eric Seidel  <eric@webkit.org>
 103
 104         Reviewed by darin.
 105
 106         Add improved argument handling to sunspider, including
 107         --runs=<number>, --tests=<pattern, --shark, and --help
 108         Also re-factor code into subroutines
 109
 110         * sunspider: improved argument handling
 111
 112 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 113
 114         Reviewed by Mark.
 115
 116         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
 117
 118         * TODO:
 119         * tests/LIST:
 120         * tests/access-binary-trees.js: Added.
 121         * tests/access-nsieve.js: Added.
 122         * tests/bitops-nsieve-bits.js: Added.
 123         * tests/math-partial-sums.js: Added.
 124         * tests/math-spectral-norm.js: Added.
 125         * tests/string-fasta.js: Added.
 126
 127 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 128
 129         Reviewed by Darin.
 130
 131         * TODO: Updated to note areas that are now well-covered.
 132
 133         - Change the tests and the driver to avoid leaving large object
 134         graphs hanging around, since that throws off the subsequent tests.
 135
 136         * resources/sunspider-standalone-driver.js:
 137         * tests/3d-cube.js:
 138         * tests/3d-morph.js:
 139         * tests/3d-raytrace.js:
 140         * tests/bitops-bitwise-and.js:
 141         * tests/string-base64.js:
 142         * tests/string-tagcloud.js:
 143
 144 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 145
 146         Reviewed by Nikolas.
 147
 148         - Rebalance test complexity.
 149
 150         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
 151
 152         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
 153
 154         However, for some tests, IE7 was a huge outlier compared to other
 155         major browsers. For those tests, I used Firefox 2.0.0.8 on the
 156         same OS and hardware as a normalization basis.
 157
 158         * tests/3d-morph.js:
 159         * tests/3d-raytrace.js:
 160         * tests/bitops-3bit-bits-in-byte.js:
 161         * tests/bitops-bits-in-byte.js:
 162         * tests/bitops-bitwise-and.js:
 163         * tests/math-cordic.js:
 164         * tests/string-base64.js:
 165         * tests/string-tagcloud.js:
 166         * tests/string-unpack-code.js:
 167
 168 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 169
 170         Reviewed by Oliver.
 171
 172         - Fix the browser-hosted driver to be compatible with Safari 2
 173
 174         * hosted/sunspider-driver.html:
 175
 176 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 177
 178         Rubber stamped by Hyatt.
 179
 180         - Add BSD license notice to cordic test, the original author said to do so.
 181
 182         * tests/math-cordic.js:
 183
 184 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 185
 186         Reviewed by Eric.
 187
 188         - Support Windows and Windows browsers.
 189
 190         * hosted/sunspider-results.html: Display results correctly in IE.
 191         * sunspider: tweaks to work on Windows, and with spaces in the path.
 192
 193 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 194
 195         Rubber stamped by Oliver.
 196
 197         * tests/string-tagcloud.js: Remove stray print()
 198
 199 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
 200
 201         Reviewed by Oliver.
 202
 203         Add some string test cases.
 204
 205         * tests/string-base64.js: Added. Does base64 encoding and decoding.
 206         * tests/string-tagcloud.js: Added. Parses a JSON string and
 207         generates tagcloud HTML markup based on the data.
 208         * tests/string-unpack-code.js: Added. Unpack compressed versions of
 209         four of the most popular JavaScript libraries.
 210         * tests/LIST: Added the new tests.
 211
 212 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
 213
 214         Reviewed by Anders.
 215
 216         * TODO: Updated with info on how to do the stats properly.
 217
 218         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
 219         avoid overly slowing down the benchmark.
 220
 221         Added some 3D-related test cases.
 222
 223         * tests/3d-cube.js: Added.
 224         * tests/3d-morph.js: Added.
 225         * tests/3d-raytrace.js: Added.
 226         * tests/LIST:
 227
 228 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
 229
 230         Reviewed by Darin.
 231
 232         - New JavaScript benchmark
 233         http://bugs.webkit.org/show_bug.cgi?id=15515
 234
 235         A start on a new JavaScript benchmark, with standalone and
 236         browser-hosted drivers.
 237
 238         The test content is still incomplete and the drivers could use
 239         some more features but there is enough here to make a good start.
 240
 241         The drivers compute a 95% confidence interval on the mean for the
 242         whole test, each category, and each individual test to make it
 243         easier to tell whether differences are statistically
 244         significant. The confidence interval can be narrowed by running
 245         the test more times.
 246
 247         * TODO: Added. Remaining things that need to be done.
 248         * sunspider: Added. Perl script that acts as the standalone test driver.
 249         * resources/sunspider-standalone-driver.js: Added. JavaScript part
 250         of standalone test driver.
 251         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
 252         analysis code.
 253         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
 254         * make-hosted: Added. Script to generate browser-hosted tests.
 255         * hosted/sunspider.html: Added. Start page for browser-hosted test.
 256         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
 257         * hosted/sunspider-results.html: Added. Results page for browser-hosted
 258         tests.
 259         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
 260         tests.
 261         * tests/LIST: Added. List of tests to use.
 262         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
 263         * tests/bitops-bits-in-byte.js: Added. Ditto.
 264         * tests/bitops-bitwise-and.js: Added. Ditto.
 265         * tests/math-cordic.js: Added. Ditto.
 266