SunSpider/ChangeLog

   1 2007-10-24  Darin Adler  <darin@apple.com>
   2
   3         Reviewed by Eric.
   4
   5         * sunspider: Open the profile in shark after completing a run.
   6         * sunspider-compare-results: Tiny perl tweaks.
   7
   8 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
   9
  10         Reviewed by Darin.
  11
  12         - Don't hardcode my path to testkjs
  13
  14         * sunspider-compare-results:
  15
  16 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
  17
  18         Reviewed by Darin.
  19
  20         - Add a compare script to compare results, and improve formatting of standard results a bit.
  21
  22         * resources/sunspider-analyze-results.js:
  23         * resources/sunspider-compare-results.js: Added.
  24         * sunspider-compare-results: Added.
  25
  26 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
  27
  28         Reviewed by Darin.
  29
  30         * resources/sunspider-analyze-results.js: Do the error range
  31         properly, using the t-distribution instead of 1.96 (which was
  32         based on the normal distribution).
  33
  34         * sunspider: Print results in a way that will be friendlier to the
  35         soon-to-come compare mode.
  36
  37 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
  38
  39         Reviewed by Review.
  40
  41         - add more tests (probably the final set for now)
  42
  43         Already balanced. Added date, regexp, control flow, and a few
  44         more string and object/array access tests.
  45
  46         * tests/LIST:
  47         * tests/access-fannkuch.js: Added.
  48         * tests/access-nbody.js: Added.
  49         * tests/controlflow-recursive.js: Added.
  50         * tests/date-format-tofte.js: Added.
  51         * tests/date-format-xparb.js: Added.
  52         * tests/regexp-dna.js: Added.
  53         * tests/string-validate-input.js: Added.
  54
  55 2007-10-21  Eric Seidel  <eric@webkit.org>
  56
  57         Reviewed by mjs.
  58
  59         * sunspider: make --shark only sample from testkjs
  60
  61 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
  62
  63         Rubber stamped by Eric.
  64
  65         - added crypto tests (already balanced)
  66
  67         * tests/LIST:
  68         * tests/crypto-aes.js: Added.
  69         * tests/crypto-md5.js: Added.
  70         * tests/crypto-sha1.js: Added.
  71
  72 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
  73
  74         Reviewed by Adam.
  75
  76         - rebalance new tests
  77
  78         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
  79
  80         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
  81
  82         This balances them with the existing tests.
  83
  84         * tests/access-binary-trees.js:
  85         * tests/access-nsieve.js:
  86         * tests/bitops-nsieve-bits.js:
  87         * tests/math-partial-sums.js:
  88         * tests/math-spectral-norm.js:
  89         * tests/string-fasta.js:
  90
  91 2007-10-20  Eric Seidel  <eric@webkit.org>
  92
  93         Reviewed by darin.
  94
  95         Add improved argument handling to sunspider, including
  96         --runs=<number>, --tests=<pattern, --shark, and --help
  97         Also re-factor code into subroutines
  98
  99         * sunspider: improved argument handling
 100
 101 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 102
 103         Reviewed by Mark.
 104
 105         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
 106
 107         * TODO:
 108         * tests/LIST:
 109         * tests/access-binary-trees.js: Added.
 110         * tests/access-nsieve.js: Added.
 111         * tests/bitops-nsieve-bits.js: Added.
 112         * tests/math-partial-sums.js: Added.
 113         * tests/math-spectral-norm.js: Added.
 114         * tests/string-fasta.js: Added.
 115
 116 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 117
 118         Reviewed by Darin.
 119
 120         * TODO: Updated to note areas that are now well-covered.
 121
 122         - Change the tests and the driver to avoid leaving large object
 123         graphs hanging around, since that throws off the subsequent tests.
 124
 125         * resources/sunspider-standalone-driver.js:
 126         * tests/3d-cube.js:
 127         * tests/3d-morph.js:
 128         * tests/3d-raytrace.js:
 129         * tests/bitops-bitwise-and.js:
 130         * tests/string-base64.js:
 131         * tests/string-tagcloud.js:
 132
 133 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 134
 135         Reviewed by Nikolas.
 136
 137         - Rebalance test complexity.
 138
 139         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
 140
 141         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
 142
 143         However, for some tests, IE7 was a huge outlier compared to other
 144         major browsers. For those tests, I used Firefox 2.0.0.8 on the
 145         same OS and hardware as a normalization basis.
 146
 147         * tests/3d-morph.js:
 148         * tests/3d-raytrace.js:
 149         * tests/bitops-3bit-bits-in-byte.js:
 150         * tests/bitops-bits-in-byte.js:
 151         * tests/bitops-bitwise-and.js:
 152         * tests/math-cordic.js:
 153         * tests/string-base64.js:
 154         * tests/string-tagcloud.js:
 155         * tests/string-unpack-code.js:
 156
 157 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 158
 159         Reviewed by Oliver.
 160
 161         - Fix the browser-hosted driver to be compatible with Safari 2
 162
 163         * hosted/sunspider-driver.html:
 164
 165 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 166
 167         Rubber stamped by Hyatt.
 168
 169         - Add BSD license notice to cordic test, the original author said to do so.
 170
 171         * tests/math-cordic.js:
 172
 173 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 174
 175         Reviewed by Eric.
 176
 177         - Support Windows and Windows browsers.
 178
 179         * hosted/sunspider-results.html: Display results correctly in IE.
 180         * sunspider: tweaks to work on Windows, and with spaces in the path.
 181
 182 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 183
 184         Rubber stamped by Oliver.
 185
 186         * tests/string-tagcloud.js: Remove stray print()
 187
 188 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
 189
 190         Reviewed by Oliver.
 191
 192         Add some string test cases.
 193
 194         * tests/string-base64.js: Added. Does base64 encoding and decoding.
 195         * tests/string-tagcloud.js: Added. Parses a JSON string and
 196         generates tagcloud HTML markup based on the data.
 197         * tests/string-unpack-code.js: Added. Unpack compressed versions of
 198         four of the most popular JavaScript libraries.
 199         * tests/LIST: Added the new tests.
 200
 201 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
 202
 203         Reviewed by Anders.
 204
 205         * TODO: Updated with info on how to do the stats properly.
 206
 207         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
 208         avoid overly slowing down the benchmark.
 209
 210         Added some 3D-related test cases.
 211
 212         * tests/3d-cube.js: Added.
 213         * tests/3d-morph.js: Added.
 214         * tests/3d-raytrace.js: Added.
 215         * tests/LIST:
 216
 217 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
 218
 219         Reviewed by Darin.
 220
 221         - New JavaScript benchmark
 222         http://bugs.webkit.org/show_bug.cgi?id=15515
 223
 224         A start on a new JavaScript benchmark, with standalone and
 225         browser-hosted drivers.
 226
 227         The test content is still incomplete and the drivers could use
 228         some more features but there is enough here to make a good start.
 229
 230         The drivers compute a 95% confidence interval on the mean for the
 231         whole test, each category, and each individual test to make it
 232         easier to tell whether differences are statistically
 233         significant. The confidence interval can be narrowed by running
 234         the test more times.
 235
 236         * TODO: Added. Remaining things that need to be done.
 237         * sunspider: Added. Perl script that acts as the standalone test driver.
 238         * resources/sunspider-standalone-driver.js: Added. JavaScript part
 239         of standalone test driver.
 240         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
 241         analysis code.
 242         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
 243         * make-hosted: Added. Script to generate browser-hosted tests.
 244         * hosted/sunspider.html: Added. Start page for browser-hosted test.
 245         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
 246         * hosted/sunspider-results.html: Added. Results page for browser-hosted
 247         tests.
 248         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
 249         tests.
 250         * tests/LIST: Added. List of tests to use.
 251         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
 252         * tests/bitops-bits-in-byte.js: Added. Ditto.
 253         * tests/bitops-bitwise-and.js: Added. Ditto.
 254         * tests/math-cordic.js: Added. Ditto.
 255