SunSpider/ChangeLog

   1 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
   2
   3         Reviewed by Darin.
   4
   5         * resources/sunspider-analyze-results.js: Do the error range
   6         properly, using the t-distribution instead of 1.96 (which was
   7         based on the normal distribution).
   8
   9         * sunspider: Print results in a way that will be friendlier to the
  10         soon-to-come compare mode.
  11
  12 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
  13
  14         Reviewed by Review.
  15
  16         - add more tests (probably the final set for now)
  17
  18         Already balanced. Added date, regexp, control flow, and a few
  19         more string and object/array access tests.
  20
  21         * tests/LIST:
  22         * tests/access-fannkuch.js: Added.
  23         * tests/access-nbody.js: Added.
  24         * tests/controlflow-recursive.js: Added.
  25         * tests/date-format-tofte.js: Added.
  26         * tests/date-format-xparb.js: Added.
  27         * tests/regexp-dna.js: Added.
  28         * tests/string-validate-input.js: Added.
  29
  30 2007-10-21  Eric Seidel  <eric@webkit.org>
  31
  32         Reviewed by mjs.
  33
  34         * sunspider: make --shark only sample from testkjs
  35
  36 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
  37
  38         Rubber stamped by Eric.
  39
  40         - added crypto tests (already balanced)
  41
  42         * tests/LIST:
  43         * tests/crypto-aes.js: Added.
  44         * tests/crypto-md5.js: Added.
  45         * tests/crypto-sha1.js: Added.
  46
  47 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
  48
  49         Reviewed by Adam.
  50
  51         - rebalance new tests
  52
  53         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
  54
  55         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
  56
  57         This balances them with the existing tests.
  58
  59         * tests/access-binary-trees.js:
  60         * tests/access-nsieve.js:
  61         * tests/bitops-nsieve-bits.js:
  62         * tests/math-partial-sums.js:
  63         * tests/math-spectral-norm.js:
  64         * tests/string-fasta.js:
  65
  66 2007-10-20  Eric Seidel  <eric@webkit.org>
  67
  68         Reviewed by darin.
  69
  70         Add improved argument handling to sunspider, including
  71         --runs=<number>, --tests=<pattern, --shark, and --help
  72         Also re-factor code into subroutines
  73
  74         * sunspider: improved argument handling
  75
  76 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
  77
  78         Reviewed by Mark.
  79
  80         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
  81
  82         * TODO:
  83         * tests/LIST:
  84         * tests/access-binary-trees.js: Added.
  85         * tests/access-nsieve.js: Added.
  86         * tests/bitops-nsieve-bits.js: Added.
  87         * tests/math-partial-sums.js: Added.
  88         * tests/math-spectral-norm.js: Added.
  89         * tests/string-fasta.js: Added.
  90
  91 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
  92
  93         Reviewed by Darin.
  94
  95         * TODO: Updated to note areas that are now well-covered.
  96
  97         - Change the tests and the driver to avoid leaving large object
  98         graphs hanging around, since that throws off the subsequent tests.
  99
 100         * resources/sunspider-standalone-driver.js:
 101         * tests/3d-cube.js:
 102         * tests/3d-morph.js:
 103         * tests/3d-raytrace.js:
 104         * tests/bitops-bitwise-and.js:
 105         * tests/string-base64.js:
 106         * tests/string-tagcloud.js:
 107
 108 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 109
 110         Reviewed by Nikolas.
 111
 112         - Rebalance test complexity.
 113
 114         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
 115
 116         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
 117
 118         However, for some tests, IE7 was a huge outlier compared to other
 119         major browsers. For those tests, I used Firefox 2.0.0.8 on the
 120         same OS and hardware as a normalization basis.
 121
 122         * tests/3d-morph.js:
 123         * tests/3d-raytrace.js:
 124         * tests/bitops-3bit-bits-in-byte.js:
 125         * tests/bitops-bits-in-byte.js:
 126         * tests/bitops-bitwise-and.js:
 127         * tests/math-cordic.js:
 128         * tests/string-base64.js:
 129         * tests/string-tagcloud.js:
 130         * tests/string-unpack-code.js:
 131
 132 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 133
 134         Reviewed by Oliver.
 135
 136         - Fix the browser-hosted driver to be compatible with Safari 2
 137
 138         * hosted/sunspider-driver.html:
 139
 140 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 141
 142         Rubber stamped by Hyatt.
 143
 144         - Add BSD license notice to cordic test, the original author said to do so.
 145
 146         * tests/math-cordic.js:
 147
 148 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 149
 150         Reviewed by Eric.
 151
 152         - Support Windows and Windows browsers.
 153
 154         * hosted/sunspider-results.html: Display results correctly in IE.
 155         * sunspider: tweaks to work on Windows, and with spaces in the path.
 156
 157 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 158
 159         Rubber stamped by Oliver.
 160
 161         * tests/string-tagcloud.js: Remove stray print()
 162
 163 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
 164
 165         Reviewed by Oliver.
 166
 167         Add some string test cases.
 168
 169         * tests/string-base64.js: Added. Does base64 encoding and decoding.
 170         * tests/string-tagcloud.js: Added. Parses a JSON string and
 171         generates tagcloud HTML markup based on the data.
 172         * tests/string-unpack-code.js: Added. Unpack compressed versions of
 173         four of the most popular JavaScript libraries.
 174         * tests/LIST: Added the new tests.
 175
 176 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
 177
 178         Reviewed by Anders.
 179
 180         * TODO: Updated with info on how to do the stats properly.
 181
 182         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
 183         avoid overly slowing down the benchmark.
 184
 185         Added some 3D-related test cases.
 186
 187         * tests/3d-cube.js: Added.
 188         * tests/3d-morph.js: Added.
 189         * tests/3d-raytrace.js: Added.
 190         * tests/LIST:
 191
 192 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
 193
 194         Reviewed by Darin.
 195
 196         - New JavaScript benchmark
 197         http://bugs.webkit.org/show_bug.cgi?id=15515
 198
 199         A start on a new JavaScript benchmark, with standalone and
 200         browser-hosted drivers.
 201
 202         The test content is still incomplete and the drivers could use
 203         some more features but there is enough here to make a good start.
 204
 205         The drivers compute a 95% confidence interval on the mean for the
 206         whole test, each category, and each individual test to make it
 207         easier to tell whether differences are statistically
 208         significant. The confidence interval can be narrowed by running
 209         the test more times.
 210
 211         * TODO: Added. Remaining things that need to be done.
 212         * sunspider: Added. Perl script that acts as the standalone test driver.
 213         * resources/sunspider-standalone-driver.js: Added. JavaScript part
 214         of standalone test driver.
 215         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
 216         analysis code.
 217         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
 218         * make-hosted: Added. Script to generate browser-hosted tests.
 219         * hosted/sunspider.html: Added. Start page for browser-hosted test.
 220         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
 221         * hosted/sunspider-results.html: Added. Results page for browser-hosted
 222         tests.
 223         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
 224         tests.
 225         * tests/LIST: Added. List of tests to use.
 226         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
 227         * tests/bitops-bits-in-byte.js: Added. Ditto.
 228         * tests/bitops-bitwise-and.js: Added. Ditto.
 229         * tests/math-cordic.js: Added. Ditto.
 230