SunSpider/ChangeLog

   1 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
   2
   3         Reviewed by Review.
   4
   5         - add more tests (probably the final set for now)
   6
   7         Already balanced. Added date, regexp, control flow, and a few
   8         more string and object/array access tests.
   9
  10         * tests/LIST:
  11         * tests/access-fannkuch.js: Added.
  12         * tests/access-nbody.js: Added.
  13         * tests/controlflow-recursive.js: Added.
  14         * tests/date-format-tofte.js: Added.
  15         * tests/date-format-xparb.js: Added.
  16         * tests/regexp-dna.js: Added.
  17         * tests/string-validate-input.js: Added.
  18
  19 2007-10-21  Eric Seidel  <eric@webkit.org>
  20
  21         Reviewed by mjs.
  22
  23         * sunspider: make --shark only sample from testkjs
  24
  25 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
  26
  27         Rubber stamped by Eric.
  28
  29         - added crypto tests (already balanced)
  30
  31         * tests/LIST:
  32         * tests/crypto-aes.js: Added.
  33         * tests/crypto-md5.js: Added.
  34         * tests/crypto-sha1.js: Added.
  35
  36 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
  37
  38         Reviewed by Adam.
  39
  40         - rebalance new tests
  41
  42         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
  43
  44         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
  45
  46         This balances them with the existing tests.
  47
  48         * tests/access-binary-trees.js:
  49         * tests/access-nsieve.js:
  50         * tests/bitops-nsieve-bits.js:
  51         * tests/math-partial-sums.js:
  52         * tests/math-spectral-norm.js:
  53         * tests/string-fasta.js:
  54
  55 2007-10-20  Eric Seidel  <eric@webkit.org>
  56
  57         Reviewed by darin.
  58
  59         Add improved argument handling to sunspider, including
  60         --runs=<number>, --tests=<pattern, --shark, and --help
  61         Also re-factor code into subroutines
  62
  63         * sunspider: improved argument handling
  64
  65 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
  66
  67         Reviewed by Mark.
  68
  69         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
  70
  71         * TODO:
  72         * tests/LIST:
  73         * tests/access-binary-trees.js: Added.
  74         * tests/access-nsieve.js: Added.
  75         * tests/bitops-nsieve-bits.js: Added.
  76         * tests/math-partial-sums.js: Added.
  77         * tests/math-spectral-norm.js: Added.
  78         * tests/string-fasta.js: Added.
  79
  80 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
  81
  82         Reviewed by Darin.
  83
  84         * TODO: Updated to note areas that are now well-covered.
  85
  86         - Change the tests and the driver to avoid leaving large object
  87         graphs hanging around, since that throws off the subsequent tests.
  88
  89         * resources/sunspider-standalone-driver.js:
  90         * tests/3d-cube.js:
  91         * tests/3d-morph.js:
  92         * tests/3d-raytrace.js:
  93         * tests/bitops-bitwise-and.js:
  94         * tests/string-base64.js:
  95         * tests/string-tagcloud.js:
  96
  97 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
  98
  99         Reviewed by Nikolas.
 100
 101         - Rebalance test complexity.
 102
 103         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
 104
 105         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
 106
 107         However, for some tests, IE7 was a huge outlier compared to other
 108         major browsers. For those tests, I used Firefox 2.0.0.8 on the
 109         same OS and hardware as a normalization basis.
 110
 111         * tests/3d-morph.js:
 112         * tests/3d-raytrace.js:
 113         * tests/bitops-3bit-bits-in-byte.js:
 114         * tests/bitops-bits-in-byte.js:
 115         * tests/bitops-bitwise-and.js:
 116         * tests/math-cordic.js:
 117         * tests/string-base64.js:
 118         * tests/string-tagcloud.js:
 119         * tests/string-unpack-code.js:
 120
 121 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 122
 123         Reviewed by Oliver.
 124
 125         - Fix the browser-hosted driver to be compatible with Safari 2
 126
 127         * hosted/sunspider-driver.html:
 128
 129 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 130
 131         Rubber stamped by Hyatt.
 132
 133         - Add BSD license notice to cordic test, the original author said to do so.
 134
 135         * tests/math-cordic.js:
 136
 137 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 138
 139         Reviewed by Eric.
 140
 141         - Support Windows and Windows browsers.
 142
 143         * hosted/sunspider-results.html: Display results correctly in IE.
 144         * sunspider: tweaks to work on Windows, and with spaces in the path.
 145
 146 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 147
 148         Rubber stamped by Oliver.
 149
 150         * tests/string-tagcloud.js: Remove stray print()
 151
 152 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
 153
 154         Reviewed by Oliver.
 155
 156         Add some string test cases.
 157
 158         * tests/string-base64.js: Added. Does base64 encoding and decoding.
 159         * tests/string-tagcloud.js: Added. Parses a JSON string and
 160         generates tagcloud HTML markup based on the data.
 161         * tests/string-unpack-code.js: Added. Unpack compressed versions of
 162         four of the most popular JavaScript libraries.
 163         * tests/LIST: Added the new tests.
 164
 165 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
 166
 167         Reviewed by Anders.
 168
 169         * TODO: Updated with info on how to do the stats properly.
 170
 171         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
 172         avoid overly slowing down the benchmark.
 173
 174         Added some 3D-related test cases.
 175
 176         * tests/3d-cube.js: Added.
 177         * tests/3d-morph.js: Added.
 178         * tests/3d-raytrace.js: Added.
 179         * tests/LIST:
 180
 181 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
 182
 183         Reviewed by Darin.
 184
 185         - New JavaScript benchmark
 186         http://bugs.webkit.org/show_bug.cgi?id=15515
 187
 188         A start on a new JavaScript benchmark, with standalone and
 189         browser-hosted drivers.
 190
 191         The test content is still incomplete and the drivers could use
 192         some more features but there is enough here to make a good start.
 193
 194         The drivers compute a 95% confidence interval on the mean for the
 195         whole test, each category, and each individual test to make it
 196         easier to tell whether differences are statistically
 197         significant. The confidence interval can be narrowed by running
 198         the test more times.
 199
 200         * TODO: Added. Remaining things that need to be done.
 201         * sunspider: Added. Perl script that acts as the standalone test driver.
 202         * resources/sunspider-standalone-driver.js: Added. JavaScript part
 203         of standalone test driver.
 204         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
 205         analysis code.
 206         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
 207         * make-hosted: Added. Script to generate browser-hosted tests.
 208         * hosted/sunspider.html: Added. Start page for browser-hosted test.
 209         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
 210         * hosted/sunspider-results.html: Added. Results page for browser-hosted
 211         tests.
 212         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
 213         tests.
 214         * tests/LIST: Added. List of tests to use.
 215         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
 216         * tests/bitops-bits-in-byte.js: Added. Ditto.
 217         * tests/bitops-bitwise-and.js: Added. Ditto.
 218         * tests/math-cordic.js: Added. Ditto.
 219