SunSpider/ChangeLog

   1 2007-10-21  Eric Seidel  <eric@webkit.org>
   2
   3         Reviewed by mjs.
   4
   5         * sunspider: make --shark only sample from testkjs
   6
   7 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
   8
   9         Rubber stamped by Eric.
  10
  11         - added crypto tests (already balanced)
  12
  13         * tests/LIST:
  14         * tests/crypto-aes.js: Added.
  15         * tests/crypto-md5.js: Added.
  16         * tests/crypto-sha1.js: Added.
  17
  18 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
  19
  20         Reviewed by Adam.
  21
  22         - rebalance new tests
  23
  24         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
  25
  26         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
  27
  28         This balances them with the existing tests.
  29
  30         * tests/access-binary-trees.js:
  31         * tests/access-nsieve.js:
  32         * tests/bitops-nsieve-bits.js:
  33         * tests/math-partial-sums.js:
  34         * tests/math-spectral-norm.js:
  35         * tests/string-fasta.js:
  36
  37 2007-10-20  Eric Seidel  <eric@webkit.org>
  38
  39         Reviewed by darin.
  40
  41         Add improved argument handling to sunspider, including
  42         --runs=<number>, --tests=<pattern, --shark, and --help
  43         Also re-factor code into subroutines
  44
  45         * sunspider: improved argument handling
  46
  47 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
  48
  49         Reviewed by Mark.
  50
  51         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
  52
  53         * TODO:
  54         * tests/LIST:
  55         * tests/access-binary-trees.js: Added.
  56         * tests/access-nsieve.js: Added.
  57         * tests/bitops-nsieve-bits.js: Added.
  58         * tests/math-partial-sums.js: Added.
  59         * tests/math-spectral-norm.js: Added.
  60         * tests/string-fasta.js: Added.
  61
  62 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
  63
  64         Reviewed by Darin.
  65
  66         * TODO: Updated to note areas that are now well-covered.
  67
  68         - Change the tests and the driver to avoid leaving large object
  69         graphs hanging around, since that throws off the subsequent tests.
  70
  71         * resources/sunspider-standalone-driver.js:
  72         * tests/3d-cube.js:
  73         * tests/3d-morph.js:
  74         * tests/3d-raytrace.js:
  75         * tests/bitops-bitwise-and.js:
  76         * tests/string-base64.js:
  77         * tests/string-tagcloud.js:
  78
  79 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
  80
  81         Reviewed by Nikolas.
  82
  83         - Rebalance test complexity.
  84
  85         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
  86
  87         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
  88
  89         However, for some tests, IE7 was a huge outlier compared to other
  90         major browsers. For those tests, I used Firefox 2.0.0.8 on the
  91         same OS and hardware as a normalization basis.
  92
  93         * tests/3d-morph.js:
  94         * tests/3d-raytrace.js:
  95         * tests/bitops-3bit-bits-in-byte.js:
  96         * tests/bitops-bits-in-byte.js:
  97         * tests/bitops-bitwise-and.js:
  98         * tests/math-cordic.js:
  99         * tests/string-base64.js:
 100         * tests/string-tagcloud.js:
 101         * tests/string-unpack-code.js:
 102
 103 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 104
 105         Reviewed by Oliver.
 106
 107         - Fix the browser-hosted driver to be compatible with Safari 2
 108
 109         * hosted/sunspider-driver.html:
 110
 111 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 112
 113         Rubber stamped by Hyatt.
 114
 115         - Add BSD license notice to cordic test, the original author said to do so.
 116
 117         * tests/math-cordic.js:
 118
 119 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 120
 121         Reviewed by Eric.
 122
 123         - Support Windows and Windows browsers.
 124
 125         * hosted/sunspider-results.html: Display results correctly in IE.
 126         * sunspider: tweaks to work on Windows, and with spaces in the path.
 127
 128 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 129
 130         Rubber stamped by Oliver.
 131
 132         * tests/string-tagcloud.js: Remove stray print()
 133
 134 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
 135
 136         Reviewed by Oliver.
 137
 138         Add some string test cases.
 139
 140         * tests/string-base64.js: Added. Does base64 encoding and decoding.
 141         * tests/string-tagcloud.js: Added. Parses a JSON string and
 142         generates tagcloud HTML markup based on the data.
 143         * tests/string-unpack-code.js: Added. Unpack compressed versions of
 144         four of the most popular JavaScript libraries.
 145         * tests/LIST: Added the new tests.
 146
 147 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
 148
 149         Reviewed by Anders.
 150
 151         * TODO: Updated with info on how to do the stats properly.
 152
 153         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
 154         avoid overly slowing down the benchmark.
 155
 156         Added some 3D-related test cases.
 157
 158         * tests/3d-cube.js: Added.
 159         * tests/3d-morph.js: Added.
 160         * tests/3d-raytrace.js: Added.
 161         * tests/LIST:
 162
 163 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
 164
 165         Reviewed by Darin.
 166
 167         - New JavaScript benchmark
 168         http://bugs.webkit.org/show_bug.cgi?id=15515
 169
 170         A start on a new JavaScript benchmark, with standalone and
 171         browser-hosted drivers.
 172
 173         The test content is still incomplete and the drivers could use
 174         some more features but there is enough here to make a good start.
 175
 176         The drivers compute a 95% confidence interval on the mean for the
 177         whole test, each category, and each individual test to make it
 178         easier to tell whether differences are statistically
 179         significant. The confidence interval can be narrowed by running
 180         the test more times.
 181
 182         * TODO: Added. Remaining things that need to be done.
 183         * sunspider: Added. Perl script that acts as the standalone test driver.
 184         * resources/sunspider-standalone-driver.js: Added. JavaScript part
 185         of standalone test driver.
 186         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
 187         analysis code.
 188         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
 189         * make-hosted: Added. Script to generate browser-hosted tests.
 190         * hosted/sunspider.html: Added. Start page for browser-hosted test.
 191         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
 192         * hosted/sunspider-results.html: Added. Results page for browser-hosted
 193         tests.
 194         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
 195         tests.
 196         * tests/LIST: Added. List of tests to use.
 197         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
 198         * tests/bitops-bits-in-byte.js: Added. Ditto.
 199         * tests/bitops-bitwise-and.js: Added. Ditto.
 200         * tests/math-cordic.js: Added. Ditto.
 201