d0e7b8feeee55dff6c3ed4ee607dbf130d5f485c
[WebKit-https.git] / SunSpider / ChangeLog
1 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
2
3         Rubber stamped by Eric.
4         
5         - added crypto tests (already balanced)
6
7         * tests/LIST:
8         * tests/crypto-aes.js: Added.
9         * tests/crypto-md5.js: Added.
10         * tests/crypto-sha1.js: Added.
11
12 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
13
14         Reviewed by Adam.
15         
16         - rebalance new tests
17         
18         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
19         
20         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
21
22         This balances them with the existing tests.
23
24         * tests/access-binary-trees.js:
25         * tests/access-nsieve.js:
26         * tests/bitops-nsieve-bits.js:
27         * tests/math-partial-sums.js:
28         * tests/math-spectral-norm.js:
29         * tests/string-fasta.js:
30
31 2007-10-20  Eric Seidel  <eric@webkit.org>
32
33         Reviewed by darin.
34         
35         Add improved argument handling to sunspider, including
36         --runs=<number>, --tests=<pattern, --shark, and --help
37         Also re-factor code into subroutines
38
39         * sunspider: improved argument handling
40
41 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
42
43         Reviewed by Mark.
44
45         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
46         
47         * TODO:
48         * tests/LIST:
49         * tests/access-binary-trees.js: Added.
50         * tests/access-nsieve.js: Added.
51         * tests/bitops-nsieve-bits.js: Added.
52         * tests/math-partial-sums.js: Added.
53         * tests/math-spectral-norm.js: Added.
54         * tests/string-fasta.js: Added.
55
56 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
57
58         Reviewed by Darin.
59
60         * TODO: Updated to note areas that are now well-covered.
61         
62         - Change the tests and the driver to avoid leaving large object
63         graphs hanging around, since that throws off the subsequent tests.
64         
65         * resources/sunspider-standalone-driver.js:
66         * tests/3d-cube.js:
67         * tests/3d-morph.js:
68         * tests/3d-raytrace.js:
69         * tests/bitops-bitwise-and.js:
70         * tests/string-base64.js:
71         * tests/string-tagcloud.js:
72
73 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
74
75         Reviewed by Nikolas.
76         
77         - Rebalance test complexity.
78         
79         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
80         
81         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
82
83         However, for some tests, IE7 was a huge outlier compared to other
84         major browsers. For those tests, I used Firefox 2.0.0.8 on the
85         same OS and hardware as a normalization basis.
86         
87         * tests/3d-morph.js:
88         * tests/3d-raytrace.js:
89         * tests/bitops-3bit-bits-in-byte.js:
90         * tests/bitops-bits-in-byte.js:
91         * tests/bitops-bitwise-and.js:
92         * tests/math-cordic.js:
93         * tests/string-base64.js:
94         * tests/string-tagcloud.js:
95         * tests/string-unpack-code.js:
96
97 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
98
99         Reviewed by Oliver.
100         
101         - Fix the browser-hosted driver to be compatible with Safari 2
102
103         * hosted/sunspider-driver.html:
104
105 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
106
107         Rubber stamped by Hyatt.
108         
109         - Add BSD license notice to cordic test, the original author said to do so.
110
111         * tests/math-cordic.js:
112
113 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
114
115         Reviewed by Eric.
116         
117         - Support Windows and Windows browsers.
118
119         * hosted/sunspider-results.html: Display results correctly in IE.
120         * sunspider: tweaks to work on Windows, and with spaces in the path.
121
122 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
123
124         Rubber stamped by Oliver.
125
126         * tests/string-tagcloud.js: Remove stray print()
127
128 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
129
130         Reviewed by Oliver.
131         
132         Add some string test cases.
133
134         * tests/string-base64.js: Added. Does base64 encoding and decoding.
135         * tests/string-tagcloud.js: Added. Parses a JSON string and
136         generates tagcloud HTML markup based on the data.        
137         * tests/string-unpack-code.js: Added. Unpack compressed versions of
138         four of the most popular JavaScript libraries.
139         * tests/LIST: Added the new tests.
140
141 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
142
143         Reviewed by Anders.
144
145         * TODO: Updated with info on how to do the stats properly.
146
147         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
148         avoid overly slowing down the benchmark.
149
150         Added some 3D-related test cases.
151         
152         * tests/3d-cube.js: Added.
153         * tests/3d-morph.js: Added.
154         * tests/3d-raytrace.js: Added.
155         * tests/LIST:
156
157 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
158
159         Reviewed by Darin.
160
161         - New JavaScript benchmark
162         http://bugs.webkit.org/show_bug.cgi?id=15515
163         
164         A start on a new JavaScript benchmark, with standalone and
165         browser-hosted drivers.
166         
167         The test content is still incomplete and the drivers could use
168         some more features but there is enough here to make a good start.
169         
170         The drivers compute a 95% confidence interval on the mean for the
171         whole test, each category, and each individual test to make it
172         easier to tell whether differences are statistically
173         significant. The confidence interval can be narrowed by running
174         the test more times.
175         
176         * TODO: Added. Remaining things that need to be done.
177         * sunspider: Added. Perl script that acts as the standalone test driver.
178         * resources/sunspider-standalone-driver.js: Added. JavaScript part
179         of standalone test driver.
180         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
181         analysis code.
182         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
183         * make-hosted: Added. Script to generate browser-hosted tests.
184         * hosted/sunspider.html: Added. Start page for browser-hosted test.
185         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
186         * hosted/sunspider-results.html: Added. Results page for browser-hosted
187         tests.
188         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
189         tests.
190         * tests/LIST: Added. List of tests to use.
191         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
192         * tests/bitops-bits-in-byte.js: Added. Ditto.
193         * tests/bitops-bitwise-and.js: Added. Ditto.
194         * tests/math-cordic.js: Added. Ditto.
195