5f698d91ef0a2d87cc089b357ca813babc9906e8
[WebKit-https.git] / SunSpider / ChangeLog
1 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
2
3         Reviewed by Darin.
4         
5         - Add a compare script to compare results, and improve formatting of standard results a bit.
6
7         * resources/sunspider-analyze-results.js:
8         * resources/sunspider-compare-results.js: Added.
9         * sunspider-compare-results: Added.
10
11 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
12
13         Reviewed by Darin.
14
15         * resources/sunspider-analyze-results.js: Do the error range
16         properly, using the t-distribution instead of 1.96 (which was
17         based on the normal distribution).
18         
19         * sunspider: Print results in a way that will be friendlier to the
20         soon-to-come compare mode.
21
22 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
23
24         Reviewed by Review.
25         
26         - add more tests (probably the final set for now)
27         
28         Already balanced. Added date, regexp, control flow, and a few
29         more string and object/array access tests.
30         
31         * tests/LIST:
32         * tests/access-fannkuch.js: Added.
33         * tests/access-nbody.js: Added.
34         * tests/controlflow-recursive.js: Added.
35         * tests/date-format-tofte.js: Added.
36         * tests/date-format-xparb.js: Added.
37         * tests/regexp-dna.js: Added.
38         * tests/string-validate-input.js: Added.
39
40 2007-10-21  Eric Seidel  <eric@webkit.org>
41
42         Reviewed by mjs.
43
44         * sunspider: make --shark only sample from testkjs
45
46 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
47
48         Rubber stamped by Eric.
49         
50         - added crypto tests (already balanced)
51
52         * tests/LIST:
53         * tests/crypto-aes.js: Added.
54         * tests/crypto-md5.js: Added.
55         * tests/crypto-sha1.js: Added.
56
57 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
58
59         Reviewed by Adam.
60         
61         - rebalance new tests
62         
63         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
64         
65         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
66
67         This balances them with the existing tests.
68
69         * tests/access-binary-trees.js:
70         * tests/access-nsieve.js:
71         * tests/bitops-nsieve-bits.js:
72         * tests/math-partial-sums.js:
73         * tests/math-spectral-norm.js:
74         * tests/string-fasta.js:
75
76 2007-10-20  Eric Seidel  <eric@webkit.org>
77
78         Reviewed by darin.
79         
80         Add improved argument handling to sunspider, including
81         --runs=<number>, --tests=<pattern, --shark, and --help
82         Also re-factor code into subroutines
83
84         * sunspider: improved argument handling
85
86 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
87
88         Reviewed by Mark.
89
90         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
91         
92         * TODO:
93         * tests/LIST:
94         * tests/access-binary-trees.js: Added.
95         * tests/access-nsieve.js: Added.
96         * tests/bitops-nsieve-bits.js: Added.
97         * tests/math-partial-sums.js: Added.
98         * tests/math-spectral-norm.js: Added.
99         * tests/string-fasta.js: Added.
100
101 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
102
103         Reviewed by Darin.
104
105         * TODO: Updated to note areas that are now well-covered.
106         
107         - Change the tests and the driver to avoid leaving large object
108         graphs hanging around, since that throws off the subsequent tests.
109         
110         * resources/sunspider-standalone-driver.js:
111         * tests/3d-cube.js:
112         * tests/3d-morph.js:
113         * tests/3d-raytrace.js:
114         * tests/bitops-bitwise-and.js:
115         * tests/string-base64.js:
116         * tests/string-tagcloud.js:
117
118 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
119
120         Reviewed by Nikolas.
121         
122         - Rebalance test complexity.
123         
124         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
125         
126         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
127
128         However, for some tests, IE7 was a huge outlier compared to other
129         major browsers. For those tests, I used Firefox 2.0.0.8 on the
130         same OS and hardware as a normalization basis.
131         
132         * tests/3d-morph.js:
133         * tests/3d-raytrace.js:
134         * tests/bitops-3bit-bits-in-byte.js:
135         * tests/bitops-bits-in-byte.js:
136         * tests/bitops-bitwise-and.js:
137         * tests/math-cordic.js:
138         * tests/string-base64.js:
139         * tests/string-tagcloud.js:
140         * tests/string-unpack-code.js:
141
142 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
143
144         Reviewed by Oliver.
145         
146         - Fix the browser-hosted driver to be compatible with Safari 2
147
148         * hosted/sunspider-driver.html:
149
150 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
151
152         Rubber stamped by Hyatt.
153         
154         - Add BSD license notice to cordic test, the original author said to do so.
155
156         * tests/math-cordic.js:
157
158 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
159
160         Reviewed by Eric.
161         
162         - Support Windows and Windows browsers.
163
164         * hosted/sunspider-results.html: Display results correctly in IE.
165         * sunspider: tweaks to work on Windows, and with spaces in the path.
166
167 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
168
169         Rubber stamped by Oliver.
170
171         * tests/string-tagcloud.js: Remove stray print()
172
173 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
174
175         Reviewed by Oliver.
176         
177         Add some string test cases.
178
179         * tests/string-base64.js: Added. Does base64 encoding and decoding.
180         * tests/string-tagcloud.js: Added. Parses a JSON string and
181         generates tagcloud HTML markup based on the data.        
182         * tests/string-unpack-code.js: Added. Unpack compressed versions of
183         four of the most popular JavaScript libraries.
184         * tests/LIST: Added the new tests.
185
186 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
187
188         Reviewed by Anders.
189
190         * TODO: Updated with info on how to do the stats properly.
191
192         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
193         avoid overly slowing down the benchmark.
194
195         Added some 3D-related test cases.
196         
197         * tests/3d-cube.js: Added.
198         * tests/3d-morph.js: Added.
199         * tests/3d-raytrace.js: Added.
200         * tests/LIST:
201
202 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
203
204         Reviewed by Darin.
205
206         - New JavaScript benchmark
207         http://bugs.webkit.org/show_bug.cgi?id=15515
208         
209         A start on a new JavaScript benchmark, with standalone and
210         browser-hosted drivers.
211         
212         The test content is still incomplete and the drivers could use
213         some more features but there is enough here to make a good start.
214         
215         The drivers compute a 95% confidence interval on the mean for the
216         whole test, each category, and each individual test to make it
217         easier to tell whether differences are statistically
218         significant. The confidence interval can be narrowed by running
219         the test more times.
220         
221         * TODO: Added. Remaining things that need to be done.
222         * sunspider: Added. Perl script that acts as the standalone test driver.
223         * resources/sunspider-standalone-driver.js: Added. JavaScript part
224         of standalone test driver.
225         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
226         analysis code.
227         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
228         * make-hosted: Added. Script to generate browser-hosted tests.
229         * hosted/sunspider.html: Added. Start page for browser-hosted test.
230         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
231         * hosted/sunspider-results.html: Added. Results page for browser-hosted
232         tests.
233         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
234         tests.
235         * tests/LIST: Added. List of tests to use.
236         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
237         * tests/bitops-bits-in-byte.js: Added. Ditto.
238         * tests/bitops-bitwise-and.js: Added. Ditto.
239         * tests/math-cordic.js: Added. Ditto.
240