SunSpider:
[WebKit-https.git] / SunSpider / ChangeLog
1 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
2
3         Reviewed by Darin.
4
5         - Don't hardcode my path to testkjs
6         
7         * sunspider-compare-results:
8
9 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
10
11         Reviewed by Darin.
12         
13         - Add a compare script to compare results, and improve formatting of standard results a bit.
14
15         * resources/sunspider-analyze-results.js:
16         * resources/sunspider-compare-results.js: Added.
17         * sunspider-compare-results: Added.
18
19 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
20
21         Reviewed by Darin.
22
23         * resources/sunspider-analyze-results.js: Do the error range
24         properly, using the t-distribution instead of 1.96 (which was
25         based on the normal distribution).
26         
27         * sunspider: Print results in a way that will be friendlier to the
28         soon-to-come compare mode.
29
30 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
31
32         Reviewed by Review.
33         
34         - add more tests (probably the final set for now)
35         
36         Already balanced. Added date, regexp, control flow, and a few
37         more string and object/array access tests.
38         
39         * tests/LIST:
40         * tests/access-fannkuch.js: Added.
41         * tests/access-nbody.js: Added.
42         * tests/controlflow-recursive.js: Added.
43         * tests/date-format-tofte.js: Added.
44         * tests/date-format-xparb.js: Added.
45         * tests/regexp-dna.js: Added.
46         * tests/string-validate-input.js: Added.
47
48 2007-10-21  Eric Seidel  <eric@webkit.org>
49
50         Reviewed by mjs.
51
52         * sunspider: make --shark only sample from testkjs
53
54 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
55
56         Rubber stamped by Eric.
57         
58         - added crypto tests (already balanced)
59
60         * tests/LIST:
61         * tests/crypto-aes.js: Added.
62         * tests/crypto-md5.js: Added.
63         * tests/crypto-sha1.js: Added.
64
65 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
66
67         Reviewed by Adam.
68         
69         - rebalance new tests
70         
71         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
72         
73         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
74
75         This balances them with the existing tests.
76
77         * tests/access-binary-trees.js:
78         * tests/access-nsieve.js:
79         * tests/bitops-nsieve-bits.js:
80         * tests/math-partial-sums.js:
81         * tests/math-spectral-norm.js:
82         * tests/string-fasta.js:
83
84 2007-10-20  Eric Seidel  <eric@webkit.org>
85
86         Reviewed by darin.
87         
88         Add improved argument handling to sunspider, including
89         --runs=<number>, --tests=<pattern, --shark, and --help
90         Also re-factor code into subroutines
91
92         * sunspider: improved argument handling
93
94 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
95
96         Reviewed by Mark.
97
98         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
99         
100         * TODO:
101         * tests/LIST:
102         * tests/access-binary-trees.js: Added.
103         * tests/access-nsieve.js: Added.
104         * tests/bitops-nsieve-bits.js: Added.
105         * tests/math-partial-sums.js: Added.
106         * tests/math-spectral-norm.js: Added.
107         * tests/string-fasta.js: Added.
108
109 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
110
111         Reviewed by Darin.
112
113         * TODO: Updated to note areas that are now well-covered.
114         
115         - Change the tests and the driver to avoid leaving large object
116         graphs hanging around, since that throws off the subsequent tests.
117         
118         * resources/sunspider-standalone-driver.js:
119         * tests/3d-cube.js:
120         * tests/3d-morph.js:
121         * tests/3d-raytrace.js:
122         * tests/bitops-bitwise-and.js:
123         * tests/string-base64.js:
124         * tests/string-tagcloud.js:
125
126 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
127
128         Reviewed by Nikolas.
129         
130         - Rebalance test complexity.
131         
132         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
133         
134         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
135
136         However, for some tests, IE7 was a huge outlier compared to other
137         major browsers. For those tests, I used Firefox 2.0.0.8 on the
138         same OS and hardware as a normalization basis.
139         
140         * tests/3d-morph.js:
141         * tests/3d-raytrace.js:
142         * tests/bitops-3bit-bits-in-byte.js:
143         * tests/bitops-bits-in-byte.js:
144         * tests/bitops-bitwise-and.js:
145         * tests/math-cordic.js:
146         * tests/string-base64.js:
147         * tests/string-tagcloud.js:
148         * tests/string-unpack-code.js:
149
150 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
151
152         Reviewed by Oliver.
153         
154         - Fix the browser-hosted driver to be compatible with Safari 2
155
156         * hosted/sunspider-driver.html:
157
158 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
159
160         Rubber stamped by Hyatt.
161         
162         - Add BSD license notice to cordic test, the original author said to do so.
163
164         * tests/math-cordic.js:
165
166 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
167
168         Reviewed by Eric.
169         
170         - Support Windows and Windows browsers.
171
172         * hosted/sunspider-results.html: Display results correctly in IE.
173         * sunspider: tweaks to work on Windows, and with spaces in the path.
174
175 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
176
177         Rubber stamped by Oliver.
178
179         * tests/string-tagcloud.js: Remove stray print()
180
181 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
182
183         Reviewed by Oliver.
184         
185         Add some string test cases.
186
187         * tests/string-base64.js: Added. Does base64 encoding and decoding.
188         * tests/string-tagcloud.js: Added. Parses a JSON string and
189         generates tagcloud HTML markup based on the data.        
190         * tests/string-unpack-code.js: Added. Unpack compressed versions of
191         four of the most popular JavaScript libraries.
192         * tests/LIST: Added the new tests.
193
194 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
195
196         Reviewed by Anders.
197
198         * TODO: Updated with info on how to do the stats properly.
199
200         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
201         avoid overly slowing down the benchmark.
202
203         Added some 3D-related test cases.
204         
205         * tests/3d-cube.js: Added.
206         * tests/3d-morph.js: Added.
207         * tests/3d-raytrace.js: Added.
208         * tests/LIST:
209
210 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
211
212         Reviewed by Darin.
213
214         - New JavaScript benchmark
215         http://bugs.webkit.org/show_bug.cgi?id=15515
216         
217         A start on a new JavaScript benchmark, with standalone and
218         browser-hosted drivers.
219         
220         The test content is still incomplete and the drivers could use
221         some more features but there is enough here to make a good start.
222         
223         The drivers compute a 95% confidence interval on the mean for the
224         whole test, each category, and each individual test to make it
225         easier to tell whether differences are statistically
226         significant. The confidence interval can be narrowed by running
227         the test more times.
228         
229         * TODO: Added. Remaining things that need to be done.
230         * sunspider: Added. Perl script that acts as the standalone test driver.
231         * resources/sunspider-standalone-driver.js: Added. JavaScript part
232         of standalone test driver.
233         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
234         analysis code.
235         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
236         * make-hosted: Added. Script to generate browser-hosted tests.
237         * hosted/sunspider.html: Added. Start page for browser-hosted test.
238         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
239         * hosted/sunspider-results.html: Added. Results page for browser-hosted
240         tests.
241         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
242         tests.
243         * tests/LIST: Added. List of tests to use.
244         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
245         * tests/bitops-bits-in-byte.js: Added. Ditto.
246         * tests/bitops-bitwise-and.js: Added. Ditto.
247         * tests/math-cordic.js: Added. Ditto.
248