Strip carriage returns from results
[WebKit-https.git] / SunSpider / ChangeLog
1 2007-10-25  Adam Roben  <aroben@apple.com>
2
3         Strip carriage returns from results
4
5         Carriage returns were screwing up sunspider-compare-results on
6         Windows.
7
8         Rubberstamped by Oliver.
9
10         * sunspider:
11
12 2007-10-24  Darin Adler  <darin@apple.com>
13
14         Reviewed by Eric.
15
16         * sunspider: Open the profile in shark after completing a run.
17         * sunspider-compare-results: Tiny perl tweaks.
18
19 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
20
21         Reviewed by Darin.
22
23         - Don't hardcode my path to testkjs
24         
25         * sunspider-compare-results:
26
27 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
28
29         Reviewed by Darin.
30         
31         - Add a compare script to compare results, and improve formatting of standard results a bit.
32
33         * resources/sunspider-analyze-results.js:
34         * resources/sunspider-compare-results.js: Added.
35         * sunspider-compare-results: Added.
36
37 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
38
39         Reviewed by Darin.
40
41         * resources/sunspider-analyze-results.js: Do the error range
42         properly, using the t-distribution instead of 1.96 (which was
43         based on the normal distribution).
44         
45         * sunspider: Print results in a way that will be friendlier to the
46         soon-to-come compare mode.
47
48 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
49
50         Reviewed by Review.
51         
52         - add more tests (probably the final set for now)
53         
54         Already balanced. Added date, regexp, control flow, and a few
55         more string and object/array access tests.
56         
57         * tests/LIST:
58         * tests/access-fannkuch.js: Added.
59         * tests/access-nbody.js: Added.
60         * tests/controlflow-recursive.js: Added.
61         * tests/date-format-tofte.js: Added.
62         * tests/date-format-xparb.js: Added.
63         * tests/regexp-dna.js: Added.
64         * tests/string-validate-input.js: Added.
65
66 2007-10-21  Eric Seidel  <eric@webkit.org>
67
68         Reviewed by mjs.
69
70         * sunspider: make --shark only sample from testkjs
71
72 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
73
74         Rubber stamped by Eric.
75         
76         - added crypto tests (already balanced)
77
78         * tests/LIST:
79         * tests/crypto-aes.js: Added.
80         * tests/crypto-md5.js: Added.
81         * tests/crypto-sha1.js: Added.
82
83 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
84
85         Reviewed by Adam.
86         
87         - rebalance new tests
88         
89         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
90         
91         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
92
93         This balances them with the existing tests.
94
95         * tests/access-binary-trees.js:
96         * tests/access-nsieve.js:
97         * tests/bitops-nsieve-bits.js:
98         * tests/math-partial-sums.js:
99         * tests/math-spectral-norm.js:
100         * tests/string-fasta.js:
101
102 2007-10-20  Eric Seidel  <eric@webkit.org>
103
104         Reviewed by darin.
105         
106         Add improved argument handling to sunspider, including
107         --runs=<number>, --tests=<pattern, --shark, and --help
108         Also re-factor code into subroutines
109
110         * sunspider: improved argument handling
111
112 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
113
114         Reviewed by Mark.
115
116         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
117         
118         * TODO:
119         * tests/LIST:
120         * tests/access-binary-trees.js: Added.
121         * tests/access-nsieve.js: Added.
122         * tests/bitops-nsieve-bits.js: Added.
123         * tests/math-partial-sums.js: Added.
124         * tests/math-spectral-norm.js: Added.
125         * tests/string-fasta.js: Added.
126
127 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
128
129         Reviewed by Darin.
130
131         * TODO: Updated to note areas that are now well-covered.
132         
133         - Change the tests and the driver to avoid leaving large object
134         graphs hanging around, since that throws off the subsequent tests.
135         
136         * resources/sunspider-standalone-driver.js:
137         * tests/3d-cube.js:
138         * tests/3d-morph.js:
139         * tests/3d-raytrace.js:
140         * tests/bitops-bitwise-and.js:
141         * tests/string-base64.js:
142         * tests/string-tagcloud.js:
143
144 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
145
146         Reviewed by Nikolas.
147         
148         - Rebalance test complexity.
149         
150         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
151         
152         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
153
154         However, for some tests, IE7 was a huge outlier compared to other
155         major browsers. For those tests, I used Firefox 2.0.0.8 on the
156         same OS and hardware as a normalization basis.
157         
158         * tests/3d-morph.js:
159         * tests/3d-raytrace.js:
160         * tests/bitops-3bit-bits-in-byte.js:
161         * tests/bitops-bits-in-byte.js:
162         * tests/bitops-bitwise-and.js:
163         * tests/math-cordic.js:
164         * tests/string-base64.js:
165         * tests/string-tagcloud.js:
166         * tests/string-unpack-code.js:
167
168 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
169
170         Reviewed by Oliver.
171         
172         - Fix the browser-hosted driver to be compatible with Safari 2
173
174         * hosted/sunspider-driver.html:
175
176 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
177
178         Rubber stamped by Hyatt.
179         
180         - Add BSD license notice to cordic test, the original author said to do so.
181
182         * tests/math-cordic.js:
183
184 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
185
186         Reviewed by Eric.
187         
188         - Support Windows and Windows browsers.
189
190         * hosted/sunspider-results.html: Display results correctly in IE.
191         * sunspider: tweaks to work on Windows, and with spaces in the path.
192
193 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
194
195         Rubber stamped by Oliver.
196
197         * tests/string-tagcloud.js: Remove stray print()
198
199 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
200
201         Reviewed by Oliver.
202         
203         Add some string test cases.
204
205         * tests/string-base64.js: Added. Does base64 encoding and decoding.
206         * tests/string-tagcloud.js: Added. Parses a JSON string and
207         generates tagcloud HTML markup based on the data.        
208         * tests/string-unpack-code.js: Added. Unpack compressed versions of
209         four of the most popular JavaScript libraries.
210         * tests/LIST: Added the new tests.
211
212 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
213
214         Reviewed by Anders.
215
216         * TODO: Updated with info on how to do the stats properly.
217
218         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
219         avoid overly slowing down the benchmark.
220
221         Added some 3D-related test cases.
222         
223         * tests/3d-cube.js: Added.
224         * tests/3d-morph.js: Added.
225         * tests/3d-raytrace.js: Added.
226         * tests/LIST:
227
228 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
229
230         Reviewed by Darin.
231
232         - New JavaScript benchmark
233         http://bugs.webkit.org/show_bug.cgi?id=15515
234         
235         A start on a new JavaScript benchmark, with standalone and
236         browser-hosted drivers.
237         
238         The test content is still incomplete and the drivers could use
239         some more features but there is enough here to make a good start.
240         
241         The drivers compute a 95% confidence interval on the mean for the
242         whole test, each category, and each individual test to make it
243         easier to tell whether differences are statistically
244         significant. The confidence interval can be narrowed by running
245         the test more times.
246         
247         * TODO: Added. Remaining things that need to be done.
248         * sunspider: Added. Perl script that acts as the standalone test driver.
249         * resources/sunspider-standalone-driver.js: Added. JavaScript part
250         of standalone test driver.
251         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
252         analysis code.
253         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
254         * make-hosted: Added. Script to generate browser-hosted tests.
255         * hosted/sunspider.html: Added. Start page for browser-hosted test.
256         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
257         * hosted/sunspider-results.html: Added. Results page for browser-hosted
258         tests.
259         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
260         tests.
261         * tests/LIST: Added. List of tests to use.
262         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
263         * tests/bitops-bits-in-byte.js: Added. Ditto.
264         * tests/bitops-bitwise-and.js: Added. Ditto.
265         * tests/math-cordic.js: Added. Ditto.
266