Factored most of SourceView out into SourceFrame so it can be shared
[WebKit-https.git] / SunSpider / ChangeLog
1 2008-03-21  Alexey Proskuryakov  <ap@webkit.org>
2
3         Reviewed by Geoff.
4
5         * sunspider: Pause update daemon on Darwin to make results reliable
6         again (workaround for <rdar://problem/5811127>).
7
8 2008-02-07  Eric Seidel  <eric@webkit.org>
9
10         Reviewed by Sam.
11
12         * sunspider: add an error message when ./tests/LIST is not found
13
14 2007-12-29  Alp Toker  <alp@atoker.com>
15
16         Fix typo.
17
18         * hosted/sunspider.html:
19
20 2007-12-29  Alp Toker  <alp@atoker.com>
21
22         Reviewed by Maciej.
23
24         Provide the current URL in the SunSpider results page. Useful for
25         copying benchmark results out of browsers without a location bar or
26         where the location bar can't handle long URLs.
27
28         * hosted/sunspider-results.html:
29
30 2007-12-20  Eric Seidel  <eric@webkit.org>
31
32         Reviewed by mjs.
33
34         * sunspider: increase default number of runs for more accurate numbers
35
36 2007-12-18  Mark Rowe  <mrowe@apple.com>
37
38         Fix typo.
39
40         * hosted/sunspider.html:
41
42 2007-12-18  Maciej Stachowiak  <mjs@apple.com>
43
44         Reviewed by Eric.
45         
46         - give an extra digit of precision for small differences.
47
48         * resources/sunspider-compare-results.js:
49
50 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
51
52         Reviewed by Eric.
53         
54         - work around IE layout bugs
55
56         * hosted/sunspider.css:
57
58 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
59
60         Reviewed by Mark.
61         
62         - fix compare feature
63
64         * hosted/sunspider-results.html:
65
66 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
67
68         Reviewed by Mark.
69         
70         - Change the format of the output URL to be shorter, to meet IE constraints
71
72         * hosted/sunspider-driver.html:
73         * hosted/sunspider-results.html:
74
75 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
76
77         Reviewed by Oliver.
78         
79         - Add some explanatory test and a dumb logo to SunSpider web hosted version
80
81         * hosted/sunspider-driver.html:
82         * hosted/sunspider-results.html:
83         * hosted/sunspider.css:
84         * hosted/sunspider.html:
85
86 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
87
88         Reviewed by Oliver.
89         
90         - Make the web-hosted version of SunSpider look a little bit less drab.
91
92         * hosted/sunspider-driver.html:
93         * hosted/sunspider-results.html:
94         * hosted/sunspider.css: Added.
95         * hosted/sunspider.html:
96         * resources/TEMPLATE.html:
97
98 2007-12-12  Maciej Stachowiak  <mjs@apple.com>
99
100         Reviewed by Sam.
101         
102         - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
103         
104         A sample of what new-style results would look like:
105         
106         TEST                   COMPARISON            FROM                 TO             DETAILS
107         ...
108         ** TOTAL **:           1.41x as fast     6613.6ms +/- 0.1%   4703.0ms +/- 0.1%     significant
109         ...
110             3bit-bits-in-byte: *1.36x as slow*     88.8ms +/- 0.6%    121.1ms +/- 0.6%     significant
111         
112         * resources/sunspider-compare-results.js:
113
114 2007-11-14  Eric Seidel  <eric@webkit.org>
115
116         Reviewed by Sam.
117
118         * sunspider: add --shark-cache for L2 Cache Miss profiling
119
120 2007-11-09  Alexey Proskuryakov  <ap@webkit.org>
121
122         Reviewed by Darin.
123
124         http://bugs.webkit.org/show_bug.cgi?id=15925
125         SunSpider should check for Shark being installed
126
127         * sunspider: Explicitly test that shark command line tool is installed.
128
129 2007-11-04  Darin Adler  <darin@apple.com>
130
131         * hosted/sunspider.html: Tweaked formatting a bit.
132
133 2007-11-03  Maciej Stachowiak  <mjs@apple.com>
134
135         Reviewed by Darin.
136
137         - Add compare mode and a description of the benchmark to the hosted version.
138
139         * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
140         * hosted/sunspider.html: Added intro text.
141         * make-hosted: Copy new file.
142         * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
143         a function.
144         * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
145         expects.
146         * sunspider-compare-results: Use sunspider-standalone-compare.js.
147
148 2007-11-02  Darin Adler  <darin@apple.com>
149
150         * sunspider: Changed "--base" to "--set-baseline".
151
152 2007-11-02  Darin Adler  <darin@apple.com>
153
154         Reviewed by Maciej.
155
156         * sunspider: Added a "--base" option that records the current test as a baseline.
157         Moved the code to find the newest .mshark file into a function (since I needed to use
158         it in the other script and I prefer to copy/paste a function).
159
160         * sunspider-compare-results: Added logic to compare the baseline with the last
161         run when you don't pass any parameters.
162
163 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
164
165         Reviewed by Eric.
166         
167         - Added list of ECMAScript3 features that SunSpider does not cover currently.
168
169         * UNCOVERED: Added.
170
171 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
172
173         Reviewed by Oliver.
174         
175         - Give better error messages when sunspider-compare-results fails
176
177         * sunspider-compare-results:
178
179 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
180
181         Reviewed by Darin.
182         
183         - fix Date tests to work in command-line SpiderMonkey
184
185         * tests/date-format-tofte.js:
186         * tests/date-format-xparb.js:
187
188 2007-10-29  Darin Adler  <darin@apple.com>
189
190         Reviewed by Maciej.
191
192         * sunspider: Added --shark20 option, to run Shark at its highest sample
193         resolution instead of its default.
194
195 2007-10-28  Adam Roben  <aroben@apple.com>
196
197         Fix SunSpider on Windows
198
199         Reviewed by Eric.
200
201         * sunspider: Don't use colons in filenames.
202
203 2007-10-28  Darin Adler  <darin@apple.com>
204
205         Reviewed by Adam.
206
207         * resources/sunspider-analyze-results.js: Tweak the output format a little.
208         Change so that when there's only one run we don't write out confidence
209         intervals at all rather than writing "NaN" over and over again.
210
211         * sunspider: Use the time and date as a suffix on the results file, that way
212         all the results are left behind in the tmp directory. This will make it easy
213         for us to add features that compare past results in the future. Also rename
214         the .mshark files using the same scheme.
215
216         * sunspider-compare-results: Relax the parsing rules so we can parse the
217         results file exactly as it's emitted from sunspider.
218
219 2007-10-25  Adam Roben  <aroben@apple.com>
220
221         Strip carriage returns from results
222
223         Carriage returns were screwing up sunspider-compare-results on
224         Windows.
225
226         Rubberstamped by Oliver.
227
228         * sunspider:
229
230 2007-10-24  Darin Adler  <darin@apple.com>
231
232         Reviewed by Eric.
233
234         * sunspider: Open the profile in shark after completing a run.
235         * sunspider-compare-results: Tiny perl tweaks.
236
237 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
238
239         Reviewed by Darin.
240
241         - Don't hardcode my path to testkjs
242         
243         * sunspider-compare-results:
244
245 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
246
247         Reviewed by Darin.
248         
249         - Add a compare script to compare results, and improve formatting of standard results a bit.
250
251         * resources/sunspider-analyze-results.js:
252         * resources/sunspider-compare-results.js: Added.
253         * sunspider-compare-results: Added.
254
255 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
256
257         Reviewed by Darin.
258
259         * resources/sunspider-analyze-results.js: Do the error range
260         properly, using the t-distribution instead of 1.96 (which was
261         based on the normal distribution).
262         
263         * sunspider: Print results in a way that will be friendlier to the
264         soon-to-come compare mode.
265
266 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
267
268         Reviewed by Review.
269         
270         - add more tests (probably the final set for now)
271         
272         Already balanced. Added date, regexp, control flow, and a few
273         more string and object/array access tests.
274         
275         * tests/LIST:
276         * tests/access-fannkuch.js: Added.
277         * tests/access-nbody.js: Added.
278         * tests/controlflow-recursive.js: Added.
279         * tests/date-format-tofte.js: Added.
280         * tests/date-format-xparb.js: Added.
281         * tests/regexp-dna.js: Added.
282         * tests/string-validate-input.js: Added.
283
284 2007-10-21  Eric Seidel  <eric@webkit.org>
285
286         Reviewed by mjs.
287
288         * sunspider: make --shark only sample from testkjs
289
290 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
291
292         Rubber stamped by Eric.
293         
294         - added crypto tests (already balanced)
295
296         * tests/LIST:
297         * tests/crypto-aes.js: Added.
298         * tests/crypto-md5.js: Added.
299         * tests/crypto-sha1.js: Added.
300
301 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
302
303         Reviewed by Adam.
304         
305         - rebalance new tests
306         
307         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
308         
309         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
310
311         This balances them with the existing tests.
312
313         * tests/access-binary-trees.js:
314         * tests/access-nsieve.js:
315         * tests/bitops-nsieve-bits.js:
316         * tests/math-partial-sums.js:
317         * tests/math-spectral-norm.js:
318         * tests/string-fasta.js:
319
320 2007-10-20  Eric Seidel  <eric@webkit.org>
321
322         Reviewed by darin.
323         
324         Add improved argument handling to sunspider, including
325         --runs=<number>, --tests=<pattern, --shark, and --help
326         Also re-factor code into subroutines
327
328         * sunspider: improved argument handling
329
330 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
331
332         Reviewed by Mark.
333
334         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
335         
336         * TODO:
337         * tests/LIST:
338         * tests/access-binary-trees.js: Added.
339         * tests/access-nsieve.js: Added.
340         * tests/bitops-nsieve-bits.js: Added.
341         * tests/math-partial-sums.js: Added.
342         * tests/math-spectral-norm.js: Added.
343         * tests/string-fasta.js: Added.
344
345 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
346
347         Reviewed by Darin.
348
349         * TODO: Updated to note areas that are now well-covered.
350         
351         - Change the tests and the driver to avoid leaving large object
352         graphs hanging around, since that throws off the subsequent tests.
353         
354         * resources/sunspider-standalone-driver.js:
355         * tests/3d-cube.js:
356         * tests/3d-morph.js:
357         * tests/3d-raytrace.js:
358         * tests/bitops-bitwise-and.js:
359         * tests/string-base64.js:
360         * tests/string-tagcloud.js:
361
362 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
363
364         Reviewed by Nikolas.
365         
366         - Rebalance test complexity.
367         
368         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
369         
370         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
371
372         However, for some tests, IE7 was a huge outlier compared to other
373         major browsers. For those tests, I used Firefox 2.0.0.8 on the
374         same OS and hardware as a normalization basis.
375         
376         * tests/3d-morph.js:
377         * tests/3d-raytrace.js:
378         * tests/bitops-3bit-bits-in-byte.js:
379         * tests/bitops-bits-in-byte.js:
380         * tests/bitops-bitwise-and.js:
381         * tests/math-cordic.js:
382         * tests/string-base64.js:
383         * tests/string-tagcloud.js:
384         * tests/string-unpack-code.js:
385
386 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
387
388         Reviewed by Oliver.
389         
390         - Fix the browser-hosted driver to be compatible with Safari 2
391
392         * hosted/sunspider-driver.html:
393
394 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
395
396         Rubber stamped by Hyatt.
397         
398         - Add BSD license notice to cordic test, the original author said to do so.
399
400         * tests/math-cordic.js:
401
402 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
403
404         Reviewed by Eric.
405         
406         - Support Windows and Windows browsers.
407
408         * hosted/sunspider-results.html: Display results correctly in IE.
409         * sunspider: tweaks to work on Windows, and with spaces in the path.
410
411 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
412
413         Rubber stamped by Oliver.
414
415         * tests/string-tagcloud.js: Remove stray print()
416
417 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
418
419         Reviewed by Oliver.
420         
421         Add some string test cases.
422
423         * tests/string-base64.js: Added. Does base64 encoding and decoding.
424         * tests/string-tagcloud.js: Added. Parses a JSON string and
425         generates tagcloud HTML markup based on the data.        
426         * tests/string-unpack-code.js: Added. Unpack compressed versions of
427         four of the most popular JavaScript libraries.
428         * tests/LIST: Added the new tests.
429
430 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
431
432         Reviewed by Anders.
433
434         * TODO: Updated with info on how to do the stats properly.
435
436         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
437         avoid overly slowing down the benchmark.
438
439         Added some 3D-related test cases.
440         
441         * tests/3d-cube.js: Added.
442         * tests/3d-morph.js: Added.
443         * tests/3d-raytrace.js: Added.
444         * tests/LIST:
445
446 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
447
448         Reviewed by Darin.
449
450         - New JavaScript benchmark
451         http://bugs.webkit.org/show_bug.cgi?id=15515
452         
453         A start on a new JavaScript benchmark, with standalone and
454         browser-hosted drivers.
455         
456         The test content is still incomplete and the drivers could use
457         some more features but there is enough here to make a good start.
458         
459         The drivers compute a 95% confidence interval on the mean for the
460         whole test, each category, and each individual test to make it
461         easier to tell whether differences are statistically
462         significant. The confidence interval can be narrowed by running
463         the test more times.
464         
465         * TODO: Added. Remaining things that need to be done.
466         * sunspider: Added. Perl script that acts as the standalone test driver.
467         * resources/sunspider-standalone-driver.js: Added. JavaScript part
468         of standalone test driver.
469         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
470         analysis code.
471         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
472         * make-hosted: Added. Script to generate browser-hosted tests.
473         * hosted/sunspider.html: Added. Start page for browser-hosted test.
474         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
475         * hosted/sunspider-results.html: Added. Results page for browser-hosted
476         tests.
477         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
478         tests.
479         * tests/LIST: Added. List of tests to use.
480         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
481         * tests/bitops-bits-in-byte.js: Added. Ditto.
482         * tests/bitops-bitwise-and.js: Added. Ditto.
483         * tests/math-cordic.js: Added. Ditto.
484