.: Replace "Apple Computer, Inc." with "Apple Inc." in copyright headers
[WebKit-https.git] / PerformanceTests / SunSpider / ChangeLog
1 2014-03-14  Maciej Stachowiak  <mjs@apple.com>
2
3         Replace "Apple Computer, Inc." with "Apple Inc." in copyright headers
4         https://bugs.webkit.org/show_bug.cgi?id=130276
5         <rdar://problem/16266927>
6
7         Reviewed by Simon Fraser.
8
9         * hosted/sunspider.html:
10         * hosted/versions.html:
11         * make-hosted:
12         * resources/TEMPLATE.html:
13         * resources/driver-TEMPLATE.html:
14         * resources/results-TEMPLATE.html:
15         * resources/sunspider-analyze-results.js:
16         * resources/sunspider-compare-results.js:
17         * resources/sunspider-standalone-compare.js:
18         * resources/sunspider-standalone-driver.js:
19         * sunspider:
20         * sunspider-compare-results:
21         * tests/sunspider-0.9.1/3d-morph.js:
22         * tests/sunspider-0.9.1/3d-raytrace.js:
23         * tests/sunspider-0.9.1/bitops-bitwise-and.js:
24         * tests/sunspider-0.9.1/math-cordic.js:
25         * tests/sunspider-0.9.1/string-tagcloud.js:
26         * tests/sunspider-0.9/3d-morph.js:
27         * tests/sunspider-0.9/3d-raytrace.js:
28         * tests/sunspider-0.9/bitops-bitwise-and.js:
29         * tests/sunspider-0.9/math-cordic.js:
30         * tests/sunspider-0.9/string-tagcloud.js:
31         * tests/sunspider-1.0.1/3d-morph.js:
32         * tests/sunspider-1.0.1/3d-raytrace.js:
33         * tests/sunspider-1.0.1/bitops-bitwise-and.js:
34         * tests/sunspider-1.0.1/math-cordic.js:
35         * tests/sunspider-1.0.1/string-tagcloud.js:
36         * tests/sunspider-1.0.2/3d-morph.js:
37         * tests/sunspider-1.0.2/3d-raytrace.js:
38         * tests/sunspider-1.0.2/bitops-bitwise-and.js:
39         * tests/sunspider-1.0.2/math-cordic.js:
40         * tests/sunspider-1.0.2/string-tagcloud.js:
41         * tests/sunspider-1.0/3d-morph.js:
42         * tests/sunspider-1.0/3d-raytrace.js:
43         * tests/sunspider-1.0/bitops-bitwise-and.js:
44         * tests/sunspider-1.0/math-cordic.js:
45         * tests/sunspider-1.0/string-tagcloud.js:
46
47 2014-02-10  Filip Pizlo  <fpizlo@apple.com>
48
49         Unreviewed, revert the accidental change from r163789.
50
51         * tests/v8-v6/v8-deltablue.js:
52
53 2013-12-10  Filip Pizlo  <fpizlo@apple.com>
54
55         Get rid of forward exit on DoubleAsInt32
56         https://bugs.webkit.org/show_bug.cgi?id=125552
57
58         Reviewed by Oliver Hunt.
59         
60         Use SunSpider as a kind of spot-check for the
61         no-architecture-specific-optimization paths in the compiler.
62
63         * no-architecture-specific-optimizations.yaml: Added.
64
65 2013-10-08  Geoffrey Garen  <ggaren@apple.com>
66
67         Refined power management in SunSpider 1.0.2
68         https://bugs.webkit.org/show_bug.cgi?id=122525
69
70         Reviewed by Gavin Barraclough.
71
72         * hosted/sunspider.css:
73         (#frameparent):
74         (#countdown):
75         * resources/TEMPLATE.html: Provide an explicit countdown element in the
76         parent, instead of hacking it into each child frame.
77
78         * resources/driver-TEMPLATE.html: Be more explicit about how we respond
79         to power management. Just moving setTimeout(0) inside the loop is a
80         little too subtle, and may not work across browsers.
81
82         Also, leave a little extra time after changing the countdown graphic,
83         to give the browser some time to paint.
84
85 2013-10-02  Geoffrey Garen  <ggaren@apple.com>
86
87         Improved painting behavior in SunSpider 1.0.2
88         https://bugs.webkit.org/show_bug.cgi?id=122257
89
90         Reviewed by Oliver Hunt.
91
92         Individual test names with times was a good painting strategy years
93         back, when each benchmark took hundreds of milliseconds to run. Now,
94         the whole suite can finish in a a few hundres milliseconds, and things
95         look pretty flashy.
96
97         Instead, display a countdown that indicates which iteration of the
98         test we're on.
99
100         * resources/TEMPLATE.html: Work around a bug in Firefox by specifying
101         our style inside the .html file instead of in an external stylesheet.
102         Under heavy JavaScript load, Firefox neglects to apply external
103         stylesheets -- probably due to a starved timer.
104         
105         * resources/driver-TEMPLATE.html: Delay a little between runs to ensure
106         that our countdown has enough time to paint.
107
108 2013-09-26  Geoffrey Garen  <ggaren@apple.com>
109
110         Fixed a version number string in SunSpider 1.0.2
111         https://bugs.webkit.org/show_bug.cgi?id=122004
112
113         Reviewed by Gavin Barraclough.
114
115         * resources/driver-TEMPLATE.html:
116         * resources/results-TEMPLATE.html: 1.0.2!
117
118 2013-09-26  Geoffrey Garen  <ggaren@apple.com>
119
120         Tentative SunSpider 1.0.2
121         https://bugs.webkit.org/show_bug.cgi?id=122002
122
123         Reviewed by Gavin Barraclough.
124
125         Be even more aggressive about asking for zero delay between tests by
126         setting a timeout at the beginning of a test instead of the end. This is
127         another step toward reducing noise -- particularly noise caused by
128         power management -- just like the step down from 10ms to 0ms.
129
130         Browsers typically put a 4ms floor on timers. The sooner we set
131         our timer, the sooner it will fire.
132
133         * make-hosted:
134         * resources/driver-TEMPLATE.html: Changed the driver to set the timeout
135         earlier.
136         * tests/sunspider-1.0.2: Added. These tests are unchanged from 1.0.1.
137
138 2013-09-09  Filip Pizlo  <fpizlo@apple.com>
139
140         Stress tests should test the jsc profiler (-p)
141         https://bugs.webkit.org/show_bug.cgi?id=121043
142
143         Reviewed by Mark Hahnenberg.
144         
145         Add a jsc-stress-test that tries to profile SunSpider.
146
147         * profiler-test.yaml: Added.
148
149 2013-08-08  Cosmin Truta  <ctruta@blackberry.com>
150
151         SunSpider: Move the 3d-morph fix from version 1.0 to version 1.0.1
152         https://bugs.webkit.org/show_bug.cgi?id=117993
153
154         Reviewed by George Staikos.
155
156         Bump the SunSpider version to 1.0.1.
157
158         Unroll r149548 in order to restore version 1.0 to its original,
159         and add the 3d-morph fix to version 1.0.1 instead.
160
161         * hosted/sunspider.html: Updated to version 1.0.1.
162         * hosted/versions.html: Updated to version 1.0.1.
163         * make-hosted: Added support for version 1.0.1.
164         * resources/driver-TEMPLATE.html: Updated to version 1.0.1.
165         * resources/results-TEMPLATE.html: Updated to version 1.0.1.
166         * sunspider: Updated to version 1.0.1.
167         * sunspider-compare-results: Updated to version 1.0.1.
168         * tests/sunspider-1.0/3d-morph.js: Rolled back to the original version.
169         * tests/sunspider-1.0.1/LIST: Added.
170         * tests/sunspider-1.0.1/3d-cube.js: Added.
171         * tests/sunspider-1.0.1/3d-morph.js: Added.
172         * tests/sunspider-1.0.1/3d-raytrace.js: Added.
173         * tests/sunspider-1.0.1/access-binary-trees.js: Added.
174         * tests/sunspider-1.0.1/access-fannkuch.js: Added.
175         * tests/sunspider-1.0.1/access-nbody.js: Added.
176         * tests/sunspider-1.0.1/access-nsieve.js: Added.
177         * tests/sunspider-1.0.1/bitops-3bit-bits-in-byte.js: Added.
178         * tests/sunspider-1.0.1/bitops-bits-in-byte.js: Added.
179         * tests/sunspider-1.0.1/bitops-bitwise-and.js: Added.
180         * tests/sunspider-1.0.1/bitops-nsieve-bits.js: Added.
181         * tests/sunspider-1.0.1/controlflow-recursive.js: Added.
182         * tests/sunspider-1.0.1/crypto-aes.js: Added.
183         * tests/sunspider-1.0.1/crypto-md5.js: Added.
184         * tests/sunspider-1.0.1/crypto-sha1.js: Added.
185         * tests/sunspider-1.0.1/date-format-tofte.js: Added.
186         * tests/sunspider-1.0.1/date-format-xparb.js: Added.
187         * tests/sunspider-1.0.1/math-cordic.js: Added.
188         * tests/sunspider-1.0.1/math-partial-sums.js: Added.
189         * tests/sunspider-1.0.1/math-spectral-norm.js: Added.
190         * tests/sunspider-1.0.1/regexp-dna.js: Added.
191         * tests/sunspider-1.0.1/string-base64.js: Added.
192         * tests/sunspider-1.0.1/string-fasta.js: Added.
193         * tests/sunspider-1.0.1/string-tagcloud.js: Added.
194         * tests/sunspider-1.0.1/string-unpack-code.js: Added.
195         * tests/sunspider-1.0.1/string-validate-input.js: Added.
196
197 2013-05-03  Cosmin Truta  <ctruta@blackberry.com>
198
199         SunSpider 1.0: 3d-morph: use epsilon to check result
200         https://bugs.webkit.org/show_bug.cgi?id=115553
201
202         Reviewed by George Staikos.
203
204         SunSpider/3d-morph should be more lenient in validating its results, since they depend on Math.sin, which isn't formally specified.
205
206         * tests/sunspider-1.0/3d-morph.js:
207
208 2013-04-19  Filip Pizlo  <fpizlo@apple.com>
209
210         SunSpider/string-tagcloud should be more lenient in validating its results, since they depend on Math.log, which isn't formally specified
211         https://bugs.webkit.org/show_bug.cgi?id=114895
212
213         Reviewed by Michael Saboff.
214
215         * tests/sunspider-1.0/string-tagcloud.js:
216
217 2013-04-18  Filip Pizlo  <fpizlo@apple.com>
218
219         Whenever it is cheap and non-invasive, SunSpider tests should validate their results to ensure that the browser runs them correctly
220         https://bugs.webkit.org/show_bug.cgi?id=114852
221
222         Reviewed by Geoffrey Garen.
223         
224         This adds low-overhead checking of the results of each SunSpider tests. This is not
225         meant to be an exhaustive test that everything was executed correctly, but rather a
226         simple sanity check that will catch glaring mistakes. The philosophy here is that we're
227         not trying to prevent all forms of cheating, or that we're trying to prove the
228         browser's correctness. Moreover, these checks are meant to incur minimal overhead;
229         they currently clock in at <2% slow-down in SunSpider 1.0.
230         
231         The test expectations were generated using the LLInt on command-line, and I've verified
232         that Firefox 20, Chrome 26, IE 10, Safari 6, and ToT with all of the JITs agree. Note
233         that some tests cannot be precisely validated because they use Math functions, which
234         ECMAScript chooses to not formally specify - those functions like sin() and friends are
235         allowed to return implementation-dependent results. Also some tests cannot be validated
236         at all because their behavior is either intentionally random or is timezone-dependent.
237         But 23 out of 26 tests now have some kind of validation.
238         
239         I've updated the harnesses to show erroneous runs when displaying results.
240
241         * resources/TEMPLATE.html:
242         * resources/driver-TEMPLATE.html:
243         * resources/sunspider-analyze-results.js:
244         (formatResult):
245         (resultLine):
246         (printOutput):
247         * resources/sunspider-compare-results.js:
248         (.formatMean):
249         (.resultLine):
250         (.printOutput):
251         (sunspiderCompareResults):
252         * resources/sunspider-standalone-driver.js:
253         * tests/sunspider-1.0/3d-cube.js:
254         (Init):
255         * tests/sunspider-1.0/3d-morph.js:
256         * tests/sunspider-1.0/3d-raytrace.js:
257         * tests/sunspider-1.0/access-binary-trees.js:
258         * tests/sunspider-1.0/access-fannkuch.js:
259         * tests/sunspider-1.0/access-nbody.js:
260         * tests/sunspider-1.0/access-nsieve.js:
261         (sieve):
262         * tests/sunspider-1.0/bitops-3bit-bits-in-byte.js:
263         * tests/sunspider-1.0/bitops-bits-in-byte.js:
264         * tests/sunspider-1.0/bitops-bitwise-and.js:
265         * tests/sunspider-1.0/bitops-nsieve-bits.js:
266         * tests/sunspider-1.0/controlflow-recursive.js:
267         * tests/sunspider-1.0/crypto-aes.js:
268         * tests/sunspider-1.0/crypto-md5.js:
269         * tests/sunspider-1.0/crypto-sha1.js:
270         * tests/sunspider-1.0/date-format-tofte.js:
271         * tests/sunspider-1.0/date-format-xparb.js:
272         * tests/sunspider-1.0/math-cordic.js:
273         * tests/sunspider-1.0/math-partial-sums.js:
274         (partial):
275         * tests/sunspider-1.0/math-spectral-norm.js:
276         * tests/sunspider-1.0/regexp-dna.js:
277         * tests/sunspider-1.0/string-base64.js:
278         * tests/sunspider-1.0/string-fasta.js:
279         (fastaRepeat):
280         (fastaRandom):
281         * tests/sunspider-1.0/string-tagcloud.js:
282         * tests/sunspider-1.0/string-unpack-code.js:
283         * tests/sunspider-1.0/string-validate-input.js:
284
285 2013-04-11  Filip Pizlo  <fpizlo@apple.com>
286
287         Get rid of the 10ms delay between test executions
288         https://bugs.webkit.org/show_bug.cgi?id=114458
289         <rdar://problem/13631112>
290
291         Reviewed by Darin Adler and Geoffrey Garen.
292         
293         More details on this in the bug. Long story short, I don't know why the 10ms delay is
294         there, and it appears to be the root of some noisyness and unreliability in the results.
295         Removing it makes results more consistent, which is a good thing.
296
297         * resources/driver-TEMPLATE.html:
298
299 2013-01-16  Eric Seidel  <eric@webkit.org>
300
301         Remove --shark* support from sunspider/run-sunspider now that Shark is dead
302         https://bugs.webkit.org/show_bug.cgi?id=99512
303
304         Reviewed by Darin Adler.
305
306         I tried to use --instruments, but that also seems broken (in the same way before/after this patch).
307
308         * sunspider:
309         (runTestsOnce):
310
311 2012-08-02  Filip Pizlo  <fpizlo@apple.com>
312
313         Unreviewed, revert debugging stuff I landed in http://trac.webkit.org/changeset/124557
314         by accident.
315
316         * tests/v8-v6/v8-crypto.js:
317         (am1):
318         (am2):
319         (am3):
320         (am4):
321         (bnpCopyTo):
322         (bnpFromString):
323         (bnpClamp):
324
325 2012-03-11  Maciej Stachowiak  <mjs@apple.com>
326
327         Add --instruments option to sunspider to profile with Instruments
328         https://bugs.webkit.org/show_bug.cgi?id=80783
329
330         Reviewed by Filip Pizlo.
331
332         * resources/TimeProfile20us.tracetemplate: Added.
333         * sunspider:
334         (runTestsOnce):
335
336 2011-11-15  Andy Wingo  <wingo@igalia.com>
337
338         Extend sunspider driver to be able to run kraken
339         https://bugs.webkit.org/show_bug.cgi?id=71799
340
341         Reviewed by Filip Pizlo.
342
343         * resources/sunspider-standalone-driver.js: Try to load a -data
344         file.  If that succeeds, we have a kraken-like test, so we time
345         the test using `load'.  Otherwise fall back to using `run'.
346
347 2011-08-11  Mark Rowe  <mrowe@apple.com>
348
349         Fix sunspider-compare-results to default to the same suite version as the sunspider script.
350
351         Rubber-stamped by Maciej Stachowiak.
352
353         * sunspider-compare-results:
354
355 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
356
357         Update SunSpider versioning to 1.0
358         https://bugs.webkit.org/show_bug.cgi?id=63870
359
360         Reviewed by Dan Bernstein.
361
362         * hosted/sunspider.html:
363         * hosted/versions.html:
364         * resources/driver-TEMPLATE.html:
365         * resources/results-TEMPLATE.html:
366         * sunspider:
367
368 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
369
370         Sunspider 0.9.1 harness doesn't actually close() its test documents
371         https://bugs.webkit.org/show_bug.cgi?id=47045
372
373         Reviewed by Daniel Bates.
374
375         * hosted/versions.html:
376         * resources/driver-TEMPLATE.html:
377
378 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
379
380         Not Reviewed. 
381         
382         Fix obviou typo in previous commit.
383
384         * tests/sunspider-1.0/bitops-bitwise-and.js:
385
386 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
387
388         Reviewed by Anders Carlsson.
389
390         SunSpider: all four bitops benchmarks can be replaced with NOP
391         https://bugs.webkit.org/show_bug.cgi?id=38446
392
393         * tests/sunspider-1.0/bitops-3bit-bits-in-byte.js:
394         (TimeFunc): Save the result.
395         * tests/sunspider-1.0/bitops-bits-in-byte.js:
396         (TimeFunc): Save the result.
397         * tests/sunspider-1.0/bitops-bitwise-and.js: More explicitly
398         save the results.
399         * tests/sunspider-1.0/bitops-nsieve-bits.js:
400         (sieve): Save the result.
401
402 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
403
404         SunSpider: string-validate-input.js uses an undeclared variable named 'name', which is a DOM API
405         https://bugs.webkit.org/show_bug.cgi?id=60937
406
407         Reviewed by Dan Bernstein.
408
409         * tests/sunspider-1.0/string-validate-input.js:
410         (doTest): Rename the variable to username
411
412 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
413
414         Reviewed by Darin Adler.
415
416         SunSpider: The main function of math-cordic is dead code
417         https://bugs.webkit.org/show_bug.cgi?id=63863
418         
419         Try to prevent math-cordic from being eliminated as dead code or
420         compiled down to a constant.
421
422         * tests/sunspider-1.0/math-cordic.js:
423         (cordicsincos):
424         (cordic):
425
426 2011-06-30  Maciej Stachowiak  <mjs@apple.com>
427
428         Reviewed by Adam Barth.
429
430         Create sunspider-1.0 directory in preparation for fixing a bunch of bugs
431         https://bugs.webkit.org/show_bug.cgi?id=63782
432
433         * make-hosted: Learn about the new directory.
434         * tests/sunspider-1.0: Copied from PerformanceTests/SunSpider/tests/sunspider-0.9.1.
435
436 2010-11-29  Geoffrey Garen  <ggaren@apple.com>
437
438         Reviewed by Gavin Barraclough.
439
440         Improved accuracy of command-line SunSpider.
441
442         * resources/sunspider-standalone-driver.js: Use the returned number of
443         elapsed milliseconds from "run" and "checkSyntax" instead of measuring
444         ourselves, for slightly more accurate numbers.
445
446 2010-09-16  Gavin Barraclough  <barraclough@apple.com>
447
448         Reviewed by Mark Rowe.
449         https://bugs.webkit.org/show_bug.cgi?id=45924
450
451         Modify the SunSpider harness to allow a path to be passed to the --suite
452         argument, supress the normal prepend-"tests/" behaviour for suite names
453         containing a '/'.
454
455         Also wrap the code in an anonymous function to move variables out of global
456         scope (currently the harness cannot handle running tests the overwrite the
457         variable 'j').
458
459         * resources/sunspider-standalone-driver.js:
460         * sunspider:
461
462 2010-08-27  Michael Saboff  <msaboff@apple.com>
463
464         Reviewed by Stephanie Lewis.
465
466         Added version 5 and version 6 of V8 tests with modifications similar
467         to the version 4 tests so they'll work with the SunSpider test harness.
468         Note that these files are external source and therefore don't conform 
469         to WebKit coding standards.
470         https://bugs.webkit.org/show_bug.cgi?id=44638
471
472         * tests/v8-v5: Added.
473         * tests/v8-v5/LIST: Added.
474         * tests/v8-v5/v8-crypto.js: Added.
475         * tests/v8-v5/v8-deltablue.js: Added.
476         * tests/v8-v5/v8-earley-boyer.js: Added.
477         * tests/v8-v5/v8-raytrace.js: Added.
478         * tests/v8-v5/v8-regexp.js: Added.
479         * tests/v8-v5/v8-richards.js: Added.
480         * tests/v8-v5/v8-splay.js: Added.
481         * tests/v8-v6: Added.
482         * tests/v8-v6/LIST: Added.
483         * tests/v8-v6/v8-crypto.js: Added.
484         * tests/v8-v6/v8-deltablue.js: Added.
485         * tests/v8-v6/v8-earley-boyer.js: Added.
486         * tests/v8-v6/v8-raytrace.js: Added.
487         * tests/v8-v6/v8-regexp.js: Added.
488         * tests/v8-v6/v8-richards.js: Added.
489         * tests/v8-v6/v8-splay.js: Added.
490
491 2010-07-15  Stephanie Lewis  <slewis@apple.com>
492
493         Reviewed by Geoff Garen.
494
495         http://bugs.webkit.org/show_bug.cgi?id=42406
496         Output location of results file.
497
498         * sunspider:
499
500 2010-05-17  Maciej Stachowiak  <mjs@apple.com>
501
502         Reviewed by Mark Rowe.
503
504         Browser-hosted version of SunSpider runs tests twice as many times as advertised
505         https://bugs.webkit.org/show_bug.cgi?id=39201
506
507         * make-hosted: Make sure to reset test list after every test suite.
508
509 2010-05-07  Adam Roben  <aroben@apple.com>
510
511         Fix typo in sunspider-compare-results.js that caused incorrect
512         two-sample t statistics to be computed
513
514         Fixes <http://webkit.org/b/38768> SunSpider computes incorrect
515         two-sample t statistics
516
517         Reviewed by Darin Adler.
518
519         * resources/sunspider-compare-results.js:
520         (sunspiderCompareResults.resultLine): Fixed the calculation of the t
521         variable to match the definition of a two-sample t statistic. Looks
522         like this was just a simple typo.
523
524 2010-04-05  Darin Adler  <darin@apple.com>
525
526         Updated the ignore property for changes to the contents here.
527
528         * .: Modified property svn:ignore.
529
530 2010-02-20  Maciej Stachowiak  <mjs@apple.com>
531
532         Reviewed by Adam Barth.
533
534         Add sunspider-0.9.1 to the site in preparation for announcing it.
535         https://bugs.webkit.org/show_bug.cgi?id=35206
536
537         * hosted/sunspider.css: Remove tabs, which I noticed where present while
538         copying to the WebKitSite directory.
539
540 2010-01-11  Oliver Hunt  <oliver@apple.com>
541
542         Reviewed by Darin Adler.
543
544         Sunspider parse-only tests don't run
545         https://bugs.webkit.org/show_bug.cgi?id=33489
546
547         Fix parse-only test list
548
549         * tests/parse-only/LIST:
550
551 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
552
553         Reviewed by Adele Peterson.
554
555         Make SunSpider version more prominent in the title
556         https://bugs.webkit.org/show_bug.cgi?id=32574
557
558         * hosted/sunspider.html:
559         * hosted/versions.html:
560         * resources/driver-TEMPLATE.html:
561         * resources/results-TEMPLATE.html:
562
563 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
564
565         Reviewed by Darin Adler.
566
567         Make SunSpider refuse to compare results across content versions
568         https://bugs.webkit.org/show_bug.cgi?id=32573
569         
570         The results URL now includes a version indicator, and compare mode
571         will refuse to compare between versions.
572
573         * resources/driver-TEMPLATE.html:
574         * resources/results-TEMPLATE.html:
575
576 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
577
578         Reviewed by Darin Adler.
579
580         Some Browser-hosted SunSpider files are not valid HTML5
581         https://bugs.webkit.org/show_bug.cgi?id=32536
582         
583         Made various fixes to validate as HTML5 with no warnings (mainly removing bogus
584         close tags and adding a meta charset declaration).
585
586         * hosted/sunspider.html:
587         * hosted/versions.html:
588         * resources/TEMPLATE.html:
589         * resources/driver-TEMPLATE.html:
590         * resources/results-TEMPLATE.html:
591
592 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
593
594         Reviewed by Eric Seidel.
595
596         Make sunspider-0.9.1 the default content set (both command-line and hosted)
597         https://bugs.webkit.org/show_bug.cgi?id=32537
598
599         * hosted/sunspider.html: Change default suite link.
600         * sunspider: Change default suite.
601         * sunspider-compare-results: Likewise.
602
603 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
604
605         Reviewed by Sam Weinig.
606
607         in-browser SunSpider suffers excessive penalty under power management
608         https://bugs.webkit.org/show_bug.cgi?id=32505
609         
610         I have made a few changes to address this:
611         
612         1) Change how browser-hosted SunSpider loads tests - preload the content and write it in with
613         document.write to reduce triggering of progress UI.
614         2) Reduce time between tests to 10ms from 500ms, so that power management doesn't keep the CPU
615         stepped all the way down the whole time.
616         3) Run the test cycle an extra time for warmup before the runs that count.
617
618         * hosted/sunspider-record-result.js: Removed.
619         * make-hosted:
620         * resources/TEMPLATE.html:
621         * resources/driver-TEMPLATE.html:
622
623 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
624
625         Reviewed by Gavin Barraclough.
626
627         SunSpider/tests/string-base64.js does not compute a valid base64 encoded string
628         https://bugs.webkit.org/show_bug.cgi?id=16806
629
630         Based on a patch by Eric Seidel.
631         
632         Fix the base64 computation to actually compute correct results. The impact on runtime of
633         the test is pretty small, but noticeable for some browsers. But at least it's not
634         doing a wrong and meaningless computation any more.
635         
636         * tests/sunspider-0.9.1/string-base64.js:
637         ():
638         (base64ToString):
639
640 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
641
642         Fixing commit error...
643         
644         I accidentally committed my last patch in a form that broke Web-hosted SunSpider. Fixing.
645
646         * resources/driver-TEMPLATE.html:
647
648 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
649
650         Reviewed by Sam Weinig.
651
652         Use JSON.parse instead of eval for Web-hosted SunSpider results processing
653         https://bugs.webkit.org/show_bug.cgi?id=32490
654
655         * hosted/json2.js: Added. Incorporated from json.org
656         * resources/driver-TEMPLATE.html: Fix an HTML validation bug I noticed.
657         * resources/results-TEMPLATE.html: Use JSON.parse instead of eval to process
658         results.
659
660 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
661
662         Reviewed by Oliver Hunt.
663
664         Enable Web-hosted version of SunSpider to handle multiple versions
665         https://bugs.webkit.org/show_bug.cgi?id=32478
666
667         * make-hosted: Now generate the hosted version to be able to run both the
668         0.9 and the 0.9.1 test suites.
669         * hosted: Modified property svn:ignore.
670         * hosted/sunspider-driver.html: Removed.
671         * hosted/sunspider-results.html: Removed.
672         * hosted/sunspider.html:
673         * hosted/versions.html: Added.
674         * resources/TEMPLATE.html:
675         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-driver.html.
676         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-results.html.
677
678 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
679
680         Reviewed by Oliver Hunt.
681
682         Give command-line sunspider the ability to handle multiple suites and versions
683         https://bugs.webkit.org/show_bug.cgi?id=32477
684         
685         Each suite/version's set of tests are now in a separate subdirectory of tests/, with a file named LIST
686         enumerating the tests. Current suites are:
687         
688         sunspider-0.9 - riginal SunSpider content 
689         sunspider-0.9.1 - SunSpider suite with a few tests fixed (and a few more to come)
690         ubench - "ubench" microbenchmark suite
691         v8-v4 - version 4 of the v8 benchmark
692         parse-only - some parser tests
693         
694         Sunspider can now be run with the --suite= parameter to select a
695         suite. The default is --suite=sunspider-0.9.
696
697         * .: Modified property svn:ignore to ignore new results directories.
698         * make-hosted: Generate based on sunspider-0.9 suite.
699         * resources/TEMPLATE.html: Fix an HTML compliance problem.
700         * resources/sunspider-standalone-driver.js: Become aware of suite names.
701         * sunspider: Modified to handle multiple suites as described above.
702         * sunspider-compare-results: ditto
703         * tests/LIST: Moved to tests/sunspider-0.9/ and tests/sunspider-0.9.1/
704         * tests/LIST-PARSE-ONLY: Moved to parse-only/LIST
705         * tests/LIST-UBENCH: Removed.
706         * tests/LIST-V8: Removed.
707         * tests/3d-cube.js: Moved to tests/sunspider-0.9 and tests/sunspider-0.9.1
708         * tests/3d-morph.js: ditto
709         * tests/3d-raytrace.js: ditto
710         * tests/access-binary-trees.js: ditto
711         * tests/access-fannkuch.js: ditto
712         * tests/access-nbody.js: ditto
713         * tests/access-nsieve.js: ditto
714         * tests/bitops-3bit-bits-in-byte.js: ditto
715         * tests/bitops-bits-in-byte.js: ditto
716         * tests/bitops-bitwise-and.js: ditto
717         * tests/bitops-nsieve-bits.js: ditto
718         * tests/controlflow-recursive.js: ditto
719         * tests/crypto-aes.js: ditto
720         * tests/crypto-md5.js: ditto
721         * tests/crypto-sha1.js: ditto
722         * tests/date-format-tofte.js: ditto
723         * tests/date-format-xparb.js: ditto
724         * tests/math-cordic.js: ditto
725         * tests/math-partial-sums.js: ditto
726         * tests/math-spectral-norm.js: ditto
727         * tests/regexp-dna.js: ditto
728         * tests/string-base64.js: ditto
729         * tests/string-fasta.js: ditto
730         * tests/string-tagcloud.js: ditto
731         * tests/string-unpack-code.js: ditto
732         * tests/string-validate-input.js: ditto
733         * tests/sunspider-0.9/: Added
734         * tests/sunspider-0.9/*.js: Moved from one level up
735         * tests/sunspider-0.9.1: Added.
736         * tests/sunspider-0.9.1/*.js: Moved from one level up.
737         * tests/v8-crypto.js: Moved to v8-v4/ directory.
738         * tests/v8-deltablue.js: ditto
739         * tests/v8-earley-boyer.js: ditto
740         * tests/v8-raytrace.js: ditto
741         * tests/v8-regexp.js: ditto
742         * tests/v8-richards.js: ditto
743         * tests/v8-splay.js: ditto
744         * tests/v8-v4: Added.
745
746 2009-09-30  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
747
748         Reviewed by Darin Adler.
749
750         Platform specific null device replaced with a platform independent.
751         https://bugs.webkit.org/show_bug.cgi?id=29544
752
753         * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL.
754
755 2009-09-21  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
756
757         Reviewed by Maciej Stachowiak.
758
759         [Qt] Make sunspider script work on Windows platform.
760         https://bugs.webkit.org/show_bug.cgi?id=29544
761
762         * sunspider:
763         Using platform specific null device instead of /dev/null.
764
765 2009-06-19  Adam Treat  <adam.treat@torchmobile.com>
766
767         Reviewed by Oliver Hunt.
768
769         https://bugs.webkit.org/show_bug.cgi?id=26540
770         Currently the SunSpider test driver lacks an option to run a test suite that
771         will test JavaScriptCore parsing performance only.  This patch adds just such
772         a test suite and option to SunSpider as well as the jsc test shell.  I've included
773         three large javascript source files found in the wild: jquery, mootools and prototype.
774         Combined with the concatenation of all three, these form a new testsuite to measure
775         and test pure JavaScriptCore parsing performance.
776
777         * resources/sunspider-standalone-driver.js:
778           Load the js with parse-only flag if it is part of the parse-only suite.
779         * sunspider:
780           Add the parse-only suite to the list of options.
781         * sunspider-compare-results:
782           Add the parse-only suite to the list of options.
783         * tests/LIST-PARSE-ONLY: Added.
784         * tests/parse-only/concat-jquery-mootools-prototype.js: Added.
785           A very large concatenation of the scripts found below.  This js takes ~30ms to parse on my machine.
786         * tests/parse-only/jquery-1.3.2.js: Added.
787           Latest version from jquery.com.
788         * tests/parse-only/mootools-1.2.2-core-nc.js: Added.
789           Latest version from mootools.net.
790         * tests/parse-only/prototype-1.6.0.3.js: Added.
791           Latest version from prototypejs.org.
792
793 2009-06-13  Steve Falkenburg  <sfalken@apple.com>
794
795         Update V8 benchmark to version 4.
796         
797         Reviewed by Cameron Zwarich.
798
799         * tests/LIST-V8:
800         * tests/v8-crypto.js:
801         * tests/v8-deltablue.js:
802         * tests/v8-earley-boyer.js:
803         * tests/v8-raytrace.js:
804         * tests/v8-regexp.js: Added.
805         * tests/v8-richards.js:
806         * tests/v8-splay.js: Added.
807
808 2009-05-26  Olivier DOLE  <odole@pleyo.com>
809
810         Reviewed by Maciej.
811
812         Store sunspider test suite results in a specific directory for each
813         different type of benchmark (sunspider, V8 or ubench).
814
815         * sunspider:
816         * sunspider-compare-results:
817
818 2009-05-12  Steve Falkenburg  <sfalken@apple.com>
819
820         Build fix.
821
822         * SunSpider.make:
823
824 2009-05-11  Steve Falkenburg  <sfalken@apple.com>
825
826         Include SunSpider tests in production builds.
827         
828         Reviewed by Adam Roben.
829
830         * SunSpider.make: Added.
831         * xcopy.excludes: Added.
832
833 2009-03-04  Oliver Hunt  <oliver@apple.com>
834
835         Added a few more tests to ubench
836
837         RS=Gavin Barraclough
838
839         Adding a couple of test to cover too few and too many arguments.  This
840         is needed to prevent regressions in all call paths from my current refactoring.
841
842         * tests/LIST-UBENCH:
843         * tests/ubench/function-correct-args.js: Added.
844         (f):
845         * tests/ubench/function-excess-args.js: Added.
846         (f):
847
848 2008-10-30  Zoltan Horvath  <Horvath.Zoltan.6@stud.u-szeged.hu>
849
850         Fix a bug where when V8's or UBENCH's test suite list file is missing
851         the error message is suggesting that SunSpider's list file is missing.
852
853         Reviewed by Sam Weinig.
854
855         * sunspider:
856         (loadTestsList): Fix the error message to use the right list name.
857
858 2008-10-07  David Hyatt  <hyatt@apple.com>
859
860         https://bugs.webkit.org/show_bug.cgi?id=18989
861
862         Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
863         we want all browsers to be doing the same thing on the test.
864
865         Reviewed by Maciej
866
867         * tests/regexp-dna.js:
868
869 2008-09-09  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
870
871         Rubber-stamped by Maciej Stachowiak.
872
873         The bleeding edge branch of V8 now supports passing fileanmes after
874         '-f', so the SunSpider script should be changed to do this again.
875         This allows all 3 major JavaScript engines to be used with the
876         unmodified SunSpider script.
877
878         * sunspider:
879
880 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
881
882         Reviewed by Maciej Stachowiak.
883
884         Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
885         and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
886         correct the punctuation in its documentation.
887
888         * sunspider:
889
890 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
891
892         Reviewed by Oliver Hunt.
893
894         Bug 20616: Incorporate V8 benchmarks in testing
895         <https://bugs.webkit.org/show_bug.cgi?id=20616>
896
897         This is a first attempt at running the V8 benchmarks within SunSpider,
898         with the --v8 option. The number of iterations is fixed for each
899         benchmark, and was chosen to make each of the benchmarks run between
900         500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
901
902         * sunspider:
903         * tests/LIST-V8: Added.
904         * tests/v8-crypto.js: Added.
905         * tests/v8-deltablue.js: Added.
906         * tests/v8-earley-boyer.js: Added.
907         * tests/v8-raytrace.js: Added.
908         * tests/v8-richards.js: Added.
909
910 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
911
912         Not reviewed.
913
914         Remove a local change that was accidentally committed in r36034.
915
916         * resources/sunspider-standalone-driver.js:
917
918 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
919
920         Rubber-stamped by Oliver Hunt.
921
922         Make SunSpider work with JavaScript shells that don't take filenames
923         after a '-f' argument.
924
925         * sunspider:
926
927 2008-06-07  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
928
929         Reviewed by Timothy.
930
931         Remove the --squirrelfish option from SunSpider, as it is no longer needed.
932
933         * sunspider:
934         * tests/LIST-SQUIRRELFISH: Removed.
935
936 2008-06-03  Alexey Proskuryakov  <ap@webkit.org>
937
938         Rubber-stamped by Mark Rowe.
939
940         Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
941
942         * sunspider:
943
944 2008-04-15  Maciej Stachowiak  <mjs@apple.com>
945
946         Rubber stamped by Oliver.
947         
948         - add newly working tests to squirrelfish list
949
950         * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
951
952 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
953
954         Rubber stamped by Oliver.
955         
956         - move ubench tests properly.
957
958         * tests/ubench: Added.
959         * tests/ubench/function-closure.js: Added.
960         * tests/ubench/function-empty.js: Added.
961         * tests/ubench/function-missing-args.js: Added.
962         * tests/ubench/function-sum.js: Added.
963         * tests/ubench/loop-empty-resolve.js: Added.
964         * tests/ubench/loop-empty.js: Added.
965         * tests/ubench/loop-sum.js: Added.
966
967 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
968
969         Rubber stamped by Oliver.
970
971         * sunspider: Don't force --runs=1 in squirrelfish mode any more.
972
973 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
974
975         Reviewed by Oliver.
976
977         - make --squirrelfish mode use the real harness, but a reduced set of tests
978
979         Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
980
981         * sunspider:
982         * tests/LIST-SQUIRRELFISH:
983         * tests/LIST-UBENCH: Added.
984         * tests/squirrelfish: Moved to tests/ubench
985
986 2008-04-14  Geoffrey Garen  <ggaren@apple.com>
987
988         Reviewed by Maciej Stachowiak.
989         
990         Removed an unused test.
991
992         * tests/squirrelfish/loop-resolve.js: Removed.
993
994 2008-04-10  Maciej Stachowiak  <mjs@apple.com>
995
996         Reviewed by Oliver.
997         
998         Add newly runnable tests to --squirrelfish mode.
999
1000         * tests/LIST-SQUIRRELFISH:
1001
1002 2008-04-06  Geoffrey Garen  <ggaren@apple.com>
1003
1004         Reviewed by Maciej Stachowiak.
1005         
1006         A little more love for --squirrelfish mode:
1007         
1008         Fixed a misplaced sort. Results properly sort now.
1009         
1010         Added a test list just for squirrelfish, and updated it to include
1011         all currently passing SunSpider tests.
1012         
1013         Fixed the pruning regexp to match 3d-morph.js.
1014
1015         * sunspider:
1016
1017 2008-03-26  Geoffrey Garen  <ggaren@apple.com>
1018
1019         Reviewed by Oliver Hunt.
1020         
1021         --squirrelfish mode: pared down tests for squirrelfish to chew on.
1022
1023         * sunspider:
1024         * tests/LIST:
1025         * tests/squirrelfish: Added.
1026         * tests/squirrelfish/function-closure.js: Added.
1027         * tests/squirrelfish/function-empty.js: Added.
1028         * tests/squirrelfish/function-missing-args.js: Added.
1029         * tests/squirrelfish/function-sum.js: Added.
1030         * tests/squirrelfish/loop-empty-resolve.js: Added.
1031         * tests/squirrelfish/loop-empty.js: Added.
1032         * tests/squirrelfish/loop-resolve.js: Added.
1033         * tests/squirrelfish/loop-sum.js: Added.
1034
1035 2008-03-21  Alexey Proskuryakov  <ap@webkit.org>
1036
1037         Reviewed by Geoff.
1038
1039         * sunspider: Pause update daemon on Darwin to make results reliable
1040         again (workaround for <rdar://problem/5811127>).
1041
1042 2008-02-07  Eric Seidel  <eric@webkit.org>
1043
1044         Reviewed by Sam.
1045
1046         * sunspider: add an error message when ./tests/LIST is not found
1047
1048 2007-12-29  Alp Toker  <alp@atoker.com>
1049
1050         Fix typo.
1051
1052         * hosted/sunspider.html:
1053
1054 2007-12-29  Alp Toker  <alp@atoker.com>
1055
1056         Reviewed by Maciej.
1057
1058         Provide the current URL in the SunSpider results page. Useful for
1059         copying benchmark results out of browsers without a location bar or
1060         where the location bar can't handle long URLs.
1061
1062         * hosted/sunspider-results.html:
1063
1064 2007-12-20  Eric Seidel  <eric@webkit.org>
1065
1066         Reviewed by mjs.
1067
1068         * sunspider: increase default number of runs for more accurate numbers
1069
1070 2007-12-18  Mark Rowe  <mrowe@apple.com>
1071
1072         Fix typo.
1073
1074         * hosted/sunspider.html:
1075
1076 2007-12-18  Maciej Stachowiak  <mjs@apple.com>
1077
1078         Reviewed by Eric.
1079         
1080         - give an extra digit of precision for small differences.
1081
1082         * resources/sunspider-compare-results.js:
1083
1084 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
1085
1086         Reviewed by Eric.
1087         
1088         - work around IE layout bugs
1089
1090         * hosted/sunspider.css:
1091
1092 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
1093
1094         Reviewed by Mark.
1095         
1096         - fix compare feature
1097
1098         * hosted/sunspider-results.html:
1099
1100 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
1101
1102         Reviewed by Mark.
1103         
1104         - Change the format of the output URL to be shorter, to meet IE constraints
1105
1106         * hosted/sunspider-driver.html:
1107         * hosted/sunspider-results.html:
1108
1109 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
1110
1111         Reviewed by Oliver.
1112         
1113         - Add some explanatory test and a dumb logo to SunSpider web hosted version
1114
1115         * hosted/sunspider-driver.html:
1116         * hosted/sunspider-results.html:
1117         * hosted/sunspider.css:
1118         * hosted/sunspider.html:
1119
1120 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
1121
1122         Reviewed by Oliver.
1123         
1124         - Make the web-hosted version of SunSpider look a little bit less drab.
1125
1126         * hosted/sunspider-driver.html:
1127         * hosted/sunspider-results.html:
1128         * hosted/sunspider.css: Added.
1129         * hosted/sunspider.html:
1130         * resources/TEMPLATE.html:
1131
1132 2007-12-12  Maciej Stachowiak  <mjs@apple.com>
1133
1134         Reviewed by Sam.
1135         
1136         - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
1137         
1138         A sample of what new-style results would look like:
1139         
1140         TEST                   COMPARISON            FROM                 TO             DETAILS
1141         ...
1142         ** TOTAL **:           1.41x as fast     6613.6ms +/- 0.1%   4703.0ms +/- 0.1%     significant
1143         ...
1144             3bit-bits-in-byte: *1.36x as slow*     88.8ms +/- 0.6%    121.1ms +/- 0.6%     significant
1145         
1146         * resources/sunspider-compare-results.js:
1147
1148 2007-11-14  Eric Seidel  <eric@webkit.org>
1149
1150         Reviewed by Sam.
1151
1152         * sunspider: add --shark-cache for L2 Cache Miss profiling
1153
1154 2007-11-09  Alexey Proskuryakov  <ap@webkit.org>
1155
1156         Reviewed by Darin Adler.
1157
1158         http://bugs.webkit.org/show_bug.cgi?id=15925
1159         SunSpider should check for Shark being installed
1160
1161         * sunspider: Explicitly test that shark command line tool is installed.
1162
1163 2007-11-04  Darin Adler  <darin@apple.com>
1164
1165         * hosted/sunspider.html: Tweaked formatting a bit.
1166
1167 2007-11-03  Maciej Stachowiak  <mjs@apple.com>
1168
1169         Reviewed by Darin Adler.
1170
1171         - Add compare mode and a description of the benchmark to the hosted version.
1172
1173         * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
1174         * hosted/sunspider.html: Added intro text.
1175         * make-hosted: Copy new file.
1176         * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
1177         a function.
1178         * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
1179         expects.
1180         * sunspider-compare-results: Use sunspider-standalone-compare.js.
1181
1182 2007-11-02  Darin Adler  <darin@apple.com>
1183
1184         * sunspider: Changed "--base" to "--set-baseline".
1185
1186 2007-11-02  Darin Adler  <darin@apple.com>
1187
1188         Reviewed by Maciej.
1189
1190         * sunspider: Added a "--base" option that records the current test as a baseline.
1191         Moved the code to find the newest .mshark file into a function (since I needed to use
1192         it in the other script and I prefer to copy/paste a function).
1193
1194         * sunspider-compare-results: Added logic to compare the baseline with the last
1195         run when you don't pass any parameters.
1196
1197 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1198
1199         Reviewed by Eric.
1200         
1201         - Added list of ECMAScript3 features that SunSpider does not cover currently.
1202
1203         * UNCOVERED: Added.
1204
1205 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1206
1207         Reviewed by Oliver.
1208         
1209         - Give better error messages when sunspider-compare-results fails
1210
1211         * sunspider-compare-results:
1212
1213 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1214
1215         Reviewed by Darin Adler.
1216         
1217         - fix Date tests to work in command-line SpiderMonkey
1218
1219         * tests/date-format-tofte.js:
1220         * tests/date-format-xparb.js:
1221
1222 2007-10-29  Darin Adler  <darin@apple.com>
1223
1224         Reviewed by Maciej.
1225
1226         * sunspider: Added --shark20 option, to run Shark at its highest sample
1227         resolution instead of its default.
1228
1229 2007-10-28  Adam Roben  <aroben@apple.com>
1230
1231         Fix SunSpider on Windows
1232
1233         Reviewed by Eric.
1234
1235         * sunspider: Don't use colons in filenames.
1236
1237 2007-10-28  Darin Adler  <darin@apple.com>
1238
1239         Reviewed by Adam.
1240
1241         * resources/sunspider-analyze-results.js: Tweak the output format a little.
1242         Change so that when there's only one run we don't write out confidence
1243         intervals at all rather than writing "NaN" over and over again.
1244
1245         * sunspider: Use the time and date as a suffix on the results file, that way
1246         all the results are left behind in the tmp directory. This will make it easy
1247         for us to add features that compare past results in the future. Also rename
1248         the .mshark files using the same scheme.
1249
1250         * sunspider-compare-results: Relax the parsing rules so we can parse the
1251         results file exactly as it's emitted from sunspider.
1252
1253 2007-10-25  Adam Roben  <aroben@apple.com>
1254
1255         Strip carriage returns from results
1256
1257         Carriage returns were screwing up sunspider-compare-results on
1258         Windows.
1259
1260         Rubberstamped by Oliver.
1261
1262         * sunspider:
1263
1264 2007-10-24  Darin Adler  <darin@apple.com>
1265
1266         Reviewed by Eric.
1267
1268         * sunspider: Open the profile in shark after completing a run.
1269         * sunspider-compare-results: Tiny perl tweaks.
1270
1271 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1272
1273         Reviewed by Darin Adler.
1274
1275         - Don't hardcode my path to testkjs
1276         
1277         * sunspider-compare-results:
1278
1279 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1280
1281         Reviewed by Darin Adler.
1282         
1283         - Add a compare script to compare results, and improve formatting of standard results a bit.
1284
1285         * resources/sunspider-analyze-results.js:
1286         * resources/sunspider-compare-results.js: Added.
1287         * sunspider-compare-results: Added.
1288
1289 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1290
1291         Reviewed by Darin Adler.
1292
1293         * resources/sunspider-analyze-results.js: Do the error range
1294         properly, using the t-distribution instead of 1.96 (which was
1295         based on the normal distribution).
1296         
1297         * sunspider: Print results in a way that will be friendlier to the
1298         soon-to-come compare mode.
1299
1300 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
1301
1302         Reviewed by Review.
1303         
1304         - add more tests (probably the final set for now)
1305         
1306         Already balanced. Added date, regexp, control flow, and a few
1307         more string and object/array access tests.
1308         
1309         * tests/LIST:
1310         * tests/access-fannkuch.js: Added.
1311         * tests/access-nbody.js: Added.
1312         * tests/controlflow-recursive.js: Added.
1313         * tests/date-format-tofte.js: Added.
1314         * tests/date-format-xparb.js: Added.
1315         * tests/regexp-dna.js: Added.
1316         * tests/string-validate-input.js: Added.
1317
1318 2007-10-21  Eric Seidel  <eric@webkit.org>
1319
1320         Reviewed by mjs.
1321
1322         * sunspider: make --shark only sample from testkjs
1323
1324 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
1325
1326         Rubber stamped by Eric.
1327         
1328         - added crypto tests (already balanced)
1329
1330         * tests/LIST:
1331         * tests/crypto-aes.js: Added.
1332         * tests/crypto-md5.js: Added.
1333         * tests/crypto-sha1.js: Added.
1334
1335 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
1336
1337         Reviewed by Adam.
1338         
1339         - rebalance new tests
1340         
1341         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
1342         
1343         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1344
1345         This balances them with the existing tests.
1346
1347         * tests/access-binary-trees.js:
1348         * tests/access-nsieve.js:
1349         * tests/bitops-nsieve-bits.js:
1350         * tests/math-partial-sums.js:
1351         * tests/math-spectral-norm.js:
1352         * tests/string-fasta.js:
1353
1354 2007-10-20  Eric Seidel  <eric@webkit.org>
1355
1356         Reviewed by darin.
1357         
1358         Add improved argument handling to sunspider, including
1359         --runs=<number>, --tests=<pattern, --shark, and --help
1360         Also re-factor code into subroutines
1361
1362         * sunspider: improved argument handling
1363
1364 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1365
1366         Reviewed by Mark.
1367
1368         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
1369         
1370         * TODO:
1371         * tests/LIST:
1372         * tests/access-binary-trees.js: Added.
1373         * tests/access-nsieve.js: Added.
1374         * tests/bitops-nsieve-bits.js: Added.
1375         * tests/math-partial-sums.js: Added.
1376         * tests/math-spectral-norm.js: Added.
1377         * tests/string-fasta.js: Added.
1378
1379 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1380
1381         Reviewed by Darin Adler.
1382
1383         * TODO: Updated to note areas that are now well-covered.
1384         
1385         - Change the tests and the driver to avoid leaving large object
1386         graphs hanging around, since that throws off the subsequent tests.
1387         
1388         * resources/sunspider-standalone-driver.js:
1389         * tests/3d-cube.js:
1390         * tests/3d-morph.js:
1391         * tests/3d-raytrace.js:
1392         * tests/bitops-bitwise-and.js:
1393         * tests/string-base64.js:
1394         * tests/string-tagcloud.js:
1395
1396 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1397
1398         Reviewed by Nikolas.
1399         
1400         - Rebalance test complexity.
1401         
1402         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
1403         
1404         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1405
1406         However, for some tests, IE7 was a huge outlier compared to other
1407         major browsers. For those tests, I used Firefox 2.0.0.8 on the
1408         same OS and hardware as a normalization basis.
1409         
1410         * tests/3d-morph.js:
1411         * tests/3d-raytrace.js:
1412         * tests/bitops-3bit-bits-in-byte.js:
1413         * tests/bitops-bits-in-byte.js:
1414         * tests/bitops-bitwise-and.js:
1415         * tests/math-cordic.js:
1416         * tests/string-base64.js:
1417         * tests/string-tagcloud.js:
1418         * tests/string-unpack-code.js:
1419
1420 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1421
1422         Reviewed by Oliver.
1423         
1424         - Fix the browser-hosted driver to be compatible with Safari 2
1425
1426         * hosted/sunspider-driver.html:
1427
1428 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1429
1430         Rubber stamped by Hyatt.
1431         
1432         - Add BSD license notice to cordic test, the original author said to do so.
1433
1434         * tests/math-cordic.js:
1435
1436 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1437
1438         Reviewed by Eric.
1439         
1440         - Support Windows and Windows browsers.
1441
1442         * hosted/sunspider-results.html: Display results correctly in IE.
1443         * sunspider: tweaks to work on Windows, and with spaces in the path.
1444
1445 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1446
1447         Rubber stamped by Oliver.
1448
1449         * tests/string-tagcloud.js: Remove stray print()
1450
1451 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
1452
1453         Reviewed by Oliver.
1454         
1455         Add some string test cases.
1456
1457         * tests/string-base64.js: Added. Does base64 encoding and decoding.
1458         * tests/string-tagcloud.js: Added. Parses a JSON string and
1459         generates tagcloud HTML markup based on the data.        
1460         * tests/string-unpack-code.js: Added. Unpack compressed versions of
1461         four of the most popular JavaScript libraries.
1462         * tests/LIST: Added the new tests.
1463
1464 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
1465
1466         Reviewed by Anders.
1467
1468         * TODO: Updated with info on how to do the stats properly.
1469
1470         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
1471         avoid overly slowing down the benchmark.
1472
1473         Added some 3D-related test cases.
1474         
1475         * tests/3d-cube.js: Added.
1476         * tests/3d-morph.js: Added.
1477         * tests/3d-raytrace.js: Added.
1478         * tests/LIST:
1479
1480 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
1481
1482         Reviewed by Darin Adler.
1483
1484         - New JavaScript benchmark
1485         http://bugs.webkit.org/show_bug.cgi?id=15515
1486         
1487         A start on a new JavaScript benchmark, with standalone and
1488         browser-hosted drivers.
1489         
1490         The test content is still incomplete and the drivers could use
1491         some more features but there is enough here to make a good start.
1492         
1493         The drivers compute a 95% confidence interval on the mean for the
1494         whole test, each category, and each individual test to make it
1495         easier to tell whether differences are statistically
1496         significant. The confidence interval can be narrowed by running
1497         the test more times.
1498         
1499         * TODO: Added. Remaining things that need to be done.
1500         * sunspider: Added. Perl script that acts as the standalone test driver.
1501         * resources/sunspider-standalone-driver.js: Added. JavaScript part
1502         of standalone test driver.
1503         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
1504         analysis code.
1505         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
1506         * make-hosted: Added. Script to generate browser-hosted tests.
1507         * hosted/sunspider.html: Added. Start page for browser-hosted test.
1508         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
1509         * hosted/sunspider-results.html: Added. Results page for browser-hosted
1510         tests.
1511         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
1512         tests.
1513         * tests/LIST: Added. List of tests to use.
1514         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
1515         * tests/bitops-bits-in-byte.js: Added. Ditto.
1516         * tests/bitops-bitwise-and.js: Added. Ditto.
1517         * tests/math-cordic.js: Added. Ditto.
1518