Unreviewed, revert debugging stuff I landed in http://trac.webkit.org/changeset/124557
[WebKit-https.git] / PerformanceTests / SunSpider / ChangeLog
1 2012-08-02  Filip Pizlo  <fpizlo@apple.com>
2
3         Unreviewed, revert debugging stuff I landed in http://trac.webkit.org/changeset/124557
4         by accident.
5
6         * tests/v8-v6/v8-crypto.js:
7         (am1):
8         (am2):
9         (am3):
10         (am4):
11         (bnpCopyTo):
12         (bnpFromString):
13         (bnpClamp):
14
15 2012-03-11  Maciej Stachowiak  <mjs@apple.com>
16
17         Add --instruments option to sunspider to profile with Instruments
18         https://bugs.webkit.org/show_bug.cgi?id=80783
19
20         Reviewed by Filip Pizlo.
21
22         * resources/TimeProfile20us.tracetemplate: Added.
23         * sunspider:
24         (runTestsOnce):
25
26 2011-11-15  Andy Wingo  <wingo@igalia.com>
27
28         Extend sunspider driver to be able to run kraken
29         https://bugs.webkit.org/show_bug.cgi?id=71799
30
31         Reviewed by Filip Pizlo.
32
33         * resources/sunspider-standalone-driver.js: Try to load a -data
34         file.  If that succeeds, we have a kraken-like test, so we time
35         the test using `load'.  Otherwise fall back to using `run'.
36
37 2011-08-11  Mark Rowe  <mrowe@apple.com>
38
39         Fix sunspider-compare-results to default to the same suite version as the sunspider script.
40
41         Rubber-stamped by Maciej Stachowiak.
42
43         * sunspider-compare-results:
44
45 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
46
47         Update SunSpider versioning to 1.0
48         https://bugs.webkit.org/show_bug.cgi?id=63870
49
50         Reviewed by Dan Bernstein.
51
52         * hosted/sunspider.html:
53         * hosted/versions.html:
54         * resources/driver-TEMPLATE.html:
55         * resources/results-TEMPLATE.html:
56         * sunspider:
57
58 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
59
60         Sunspider 0.9.1 harness doesn't actually close() its test documents
61         https://bugs.webkit.org/show_bug.cgi?id=47045
62
63         Reviewed by Daniel Bates.
64
65         * hosted/versions.html:
66         * resources/driver-TEMPLATE.html:
67
68 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
69
70         Not Reviewed. 
71         
72         Fix obviou typo in previous commit.
73
74         * tests/sunspider-1.0/bitops-bitwise-and.js:
75
76 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
77
78         Reviewed by Anders Carlsson.
79
80         SunSpider: all four bitops benchmarks can be replaced with NOP
81         https://bugs.webkit.org/show_bug.cgi?id=38446
82
83         * tests/sunspider-1.0/bitops-3bit-bits-in-byte.js:
84         (TimeFunc): Save the result.
85         * tests/sunspider-1.0/bitops-bits-in-byte.js:
86         (TimeFunc): Save the result.
87         * tests/sunspider-1.0/bitops-bitwise-and.js: More explicitly
88         save the results.
89         * tests/sunspider-1.0/bitops-nsieve-bits.js:
90         (sieve): Save the result.
91
92 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
93
94         SunSpider: string-validate-input.js uses an undeclared variable named 'name', which is a DOM API
95         https://bugs.webkit.org/show_bug.cgi?id=60937
96
97         Reviewed by Dan Bernstein.
98
99         * tests/sunspider-1.0/string-validate-input.js:
100         (doTest): Rename the variable to username
101
102 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
103
104         Reviewed by Darin Adler.
105
106         SunSpider: The main function of math-cordic is dead code
107         https://bugs.webkit.org/show_bug.cgi?id=63863
108         
109         Try to prevent math-cordic from being eliminated as dead code or
110         compiled down to a constant.
111
112         * tests/sunspider-1.0/math-cordic.js:
113         (cordicsincos):
114         (cordic):
115
116 2011-06-30  Maciej Stachowiak  <mjs@apple.com>
117
118         Reviewed by Adam Barth.
119
120         Create sunspider-1.0 directory in preparation for fixing a bunch of bugs
121         https://bugs.webkit.org/show_bug.cgi?id=63782
122
123         * make-hosted: Learn about the new directory.
124         * tests/sunspider-1.0: Copied from PerformanceTests/SunSpider/tests/sunspider-0.9.1.
125
126 2010-11-29  Geoffrey Garen  <ggaren@apple.com>
127
128         Reviewed by Gavin Barraclough.
129
130         Improved accuracy of command-line SunSpider.
131
132         * resources/sunspider-standalone-driver.js: Use the returned number of
133         elapsed milliseconds from "run" and "checkSyntax" instead of measuring
134         ourselves, for slightly more accurate numbers.
135
136 2010-09-16  Gavin Barraclough  <barraclough@apple.com>
137
138         Reviewed by Mark Rowe.
139         https://bugs.webkit.org/show_bug.cgi?id=45924
140
141         Modify the SunSpider harness to allow a path to be passed to the --suite
142         argument, supress the normal prepend-"tests/" behaviour for suite names
143         containing a '/'.
144
145         Also wrap the code in an anonymous function to move variables out of global
146         scope (currently the harness cannot handle running tests the overwrite the
147         variable 'j').
148
149         * resources/sunspider-standalone-driver.js:
150         * sunspider:
151
152 2010-08-27  Michael Saboff  <msaboff@apple.com>
153
154         Reviewed by Stephanie Lewis.
155
156         Added version 5 and version 6 of V8 tests with modifications similar
157         to the version 4 tests so they'll work with the SunSpider test harness.
158         Note that these files are external source and therefore don't conform 
159         to WebKit coding standards.
160         https://bugs.webkit.org/show_bug.cgi?id=44638
161
162         * tests/v8-v5: Added.
163         * tests/v8-v5/LIST: Added.
164         * tests/v8-v5/v8-crypto.js: Added.
165         * tests/v8-v5/v8-deltablue.js: Added.
166         * tests/v8-v5/v8-earley-boyer.js: Added.
167         * tests/v8-v5/v8-raytrace.js: Added.
168         * tests/v8-v5/v8-regexp.js: Added.
169         * tests/v8-v5/v8-richards.js: Added.
170         * tests/v8-v5/v8-splay.js: Added.
171         * tests/v8-v6: Added.
172         * tests/v8-v6/LIST: Added.
173         * tests/v8-v6/v8-crypto.js: Added.
174         * tests/v8-v6/v8-deltablue.js: Added.
175         * tests/v8-v6/v8-earley-boyer.js: Added.
176         * tests/v8-v6/v8-raytrace.js: Added.
177         * tests/v8-v6/v8-regexp.js: Added.
178         * tests/v8-v6/v8-richards.js: Added.
179         * tests/v8-v6/v8-splay.js: Added.
180
181 2010-07-15  Stephanie Lewis  <slewis@apple.com>
182
183         Reviewed by Geoff Garen.
184
185         http://bugs.webkit.org/show_bug.cgi?id=42406
186         Output location of results file.
187
188         * sunspider:
189
190 2010-05-17  Maciej Stachowiak  <mjs@apple.com>
191
192         Reviewed by Mark Rowe.
193
194         Browser-hosted version of SunSpider runs tests twice as many times as advertised
195         https://bugs.webkit.org/show_bug.cgi?id=39201
196
197         * make-hosted: Make sure to reset test list after every test suite.
198
199 2010-05-07  Adam Roben  <aroben@apple.com>
200
201         Fix typo in sunspider-compare-results.js that caused incorrect
202         two-sample t statistics to be computed
203
204         Fixes <http://webkit.org/b/38768> SunSpider computes incorrect
205         two-sample t statistics
206
207         Reviewed by Darin Adler.
208
209         * resources/sunspider-compare-results.js:
210         (sunspiderCompareResults.resultLine): Fixed the calculation of the t
211         variable to match the definition of a two-sample t statistic. Looks
212         like this was just a simple typo.
213
214 2010-04-05  Darin Adler  <darin@apple.com>
215
216         Updated the ignore property for changes to the contents here.
217
218         * .: Modified property svn:ignore.
219
220 2010-02-20  Maciej Stachowiak  <mjs@apple.com>
221
222         Reviewed by Adam Barth.
223
224         Add sunspider-0.9.1 to the site in preparation for announcing it.
225         https://bugs.webkit.org/show_bug.cgi?id=35206
226
227         * hosted/sunspider.css: Remove tabs, which I noticed where present while
228         copying to the WebKitSite directory.
229
230 2010-01-11  Oliver Hunt  <oliver@apple.com>
231
232         Reviewed by Darin Adler.
233
234         Sunspider parse-only tests don't run
235         https://bugs.webkit.org/show_bug.cgi?id=33489
236
237         Fix parse-only test list
238
239         * tests/parse-only/LIST:
240
241 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
242
243         Reviewed by Adele Peterson.
244
245         Make SunSpider version more prominent in the title
246         https://bugs.webkit.org/show_bug.cgi?id=32574
247
248         * hosted/sunspider.html:
249         * hosted/versions.html:
250         * resources/driver-TEMPLATE.html:
251         * resources/results-TEMPLATE.html:
252
253 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
254
255         Reviewed by Darin Adler.
256
257         Make SunSpider refuse to compare results across content versions
258         https://bugs.webkit.org/show_bug.cgi?id=32573
259         
260         The results URL now includes a version indicator, and compare mode
261         will refuse to compare between versions.
262
263         * resources/driver-TEMPLATE.html:
264         * resources/results-TEMPLATE.html:
265
266 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
267
268         Reviewed by Darin Adler.
269
270         Some Browser-hosted SunSpider files are not valid HTML5
271         https://bugs.webkit.org/show_bug.cgi?id=32536
272         
273         Made various fixes to validate as HTML5 with no warnings (mainly removing bogus
274         close tags and adding a meta charset declaration).
275
276         * hosted/sunspider.html:
277         * hosted/versions.html:
278         * resources/TEMPLATE.html:
279         * resources/driver-TEMPLATE.html:
280         * resources/results-TEMPLATE.html:
281
282 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
283
284         Reviewed by Eric Seidel.
285
286         Make sunspider-0.9.1 the default content set (both command-line and hosted)
287         https://bugs.webkit.org/show_bug.cgi?id=32537
288
289         * hosted/sunspider.html: Change default suite link.
290         * sunspider: Change default suite.
291         * sunspider-compare-results: Likewise.
292
293 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
294
295         Reviewed by Sam Weinig.
296
297         in-browser SunSpider suffers excessive penalty under power management
298         https://bugs.webkit.org/show_bug.cgi?id=32505
299         
300         I have made a few changes to address this:
301         
302         1) Change how browser-hosted SunSpider loads tests - preload the content and write it in with
303         document.write to reduce triggering of progress UI.
304         2) Reduce time between tests to 10ms from 500ms, so that power management doesn't keep the CPU
305         stepped all the way down the whole time.
306         3) Run the test cycle an extra time for warmup before the runs that count.
307
308         * hosted/sunspider-record-result.js: Removed.
309         * make-hosted:
310         * resources/TEMPLATE.html:
311         * resources/driver-TEMPLATE.html:
312
313 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
314
315         Reviewed by Gavin Barraclough.
316
317         SunSpider/tests/string-base64.js does not compute a valid base64 encoded string
318         https://bugs.webkit.org/show_bug.cgi?id=16806
319
320         Based on a patch by Eric Seidel.
321         
322         Fix the base64 computation to actually compute correct results. The impact on runtime of
323         the test is pretty small, but noticeable for some browsers. But at least it's not
324         doing a wrong and meaningless computation any more.
325         
326         * tests/sunspider-0.9.1/string-base64.js:
327         ():
328         (base64ToString):
329
330 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
331
332         Fixing commit error...
333         
334         I accidentally committed my last patch in a form that broke Web-hosted SunSpider. Fixing.
335
336         * resources/driver-TEMPLATE.html:
337
338 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
339
340         Reviewed by Sam Weinig.
341
342         Use JSON.parse instead of eval for Web-hosted SunSpider results processing
343         https://bugs.webkit.org/show_bug.cgi?id=32490
344
345         * hosted/json2.js: Added. Incorporated from json.org
346         * resources/driver-TEMPLATE.html: Fix an HTML validation bug I noticed.
347         * resources/results-TEMPLATE.html: Use JSON.parse instead of eval to process
348         results.
349
350 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
351
352         Reviewed by Oliver Hunt.
353
354         Enable Web-hosted version of SunSpider to handle multiple versions
355         https://bugs.webkit.org/show_bug.cgi?id=32478
356
357         * make-hosted: Now generate the hosted version to be able to run both the
358         0.9 and the 0.9.1 test suites.
359         * hosted: Modified property svn:ignore.
360         * hosted/sunspider-driver.html: Removed.
361         * hosted/sunspider-results.html: Removed.
362         * hosted/sunspider.html:
363         * hosted/versions.html: Added.
364         * resources/TEMPLATE.html:
365         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-driver.html.
366         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-results.html.
367
368 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
369
370         Reviewed by Oliver Hunt.
371
372         Give command-line sunspider the ability to handle multiple suites and versions
373         https://bugs.webkit.org/show_bug.cgi?id=32477
374         
375         Each suite/version's set of tests are now in a separate subdirectory of tests/, with a file named LIST
376         enumerating the tests. Current suites are:
377         
378         sunspider-0.9 - riginal SunSpider content 
379         sunspider-0.9.1 - SunSpider suite with a few tests fixed (and a few more to come)
380         ubench - "ubench" microbenchmark suite
381         v8-v4 - version 4 of the v8 benchmark
382         parse-only - some parser tests
383         
384         Sunspider can now be run with the --suite= parameter to select a
385         suite. The default is --suite=sunspider-0.9.
386
387         * .: Modified property svn:ignore to ignore new results directories.
388         * make-hosted: Generate based on sunspider-0.9 suite.
389         * resources/TEMPLATE.html: Fix an HTML compliance problem.
390         * resources/sunspider-standalone-driver.js: Become aware of suite names.
391         * sunspider: Modified to handle multiple suites as described above.
392         * sunspider-compare-results: ditto
393         * tests/LIST: Moved to tests/sunspider-0.9/ and tests/sunspider-0.9.1/
394         * tests/LIST-PARSE-ONLY: Moved to parse-only/LIST
395         * tests/LIST-UBENCH: Removed.
396         * tests/LIST-V8: Removed.
397         * tests/3d-cube.js: Moved to tests/sunspider-0.9 and tests/sunspider-0.9.1
398         * tests/3d-morph.js: ditto
399         * tests/3d-raytrace.js: ditto
400         * tests/access-binary-trees.js: ditto
401         * tests/access-fannkuch.js: ditto
402         * tests/access-nbody.js: ditto
403         * tests/access-nsieve.js: ditto
404         * tests/bitops-3bit-bits-in-byte.js: ditto
405         * tests/bitops-bits-in-byte.js: ditto
406         * tests/bitops-bitwise-and.js: ditto
407         * tests/bitops-nsieve-bits.js: ditto
408         * tests/controlflow-recursive.js: ditto
409         * tests/crypto-aes.js: ditto
410         * tests/crypto-md5.js: ditto
411         * tests/crypto-sha1.js: ditto
412         * tests/date-format-tofte.js: ditto
413         * tests/date-format-xparb.js: ditto
414         * tests/math-cordic.js: ditto
415         * tests/math-partial-sums.js: ditto
416         * tests/math-spectral-norm.js: ditto
417         * tests/regexp-dna.js: ditto
418         * tests/string-base64.js: ditto
419         * tests/string-fasta.js: ditto
420         * tests/string-tagcloud.js: ditto
421         * tests/string-unpack-code.js: ditto
422         * tests/string-validate-input.js: ditto
423         * tests/sunspider-0.9/: Added
424         * tests/sunspider-0.9/*.js: Moved from one level up
425         * tests/sunspider-0.9.1: Added.
426         * tests/sunspider-0.9.1/*.js: Moved from one level up.
427         * tests/v8-crypto.js: Moved to v8-v4/ directory.
428         * tests/v8-deltablue.js: ditto
429         * tests/v8-earley-boyer.js: ditto
430         * tests/v8-raytrace.js: ditto
431         * tests/v8-regexp.js: ditto
432         * tests/v8-richards.js: ditto
433         * tests/v8-splay.js: ditto
434         * tests/v8-v4: Added.
435
436 2009-09-30  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
437
438         Reviewed by Darin Adler.
439
440         Platform specific null device replaced with a platform independent.
441         https://bugs.webkit.org/show_bug.cgi?id=29544
442
443         * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL.
444
445 2009-09-21  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
446
447         Reviewed by Maciej Stachowiak.
448
449         [Qt] Make sunspider script work on Windows platform.
450         https://bugs.webkit.org/show_bug.cgi?id=29544
451
452         * sunspider:
453         Using platform specific null device instead of /dev/null.
454
455 2009-06-19  Adam Treat  <adam.treat@torchmobile.com>
456
457         Reviewed by Oliver Hunt.
458
459         https://bugs.webkit.org/show_bug.cgi?id=26540
460         Currently the SunSpider test driver lacks an option to run a test suite that
461         will test JavaScriptCore parsing performance only.  This patch adds just such
462         a test suite and option to SunSpider as well as the jsc test shell.  I've included
463         three large javascript source files found in the wild: jquery, mootools and prototype.
464         Combined with the concatenation of all three, these form a new testsuite to measure
465         and test pure JavaScriptCore parsing performance.
466
467         * resources/sunspider-standalone-driver.js:
468           Load the js with parse-only flag if it is part of the parse-only suite.
469         * sunspider:
470           Add the parse-only suite to the list of options.
471         * sunspider-compare-results:
472           Add the parse-only suite to the list of options.
473         * tests/LIST-PARSE-ONLY: Added.
474         * tests/parse-only/concat-jquery-mootools-prototype.js: Added.
475           A very large concatenation of the scripts found below.  This js takes ~30ms to parse on my machine.
476         * tests/parse-only/jquery-1.3.2.js: Added.
477           Latest version from jquery.com.
478         * tests/parse-only/mootools-1.2.2-core-nc.js: Added.
479           Latest version from mootools.net.
480         * tests/parse-only/prototype-1.6.0.3.js: Added.
481           Latest version from prototypejs.org.
482
483 2009-06-13  Steve Falkenburg  <sfalken@apple.com>
484
485         Update V8 benchmark to version 4.
486         
487         Reviewed by Cameron Zwarich.
488
489         * tests/LIST-V8:
490         * tests/v8-crypto.js:
491         * tests/v8-deltablue.js:
492         * tests/v8-earley-boyer.js:
493         * tests/v8-raytrace.js:
494         * tests/v8-regexp.js: Added.
495         * tests/v8-richards.js:
496         * tests/v8-splay.js: Added.
497
498 2009-05-26  Olivier DOLE  <odole@pleyo.com>
499
500         Reviewed by Maciej.
501
502         Store sunspider test suite results in a specific directory for each
503         different type of benchmark (sunspider, V8 or ubench).
504
505         * sunspider:
506         * sunspider-compare-results:
507
508 2009-05-12  Steve Falkenburg  <sfalken@apple.com>
509
510         Build fix.
511
512         * SunSpider.make:
513
514 2009-05-11  Steve Falkenburg  <sfalken@apple.com>
515
516         Include SunSpider tests in production builds.
517         
518         Reviewed by Adam Roben.
519
520         * SunSpider.make: Added.
521         * xcopy.excludes: Added.
522
523 2009-03-04  Oliver Hunt  <oliver@apple.com>
524
525         Added a few more tests to ubench
526
527         RS=Gavin Barraclough
528
529         Adding a couple of test to cover too few and too many arguments.  This
530         is needed to prevent regressions in all call paths from my current refactoring.
531
532         * tests/LIST-UBENCH:
533         * tests/ubench/function-correct-args.js: Added.
534         (f):
535         * tests/ubench/function-excess-args.js: Added.
536         (f):
537
538 2008-10-30  Zoltan Horvath  <Horvath.Zoltan.6@stud.u-szeged.hu>
539
540         Fix a bug where when V8's or UBENCH's test suite list file is missing
541         the error message is suggesting that SunSpider's list file is missing.
542
543         Reviewed by Sam Weinig.
544
545         * sunspider:
546         (loadTestsList): Fix the error message to use the right list name.
547
548 2008-10-07  David Hyatt  <hyatt@apple.com>
549
550         https://bugs.webkit.org/show_bug.cgi?id=18989
551
552         Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
553         we want all browsers to be doing the same thing on the test.
554
555         Reviewed by Maciej
556
557         * tests/regexp-dna.js:
558
559 2008-09-09  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
560
561         Rubber-stamped by Maciej Stachowiak.
562
563         The bleeding edge branch of V8 now supports passing fileanmes after
564         '-f', so the SunSpider script should be changed to do this again.
565         This allows all 3 major JavaScript engines to be used with the
566         unmodified SunSpider script.
567
568         * sunspider:
569
570 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
571
572         Reviewed by Maciej Stachowiak.
573
574         Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
575         and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
576         correct the punctuation in its documentation.
577
578         * sunspider:
579
580 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
581
582         Reviewed by Oliver Hunt.
583
584         Bug 20616: Incorporate V8 benchmarks in testing
585         <https://bugs.webkit.org/show_bug.cgi?id=20616>
586
587         This is a first attempt at running the V8 benchmarks within SunSpider,
588         with the --v8 option. The number of iterations is fixed for each
589         benchmark, and was chosen to make each of the benchmarks run between
590         500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
591
592         * sunspider:
593         * tests/LIST-V8: Added.
594         * tests/v8-crypto.js: Added.
595         * tests/v8-deltablue.js: Added.
596         * tests/v8-earley-boyer.js: Added.
597         * tests/v8-raytrace.js: Added.
598         * tests/v8-richards.js: Added.
599
600 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
601
602         Not reviewed.
603
604         Remove a local change that was accidentally committed in r36034.
605
606         * resources/sunspider-standalone-driver.js:
607
608 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
609
610         Rubber-stamped by Oliver Hunt.
611
612         Make SunSpider work with JavaScript shells that don't take filenames
613         after a '-f' argument.
614
615         * sunspider:
616
617 2008-06-07  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
618
619         Reviewed by Timothy.
620
621         Remove the --squirrelfish option from SunSpider, as it is no longer needed.
622
623         * sunspider:
624         * tests/LIST-SQUIRRELFISH: Removed.
625
626 2008-06-03  Alexey Proskuryakov  <ap@webkit.org>
627
628         Rubber-stamped by Mark Rowe.
629
630         Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
631
632         * sunspider:
633
634 2008-04-15  Maciej Stachowiak  <mjs@apple.com>
635
636         Rubber stamped by Oliver.
637         
638         - add newly working tests to squirrelfish list
639
640         * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
641
642 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
643
644         Rubber stamped by Oliver.
645         
646         - move ubench tests properly.
647
648         * tests/ubench: Added.
649         * tests/ubench/function-closure.js: Added.
650         * tests/ubench/function-empty.js: Added.
651         * tests/ubench/function-missing-args.js: Added.
652         * tests/ubench/function-sum.js: Added.
653         * tests/ubench/loop-empty-resolve.js: Added.
654         * tests/ubench/loop-empty.js: Added.
655         * tests/ubench/loop-sum.js: Added.
656
657 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
658
659         Rubber stamped by Oliver.
660
661         * sunspider: Don't force --runs=1 in squirrelfish mode any more.
662
663 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
664
665         Reviewed by Oliver.
666
667         - make --squirrelfish mode use the real harness, but a reduced set of tests
668
669         Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
670
671         * sunspider:
672         * tests/LIST-SQUIRRELFISH:
673         * tests/LIST-UBENCH: Added.
674         * tests/squirrelfish: Moved to tests/ubench
675
676 2008-04-14  Geoffrey Garen  <ggaren@apple.com>
677
678         Reviewed by Maciej Stachowiak.
679         
680         Removed an unused test.
681
682         * tests/squirrelfish/loop-resolve.js: Removed.
683
684 2008-04-10  Maciej Stachowiak  <mjs@apple.com>
685
686         Reviewed by Oliver.
687         
688         Add newly runnable tests to --squirrelfish mode.
689
690         * tests/LIST-SQUIRRELFISH:
691
692 2008-04-06  Geoffrey Garen  <ggaren@apple.com>
693
694         Reviewed by Maciej Stachowiak.
695         
696         A little more love for --squirrelfish mode:
697         
698         Fixed a misplaced sort. Results properly sort now.
699         
700         Added a test list just for squirrelfish, and updated it to include
701         all currently passing SunSpider tests.
702         
703         Fixed the pruning regexp to match 3d-morph.js.
704
705         * sunspider:
706
707 2008-03-26  Geoffrey Garen  <ggaren@apple.com>
708
709         Reviewed by Oliver Hunt.
710         
711         --squirrelfish mode: pared down tests for squirrelfish to chew on.
712
713         * sunspider:
714         * tests/LIST:
715         * tests/squirrelfish: Added.
716         * tests/squirrelfish/function-closure.js: Added.
717         * tests/squirrelfish/function-empty.js: Added.
718         * tests/squirrelfish/function-missing-args.js: Added.
719         * tests/squirrelfish/function-sum.js: Added.
720         * tests/squirrelfish/loop-empty-resolve.js: Added.
721         * tests/squirrelfish/loop-empty.js: Added.
722         * tests/squirrelfish/loop-resolve.js: Added.
723         * tests/squirrelfish/loop-sum.js: Added.
724
725 2008-03-21  Alexey Proskuryakov  <ap@webkit.org>
726
727         Reviewed by Geoff.
728
729         * sunspider: Pause update daemon on Darwin to make results reliable
730         again (workaround for <rdar://problem/5811127>).
731
732 2008-02-07  Eric Seidel  <eric@webkit.org>
733
734         Reviewed by Sam.
735
736         * sunspider: add an error message when ./tests/LIST is not found
737
738 2007-12-29  Alp Toker  <alp@atoker.com>
739
740         Fix typo.
741
742         * hosted/sunspider.html:
743
744 2007-12-29  Alp Toker  <alp@atoker.com>
745
746         Reviewed by Maciej.
747
748         Provide the current URL in the SunSpider results page. Useful for
749         copying benchmark results out of browsers without a location bar or
750         where the location bar can't handle long URLs.
751
752         * hosted/sunspider-results.html:
753
754 2007-12-20  Eric Seidel  <eric@webkit.org>
755
756         Reviewed by mjs.
757
758         * sunspider: increase default number of runs for more accurate numbers
759
760 2007-12-18  Mark Rowe  <mrowe@apple.com>
761
762         Fix typo.
763
764         * hosted/sunspider.html:
765
766 2007-12-18  Maciej Stachowiak  <mjs@apple.com>
767
768         Reviewed by Eric.
769         
770         - give an extra digit of precision for small differences.
771
772         * resources/sunspider-compare-results.js:
773
774 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
775
776         Reviewed by Eric.
777         
778         - work around IE layout bugs
779
780         * hosted/sunspider.css:
781
782 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
783
784         Reviewed by Mark.
785         
786         - fix compare feature
787
788         * hosted/sunspider-results.html:
789
790 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
791
792         Reviewed by Mark.
793         
794         - Change the format of the output URL to be shorter, to meet IE constraints
795
796         * hosted/sunspider-driver.html:
797         * hosted/sunspider-results.html:
798
799 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
800
801         Reviewed by Oliver.
802         
803         - Add some explanatory test and a dumb logo to SunSpider web hosted version
804
805         * hosted/sunspider-driver.html:
806         * hosted/sunspider-results.html:
807         * hosted/sunspider.css:
808         * hosted/sunspider.html:
809
810 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
811
812         Reviewed by Oliver.
813         
814         - Make the web-hosted version of SunSpider look a little bit less drab.
815
816         * hosted/sunspider-driver.html:
817         * hosted/sunspider-results.html:
818         * hosted/sunspider.css: Added.
819         * hosted/sunspider.html:
820         * resources/TEMPLATE.html:
821
822 2007-12-12  Maciej Stachowiak  <mjs@apple.com>
823
824         Reviewed by Sam.
825         
826         - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
827         
828         A sample of what new-style results would look like:
829         
830         TEST                   COMPARISON            FROM                 TO             DETAILS
831         ...
832         ** TOTAL **:           1.41x as fast     6613.6ms +/- 0.1%   4703.0ms +/- 0.1%     significant
833         ...
834             3bit-bits-in-byte: *1.36x as slow*     88.8ms +/- 0.6%    121.1ms +/- 0.6%     significant
835         
836         * resources/sunspider-compare-results.js:
837
838 2007-11-14  Eric Seidel  <eric@webkit.org>
839
840         Reviewed by Sam.
841
842         * sunspider: add --shark-cache for L2 Cache Miss profiling
843
844 2007-11-09  Alexey Proskuryakov  <ap@webkit.org>
845
846         Reviewed by Darin Adler.
847
848         http://bugs.webkit.org/show_bug.cgi?id=15925
849         SunSpider should check for Shark being installed
850
851         * sunspider: Explicitly test that shark command line tool is installed.
852
853 2007-11-04  Darin Adler  <darin@apple.com>
854
855         * hosted/sunspider.html: Tweaked formatting a bit.
856
857 2007-11-03  Maciej Stachowiak  <mjs@apple.com>
858
859         Reviewed by Darin Adler.
860
861         - Add compare mode and a description of the benchmark to the hosted version.
862
863         * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
864         * hosted/sunspider.html: Added intro text.
865         * make-hosted: Copy new file.
866         * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
867         a function.
868         * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
869         expects.
870         * sunspider-compare-results: Use sunspider-standalone-compare.js.
871
872 2007-11-02  Darin Adler  <darin@apple.com>
873
874         * sunspider: Changed "--base" to "--set-baseline".
875
876 2007-11-02  Darin Adler  <darin@apple.com>
877
878         Reviewed by Maciej.
879
880         * sunspider: Added a "--base" option that records the current test as a baseline.
881         Moved the code to find the newest .mshark file into a function (since I needed to use
882         it in the other script and I prefer to copy/paste a function).
883
884         * sunspider-compare-results: Added logic to compare the baseline with the last
885         run when you don't pass any parameters.
886
887 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
888
889         Reviewed by Eric.
890         
891         - Added list of ECMAScript3 features that SunSpider does not cover currently.
892
893         * UNCOVERED: Added.
894
895 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
896
897         Reviewed by Oliver.
898         
899         - Give better error messages when sunspider-compare-results fails
900
901         * sunspider-compare-results:
902
903 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
904
905         Reviewed by Darin Adler.
906         
907         - fix Date tests to work in command-line SpiderMonkey
908
909         * tests/date-format-tofte.js:
910         * tests/date-format-xparb.js:
911
912 2007-10-29  Darin Adler  <darin@apple.com>
913
914         Reviewed by Maciej.
915
916         * sunspider: Added --shark20 option, to run Shark at its highest sample
917         resolution instead of its default.
918
919 2007-10-28  Adam Roben  <aroben@apple.com>
920
921         Fix SunSpider on Windows
922
923         Reviewed by Eric.
924
925         * sunspider: Don't use colons in filenames.
926
927 2007-10-28  Darin Adler  <darin@apple.com>
928
929         Reviewed by Adam.
930
931         * resources/sunspider-analyze-results.js: Tweak the output format a little.
932         Change so that when there's only one run we don't write out confidence
933         intervals at all rather than writing "NaN" over and over again.
934
935         * sunspider: Use the time and date as a suffix on the results file, that way
936         all the results are left behind in the tmp directory. This will make it easy
937         for us to add features that compare past results in the future. Also rename
938         the .mshark files using the same scheme.
939
940         * sunspider-compare-results: Relax the parsing rules so we can parse the
941         results file exactly as it's emitted from sunspider.
942
943 2007-10-25  Adam Roben  <aroben@apple.com>
944
945         Strip carriage returns from results
946
947         Carriage returns were screwing up sunspider-compare-results on
948         Windows.
949
950         Rubberstamped by Oliver.
951
952         * sunspider:
953
954 2007-10-24  Darin Adler  <darin@apple.com>
955
956         Reviewed by Eric.
957
958         * sunspider: Open the profile in shark after completing a run.
959         * sunspider-compare-results: Tiny perl tweaks.
960
961 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
962
963         Reviewed by Darin Adler.
964
965         - Don't hardcode my path to testkjs
966         
967         * sunspider-compare-results:
968
969 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
970
971         Reviewed by Darin Adler.
972         
973         - Add a compare script to compare results, and improve formatting of standard results a bit.
974
975         * resources/sunspider-analyze-results.js:
976         * resources/sunspider-compare-results.js: Added.
977         * sunspider-compare-results: Added.
978
979 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
980
981         Reviewed by Darin Adler.
982
983         * resources/sunspider-analyze-results.js: Do the error range
984         properly, using the t-distribution instead of 1.96 (which was
985         based on the normal distribution).
986         
987         * sunspider: Print results in a way that will be friendlier to the
988         soon-to-come compare mode.
989
990 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
991
992         Reviewed by Review.
993         
994         - add more tests (probably the final set for now)
995         
996         Already balanced. Added date, regexp, control flow, and a few
997         more string and object/array access tests.
998         
999         * tests/LIST:
1000         * tests/access-fannkuch.js: Added.
1001         * tests/access-nbody.js: Added.
1002         * tests/controlflow-recursive.js: Added.
1003         * tests/date-format-tofte.js: Added.
1004         * tests/date-format-xparb.js: Added.
1005         * tests/regexp-dna.js: Added.
1006         * tests/string-validate-input.js: Added.
1007
1008 2007-10-21  Eric Seidel  <eric@webkit.org>
1009
1010         Reviewed by mjs.
1011
1012         * sunspider: make --shark only sample from testkjs
1013
1014 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
1015
1016         Rubber stamped by Eric.
1017         
1018         - added crypto tests (already balanced)
1019
1020         * tests/LIST:
1021         * tests/crypto-aes.js: Added.
1022         * tests/crypto-md5.js: Added.
1023         * tests/crypto-sha1.js: Added.
1024
1025 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
1026
1027         Reviewed by Adam.
1028         
1029         - rebalance new tests
1030         
1031         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
1032         
1033         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1034
1035         This balances them with the existing tests.
1036
1037         * tests/access-binary-trees.js:
1038         * tests/access-nsieve.js:
1039         * tests/bitops-nsieve-bits.js:
1040         * tests/math-partial-sums.js:
1041         * tests/math-spectral-norm.js:
1042         * tests/string-fasta.js:
1043
1044 2007-10-20  Eric Seidel  <eric@webkit.org>
1045
1046         Reviewed by darin.
1047         
1048         Add improved argument handling to sunspider, including
1049         --runs=<number>, --tests=<pattern, --shark, and --help
1050         Also re-factor code into subroutines
1051
1052         * sunspider: improved argument handling
1053
1054 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1055
1056         Reviewed by Mark.
1057
1058         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
1059         
1060         * TODO:
1061         * tests/LIST:
1062         * tests/access-binary-trees.js: Added.
1063         * tests/access-nsieve.js: Added.
1064         * tests/bitops-nsieve-bits.js: Added.
1065         * tests/math-partial-sums.js: Added.
1066         * tests/math-spectral-norm.js: Added.
1067         * tests/string-fasta.js: Added.
1068
1069 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1070
1071         Reviewed by Darin Adler.
1072
1073         * TODO: Updated to note areas that are now well-covered.
1074         
1075         - Change the tests and the driver to avoid leaving large object
1076         graphs hanging around, since that throws off the subsequent tests.
1077         
1078         * resources/sunspider-standalone-driver.js:
1079         * tests/3d-cube.js:
1080         * tests/3d-morph.js:
1081         * tests/3d-raytrace.js:
1082         * tests/bitops-bitwise-and.js:
1083         * tests/string-base64.js:
1084         * tests/string-tagcloud.js:
1085
1086 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1087
1088         Reviewed by Nikolas.
1089         
1090         - Rebalance test complexity.
1091         
1092         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
1093         
1094         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1095
1096         However, for some tests, IE7 was a huge outlier compared to other
1097         major browsers. For those tests, I used Firefox 2.0.0.8 on the
1098         same OS and hardware as a normalization basis.
1099         
1100         * tests/3d-morph.js:
1101         * tests/3d-raytrace.js:
1102         * tests/bitops-3bit-bits-in-byte.js:
1103         * tests/bitops-bits-in-byte.js:
1104         * tests/bitops-bitwise-and.js:
1105         * tests/math-cordic.js:
1106         * tests/string-base64.js:
1107         * tests/string-tagcloud.js:
1108         * tests/string-unpack-code.js:
1109
1110 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1111
1112         Reviewed by Oliver.
1113         
1114         - Fix the browser-hosted driver to be compatible with Safari 2
1115
1116         * hosted/sunspider-driver.html:
1117
1118 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1119
1120         Rubber stamped by Hyatt.
1121         
1122         - Add BSD license notice to cordic test, the original author said to do so.
1123
1124         * tests/math-cordic.js:
1125
1126 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1127
1128         Reviewed by Eric.
1129         
1130         - Support Windows and Windows browsers.
1131
1132         * hosted/sunspider-results.html: Display results correctly in IE.
1133         * sunspider: tweaks to work on Windows, and with spaces in the path.
1134
1135 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1136
1137         Rubber stamped by Oliver.
1138
1139         * tests/string-tagcloud.js: Remove stray print()
1140
1141 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
1142
1143         Reviewed by Oliver.
1144         
1145         Add some string test cases.
1146
1147         * tests/string-base64.js: Added. Does base64 encoding and decoding.
1148         * tests/string-tagcloud.js: Added. Parses a JSON string and
1149         generates tagcloud HTML markup based on the data.        
1150         * tests/string-unpack-code.js: Added. Unpack compressed versions of
1151         four of the most popular JavaScript libraries.
1152         * tests/LIST: Added the new tests.
1153
1154 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
1155
1156         Reviewed by Anders.
1157
1158         * TODO: Updated with info on how to do the stats properly.
1159
1160         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
1161         avoid overly slowing down the benchmark.
1162
1163         Added some 3D-related test cases.
1164         
1165         * tests/3d-cube.js: Added.
1166         * tests/3d-morph.js: Added.
1167         * tests/3d-raytrace.js: Added.
1168         * tests/LIST:
1169
1170 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
1171
1172         Reviewed by Darin Adler.
1173
1174         - New JavaScript benchmark
1175         http://bugs.webkit.org/show_bug.cgi?id=15515
1176         
1177         A start on a new JavaScript benchmark, with standalone and
1178         browser-hosted drivers.
1179         
1180         The test content is still incomplete and the drivers could use
1181         some more features but there is enough here to make a good start.
1182         
1183         The drivers compute a 95% confidence interval on the mean for the
1184         whole test, each category, and each individual test to make it
1185         easier to tell whether differences are statistically
1186         significant. The confidence interval can be narrowed by running
1187         the test more times.
1188         
1189         * TODO: Added. Remaining things that need to be done.
1190         * sunspider: Added. Perl script that acts as the standalone test driver.
1191         * resources/sunspider-standalone-driver.js: Added. JavaScript part
1192         of standalone test driver.
1193         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
1194         analysis code.
1195         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
1196         * make-hosted: Added. Script to generate browser-hosted tests.
1197         * hosted/sunspider.html: Added. Start page for browser-hosted test.
1198         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
1199         * hosted/sunspider-results.html: Added. Results page for browser-hosted
1200         tests.
1201         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
1202         tests.
1203         * tests/LIST: Added. List of tests to use.
1204         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
1205         * tests/bitops-bits-in-byte.js: Added. Ditto.
1206         * tests/bitops-bitwise-and.js: Added. Ditto.
1207         * tests/math-cordic.js: Added. Ditto.
1208