2009-12-13 Maciej Stachowiak <mjs@apple.com>
[WebKit.git] / SunSpider / ChangeLog
1 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
2
3         Reviewed by Sam Weinig.
4
5         Use JSON.parse instead of eval for Web-hosted SunSpider results processing
6         https://bugs.webkit.org/show_bug.cgi?id=32490
7
8         * hosted/json2.js: Added. Incorporated from json.org
9         * resources/driver-TEMPLATE.html: Fix an HTML validation bug I noticed.
10         * resources/results-TEMPLATE.html: Use JSON.parse instead of eval to process
11         results.
12
13 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
14
15         Reviewed by Oliver Hunt.
16
17         Enable Web-hosted version of SunSpider to handle multiple versions
18         https://bugs.webkit.org/show_bug.cgi?id=32478
19
20         * make-hosted: Now generate the hosted version to be able to run both the
21         0.9 and the 0.9.1 test suites.
22         * hosted: Modified property svn:ignore.
23         * hosted/sunspider-driver.html: Removed.
24         * hosted/sunspider-results.html: Removed.
25         * hosted/sunspider.html:
26         * hosted/versions.html: Added.
27         * resources/TEMPLATE.html:
28         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-driver.html.
29         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-results.html.
30
31 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
32
33         Reviewed by Oliver Hunt.
34
35         Give command-line sunspider the ability to handle multiple suites and versions
36         https://bugs.webkit.org/show_bug.cgi?id=32477
37         
38         Each suite/version's set of tests are now in a separate subdirectory of tests/, with a file named LIST
39         enumerating the tests. Current suites are:
40         
41         sunspider-0.9 - riginal SunSpider content 
42         sunspider-0.9.1 - SunSpider suite with a few tests fixed (and a few more to come)
43         ubench - "ubench" microbenchmark suite
44         v8-v4 - version 4 of the v8 benchmark
45         parse-only - some parser tests
46         
47         Sunspider can now be run with the --suite= parameter to select a
48         suite. The default is --suite=sunspider-0.9.
49
50         * .: Modified property svn:ignore to ignore new results directories.
51         * make-hosted: Generate based on sunspider-0.9 suite.
52         * resources/TEMPLATE.html: Fix an HTML compliance problem.
53         * resources/sunspider-standalone-driver.js: Become aware of suite names.
54         * sunspider: Modified to handle multiple suites as described above.
55         * sunspider-compare-results: ditto
56         * tests/LIST: Moved to tests/sunspider-0.9/ and tests/sunspider-0.9.1/
57         * tests/LIST-PARSE-ONLY: Moved to parse-only/LIST
58         * tests/LIST-UBENCH: Removed.
59         * tests/LIST-V8: Removed.
60         * tests/3d-cube.js: Moved to tests/sunspider-0.9 and tests/sunspider-0.9.1
61         * tests/3d-morph.js: ditto
62         * tests/3d-raytrace.js: ditto
63         * tests/access-binary-trees.js: ditto
64         * tests/access-fannkuch.js: ditto
65         * tests/access-nbody.js: ditto
66         * tests/access-nsieve.js: ditto
67         * tests/bitops-3bit-bits-in-byte.js: ditto
68         * tests/bitops-bits-in-byte.js: ditto
69         * tests/bitops-bitwise-and.js: ditto
70         * tests/bitops-nsieve-bits.js: ditto
71         * tests/controlflow-recursive.js: ditto
72         * tests/crypto-aes.js: ditto
73         * tests/crypto-md5.js: ditto
74         * tests/crypto-sha1.js: ditto
75         * tests/date-format-tofte.js: ditto
76         * tests/date-format-xparb.js: ditto
77         * tests/math-cordic.js: ditto
78         * tests/math-partial-sums.js: ditto
79         * tests/math-spectral-norm.js: ditto
80         * tests/regexp-dna.js: ditto
81         * tests/string-base64.js: ditto
82         * tests/string-fasta.js: ditto
83         * tests/string-tagcloud.js: ditto
84         * tests/string-unpack-code.js: ditto
85         * tests/string-validate-input.js: ditto
86         * tests/sunspider-0.9/: Added
87         * tests/sunspider-0.9/*.js: Moved from one level up
88         * tests/sunspider-0.9.1: Added.
89         * tests/sunspider-0.9.1/*.js: Moved from one level up.
90         * tests/v8-crypto.js: Moved to v8-v4/ directory.
91         * tests/v8-deltablue.js: ditto
92         * tests/v8-earley-boyer.js: ditto
93         * tests/v8-raytrace.js: ditto
94         * tests/v8-regexp.js: ditto
95         * tests/v8-richards.js: ditto
96         * tests/v8-splay.js: ditto
97         * tests/v8-v4: Added.
98
99 2009-09-30  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
100
101         Reviewed by Darin Adler.
102
103         Platform specific null device replaced with a platform independent.
104         https://bugs.webkit.org/show_bug.cgi?id=29544
105
106         * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL.
107
108 2009-09-21  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
109
110         Reviewed by Maciej Stachowiak.
111
112         [Qt] Make sunspider script work on Windows platform.
113         https://bugs.webkit.org/show_bug.cgi?id=29544
114
115         * sunspider:
116         Using platform specific null device instead of /dev/null.
117
118 2009-06-19  Adam Treat  <adam.treat@torchmobile.com>
119
120         Reviewed by Oliver Hunt.
121
122         https://bugs.webkit.org/show_bug.cgi?id=26540
123         Currently the SunSpider test driver lacks an option to run a test suite that
124         will test JavaScriptCore parsing performance only.  This patch adds just such
125         a test suite and option to SunSpider as well as the jsc test shell.  I've included
126         three large javascript source files found in the wild: jquery, mootools and prototype.
127         Combined with the concatenation of all three, these form a new testsuite to measure
128         and test pure JavaScriptCore parsing performance.
129
130         * resources/sunspider-standalone-driver.js:
131           Load the js with parse-only flag if it is part of the parse-only suite.
132         * sunspider:
133           Add the parse-only suite to the list of options.
134         * sunspider-compare-results:
135           Add the parse-only suite to the list of options.
136         * tests/LIST-PARSE-ONLY: Added.
137         * tests/parse-only/concat-jquery-mootools-prototype.js: Added.
138           A very large concatenation of the scripts found below.  This js takes ~30ms to parse on my machine.
139         * tests/parse-only/jquery-1.3.2.js: Added.
140           Latest version from jquery.com.
141         * tests/parse-only/mootools-1.2.2-core-nc.js: Added.
142           Latest version from mootools.net.
143         * tests/parse-only/prototype-1.6.0.3.js: Added.
144           Latest version from prototypejs.org.
145
146 2009-06-13  Steve Falkenburg  <sfalken@apple.com>
147
148         Update V8 benchmark to version 4.
149         
150         Reviewed by Cameron Zwarich.
151
152         * tests/LIST-V8:
153         * tests/v8-crypto.js:
154         * tests/v8-deltablue.js:
155         * tests/v8-earley-boyer.js:
156         * tests/v8-raytrace.js:
157         * tests/v8-regexp.js: Added.
158         * tests/v8-richards.js:
159         * tests/v8-splay.js: Added.
160
161 2009-05-26  Olivier DOLE  <odole@pleyo.com>
162
163         Reviewed by Maciej.
164
165         Store sunspider test suite results in a specific directory for each
166         different type of benchmark (sunspider, V8 or ubench).
167
168         * sunspider:
169         * sunspider-compare-results:
170
171 2009-05-12  Steve Falkenburg  <sfalken@apple.com>
172
173         Build fix.
174
175         * SunSpider.make:
176
177 2009-05-11  Steve Falkenburg  <sfalken@apple.com>
178
179         Include SunSpider tests in production builds.
180         
181         Reviewed by Adam Roben.
182
183         * SunSpider.make: Added.
184         * xcopy.excludes: Added.
185
186 2009-03-04  Oliver Hunt  <oliver@apple.com>
187
188         Added a few more tests to ubench
189
190         RS=Gavin Barraclough
191
192         Adding a couple of test to cover too few and too many arguments.  This
193         is needed to prevent regressions in all call paths from my current refactoring.
194
195         * tests/LIST-UBENCH:
196         * tests/ubench/function-correct-args.js: Added.
197         (f):
198         * tests/ubench/function-excess-args.js: Added.
199         (f):
200
201 2008-10-30  Zoltan Horvath  <Horvath.Zoltan.6@stud.u-szeged.hu>
202
203         Fix a bug where when V8's or UBENCH's test suite list file is missing
204         the error message is suggesting that SunSpider's list file is missing.
205
206         Reviewed by Sam Weinig.
207
208         * sunspider:
209         (loadTestsList): Fix the error message to use the right list name.
210
211 2008-10-07  David Hyatt  <hyatt@apple.com>
212
213         https://bugs.webkit.org/show_bug.cgi?id=18989
214
215         Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
216         we want all browsers to be doing the same thing on the test.
217
218         Reviewed by Maciej
219
220         * tests/regexp-dna.js:
221
222 2008-09-09  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
223
224         Rubber-stamped by Maciej Stachowiak.
225
226         The bleeding edge branch of V8 now supports passing fileanmes after
227         '-f', so the SunSpider script should be changed to do this again.
228         This allows all 3 major JavaScript engines to be used with the
229         unmodified SunSpider script.
230
231         * sunspider:
232
233 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
234
235         Reviewed by Maciej Stachowiak.
236
237         Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
238         and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
239         correct the punctuation in its documentation.
240
241         * sunspider:
242
243 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
244
245         Reviewed by Oliver Hunt.
246
247         Bug 20616: Incorporate V8 benchmarks in testing
248         <https://bugs.webkit.org/show_bug.cgi?id=20616>
249
250         This is a first attempt at running the V8 benchmarks within SunSpider,
251         with the --v8 option. The number of iterations is fixed for each
252         benchmark, and was chosen to make each of the benchmarks run between
253         500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
254
255         * sunspider:
256         * tests/LIST-V8: Added.
257         * tests/v8-crypto.js: Added.
258         * tests/v8-deltablue.js: Added.
259         * tests/v8-earley-boyer.js: Added.
260         * tests/v8-raytrace.js: Added.
261         * tests/v8-richards.js: Added.
262
263 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
264
265         Not reviewed.
266
267         Remove a local change that was accidentally committed in r36034.
268
269         * resources/sunspider-standalone-driver.js:
270
271 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
272
273         Rubber-stamped by Oliver Hunt.
274
275         Make SunSpider work with JavaScript shells that don't take filenames
276         after a '-f' argument.
277
278         * sunspider:
279
280 2008-06-07  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
281
282         Reviewed by Timothy.
283
284         Remove the --squirrelfish option from SunSpider, as it is no longer needed.
285
286         * sunspider:
287         * tests/LIST-SQUIRRELFISH: Removed.
288
289 2008-06-03  Alexey Proskuryakov  <ap@webkit.org>
290
291         Rubber-stamped by Mark Rowe.
292
293         Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
294
295         * sunspider:
296
297 2008-04-15  Maciej Stachowiak  <mjs@apple.com>
298
299         Rubber stamped by Oliver.
300         
301         - add newly working tests to squirrelfish list
302
303         * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
304
305 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
306
307         Rubber stamped by Oliver.
308         
309         - move ubench tests properly.
310
311         * tests/ubench: Added.
312         * tests/ubench/function-closure.js: Added.
313         * tests/ubench/function-empty.js: Added.
314         * tests/ubench/function-missing-args.js: Added.
315         * tests/ubench/function-sum.js: Added.
316         * tests/ubench/loop-empty-resolve.js: Added.
317         * tests/ubench/loop-empty.js: Added.
318         * tests/ubench/loop-sum.js: Added.
319
320 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
321
322         Rubber stamped by Oliver.
323
324         * sunspider: Don't force --runs=1 in squirrelfish mode any more.
325
326 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
327
328         Reviewed by Oliver.
329
330         - make --squirrelfish mode use the real harness, but a reduced set of tests
331
332         Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
333
334         * sunspider:
335         * tests/LIST-SQUIRRELFISH:
336         * tests/LIST-UBENCH: Added.
337         * tests/squirrelfish: Moved to tests/ubench
338
339 2008-04-14  Geoffrey Garen  <ggaren@apple.com>
340
341         Reviewed by Maciej Stachowiak.
342         
343         Removed an unused test.
344
345         * tests/squirrelfish/loop-resolve.js: Removed.
346
347 2008-04-10  Maciej Stachowiak  <mjs@apple.com>
348
349         Reviewed by Oliver.
350         
351         Add newly runnable tests to --squirrelfish mode.
352
353         * tests/LIST-SQUIRRELFISH:
354
355 2008-04-06  Geoffrey Garen  <ggaren@apple.com>
356
357         Reviewed by Maciej Stachowiak.
358         
359         A little more love for --squirrelfish mode:
360         
361         Fixed a misplaced sort. Results properly sort now.
362         
363         Added a test list just for squirrelfish, and updated it to include
364         all currently passing SunSpider tests.
365         
366         Fixed the pruning regexp to match 3d-morph.js.
367
368         * sunspider:
369
370 2008-03-26  Geoffrey Garen  <ggaren@apple.com>
371
372         Reviewed by Oliver Hunt.
373         
374         --squirrelfish mode: pared down tests for squirrelfish to chew on.
375
376         * sunspider:
377         * tests/LIST:
378         * tests/squirrelfish: Added.
379         * tests/squirrelfish/function-closure.js: Added.
380         * tests/squirrelfish/function-empty.js: Added.
381         * tests/squirrelfish/function-missing-args.js: Added.
382         * tests/squirrelfish/function-sum.js: Added.
383         * tests/squirrelfish/loop-empty-resolve.js: Added.
384         * tests/squirrelfish/loop-empty.js: Added.
385         * tests/squirrelfish/loop-resolve.js: Added.
386         * tests/squirrelfish/loop-sum.js: Added.
387
388 2008-03-21  Alexey Proskuryakov  <ap@webkit.org>
389
390         Reviewed by Geoff.
391
392         * sunspider: Pause update daemon on Darwin to make results reliable
393         again (workaround for <rdar://problem/5811127>).
394
395 2008-02-07  Eric Seidel  <eric@webkit.org>
396
397         Reviewed by Sam.
398
399         * sunspider: add an error message when ./tests/LIST is not found
400
401 2007-12-29  Alp Toker  <alp@atoker.com>
402
403         Fix typo.
404
405         * hosted/sunspider.html:
406
407 2007-12-29  Alp Toker  <alp@atoker.com>
408
409         Reviewed by Maciej.
410
411         Provide the current URL in the SunSpider results page. Useful for
412         copying benchmark results out of browsers without a location bar or
413         where the location bar can't handle long URLs.
414
415         * hosted/sunspider-results.html:
416
417 2007-12-20  Eric Seidel  <eric@webkit.org>
418
419         Reviewed by mjs.
420
421         * sunspider: increase default number of runs for more accurate numbers
422
423 2007-12-18  Mark Rowe  <mrowe@apple.com>
424
425         Fix typo.
426
427         * hosted/sunspider.html:
428
429 2007-12-18  Maciej Stachowiak  <mjs@apple.com>
430
431         Reviewed by Eric.
432         
433         - give an extra digit of precision for small differences.
434
435         * resources/sunspider-compare-results.js:
436
437 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
438
439         Reviewed by Eric.
440         
441         - work around IE layout bugs
442
443         * hosted/sunspider.css:
444
445 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
446
447         Reviewed by Mark.
448         
449         - fix compare feature
450
451         * hosted/sunspider-results.html:
452
453 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
454
455         Reviewed by Mark.
456         
457         - Change the format of the output URL to be shorter, to meet IE constraints
458
459         * hosted/sunspider-driver.html:
460         * hosted/sunspider-results.html:
461
462 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
463
464         Reviewed by Oliver.
465         
466         - Add some explanatory test and a dumb logo to SunSpider web hosted version
467
468         * hosted/sunspider-driver.html:
469         * hosted/sunspider-results.html:
470         * hosted/sunspider.css:
471         * hosted/sunspider.html:
472
473 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
474
475         Reviewed by Oliver.
476         
477         - Make the web-hosted version of SunSpider look a little bit less drab.
478
479         * hosted/sunspider-driver.html:
480         * hosted/sunspider-results.html:
481         * hosted/sunspider.css: Added.
482         * hosted/sunspider.html:
483         * resources/TEMPLATE.html:
484
485 2007-12-12  Maciej Stachowiak  <mjs@apple.com>
486
487         Reviewed by Sam.
488         
489         - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
490         
491         A sample of what new-style results would look like:
492         
493         TEST                   COMPARISON            FROM                 TO             DETAILS
494         ...
495         ** TOTAL **:           1.41x as fast     6613.6ms +/- 0.1%   4703.0ms +/- 0.1%     significant
496         ...
497             3bit-bits-in-byte: *1.36x as slow*     88.8ms +/- 0.6%    121.1ms +/- 0.6%     significant
498         
499         * resources/sunspider-compare-results.js:
500
501 2007-11-14  Eric Seidel  <eric@webkit.org>
502
503         Reviewed by Sam.
504
505         * sunspider: add --shark-cache for L2 Cache Miss profiling
506
507 2007-11-09  Alexey Proskuryakov  <ap@webkit.org>
508
509         Reviewed by Darin Adler.
510
511         http://bugs.webkit.org/show_bug.cgi?id=15925
512         SunSpider should check for Shark being installed
513
514         * sunspider: Explicitly test that shark command line tool is installed.
515
516 2007-11-04  Darin Adler  <darin@apple.com>
517
518         * hosted/sunspider.html: Tweaked formatting a bit.
519
520 2007-11-03  Maciej Stachowiak  <mjs@apple.com>
521
522         Reviewed by Darin Adler.
523
524         - Add compare mode and a description of the benchmark to the hosted version.
525
526         * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
527         * hosted/sunspider.html: Added intro text.
528         * make-hosted: Copy new file.
529         * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
530         a function.
531         * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
532         expects.
533         * sunspider-compare-results: Use sunspider-standalone-compare.js.
534
535 2007-11-02  Darin Adler  <darin@apple.com>
536
537         * sunspider: Changed "--base" to "--set-baseline".
538
539 2007-11-02  Darin Adler  <darin@apple.com>
540
541         Reviewed by Maciej.
542
543         * sunspider: Added a "--base" option that records the current test as a baseline.
544         Moved the code to find the newest .mshark file into a function (since I needed to use
545         it in the other script and I prefer to copy/paste a function).
546
547         * sunspider-compare-results: Added logic to compare the baseline with the last
548         run when you don't pass any parameters.
549
550 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
551
552         Reviewed by Eric.
553         
554         - Added list of ECMAScript3 features that SunSpider does not cover currently.
555
556         * UNCOVERED: Added.
557
558 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
559
560         Reviewed by Oliver.
561         
562         - Give better error messages when sunspider-compare-results fails
563
564         * sunspider-compare-results:
565
566 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
567
568         Reviewed by Darin Adler.
569         
570         - fix Date tests to work in command-line SpiderMonkey
571
572         * tests/date-format-tofte.js:
573         * tests/date-format-xparb.js:
574
575 2007-10-29  Darin Adler  <darin@apple.com>
576
577         Reviewed by Maciej.
578
579         * sunspider: Added --shark20 option, to run Shark at its highest sample
580         resolution instead of its default.
581
582 2007-10-28  Adam Roben  <aroben@apple.com>
583
584         Fix SunSpider on Windows
585
586         Reviewed by Eric.
587
588         * sunspider: Don't use colons in filenames.
589
590 2007-10-28  Darin Adler  <darin@apple.com>
591
592         Reviewed by Adam.
593
594         * resources/sunspider-analyze-results.js: Tweak the output format a little.
595         Change so that when there's only one run we don't write out confidence
596         intervals at all rather than writing "NaN" over and over again.
597
598         * sunspider: Use the time and date as a suffix on the results file, that way
599         all the results are left behind in the tmp directory. This will make it easy
600         for us to add features that compare past results in the future. Also rename
601         the .mshark files using the same scheme.
602
603         * sunspider-compare-results: Relax the parsing rules so we can parse the
604         results file exactly as it's emitted from sunspider.
605
606 2007-10-25  Adam Roben  <aroben@apple.com>
607
608         Strip carriage returns from results
609
610         Carriage returns were screwing up sunspider-compare-results on
611         Windows.
612
613         Rubberstamped by Oliver.
614
615         * sunspider:
616
617 2007-10-24  Darin Adler  <darin@apple.com>
618
619         Reviewed by Eric.
620
621         * sunspider: Open the profile in shark after completing a run.
622         * sunspider-compare-results: Tiny perl tweaks.
623
624 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
625
626         Reviewed by Darin Adler.
627
628         - Don't hardcode my path to testkjs
629         
630         * sunspider-compare-results:
631
632 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
633
634         Reviewed by Darin Adler.
635         
636         - Add a compare script to compare results, and improve formatting of standard results a bit.
637
638         * resources/sunspider-analyze-results.js:
639         * resources/sunspider-compare-results.js: Added.
640         * sunspider-compare-results: Added.
641
642 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
643
644         Reviewed by Darin Adler.
645
646         * resources/sunspider-analyze-results.js: Do the error range
647         properly, using the t-distribution instead of 1.96 (which was
648         based on the normal distribution).
649         
650         * sunspider: Print results in a way that will be friendlier to the
651         soon-to-come compare mode.
652
653 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
654
655         Reviewed by Review.
656         
657         - add more tests (probably the final set for now)
658         
659         Already balanced. Added date, regexp, control flow, and a few
660         more string and object/array access tests.
661         
662         * tests/LIST:
663         * tests/access-fannkuch.js: Added.
664         * tests/access-nbody.js: Added.
665         * tests/controlflow-recursive.js: Added.
666         * tests/date-format-tofte.js: Added.
667         * tests/date-format-xparb.js: Added.
668         * tests/regexp-dna.js: Added.
669         * tests/string-validate-input.js: Added.
670
671 2007-10-21  Eric Seidel  <eric@webkit.org>
672
673         Reviewed by mjs.
674
675         * sunspider: make --shark only sample from testkjs
676
677 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
678
679         Rubber stamped by Eric.
680         
681         - added crypto tests (already balanced)
682
683         * tests/LIST:
684         * tests/crypto-aes.js: Added.
685         * tests/crypto-md5.js: Added.
686         * tests/crypto-sha1.js: Added.
687
688 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
689
690         Reviewed by Adam.
691         
692         - rebalance new tests
693         
694         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
695         
696         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
697
698         This balances them with the existing tests.
699
700         * tests/access-binary-trees.js:
701         * tests/access-nsieve.js:
702         * tests/bitops-nsieve-bits.js:
703         * tests/math-partial-sums.js:
704         * tests/math-spectral-norm.js:
705         * tests/string-fasta.js:
706
707 2007-10-20  Eric Seidel  <eric@webkit.org>
708
709         Reviewed by darin.
710         
711         Add improved argument handling to sunspider, including
712         --runs=<number>, --tests=<pattern, --shark, and --help
713         Also re-factor code into subroutines
714
715         * sunspider: improved argument handling
716
717 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
718
719         Reviewed by Mark.
720
721         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
722         
723         * TODO:
724         * tests/LIST:
725         * tests/access-binary-trees.js: Added.
726         * tests/access-nsieve.js: Added.
727         * tests/bitops-nsieve-bits.js: Added.
728         * tests/math-partial-sums.js: Added.
729         * tests/math-spectral-norm.js: Added.
730         * tests/string-fasta.js: Added.
731
732 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
733
734         Reviewed by Darin Adler.
735
736         * TODO: Updated to note areas that are now well-covered.
737         
738         - Change the tests and the driver to avoid leaving large object
739         graphs hanging around, since that throws off the subsequent tests.
740         
741         * resources/sunspider-standalone-driver.js:
742         * tests/3d-cube.js:
743         * tests/3d-morph.js:
744         * tests/3d-raytrace.js:
745         * tests/bitops-bitwise-and.js:
746         * tests/string-base64.js:
747         * tests/string-tagcloud.js:
748
749 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
750
751         Reviewed by Nikolas.
752         
753         - Rebalance test complexity.
754         
755         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
756         
757         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
758
759         However, for some tests, IE7 was a huge outlier compared to other
760         major browsers. For those tests, I used Firefox 2.0.0.8 on the
761         same OS and hardware as a normalization basis.
762         
763         * tests/3d-morph.js:
764         * tests/3d-raytrace.js:
765         * tests/bitops-3bit-bits-in-byte.js:
766         * tests/bitops-bits-in-byte.js:
767         * tests/bitops-bitwise-and.js:
768         * tests/math-cordic.js:
769         * tests/string-base64.js:
770         * tests/string-tagcloud.js:
771         * tests/string-unpack-code.js:
772
773 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
774
775         Reviewed by Oliver.
776         
777         - Fix the browser-hosted driver to be compatible with Safari 2
778
779         * hosted/sunspider-driver.html:
780
781 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
782
783         Rubber stamped by Hyatt.
784         
785         - Add BSD license notice to cordic test, the original author said to do so.
786
787         * tests/math-cordic.js:
788
789 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
790
791         Reviewed by Eric.
792         
793         - Support Windows and Windows browsers.
794
795         * hosted/sunspider-results.html: Display results correctly in IE.
796         * sunspider: tweaks to work on Windows, and with spaces in the path.
797
798 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
799
800         Rubber stamped by Oliver.
801
802         * tests/string-tagcloud.js: Remove stray print()
803
804 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
805
806         Reviewed by Oliver.
807         
808         Add some string test cases.
809
810         * tests/string-base64.js: Added. Does base64 encoding and decoding.
811         * tests/string-tagcloud.js: Added. Parses a JSON string and
812         generates tagcloud HTML markup based on the data.        
813         * tests/string-unpack-code.js: Added. Unpack compressed versions of
814         four of the most popular JavaScript libraries.
815         * tests/LIST: Added the new tests.
816
817 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
818
819         Reviewed by Anders.
820
821         * TODO: Updated with info on how to do the stats properly.
822
823         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
824         avoid overly slowing down the benchmark.
825
826         Added some 3D-related test cases.
827         
828         * tests/3d-cube.js: Added.
829         * tests/3d-morph.js: Added.
830         * tests/3d-raytrace.js: Added.
831         * tests/LIST:
832
833 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
834
835         Reviewed by Darin Adler.
836
837         - New JavaScript benchmark
838         http://bugs.webkit.org/show_bug.cgi?id=15515
839         
840         A start on a new JavaScript benchmark, with standalone and
841         browser-hosted drivers.
842         
843         The test content is still incomplete and the drivers could use
844         some more features but there is enough here to make a good start.
845         
846         The drivers compute a 95% confidence interval on the mean for the
847         whole test, each category, and each individual test to make it
848         easier to tell whether differences are statistically
849         significant. The confidence interval can be narrowed by running
850         the test more times.
851         
852         * TODO: Added. Remaining things that need to be done.
853         * sunspider: Added. Perl script that acts as the standalone test driver.
854         * resources/sunspider-standalone-driver.js: Added. JavaScript part
855         of standalone test driver.
856         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
857         analysis code.
858         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
859         * make-hosted: Added. Script to generate browser-hosted tests.
860         * hosted/sunspider.html: Added. Start page for browser-hosted test.
861         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
862         * hosted/sunspider-results.html: Added. Results page for browser-hosted
863         tests.
864         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
865         tests.
866         * tests/LIST: Added. List of tests to use.
867         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
868         * tests/bitops-bits-in-byte.js: Added. Ditto.
869         * tests/bitops-bitwise-and.js: Added. Ditto.
870         * tests/math-cordic.js: Added. Ditto.
871