be7c393b7453962a82cb43722def6074bbcd4962
[WebKit.git] / SunSpider / ChangeLog
1 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
2
3         Fixing commit error...
4         
5         I accidentally committed my last patch in a form that broke Web-hosted SunSpider. Fixing.
6
7         * resources/driver-TEMPLATE.html:
8
9 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
10
11         Reviewed by Sam Weinig.
12
13         Use JSON.parse instead of eval for Web-hosted SunSpider results processing
14         https://bugs.webkit.org/show_bug.cgi?id=32490
15
16         * hosted/json2.js: Added. Incorporated from json.org
17         * resources/driver-TEMPLATE.html: Fix an HTML validation bug I noticed.
18         * resources/results-TEMPLATE.html: Use JSON.parse instead of eval to process
19         results.
20
21 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
22
23         Reviewed by Oliver Hunt.
24
25         Enable Web-hosted version of SunSpider to handle multiple versions
26         https://bugs.webkit.org/show_bug.cgi?id=32478
27
28         * make-hosted: Now generate the hosted version to be able to run both the
29         0.9 and the 0.9.1 test suites.
30         * hosted: Modified property svn:ignore.
31         * hosted/sunspider-driver.html: Removed.
32         * hosted/sunspider-results.html: Removed.
33         * hosted/sunspider.html:
34         * hosted/versions.html: Added.
35         * resources/TEMPLATE.html:
36         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-driver.html.
37         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-results.html.
38
39 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
40
41         Reviewed by Oliver Hunt.
42
43         Give command-line sunspider the ability to handle multiple suites and versions
44         https://bugs.webkit.org/show_bug.cgi?id=32477
45         
46         Each suite/version's set of tests are now in a separate subdirectory of tests/, with a file named LIST
47         enumerating the tests. Current suites are:
48         
49         sunspider-0.9 - riginal SunSpider content 
50         sunspider-0.9.1 - SunSpider suite with a few tests fixed (and a few more to come)
51         ubench - "ubench" microbenchmark suite
52         v8-v4 - version 4 of the v8 benchmark
53         parse-only - some parser tests
54         
55         Sunspider can now be run with the --suite= parameter to select a
56         suite. The default is --suite=sunspider-0.9.
57
58         * .: Modified property svn:ignore to ignore new results directories.
59         * make-hosted: Generate based on sunspider-0.9 suite.
60         * resources/TEMPLATE.html: Fix an HTML compliance problem.
61         * resources/sunspider-standalone-driver.js: Become aware of suite names.
62         * sunspider: Modified to handle multiple suites as described above.
63         * sunspider-compare-results: ditto
64         * tests/LIST: Moved to tests/sunspider-0.9/ and tests/sunspider-0.9.1/
65         * tests/LIST-PARSE-ONLY: Moved to parse-only/LIST
66         * tests/LIST-UBENCH: Removed.
67         * tests/LIST-V8: Removed.
68         * tests/3d-cube.js: Moved to tests/sunspider-0.9 and tests/sunspider-0.9.1
69         * tests/3d-morph.js: ditto
70         * tests/3d-raytrace.js: ditto
71         * tests/access-binary-trees.js: ditto
72         * tests/access-fannkuch.js: ditto
73         * tests/access-nbody.js: ditto
74         * tests/access-nsieve.js: ditto
75         * tests/bitops-3bit-bits-in-byte.js: ditto
76         * tests/bitops-bits-in-byte.js: ditto
77         * tests/bitops-bitwise-and.js: ditto
78         * tests/bitops-nsieve-bits.js: ditto
79         * tests/controlflow-recursive.js: ditto
80         * tests/crypto-aes.js: ditto
81         * tests/crypto-md5.js: ditto
82         * tests/crypto-sha1.js: ditto
83         * tests/date-format-tofte.js: ditto
84         * tests/date-format-xparb.js: ditto
85         * tests/math-cordic.js: ditto
86         * tests/math-partial-sums.js: ditto
87         * tests/math-spectral-norm.js: ditto
88         * tests/regexp-dna.js: ditto
89         * tests/string-base64.js: ditto
90         * tests/string-fasta.js: ditto
91         * tests/string-tagcloud.js: ditto
92         * tests/string-unpack-code.js: ditto
93         * tests/string-validate-input.js: ditto
94         * tests/sunspider-0.9/: Added
95         * tests/sunspider-0.9/*.js: Moved from one level up
96         * tests/sunspider-0.9.1: Added.
97         * tests/sunspider-0.9.1/*.js: Moved from one level up.
98         * tests/v8-crypto.js: Moved to v8-v4/ directory.
99         * tests/v8-deltablue.js: ditto
100         * tests/v8-earley-boyer.js: ditto
101         * tests/v8-raytrace.js: ditto
102         * tests/v8-regexp.js: ditto
103         * tests/v8-richards.js: ditto
104         * tests/v8-splay.js: ditto
105         * tests/v8-v4: Added.
106
107 2009-09-30  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
108
109         Reviewed by Darin Adler.
110
111         Platform specific null device replaced with a platform independent.
112         https://bugs.webkit.org/show_bug.cgi?id=29544
113
114         * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL.
115
116 2009-09-21  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
117
118         Reviewed by Maciej Stachowiak.
119
120         [Qt] Make sunspider script work on Windows platform.
121         https://bugs.webkit.org/show_bug.cgi?id=29544
122
123         * sunspider:
124         Using platform specific null device instead of /dev/null.
125
126 2009-06-19  Adam Treat  <adam.treat@torchmobile.com>
127
128         Reviewed by Oliver Hunt.
129
130         https://bugs.webkit.org/show_bug.cgi?id=26540
131         Currently the SunSpider test driver lacks an option to run a test suite that
132         will test JavaScriptCore parsing performance only.  This patch adds just such
133         a test suite and option to SunSpider as well as the jsc test shell.  I've included
134         three large javascript source files found in the wild: jquery, mootools and prototype.
135         Combined with the concatenation of all three, these form a new testsuite to measure
136         and test pure JavaScriptCore parsing performance.
137
138         * resources/sunspider-standalone-driver.js:
139           Load the js with parse-only flag if it is part of the parse-only suite.
140         * sunspider:
141           Add the parse-only suite to the list of options.
142         * sunspider-compare-results:
143           Add the parse-only suite to the list of options.
144         * tests/LIST-PARSE-ONLY: Added.
145         * tests/parse-only/concat-jquery-mootools-prototype.js: Added.
146           A very large concatenation of the scripts found below.  This js takes ~30ms to parse on my machine.
147         * tests/parse-only/jquery-1.3.2.js: Added.
148           Latest version from jquery.com.
149         * tests/parse-only/mootools-1.2.2-core-nc.js: Added.
150           Latest version from mootools.net.
151         * tests/parse-only/prototype-1.6.0.3.js: Added.
152           Latest version from prototypejs.org.
153
154 2009-06-13  Steve Falkenburg  <sfalken@apple.com>
155
156         Update V8 benchmark to version 4.
157         
158         Reviewed by Cameron Zwarich.
159
160         * tests/LIST-V8:
161         * tests/v8-crypto.js:
162         * tests/v8-deltablue.js:
163         * tests/v8-earley-boyer.js:
164         * tests/v8-raytrace.js:
165         * tests/v8-regexp.js: Added.
166         * tests/v8-richards.js:
167         * tests/v8-splay.js: Added.
168
169 2009-05-26  Olivier DOLE  <odole@pleyo.com>
170
171         Reviewed by Maciej.
172
173         Store sunspider test suite results in a specific directory for each
174         different type of benchmark (sunspider, V8 or ubench).
175
176         * sunspider:
177         * sunspider-compare-results:
178
179 2009-05-12  Steve Falkenburg  <sfalken@apple.com>
180
181         Build fix.
182
183         * SunSpider.make:
184
185 2009-05-11  Steve Falkenburg  <sfalken@apple.com>
186
187         Include SunSpider tests in production builds.
188         
189         Reviewed by Adam Roben.
190
191         * SunSpider.make: Added.
192         * xcopy.excludes: Added.
193
194 2009-03-04  Oliver Hunt  <oliver@apple.com>
195
196         Added a few more tests to ubench
197
198         RS=Gavin Barraclough
199
200         Adding a couple of test to cover too few and too many arguments.  This
201         is needed to prevent regressions in all call paths from my current refactoring.
202
203         * tests/LIST-UBENCH:
204         * tests/ubench/function-correct-args.js: Added.
205         (f):
206         * tests/ubench/function-excess-args.js: Added.
207         (f):
208
209 2008-10-30  Zoltan Horvath  <Horvath.Zoltan.6@stud.u-szeged.hu>
210
211         Fix a bug where when V8's or UBENCH's test suite list file is missing
212         the error message is suggesting that SunSpider's list file is missing.
213
214         Reviewed by Sam Weinig.
215
216         * sunspider:
217         (loadTestsList): Fix the error message to use the right list name.
218
219 2008-10-07  David Hyatt  <hyatt@apple.com>
220
221         https://bugs.webkit.org/show_bug.cgi?id=18989
222
223         Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
224         we want all browsers to be doing the same thing on the test.
225
226         Reviewed by Maciej
227
228         * tests/regexp-dna.js:
229
230 2008-09-09  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
231
232         Rubber-stamped by Maciej Stachowiak.
233
234         The bleeding edge branch of V8 now supports passing fileanmes after
235         '-f', so the SunSpider script should be changed to do this again.
236         This allows all 3 major JavaScript engines to be used with the
237         unmodified SunSpider script.
238
239         * sunspider:
240
241 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
242
243         Reviewed by Maciej Stachowiak.
244
245         Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
246         and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
247         correct the punctuation in its documentation.
248
249         * sunspider:
250
251 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
252
253         Reviewed by Oliver Hunt.
254
255         Bug 20616: Incorporate V8 benchmarks in testing
256         <https://bugs.webkit.org/show_bug.cgi?id=20616>
257
258         This is a first attempt at running the V8 benchmarks within SunSpider,
259         with the --v8 option. The number of iterations is fixed for each
260         benchmark, and was chosen to make each of the benchmarks run between
261         500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
262
263         * sunspider:
264         * tests/LIST-V8: Added.
265         * tests/v8-crypto.js: Added.
266         * tests/v8-deltablue.js: Added.
267         * tests/v8-earley-boyer.js: Added.
268         * tests/v8-raytrace.js: Added.
269         * tests/v8-richards.js: Added.
270
271 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
272
273         Not reviewed.
274
275         Remove a local change that was accidentally committed in r36034.
276
277         * resources/sunspider-standalone-driver.js:
278
279 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
280
281         Rubber-stamped by Oliver Hunt.
282
283         Make SunSpider work with JavaScript shells that don't take filenames
284         after a '-f' argument.
285
286         * sunspider:
287
288 2008-06-07  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
289
290         Reviewed by Timothy.
291
292         Remove the --squirrelfish option from SunSpider, as it is no longer needed.
293
294         * sunspider:
295         * tests/LIST-SQUIRRELFISH: Removed.
296
297 2008-06-03  Alexey Proskuryakov  <ap@webkit.org>
298
299         Rubber-stamped by Mark Rowe.
300
301         Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
302
303         * sunspider:
304
305 2008-04-15  Maciej Stachowiak  <mjs@apple.com>
306
307         Rubber stamped by Oliver.
308         
309         - add newly working tests to squirrelfish list
310
311         * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
312
313 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
314
315         Rubber stamped by Oliver.
316         
317         - move ubench tests properly.
318
319         * tests/ubench: Added.
320         * tests/ubench/function-closure.js: Added.
321         * tests/ubench/function-empty.js: Added.
322         * tests/ubench/function-missing-args.js: Added.
323         * tests/ubench/function-sum.js: Added.
324         * tests/ubench/loop-empty-resolve.js: Added.
325         * tests/ubench/loop-empty.js: Added.
326         * tests/ubench/loop-sum.js: Added.
327
328 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
329
330         Rubber stamped by Oliver.
331
332         * sunspider: Don't force --runs=1 in squirrelfish mode any more.
333
334 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
335
336         Reviewed by Oliver.
337
338         - make --squirrelfish mode use the real harness, but a reduced set of tests
339
340         Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
341
342         * sunspider:
343         * tests/LIST-SQUIRRELFISH:
344         * tests/LIST-UBENCH: Added.
345         * tests/squirrelfish: Moved to tests/ubench
346
347 2008-04-14  Geoffrey Garen  <ggaren@apple.com>
348
349         Reviewed by Maciej Stachowiak.
350         
351         Removed an unused test.
352
353         * tests/squirrelfish/loop-resolve.js: Removed.
354
355 2008-04-10  Maciej Stachowiak  <mjs@apple.com>
356
357         Reviewed by Oliver.
358         
359         Add newly runnable tests to --squirrelfish mode.
360
361         * tests/LIST-SQUIRRELFISH:
362
363 2008-04-06  Geoffrey Garen  <ggaren@apple.com>
364
365         Reviewed by Maciej Stachowiak.
366         
367         A little more love for --squirrelfish mode:
368         
369         Fixed a misplaced sort. Results properly sort now.
370         
371         Added a test list just for squirrelfish, and updated it to include
372         all currently passing SunSpider tests.
373         
374         Fixed the pruning regexp to match 3d-morph.js.
375
376         * sunspider:
377
378 2008-03-26  Geoffrey Garen  <ggaren@apple.com>
379
380         Reviewed by Oliver Hunt.
381         
382         --squirrelfish mode: pared down tests for squirrelfish to chew on.
383
384         * sunspider:
385         * tests/LIST:
386         * tests/squirrelfish: Added.
387         * tests/squirrelfish/function-closure.js: Added.
388         * tests/squirrelfish/function-empty.js: Added.
389         * tests/squirrelfish/function-missing-args.js: Added.
390         * tests/squirrelfish/function-sum.js: Added.
391         * tests/squirrelfish/loop-empty-resolve.js: Added.
392         * tests/squirrelfish/loop-empty.js: Added.
393         * tests/squirrelfish/loop-resolve.js: Added.
394         * tests/squirrelfish/loop-sum.js: Added.
395
396 2008-03-21  Alexey Proskuryakov  <ap@webkit.org>
397
398         Reviewed by Geoff.
399
400         * sunspider: Pause update daemon on Darwin to make results reliable
401         again (workaround for <rdar://problem/5811127>).
402
403 2008-02-07  Eric Seidel  <eric@webkit.org>
404
405         Reviewed by Sam.
406
407         * sunspider: add an error message when ./tests/LIST is not found
408
409 2007-12-29  Alp Toker  <alp@atoker.com>
410
411         Fix typo.
412
413         * hosted/sunspider.html:
414
415 2007-12-29  Alp Toker  <alp@atoker.com>
416
417         Reviewed by Maciej.
418
419         Provide the current URL in the SunSpider results page. Useful for
420         copying benchmark results out of browsers without a location bar or
421         where the location bar can't handle long URLs.
422
423         * hosted/sunspider-results.html:
424
425 2007-12-20  Eric Seidel  <eric@webkit.org>
426
427         Reviewed by mjs.
428
429         * sunspider: increase default number of runs for more accurate numbers
430
431 2007-12-18  Mark Rowe  <mrowe@apple.com>
432
433         Fix typo.
434
435         * hosted/sunspider.html:
436
437 2007-12-18  Maciej Stachowiak  <mjs@apple.com>
438
439         Reviewed by Eric.
440         
441         - give an extra digit of precision for small differences.
442
443         * resources/sunspider-compare-results.js:
444
445 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
446
447         Reviewed by Eric.
448         
449         - work around IE layout bugs
450
451         * hosted/sunspider.css:
452
453 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
454
455         Reviewed by Mark.
456         
457         - fix compare feature
458
459         * hosted/sunspider-results.html:
460
461 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
462
463         Reviewed by Mark.
464         
465         - Change the format of the output URL to be shorter, to meet IE constraints
466
467         * hosted/sunspider-driver.html:
468         * hosted/sunspider-results.html:
469
470 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
471
472         Reviewed by Oliver.
473         
474         - Add some explanatory test and a dumb logo to SunSpider web hosted version
475
476         * hosted/sunspider-driver.html:
477         * hosted/sunspider-results.html:
478         * hosted/sunspider.css:
479         * hosted/sunspider.html:
480
481 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
482
483         Reviewed by Oliver.
484         
485         - Make the web-hosted version of SunSpider look a little bit less drab.
486
487         * hosted/sunspider-driver.html:
488         * hosted/sunspider-results.html:
489         * hosted/sunspider.css: Added.
490         * hosted/sunspider.html:
491         * resources/TEMPLATE.html:
492
493 2007-12-12  Maciej Stachowiak  <mjs@apple.com>
494
495         Reviewed by Sam.
496         
497         - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
498         
499         A sample of what new-style results would look like:
500         
501         TEST                   COMPARISON            FROM                 TO             DETAILS
502         ...
503         ** TOTAL **:           1.41x as fast     6613.6ms +/- 0.1%   4703.0ms +/- 0.1%     significant
504         ...
505             3bit-bits-in-byte: *1.36x as slow*     88.8ms +/- 0.6%    121.1ms +/- 0.6%     significant
506         
507         * resources/sunspider-compare-results.js:
508
509 2007-11-14  Eric Seidel  <eric@webkit.org>
510
511         Reviewed by Sam.
512
513         * sunspider: add --shark-cache for L2 Cache Miss profiling
514
515 2007-11-09  Alexey Proskuryakov  <ap@webkit.org>
516
517         Reviewed by Darin Adler.
518
519         http://bugs.webkit.org/show_bug.cgi?id=15925
520         SunSpider should check for Shark being installed
521
522         * sunspider: Explicitly test that shark command line tool is installed.
523
524 2007-11-04  Darin Adler  <darin@apple.com>
525
526         * hosted/sunspider.html: Tweaked formatting a bit.
527
528 2007-11-03  Maciej Stachowiak  <mjs@apple.com>
529
530         Reviewed by Darin Adler.
531
532         - Add compare mode and a description of the benchmark to the hosted version.
533
534         * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
535         * hosted/sunspider.html: Added intro text.
536         * make-hosted: Copy new file.
537         * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
538         a function.
539         * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
540         expects.
541         * sunspider-compare-results: Use sunspider-standalone-compare.js.
542
543 2007-11-02  Darin Adler  <darin@apple.com>
544
545         * sunspider: Changed "--base" to "--set-baseline".
546
547 2007-11-02  Darin Adler  <darin@apple.com>
548
549         Reviewed by Maciej.
550
551         * sunspider: Added a "--base" option that records the current test as a baseline.
552         Moved the code to find the newest .mshark file into a function (since I needed to use
553         it in the other script and I prefer to copy/paste a function).
554
555         * sunspider-compare-results: Added logic to compare the baseline with the last
556         run when you don't pass any parameters.
557
558 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
559
560         Reviewed by Eric.
561         
562         - Added list of ECMAScript3 features that SunSpider does not cover currently.
563
564         * UNCOVERED: Added.
565
566 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
567
568         Reviewed by Oliver.
569         
570         - Give better error messages when sunspider-compare-results fails
571
572         * sunspider-compare-results:
573
574 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
575
576         Reviewed by Darin Adler.
577         
578         - fix Date tests to work in command-line SpiderMonkey
579
580         * tests/date-format-tofte.js:
581         * tests/date-format-xparb.js:
582
583 2007-10-29  Darin Adler  <darin@apple.com>
584
585         Reviewed by Maciej.
586
587         * sunspider: Added --shark20 option, to run Shark at its highest sample
588         resolution instead of its default.
589
590 2007-10-28  Adam Roben  <aroben@apple.com>
591
592         Fix SunSpider on Windows
593
594         Reviewed by Eric.
595
596         * sunspider: Don't use colons in filenames.
597
598 2007-10-28  Darin Adler  <darin@apple.com>
599
600         Reviewed by Adam.
601
602         * resources/sunspider-analyze-results.js: Tweak the output format a little.
603         Change so that when there's only one run we don't write out confidence
604         intervals at all rather than writing "NaN" over and over again.
605
606         * sunspider: Use the time and date as a suffix on the results file, that way
607         all the results are left behind in the tmp directory. This will make it easy
608         for us to add features that compare past results in the future. Also rename
609         the .mshark files using the same scheme.
610
611         * sunspider-compare-results: Relax the parsing rules so we can parse the
612         results file exactly as it's emitted from sunspider.
613
614 2007-10-25  Adam Roben  <aroben@apple.com>
615
616         Strip carriage returns from results
617
618         Carriage returns were screwing up sunspider-compare-results on
619         Windows.
620
621         Rubberstamped by Oliver.
622
623         * sunspider:
624
625 2007-10-24  Darin Adler  <darin@apple.com>
626
627         Reviewed by Eric.
628
629         * sunspider: Open the profile in shark after completing a run.
630         * sunspider-compare-results: Tiny perl tweaks.
631
632 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
633
634         Reviewed by Darin Adler.
635
636         - Don't hardcode my path to testkjs
637         
638         * sunspider-compare-results:
639
640 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
641
642         Reviewed by Darin Adler.
643         
644         - Add a compare script to compare results, and improve formatting of standard results a bit.
645
646         * resources/sunspider-analyze-results.js:
647         * resources/sunspider-compare-results.js: Added.
648         * sunspider-compare-results: Added.
649
650 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
651
652         Reviewed by Darin Adler.
653
654         * resources/sunspider-analyze-results.js: Do the error range
655         properly, using the t-distribution instead of 1.96 (which was
656         based on the normal distribution).
657         
658         * sunspider: Print results in a way that will be friendlier to the
659         soon-to-come compare mode.
660
661 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
662
663         Reviewed by Review.
664         
665         - add more tests (probably the final set for now)
666         
667         Already balanced. Added date, regexp, control flow, and a few
668         more string and object/array access tests.
669         
670         * tests/LIST:
671         * tests/access-fannkuch.js: Added.
672         * tests/access-nbody.js: Added.
673         * tests/controlflow-recursive.js: Added.
674         * tests/date-format-tofte.js: Added.
675         * tests/date-format-xparb.js: Added.
676         * tests/regexp-dna.js: Added.
677         * tests/string-validate-input.js: Added.
678
679 2007-10-21  Eric Seidel  <eric@webkit.org>
680
681         Reviewed by mjs.
682
683         * sunspider: make --shark only sample from testkjs
684
685 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
686
687         Rubber stamped by Eric.
688         
689         - added crypto tests (already balanced)
690
691         * tests/LIST:
692         * tests/crypto-aes.js: Added.
693         * tests/crypto-md5.js: Added.
694         * tests/crypto-sha1.js: Added.
695
696 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
697
698         Reviewed by Adam.
699         
700         - rebalance new tests
701         
702         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
703         
704         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
705
706         This balances them with the existing tests.
707
708         * tests/access-binary-trees.js:
709         * tests/access-nsieve.js:
710         * tests/bitops-nsieve-bits.js:
711         * tests/math-partial-sums.js:
712         * tests/math-spectral-norm.js:
713         * tests/string-fasta.js:
714
715 2007-10-20  Eric Seidel  <eric@webkit.org>
716
717         Reviewed by darin.
718         
719         Add improved argument handling to sunspider, including
720         --runs=<number>, --tests=<pattern, --shark, and --help
721         Also re-factor code into subroutines
722
723         * sunspider: improved argument handling
724
725 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
726
727         Reviewed by Mark.
728
729         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
730         
731         * TODO:
732         * tests/LIST:
733         * tests/access-binary-trees.js: Added.
734         * tests/access-nsieve.js: Added.
735         * tests/bitops-nsieve-bits.js: Added.
736         * tests/math-partial-sums.js: Added.
737         * tests/math-spectral-norm.js: Added.
738         * tests/string-fasta.js: Added.
739
740 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
741
742         Reviewed by Darin Adler.
743
744         * TODO: Updated to note areas that are now well-covered.
745         
746         - Change the tests and the driver to avoid leaving large object
747         graphs hanging around, since that throws off the subsequent tests.
748         
749         * resources/sunspider-standalone-driver.js:
750         * tests/3d-cube.js:
751         * tests/3d-morph.js:
752         * tests/3d-raytrace.js:
753         * tests/bitops-bitwise-and.js:
754         * tests/string-base64.js:
755         * tests/string-tagcloud.js:
756
757 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
758
759         Reviewed by Nikolas.
760         
761         - Rebalance test complexity.
762         
763         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
764         
765         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
766
767         However, for some tests, IE7 was a huge outlier compared to other
768         major browsers. For those tests, I used Firefox 2.0.0.8 on the
769         same OS and hardware as a normalization basis.
770         
771         * tests/3d-morph.js:
772         * tests/3d-raytrace.js:
773         * tests/bitops-3bit-bits-in-byte.js:
774         * tests/bitops-bits-in-byte.js:
775         * tests/bitops-bitwise-and.js:
776         * tests/math-cordic.js:
777         * tests/string-base64.js:
778         * tests/string-tagcloud.js:
779         * tests/string-unpack-code.js:
780
781 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
782
783         Reviewed by Oliver.
784         
785         - Fix the browser-hosted driver to be compatible with Safari 2
786
787         * hosted/sunspider-driver.html:
788
789 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
790
791         Rubber stamped by Hyatt.
792         
793         - Add BSD license notice to cordic test, the original author said to do so.
794
795         * tests/math-cordic.js:
796
797 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
798
799         Reviewed by Eric.
800         
801         - Support Windows and Windows browsers.
802
803         * hosted/sunspider-results.html: Display results correctly in IE.
804         * sunspider: tweaks to work on Windows, and with spaces in the path.
805
806 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
807
808         Rubber stamped by Oliver.
809
810         * tests/string-tagcloud.js: Remove stray print()
811
812 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
813
814         Reviewed by Oliver.
815         
816         Add some string test cases.
817
818         * tests/string-base64.js: Added. Does base64 encoding and decoding.
819         * tests/string-tagcloud.js: Added. Parses a JSON string and
820         generates tagcloud HTML markup based on the data.        
821         * tests/string-unpack-code.js: Added. Unpack compressed versions of
822         four of the most popular JavaScript libraries.
823         * tests/LIST: Added the new tests.
824
825 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
826
827         Reviewed by Anders.
828
829         * TODO: Updated with info on how to do the stats properly.
830
831         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
832         avoid overly slowing down the benchmark.
833
834         Added some 3D-related test cases.
835         
836         * tests/3d-cube.js: Added.
837         * tests/3d-morph.js: Added.
838         * tests/3d-raytrace.js: Added.
839         * tests/LIST:
840
841 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
842
843         Reviewed by Darin Adler.
844
845         - New JavaScript benchmark
846         http://bugs.webkit.org/show_bug.cgi?id=15515
847         
848         A start on a new JavaScript benchmark, with standalone and
849         browser-hosted drivers.
850         
851         The test content is still incomplete and the drivers could use
852         some more features but there is enough here to make a good start.
853         
854         The drivers compute a 95% confidence interval on the mean for the
855         whole test, each category, and each individual test to make it
856         easier to tell whether differences are statistically
857         significant. The confidence interval can be narrowed by running
858         the test more times.
859         
860         * TODO: Added. Remaining things that need to be done.
861         * sunspider: Added. Perl script that acts as the standalone test driver.
862         * resources/sunspider-standalone-driver.js: Added. JavaScript part
863         of standalone test driver.
864         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
865         analysis code.
866         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
867         * make-hosted: Added. Script to generate browser-hosted tests.
868         * hosted/sunspider.html: Added. Start page for browser-hosted test.
869         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
870         * hosted/sunspider-results.html: Added. Results page for browser-hosted
871         tests.
872         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
873         tests.
874         * tests/LIST: Added. List of tests to use.
875         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
876         * tests/bitops-bits-in-byte.js: Added. Ditto.
877         * tests/bitops-bitwise-and.js: Added. Ditto.
878         * tests/math-cordic.js: Added. Ditto.
879