2009-10-12 Dirk Schulze <krit@webkit.org>
[WebKit-https.git] / SunSpider / ChangeLog
1 2009-09-30  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
2
3         Reviewed by Darin Adler.
4
5         Platform specific null device replaced with a platform independent.
6         https://bugs.webkit.org/show_bug.cgi?id=29544
7
8         * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL.
9
10 2009-09-21  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
11
12         Reviewed by Maciej Stachowiak.
13
14         [Qt] Make sunspider script work on Windows platform.
15         https://bugs.webkit.org/show_bug.cgi?id=29544
16
17         * sunspider:
18         Using platform specific null device instead of /dev/null.
19
20 2009-06-19  Adam Treat  <adam.treat@torchmobile.com>
21
22         Reviewed by Oliver Hunt.
23
24         https://bugs.webkit.org/show_bug.cgi?id=26540
25         Currently the SunSpider test driver lacks an option to run a test suite that
26         will test JavaScriptCore parsing performance only.  This patch adds just such
27         a test suite and option to SunSpider as well as the jsc test shell.  I've included
28         three large javascript source files found in the wild: jquery, mootools and prototype.
29         Combined with the concatenation of all three, these form a new testsuite to measure
30         and test pure JavaScriptCore parsing performance.
31
32         * resources/sunspider-standalone-driver.js:
33           Load the js with parse-only flag if it is part of the parse-only suite.
34         * sunspider:
35           Add the parse-only suite to the list of options.
36         * sunspider-compare-results:
37           Add the parse-only suite to the list of options.
38         * tests/LIST-PARSE-ONLY: Added.
39         * tests/parse-only/concat-jquery-mootools-prototype.js: Added.
40           A very large concatenation of the scripts found below.  This js takes ~30ms to parse on my machine.
41         * tests/parse-only/jquery-1.3.2.js: Added.
42           Latest version from jquery.com.
43         * tests/parse-only/mootools-1.2.2-core-nc.js: Added.
44           Latest version from mootools.net.
45         * tests/parse-only/prototype-1.6.0.3.js: Added.
46           Latest version from prototypejs.org.
47
48 2009-06-13  Steve Falkenburg  <sfalken@apple.com>
49
50         Update V8 benchmark to version 4.
51         
52         Reviewed by Cameron Zwarich.
53
54         * tests/LIST-V8:
55         * tests/v8-crypto.js:
56         * tests/v8-deltablue.js:
57         * tests/v8-earley-boyer.js:
58         * tests/v8-raytrace.js:
59         * tests/v8-regexp.js: Added.
60         * tests/v8-richards.js:
61         * tests/v8-splay.js: Added.
62
63 2009-05-26  Olivier DOLE  <odole@pleyo.com>
64
65         Reviewed by Maciej.
66
67         Store sunspider test suite results in a specific directory for each
68         different type of benchmark (sunspider, V8 or ubench).
69
70         * sunspider:
71         * sunspider-compare-results:
72
73 2009-05-12  Steve Falkenburg  <sfalken@apple.com>
74
75         Build fix.
76
77         * SunSpider.make:
78
79 2009-05-11  Steve Falkenburg  <sfalken@apple.com>
80
81         Include SunSpider tests in production builds.
82         
83         Reviewed by Adam Roben.
84
85         * SunSpider.make: Added.
86         * xcopy.excludes: Added.
87
88 2009-03-04  Oliver Hunt  <oliver@apple.com>
89
90         Added a few more tests to ubench
91
92         RS=Gavin Barraclough
93
94         Adding a couple of test to cover too few and too many arguments.  This
95         is needed to prevent regressions in all call paths from my current refactoring.
96
97         * tests/LIST-UBENCH:
98         * tests/ubench/function-correct-args.js: Added.
99         (f):
100         * tests/ubench/function-excess-args.js: Added.
101         (f):
102
103 2008-10-30  Zoltan Horvath  <Horvath.Zoltan.6@stud.u-szeged.hu>
104
105         Fix a bug where when V8's or UBENCH's test suite list file is missing
106         the error message is suggesting that SunSpider's list file is missing.
107
108         Reviewed by Sam Weinig.
109
110         * sunspider:
111         (loadTestsList): Fix the error message to use the right list name.
112
113 2008-10-07  David Hyatt  <hyatt@apple.com>
114
115         https://bugs.webkit.org/show_bug.cgi?id=18989
116
117         Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
118         we want all browsers to be doing the same thing on the test.
119
120         Reviewed by Maciej
121
122         * tests/regexp-dna.js:
123
124 2008-09-09  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
125
126         Rubber-stamped by Maciej Stachowiak.
127
128         The bleeding edge branch of V8 now supports passing fileanmes after
129         '-f', so the SunSpider script should be changed to do this again.
130         This allows all 3 major JavaScript engines to be used with the
131         unmodified SunSpider script.
132
133         * sunspider:
134
135 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
136
137         Reviewed by Maciej Stachowiak.
138
139         Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
140         and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
141         correct the punctuation in its documentation.
142
143         * sunspider:
144
145 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
146
147         Reviewed by Oliver Hunt.
148
149         Bug 20616: Incorporate V8 benchmarks in testing
150         <https://bugs.webkit.org/show_bug.cgi?id=20616>
151
152         This is a first attempt at running the V8 benchmarks within SunSpider,
153         with the --v8 option. The number of iterations is fixed for each
154         benchmark, and was chosen to make each of the benchmarks run between
155         500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
156
157         * sunspider:
158         * tests/LIST-V8: Added.
159         * tests/v8-crypto.js: Added.
160         * tests/v8-deltablue.js: Added.
161         * tests/v8-earley-boyer.js: Added.
162         * tests/v8-raytrace.js: Added.
163         * tests/v8-richards.js: Added.
164
165 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
166
167         Not reviewed.
168
169         Remove a local change that was accidentally committed in r36034.
170
171         * resources/sunspider-standalone-driver.js:
172
173 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
174
175         Rubber-stamped by Oliver Hunt.
176
177         Make SunSpider work with JavaScript shells that don't take filenames
178         after a '-f' argument.
179
180         * sunspider:
181
182 2008-06-07  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
183
184         Reviewed by Timothy.
185
186         Remove the --squirrelfish option from SunSpider, as it is no longer needed.
187
188         * sunspider:
189         * tests/LIST-SQUIRRELFISH: Removed.
190
191 2008-06-03  Alexey Proskuryakov  <ap@webkit.org>
192
193         Rubber-stamped by Mark Rowe.
194
195         Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
196
197         * sunspider:
198
199 2008-04-15  Maciej Stachowiak  <mjs@apple.com>
200
201         Rubber stamped by Oliver.
202         
203         - add newly working tests to squirrelfish list
204
205         * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
206
207 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
208
209         Rubber stamped by Oliver.
210         
211         - move ubench tests properly.
212
213         * tests/ubench: Added.
214         * tests/ubench/function-closure.js: Added.
215         * tests/ubench/function-empty.js: Added.
216         * tests/ubench/function-missing-args.js: Added.
217         * tests/ubench/function-sum.js: Added.
218         * tests/ubench/loop-empty-resolve.js: Added.
219         * tests/ubench/loop-empty.js: Added.
220         * tests/ubench/loop-sum.js: Added.
221
222 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
223
224         Rubber stamped by Oliver.
225
226         * sunspider: Don't force --runs=1 in squirrelfish mode any more.
227
228 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
229
230         Reviewed by Oliver.
231
232         - make --squirrelfish mode use the real harness, but a reduced set of tests
233
234         Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
235
236         * sunspider:
237         * tests/LIST-SQUIRRELFISH:
238         * tests/LIST-UBENCH: Added.
239         * tests/squirrelfish: Moved to tests/ubench
240
241 2008-04-14  Geoffrey Garen  <ggaren@apple.com>
242
243         Reviewed by Maciej Stachowiak.
244         
245         Removed an unused test.
246
247         * tests/squirrelfish/loop-resolve.js: Removed.
248
249 2008-04-10  Maciej Stachowiak  <mjs@apple.com>
250
251         Reviewed by Oliver.
252         
253         Add newly runnable tests to --squirrelfish mode.
254
255         * tests/LIST-SQUIRRELFISH:
256
257 2008-04-06  Geoffrey Garen  <ggaren@apple.com>
258
259         Reviewed by Maciej Stachowiak.
260         
261         A little more love for --squirrelfish mode:
262         
263         Fixed a misplaced sort. Results properly sort now.
264         
265         Added a test list just for squirrelfish, and updated it to include
266         all currently passing SunSpider tests.
267         
268         Fixed the pruning regexp to match 3d-morph.js.
269
270         * sunspider:
271
272 2008-03-26  Geoffrey Garen  <ggaren@apple.com>
273
274         Reviewed by Oliver Hunt.
275         
276         --squirrelfish mode: pared down tests for squirrelfish to chew on.
277
278         * sunspider:
279         * tests/LIST:
280         * tests/squirrelfish: Added.
281         * tests/squirrelfish/function-closure.js: Added.
282         * tests/squirrelfish/function-empty.js: Added.
283         * tests/squirrelfish/function-missing-args.js: Added.
284         * tests/squirrelfish/function-sum.js: Added.
285         * tests/squirrelfish/loop-empty-resolve.js: Added.
286         * tests/squirrelfish/loop-empty.js: Added.
287         * tests/squirrelfish/loop-resolve.js: Added.
288         * tests/squirrelfish/loop-sum.js: Added.
289
290 2008-03-21  Alexey Proskuryakov  <ap@webkit.org>
291
292         Reviewed by Geoff.
293
294         * sunspider: Pause update daemon on Darwin to make results reliable
295         again (workaround for <rdar://problem/5811127>).
296
297 2008-02-07  Eric Seidel  <eric@webkit.org>
298
299         Reviewed by Sam.
300
301         * sunspider: add an error message when ./tests/LIST is not found
302
303 2007-12-29  Alp Toker  <alp@atoker.com>
304
305         Fix typo.
306
307         * hosted/sunspider.html:
308
309 2007-12-29  Alp Toker  <alp@atoker.com>
310
311         Reviewed by Maciej.
312
313         Provide the current URL in the SunSpider results page. Useful for
314         copying benchmark results out of browsers without a location bar or
315         where the location bar can't handle long URLs.
316
317         * hosted/sunspider-results.html:
318
319 2007-12-20  Eric Seidel  <eric@webkit.org>
320
321         Reviewed by mjs.
322
323         * sunspider: increase default number of runs for more accurate numbers
324
325 2007-12-18  Mark Rowe  <mrowe@apple.com>
326
327         Fix typo.
328
329         * hosted/sunspider.html:
330
331 2007-12-18  Maciej Stachowiak  <mjs@apple.com>
332
333         Reviewed by Eric.
334         
335         - give an extra digit of precision for small differences.
336
337         * resources/sunspider-compare-results.js:
338
339 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
340
341         Reviewed by Eric.
342         
343         - work around IE layout bugs
344
345         * hosted/sunspider.css:
346
347 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
348
349         Reviewed by Mark.
350         
351         - fix compare feature
352
353         * hosted/sunspider-results.html:
354
355 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
356
357         Reviewed by Mark.
358         
359         - Change the format of the output URL to be shorter, to meet IE constraints
360
361         * hosted/sunspider-driver.html:
362         * hosted/sunspider-results.html:
363
364 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
365
366         Reviewed by Oliver.
367         
368         - Add some explanatory test and a dumb logo to SunSpider web hosted version
369
370         * hosted/sunspider-driver.html:
371         * hosted/sunspider-results.html:
372         * hosted/sunspider.css:
373         * hosted/sunspider.html:
374
375 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
376
377         Reviewed by Oliver.
378         
379         - Make the web-hosted version of SunSpider look a little bit less drab.
380
381         * hosted/sunspider-driver.html:
382         * hosted/sunspider-results.html:
383         * hosted/sunspider.css: Added.
384         * hosted/sunspider.html:
385         * resources/TEMPLATE.html:
386
387 2007-12-12  Maciej Stachowiak  <mjs@apple.com>
388
389         Reviewed by Sam.
390         
391         - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
392         
393         A sample of what new-style results would look like:
394         
395         TEST                   COMPARISON            FROM                 TO             DETAILS
396         ...
397         ** TOTAL **:           1.41x as fast     6613.6ms +/- 0.1%   4703.0ms +/- 0.1%     significant
398         ...
399             3bit-bits-in-byte: *1.36x as slow*     88.8ms +/- 0.6%    121.1ms +/- 0.6%     significant
400         
401         * resources/sunspider-compare-results.js:
402
403 2007-11-14  Eric Seidel  <eric@webkit.org>
404
405         Reviewed by Sam.
406
407         * sunspider: add --shark-cache for L2 Cache Miss profiling
408
409 2007-11-09  Alexey Proskuryakov  <ap@webkit.org>
410
411         Reviewed by Darin Adler.
412
413         http://bugs.webkit.org/show_bug.cgi?id=15925
414         SunSpider should check for Shark being installed
415
416         * sunspider: Explicitly test that shark command line tool is installed.
417
418 2007-11-04  Darin Adler  <darin@apple.com>
419
420         * hosted/sunspider.html: Tweaked formatting a bit.
421
422 2007-11-03  Maciej Stachowiak  <mjs@apple.com>
423
424         Reviewed by Darin Adler.
425
426         - Add compare mode and a description of the benchmark to the hosted version.
427
428         * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
429         * hosted/sunspider.html: Added intro text.
430         * make-hosted: Copy new file.
431         * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
432         a function.
433         * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
434         expects.
435         * sunspider-compare-results: Use sunspider-standalone-compare.js.
436
437 2007-11-02  Darin Adler  <darin@apple.com>
438
439         * sunspider: Changed "--base" to "--set-baseline".
440
441 2007-11-02  Darin Adler  <darin@apple.com>
442
443         Reviewed by Maciej.
444
445         * sunspider: Added a "--base" option that records the current test as a baseline.
446         Moved the code to find the newest .mshark file into a function (since I needed to use
447         it in the other script and I prefer to copy/paste a function).
448
449         * sunspider-compare-results: Added logic to compare the baseline with the last
450         run when you don't pass any parameters.
451
452 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
453
454         Reviewed by Eric.
455         
456         - Added list of ECMAScript3 features that SunSpider does not cover currently.
457
458         * UNCOVERED: Added.
459
460 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
461
462         Reviewed by Oliver.
463         
464         - Give better error messages when sunspider-compare-results fails
465
466         * sunspider-compare-results:
467
468 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
469
470         Reviewed by Darin Adler.
471         
472         - fix Date tests to work in command-line SpiderMonkey
473
474         * tests/date-format-tofte.js:
475         * tests/date-format-xparb.js:
476
477 2007-10-29  Darin Adler  <darin@apple.com>
478
479         Reviewed by Maciej.
480
481         * sunspider: Added --shark20 option, to run Shark at its highest sample
482         resolution instead of its default.
483
484 2007-10-28  Adam Roben  <aroben@apple.com>
485
486         Fix SunSpider on Windows
487
488         Reviewed by Eric.
489
490         * sunspider: Don't use colons in filenames.
491
492 2007-10-28  Darin Adler  <darin@apple.com>
493
494         Reviewed by Adam.
495
496         * resources/sunspider-analyze-results.js: Tweak the output format a little.
497         Change so that when there's only one run we don't write out confidence
498         intervals at all rather than writing "NaN" over and over again.
499
500         * sunspider: Use the time and date as a suffix on the results file, that way
501         all the results are left behind in the tmp directory. This will make it easy
502         for us to add features that compare past results in the future. Also rename
503         the .mshark files using the same scheme.
504
505         * sunspider-compare-results: Relax the parsing rules so we can parse the
506         results file exactly as it's emitted from sunspider.
507
508 2007-10-25  Adam Roben  <aroben@apple.com>
509
510         Strip carriage returns from results
511
512         Carriage returns were screwing up sunspider-compare-results on
513         Windows.
514
515         Rubberstamped by Oliver.
516
517         * sunspider:
518
519 2007-10-24  Darin Adler  <darin@apple.com>
520
521         Reviewed by Eric.
522
523         * sunspider: Open the profile in shark after completing a run.
524         * sunspider-compare-results: Tiny perl tweaks.
525
526 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
527
528         Reviewed by Darin Adler.
529
530         - Don't hardcode my path to testkjs
531         
532         * sunspider-compare-results:
533
534 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
535
536         Reviewed by Darin Adler.
537         
538         - Add a compare script to compare results, and improve formatting of standard results a bit.
539
540         * resources/sunspider-analyze-results.js:
541         * resources/sunspider-compare-results.js: Added.
542         * sunspider-compare-results: Added.
543
544 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
545
546         Reviewed by Darin Adler.
547
548         * resources/sunspider-analyze-results.js: Do the error range
549         properly, using the t-distribution instead of 1.96 (which was
550         based on the normal distribution).
551         
552         * sunspider: Print results in a way that will be friendlier to the
553         soon-to-come compare mode.
554
555 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
556
557         Reviewed by Review.
558         
559         - add more tests (probably the final set for now)
560         
561         Already balanced. Added date, regexp, control flow, and a few
562         more string and object/array access tests.
563         
564         * tests/LIST:
565         * tests/access-fannkuch.js: Added.
566         * tests/access-nbody.js: Added.
567         * tests/controlflow-recursive.js: Added.
568         * tests/date-format-tofte.js: Added.
569         * tests/date-format-xparb.js: Added.
570         * tests/regexp-dna.js: Added.
571         * tests/string-validate-input.js: Added.
572
573 2007-10-21  Eric Seidel  <eric@webkit.org>
574
575         Reviewed by mjs.
576
577         * sunspider: make --shark only sample from testkjs
578
579 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
580
581         Rubber stamped by Eric.
582         
583         - added crypto tests (already balanced)
584
585         * tests/LIST:
586         * tests/crypto-aes.js: Added.
587         * tests/crypto-md5.js: Added.
588         * tests/crypto-sha1.js: Added.
589
590 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
591
592         Reviewed by Adam.
593         
594         - rebalance new tests
595         
596         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
597         
598         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
599
600         This balances them with the existing tests.
601
602         * tests/access-binary-trees.js:
603         * tests/access-nsieve.js:
604         * tests/bitops-nsieve-bits.js:
605         * tests/math-partial-sums.js:
606         * tests/math-spectral-norm.js:
607         * tests/string-fasta.js:
608
609 2007-10-20  Eric Seidel  <eric@webkit.org>
610
611         Reviewed by darin.
612         
613         Add improved argument handling to sunspider, including
614         --runs=<number>, --tests=<pattern, --shark, and --help
615         Also re-factor code into subroutines
616
617         * sunspider: improved argument handling
618
619 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
620
621         Reviewed by Mark.
622
623         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
624         
625         * TODO:
626         * tests/LIST:
627         * tests/access-binary-trees.js: Added.
628         * tests/access-nsieve.js: Added.
629         * tests/bitops-nsieve-bits.js: Added.
630         * tests/math-partial-sums.js: Added.
631         * tests/math-spectral-norm.js: Added.
632         * tests/string-fasta.js: Added.
633
634 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
635
636         Reviewed by Darin Adler.
637
638         * TODO: Updated to note areas that are now well-covered.
639         
640         - Change the tests and the driver to avoid leaving large object
641         graphs hanging around, since that throws off the subsequent tests.
642         
643         * resources/sunspider-standalone-driver.js:
644         * tests/3d-cube.js:
645         * tests/3d-morph.js:
646         * tests/3d-raytrace.js:
647         * tests/bitops-bitwise-and.js:
648         * tests/string-base64.js:
649         * tests/string-tagcloud.js:
650
651 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
652
653         Reviewed by Nikolas.
654         
655         - Rebalance test complexity.
656         
657         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
658         
659         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
660
661         However, for some tests, IE7 was a huge outlier compared to other
662         major browsers. For those tests, I used Firefox 2.0.0.8 on the
663         same OS and hardware as a normalization basis.
664         
665         * tests/3d-morph.js:
666         * tests/3d-raytrace.js:
667         * tests/bitops-3bit-bits-in-byte.js:
668         * tests/bitops-bits-in-byte.js:
669         * tests/bitops-bitwise-and.js:
670         * tests/math-cordic.js:
671         * tests/string-base64.js:
672         * tests/string-tagcloud.js:
673         * tests/string-unpack-code.js:
674
675 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
676
677         Reviewed by Oliver.
678         
679         - Fix the browser-hosted driver to be compatible with Safari 2
680
681         * hosted/sunspider-driver.html:
682
683 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
684
685         Rubber stamped by Hyatt.
686         
687         - Add BSD license notice to cordic test, the original author said to do so.
688
689         * tests/math-cordic.js:
690
691 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
692
693         Reviewed by Eric.
694         
695         - Support Windows and Windows browsers.
696
697         * hosted/sunspider-results.html: Display results correctly in IE.
698         * sunspider: tweaks to work on Windows, and with spaces in the path.
699
700 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
701
702         Rubber stamped by Oliver.
703
704         * tests/string-tagcloud.js: Remove stray print()
705
706 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
707
708         Reviewed by Oliver.
709         
710         Add some string test cases.
711
712         * tests/string-base64.js: Added. Does base64 encoding and decoding.
713         * tests/string-tagcloud.js: Added. Parses a JSON string and
714         generates tagcloud HTML markup based on the data.        
715         * tests/string-unpack-code.js: Added. Unpack compressed versions of
716         four of the most popular JavaScript libraries.
717         * tests/LIST: Added the new tests.
718
719 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
720
721         Reviewed by Anders.
722
723         * TODO: Updated with info on how to do the stats properly.
724
725         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
726         avoid overly slowing down the benchmark.
727
728         Added some 3D-related test cases.
729         
730         * tests/3d-cube.js: Added.
731         * tests/3d-morph.js: Added.
732         * tests/3d-raytrace.js: Added.
733         * tests/LIST:
734
735 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
736
737         Reviewed by Darin Adler.
738
739         - New JavaScript benchmark
740         http://bugs.webkit.org/show_bug.cgi?id=15515
741         
742         A start on a new JavaScript benchmark, with standalone and
743         browser-hosted drivers.
744         
745         The test content is still incomplete and the drivers could use
746         some more features but there is enough here to make a good start.
747         
748         The drivers compute a 95% confidence interval on the mean for the
749         whole test, each category, and each individual test to make it
750         easier to tell whether differences are statistically
751         significant. The confidence interval can be narrowed by running
752         the test more times.
753         
754         * TODO: Added. Remaining things that need to be done.
755         * sunspider: Added. Perl script that acts as the standalone test driver.
756         * resources/sunspider-standalone-driver.js: Added. JavaScript part
757         of standalone test driver.
758         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
759         analysis code.
760         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
761         * make-hosted: Added. Script to generate browser-hosted tests.
762         * hosted/sunspider.html: Added. Start page for browser-hosted test.
763         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
764         * hosted/sunspider-results.html: Added. Results page for browser-hosted
765         tests.
766         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
767         tests.
768         * tests/LIST: Added. List of tests to use.
769         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
770         * tests/bitops-bits-in-byte.js: Added. Ditto.
771         * tests/bitops-bitwise-and.js: Added. Ditto.
772         * tests/math-cordic.js: Added. Ditto.
773