f96ef41326f6ff15e7e8edcbbc24dc21fdf8bace
[WebKit.git] / SunSpider / ChangeLog
1 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
2
3         Reviewed by Gavin Barraclough.
4
5         SunSpider/tests/string-base64.js does not compute a valid base64 encoded string
6         https://bugs.webkit.org/show_bug.cgi?id=16806
7
8         Based on a patch by Eric Seidel.
9         
10         Fix the base64 computation to actually compute correct results. The impact on runtime of
11         the test is pretty small, but noticeable for some browsers. But at least it's not
12         doing a wrong and meaningless computation any more.
13         
14         * tests/sunspider-0.9.1/string-base64.js:
15         ():
16         (base64ToString):
17
18 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
19
20         Fixing commit error...
21         
22         I accidentally committed my last patch in a form that broke Web-hosted SunSpider. Fixing.
23
24         * resources/driver-TEMPLATE.html:
25
26 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
27
28         Reviewed by Sam Weinig.
29
30         Use JSON.parse instead of eval for Web-hosted SunSpider results processing
31         https://bugs.webkit.org/show_bug.cgi?id=32490
32
33         * hosted/json2.js: Added. Incorporated from json.org
34         * resources/driver-TEMPLATE.html: Fix an HTML validation bug I noticed.
35         * resources/results-TEMPLATE.html: Use JSON.parse instead of eval to process
36         results.
37
38 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
39
40         Reviewed by Oliver Hunt.
41
42         Enable Web-hosted version of SunSpider to handle multiple versions
43         https://bugs.webkit.org/show_bug.cgi?id=32478
44
45         * make-hosted: Now generate the hosted version to be able to run both the
46         0.9 and the 0.9.1 test suites.
47         * hosted: Modified property svn:ignore.
48         * hosted/sunspider-driver.html: Removed.
49         * hosted/sunspider-results.html: Removed.
50         * hosted/sunspider.html:
51         * hosted/versions.html: Added.
52         * resources/TEMPLATE.html:
53         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-driver.html.
54         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-results.html.
55
56 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
57
58         Reviewed by Oliver Hunt.
59
60         Give command-line sunspider the ability to handle multiple suites and versions
61         https://bugs.webkit.org/show_bug.cgi?id=32477
62         
63         Each suite/version's set of tests are now in a separate subdirectory of tests/, with a file named LIST
64         enumerating the tests. Current suites are:
65         
66         sunspider-0.9 - riginal SunSpider content 
67         sunspider-0.9.1 - SunSpider suite with a few tests fixed (and a few more to come)
68         ubench - "ubench" microbenchmark suite
69         v8-v4 - version 4 of the v8 benchmark
70         parse-only - some parser tests
71         
72         Sunspider can now be run with the --suite= parameter to select a
73         suite. The default is --suite=sunspider-0.9.
74
75         * .: Modified property svn:ignore to ignore new results directories.
76         * make-hosted: Generate based on sunspider-0.9 suite.
77         * resources/TEMPLATE.html: Fix an HTML compliance problem.
78         * resources/sunspider-standalone-driver.js: Become aware of suite names.
79         * sunspider: Modified to handle multiple suites as described above.
80         * sunspider-compare-results: ditto
81         * tests/LIST: Moved to tests/sunspider-0.9/ and tests/sunspider-0.9.1/
82         * tests/LIST-PARSE-ONLY: Moved to parse-only/LIST
83         * tests/LIST-UBENCH: Removed.
84         * tests/LIST-V8: Removed.
85         * tests/3d-cube.js: Moved to tests/sunspider-0.9 and tests/sunspider-0.9.1
86         * tests/3d-morph.js: ditto
87         * tests/3d-raytrace.js: ditto
88         * tests/access-binary-trees.js: ditto
89         * tests/access-fannkuch.js: ditto
90         * tests/access-nbody.js: ditto
91         * tests/access-nsieve.js: ditto
92         * tests/bitops-3bit-bits-in-byte.js: ditto
93         * tests/bitops-bits-in-byte.js: ditto
94         * tests/bitops-bitwise-and.js: ditto
95         * tests/bitops-nsieve-bits.js: ditto
96         * tests/controlflow-recursive.js: ditto
97         * tests/crypto-aes.js: ditto
98         * tests/crypto-md5.js: ditto
99         * tests/crypto-sha1.js: ditto
100         * tests/date-format-tofte.js: ditto
101         * tests/date-format-xparb.js: ditto
102         * tests/math-cordic.js: ditto
103         * tests/math-partial-sums.js: ditto
104         * tests/math-spectral-norm.js: ditto
105         * tests/regexp-dna.js: ditto
106         * tests/string-base64.js: ditto
107         * tests/string-fasta.js: ditto
108         * tests/string-tagcloud.js: ditto
109         * tests/string-unpack-code.js: ditto
110         * tests/string-validate-input.js: ditto
111         * tests/sunspider-0.9/: Added
112         * tests/sunspider-0.9/*.js: Moved from one level up
113         * tests/sunspider-0.9.1: Added.
114         * tests/sunspider-0.9.1/*.js: Moved from one level up.
115         * tests/v8-crypto.js: Moved to v8-v4/ directory.
116         * tests/v8-deltablue.js: ditto
117         * tests/v8-earley-boyer.js: ditto
118         * tests/v8-raytrace.js: ditto
119         * tests/v8-regexp.js: ditto
120         * tests/v8-richards.js: ditto
121         * tests/v8-splay.js: ditto
122         * tests/v8-v4: Added.
123
124 2009-09-30  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
125
126         Reviewed by Darin Adler.
127
128         Platform specific null device replaced with a platform independent.
129         https://bugs.webkit.org/show_bug.cgi?id=29544
130
131         * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL.
132
133 2009-09-21  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
134
135         Reviewed by Maciej Stachowiak.
136
137         [Qt] Make sunspider script work on Windows platform.
138         https://bugs.webkit.org/show_bug.cgi?id=29544
139
140         * sunspider:
141         Using platform specific null device instead of /dev/null.
142
143 2009-06-19  Adam Treat  <adam.treat@torchmobile.com>
144
145         Reviewed by Oliver Hunt.
146
147         https://bugs.webkit.org/show_bug.cgi?id=26540
148         Currently the SunSpider test driver lacks an option to run a test suite that
149         will test JavaScriptCore parsing performance only.  This patch adds just such
150         a test suite and option to SunSpider as well as the jsc test shell.  I've included
151         three large javascript source files found in the wild: jquery, mootools and prototype.
152         Combined with the concatenation of all three, these form a new testsuite to measure
153         and test pure JavaScriptCore parsing performance.
154
155         * resources/sunspider-standalone-driver.js:
156           Load the js with parse-only flag if it is part of the parse-only suite.
157         * sunspider:
158           Add the parse-only suite to the list of options.
159         * sunspider-compare-results:
160           Add the parse-only suite to the list of options.
161         * tests/LIST-PARSE-ONLY: Added.
162         * tests/parse-only/concat-jquery-mootools-prototype.js: Added.
163           A very large concatenation of the scripts found below.  This js takes ~30ms to parse on my machine.
164         * tests/parse-only/jquery-1.3.2.js: Added.
165           Latest version from jquery.com.
166         * tests/parse-only/mootools-1.2.2-core-nc.js: Added.
167           Latest version from mootools.net.
168         * tests/parse-only/prototype-1.6.0.3.js: Added.
169           Latest version from prototypejs.org.
170
171 2009-06-13  Steve Falkenburg  <sfalken@apple.com>
172
173         Update V8 benchmark to version 4.
174         
175         Reviewed by Cameron Zwarich.
176
177         * tests/LIST-V8:
178         * tests/v8-crypto.js:
179         * tests/v8-deltablue.js:
180         * tests/v8-earley-boyer.js:
181         * tests/v8-raytrace.js:
182         * tests/v8-regexp.js: Added.
183         * tests/v8-richards.js:
184         * tests/v8-splay.js: Added.
185
186 2009-05-26  Olivier DOLE  <odole@pleyo.com>
187
188         Reviewed by Maciej.
189
190         Store sunspider test suite results in a specific directory for each
191         different type of benchmark (sunspider, V8 or ubench).
192
193         * sunspider:
194         * sunspider-compare-results:
195
196 2009-05-12  Steve Falkenburg  <sfalken@apple.com>
197
198         Build fix.
199
200         * SunSpider.make:
201
202 2009-05-11  Steve Falkenburg  <sfalken@apple.com>
203
204         Include SunSpider tests in production builds.
205         
206         Reviewed by Adam Roben.
207
208         * SunSpider.make: Added.
209         * xcopy.excludes: Added.
210
211 2009-03-04  Oliver Hunt  <oliver@apple.com>
212
213         Added a few more tests to ubench
214
215         RS=Gavin Barraclough
216
217         Adding a couple of test to cover too few and too many arguments.  This
218         is needed to prevent regressions in all call paths from my current refactoring.
219
220         * tests/LIST-UBENCH:
221         * tests/ubench/function-correct-args.js: Added.
222         (f):
223         * tests/ubench/function-excess-args.js: Added.
224         (f):
225
226 2008-10-30  Zoltan Horvath  <Horvath.Zoltan.6@stud.u-szeged.hu>
227
228         Fix a bug where when V8's or UBENCH's test suite list file is missing
229         the error message is suggesting that SunSpider's list file is missing.
230
231         Reviewed by Sam Weinig.
232
233         * sunspider:
234         (loadTestsList): Fix the error message to use the right list name.
235
236 2008-10-07  David Hyatt  <hyatt@apple.com>
237
238         https://bugs.webkit.org/show_bug.cgi?id=18989
239
240         Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
241         we want all browsers to be doing the same thing on the test.
242
243         Reviewed by Maciej
244
245         * tests/regexp-dna.js:
246
247 2008-09-09  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
248
249         Rubber-stamped by Maciej Stachowiak.
250
251         The bleeding edge branch of V8 now supports passing fileanmes after
252         '-f', so the SunSpider script should be changed to do this again.
253         This allows all 3 major JavaScript engines to be used with the
254         unmodified SunSpider script.
255
256         * sunspider:
257
258 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
259
260         Reviewed by Maciej Stachowiak.
261
262         Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
263         and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
264         correct the punctuation in its documentation.
265
266         * sunspider:
267
268 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
269
270         Reviewed by Oliver Hunt.
271
272         Bug 20616: Incorporate V8 benchmarks in testing
273         <https://bugs.webkit.org/show_bug.cgi?id=20616>
274
275         This is a first attempt at running the V8 benchmarks within SunSpider,
276         with the --v8 option. The number of iterations is fixed for each
277         benchmark, and was chosen to make each of the benchmarks run between
278         500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
279
280         * sunspider:
281         * tests/LIST-V8: Added.
282         * tests/v8-crypto.js: Added.
283         * tests/v8-deltablue.js: Added.
284         * tests/v8-earley-boyer.js: Added.
285         * tests/v8-raytrace.js: Added.
286         * tests/v8-richards.js: Added.
287
288 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
289
290         Not reviewed.
291
292         Remove a local change that was accidentally committed in r36034.
293
294         * resources/sunspider-standalone-driver.js:
295
296 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
297
298         Rubber-stamped by Oliver Hunt.
299
300         Make SunSpider work with JavaScript shells that don't take filenames
301         after a '-f' argument.
302
303         * sunspider:
304
305 2008-06-07  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
306
307         Reviewed by Timothy.
308
309         Remove the --squirrelfish option from SunSpider, as it is no longer needed.
310
311         * sunspider:
312         * tests/LIST-SQUIRRELFISH: Removed.
313
314 2008-06-03  Alexey Proskuryakov  <ap@webkit.org>
315
316         Rubber-stamped by Mark Rowe.
317
318         Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
319
320         * sunspider:
321
322 2008-04-15  Maciej Stachowiak  <mjs@apple.com>
323
324         Rubber stamped by Oliver.
325         
326         - add newly working tests to squirrelfish list
327
328         * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
329
330 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
331
332         Rubber stamped by Oliver.
333         
334         - move ubench tests properly.
335
336         * tests/ubench: Added.
337         * tests/ubench/function-closure.js: Added.
338         * tests/ubench/function-empty.js: Added.
339         * tests/ubench/function-missing-args.js: Added.
340         * tests/ubench/function-sum.js: Added.
341         * tests/ubench/loop-empty-resolve.js: Added.
342         * tests/ubench/loop-empty.js: Added.
343         * tests/ubench/loop-sum.js: Added.
344
345 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
346
347         Rubber stamped by Oliver.
348
349         * sunspider: Don't force --runs=1 in squirrelfish mode any more.
350
351 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
352
353         Reviewed by Oliver.
354
355         - make --squirrelfish mode use the real harness, but a reduced set of tests
356
357         Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
358
359         * sunspider:
360         * tests/LIST-SQUIRRELFISH:
361         * tests/LIST-UBENCH: Added.
362         * tests/squirrelfish: Moved to tests/ubench
363
364 2008-04-14  Geoffrey Garen  <ggaren@apple.com>
365
366         Reviewed by Maciej Stachowiak.
367         
368         Removed an unused test.
369
370         * tests/squirrelfish/loop-resolve.js: Removed.
371
372 2008-04-10  Maciej Stachowiak  <mjs@apple.com>
373
374         Reviewed by Oliver.
375         
376         Add newly runnable tests to --squirrelfish mode.
377
378         * tests/LIST-SQUIRRELFISH:
379
380 2008-04-06  Geoffrey Garen  <ggaren@apple.com>
381
382         Reviewed by Maciej Stachowiak.
383         
384         A little more love for --squirrelfish mode:
385         
386         Fixed a misplaced sort. Results properly sort now.
387         
388         Added a test list just for squirrelfish, and updated it to include
389         all currently passing SunSpider tests.
390         
391         Fixed the pruning regexp to match 3d-morph.js.
392
393         * sunspider:
394
395 2008-03-26  Geoffrey Garen  <ggaren@apple.com>
396
397         Reviewed by Oliver Hunt.
398         
399         --squirrelfish mode: pared down tests for squirrelfish to chew on.
400
401         * sunspider:
402         * tests/LIST:
403         * tests/squirrelfish: Added.
404         * tests/squirrelfish/function-closure.js: Added.
405         * tests/squirrelfish/function-empty.js: Added.
406         * tests/squirrelfish/function-missing-args.js: Added.
407         * tests/squirrelfish/function-sum.js: Added.
408         * tests/squirrelfish/loop-empty-resolve.js: Added.
409         * tests/squirrelfish/loop-empty.js: Added.
410         * tests/squirrelfish/loop-resolve.js: Added.
411         * tests/squirrelfish/loop-sum.js: Added.
412
413 2008-03-21  Alexey Proskuryakov  <ap@webkit.org>
414
415         Reviewed by Geoff.
416
417         * sunspider: Pause update daemon on Darwin to make results reliable
418         again (workaround for <rdar://problem/5811127>).
419
420 2008-02-07  Eric Seidel  <eric@webkit.org>
421
422         Reviewed by Sam.
423
424         * sunspider: add an error message when ./tests/LIST is not found
425
426 2007-12-29  Alp Toker  <alp@atoker.com>
427
428         Fix typo.
429
430         * hosted/sunspider.html:
431
432 2007-12-29  Alp Toker  <alp@atoker.com>
433
434         Reviewed by Maciej.
435
436         Provide the current URL in the SunSpider results page. Useful for
437         copying benchmark results out of browsers without a location bar or
438         where the location bar can't handle long URLs.
439
440         * hosted/sunspider-results.html:
441
442 2007-12-20  Eric Seidel  <eric@webkit.org>
443
444         Reviewed by mjs.
445
446         * sunspider: increase default number of runs for more accurate numbers
447
448 2007-12-18  Mark Rowe  <mrowe@apple.com>
449
450         Fix typo.
451
452         * hosted/sunspider.html:
453
454 2007-12-18  Maciej Stachowiak  <mjs@apple.com>
455
456         Reviewed by Eric.
457         
458         - give an extra digit of precision for small differences.
459
460         * resources/sunspider-compare-results.js:
461
462 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
463
464         Reviewed by Eric.
465         
466         - work around IE layout bugs
467
468         * hosted/sunspider.css:
469
470 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
471
472         Reviewed by Mark.
473         
474         - fix compare feature
475
476         * hosted/sunspider-results.html:
477
478 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
479
480         Reviewed by Mark.
481         
482         - Change the format of the output URL to be shorter, to meet IE constraints
483
484         * hosted/sunspider-driver.html:
485         * hosted/sunspider-results.html:
486
487 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
488
489         Reviewed by Oliver.
490         
491         - Add some explanatory test and a dumb logo to SunSpider web hosted version
492
493         * hosted/sunspider-driver.html:
494         * hosted/sunspider-results.html:
495         * hosted/sunspider.css:
496         * hosted/sunspider.html:
497
498 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
499
500         Reviewed by Oliver.
501         
502         - Make the web-hosted version of SunSpider look a little bit less drab.
503
504         * hosted/sunspider-driver.html:
505         * hosted/sunspider-results.html:
506         * hosted/sunspider.css: Added.
507         * hosted/sunspider.html:
508         * resources/TEMPLATE.html:
509
510 2007-12-12  Maciej Stachowiak  <mjs@apple.com>
511
512         Reviewed by Sam.
513         
514         - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
515         
516         A sample of what new-style results would look like:
517         
518         TEST                   COMPARISON            FROM                 TO             DETAILS
519         ...
520         ** TOTAL **:           1.41x as fast     6613.6ms +/- 0.1%   4703.0ms +/- 0.1%     significant
521         ...
522             3bit-bits-in-byte: *1.36x as slow*     88.8ms +/- 0.6%    121.1ms +/- 0.6%     significant
523         
524         * resources/sunspider-compare-results.js:
525
526 2007-11-14  Eric Seidel  <eric@webkit.org>
527
528         Reviewed by Sam.
529
530         * sunspider: add --shark-cache for L2 Cache Miss profiling
531
532 2007-11-09  Alexey Proskuryakov  <ap@webkit.org>
533
534         Reviewed by Darin Adler.
535
536         http://bugs.webkit.org/show_bug.cgi?id=15925
537         SunSpider should check for Shark being installed
538
539         * sunspider: Explicitly test that shark command line tool is installed.
540
541 2007-11-04  Darin Adler  <darin@apple.com>
542
543         * hosted/sunspider.html: Tweaked formatting a bit.
544
545 2007-11-03  Maciej Stachowiak  <mjs@apple.com>
546
547         Reviewed by Darin Adler.
548
549         - Add compare mode and a description of the benchmark to the hosted version.
550
551         * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
552         * hosted/sunspider.html: Added intro text.
553         * make-hosted: Copy new file.
554         * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
555         a function.
556         * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
557         expects.
558         * sunspider-compare-results: Use sunspider-standalone-compare.js.
559
560 2007-11-02  Darin Adler  <darin@apple.com>
561
562         * sunspider: Changed "--base" to "--set-baseline".
563
564 2007-11-02  Darin Adler  <darin@apple.com>
565
566         Reviewed by Maciej.
567
568         * sunspider: Added a "--base" option that records the current test as a baseline.
569         Moved the code to find the newest .mshark file into a function (since I needed to use
570         it in the other script and I prefer to copy/paste a function).
571
572         * sunspider-compare-results: Added logic to compare the baseline with the last
573         run when you don't pass any parameters.
574
575 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
576
577         Reviewed by Eric.
578         
579         - Added list of ECMAScript3 features that SunSpider does not cover currently.
580
581         * UNCOVERED: Added.
582
583 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
584
585         Reviewed by Oliver.
586         
587         - Give better error messages when sunspider-compare-results fails
588
589         * sunspider-compare-results:
590
591 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
592
593         Reviewed by Darin Adler.
594         
595         - fix Date tests to work in command-line SpiderMonkey
596
597         * tests/date-format-tofte.js:
598         * tests/date-format-xparb.js:
599
600 2007-10-29  Darin Adler  <darin@apple.com>
601
602         Reviewed by Maciej.
603
604         * sunspider: Added --shark20 option, to run Shark at its highest sample
605         resolution instead of its default.
606
607 2007-10-28  Adam Roben  <aroben@apple.com>
608
609         Fix SunSpider on Windows
610
611         Reviewed by Eric.
612
613         * sunspider: Don't use colons in filenames.
614
615 2007-10-28  Darin Adler  <darin@apple.com>
616
617         Reviewed by Adam.
618
619         * resources/sunspider-analyze-results.js: Tweak the output format a little.
620         Change so that when there's only one run we don't write out confidence
621         intervals at all rather than writing "NaN" over and over again.
622
623         * sunspider: Use the time and date as a suffix on the results file, that way
624         all the results are left behind in the tmp directory. This will make it easy
625         for us to add features that compare past results in the future. Also rename
626         the .mshark files using the same scheme.
627
628         * sunspider-compare-results: Relax the parsing rules so we can parse the
629         results file exactly as it's emitted from sunspider.
630
631 2007-10-25  Adam Roben  <aroben@apple.com>
632
633         Strip carriage returns from results
634
635         Carriage returns were screwing up sunspider-compare-results on
636         Windows.
637
638         Rubberstamped by Oliver.
639
640         * sunspider:
641
642 2007-10-24  Darin Adler  <darin@apple.com>
643
644         Reviewed by Eric.
645
646         * sunspider: Open the profile in shark after completing a run.
647         * sunspider-compare-results: Tiny perl tweaks.
648
649 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
650
651         Reviewed by Darin Adler.
652
653         - Don't hardcode my path to testkjs
654         
655         * sunspider-compare-results:
656
657 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
658
659         Reviewed by Darin Adler.
660         
661         - Add a compare script to compare results, and improve formatting of standard results a bit.
662
663         * resources/sunspider-analyze-results.js:
664         * resources/sunspider-compare-results.js: Added.
665         * sunspider-compare-results: Added.
666
667 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
668
669         Reviewed by Darin Adler.
670
671         * resources/sunspider-analyze-results.js: Do the error range
672         properly, using the t-distribution instead of 1.96 (which was
673         based on the normal distribution).
674         
675         * sunspider: Print results in a way that will be friendlier to the
676         soon-to-come compare mode.
677
678 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
679
680         Reviewed by Review.
681         
682         - add more tests (probably the final set for now)
683         
684         Already balanced. Added date, regexp, control flow, and a few
685         more string and object/array access tests.
686         
687         * tests/LIST:
688         * tests/access-fannkuch.js: Added.
689         * tests/access-nbody.js: Added.
690         * tests/controlflow-recursive.js: Added.
691         * tests/date-format-tofte.js: Added.
692         * tests/date-format-xparb.js: Added.
693         * tests/regexp-dna.js: Added.
694         * tests/string-validate-input.js: Added.
695
696 2007-10-21  Eric Seidel  <eric@webkit.org>
697
698         Reviewed by mjs.
699
700         * sunspider: make --shark only sample from testkjs
701
702 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
703
704         Rubber stamped by Eric.
705         
706         - added crypto tests (already balanced)
707
708         * tests/LIST:
709         * tests/crypto-aes.js: Added.
710         * tests/crypto-md5.js: Added.
711         * tests/crypto-sha1.js: Added.
712
713 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
714
715         Reviewed by Adam.
716         
717         - rebalance new tests
718         
719         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
720         
721         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
722
723         This balances them with the existing tests.
724
725         * tests/access-binary-trees.js:
726         * tests/access-nsieve.js:
727         * tests/bitops-nsieve-bits.js:
728         * tests/math-partial-sums.js:
729         * tests/math-spectral-norm.js:
730         * tests/string-fasta.js:
731
732 2007-10-20  Eric Seidel  <eric@webkit.org>
733
734         Reviewed by darin.
735         
736         Add improved argument handling to sunspider, including
737         --runs=<number>, --tests=<pattern, --shark, and --help
738         Also re-factor code into subroutines
739
740         * sunspider: improved argument handling
741
742 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
743
744         Reviewed by Mark.
745
746         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
747         
748         * TODO:
749         * tests/LIST:
750         * tests/access-binary-trees.js: Added.
751         * tests/access-nsieve.js: Added.
752         * tests/bitops-nsieve-bits.js: Added.
753         * tests/math-partial-sums.js: Added.
754         * tests/math-spectral-norm.js: Added.
755         * tests/string-fasta.js: Added.
756
757 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
758
759         Reviewed by Darin Adler.
760
761         * TODO: Updated to note areas that are now well-covered.
762         
763         - Change the tests and the driver to avoid leaving large object
764         graphs hanging around, since that throws off the subsequent tests.
765         
766         * resources/sunspider-standalone-driver.js:
767         * tests/3d-cube.js:
768         * tests/3d-morph.js:
769         * tests/3d-raytrace.js:
770         * tests/bitops-bitwise-and.js:
771         * tests/string-base64.js:
772         * tests/string-tagcloud.js:
773
774 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
775
776         Reviewed by Nikolas.
777         
778         - Rebalance test complexity.
779         
780         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
781         
782         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
783
784         However, for some tests, IE7 was a huge outlier compared to other
785         major browsers. For those tests, I used Firefox 2.0.0.8 on the
786         same OS and hardware as a normalization basis.
787         
788         * tests/3d-morph.js:
789         * tests/3d-raytrace.js:
790         * tests/bitops-3bit-bits-in-byte.js:
791         * tests/bitops-bits-in-byte.js:
792         * tests/bitops-bitwise-and.js:
793         * tests/math-cordic.js:
794         * tests/string-base64.js:
795         * tests/string-tagcloud.js:
796         * tests/string-unpack-code.js:
797
798 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
799
800         Reviewed by Oliver.
801         
802         - Fix the browser-hosted driver to be compatible with Safari 2
803
804         * hosted/sunspider-driver.html:
805
806 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
807
808         Rubber stamped by Hyatt.
809         
810         - Add BSD license notice to cordic test, the original author said to do so.
811
812         * tests/math-cordic.js:
813
814 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
815
816         Reviewed by Eric.
817         
818         - Support Windows and Windows browsers.
819
820         * hosted/sunspider-results.html: Display results correctly in IE.
821         * sunspider: tweaks to work on Windows, and with spaces in the path.
822
823 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
824
825         Rubber stamped by Oliver.
826
827         * tests/string-tagcloud.js: Remove stray print()
828
829 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
830
831         Reviewed by Oliver.
832         
833         Add some string test cases.
834
835         * tests/string-base64.js: Added. Does base64 encoding and decoding.
836         * tests/string-tagcloud.js: Added. Parses a JSON string and
837         generates tagcloud HTML markup based on the data.        
838         * tests/string-unpack-code.js: Added. Unpack compressed versions of
839         four of the most popular JavaScript libraries.
840         * tests/LIST: Added the new tests.
841
842 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
843
844         Reviewed by Anders.
845
846         * TODO: Updated with info on how to do the stats properly.
847
848         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
849         avoid overly slowing down the benchmark.
850
851         Added some 3D-related test cases.
852         
853         * tests/3d-cube.js: Added.
854         * tests/3d-morph.js: Added.
855         * tests/3d-raytrace.js: Added.
856         * tests/LIST:
857
858 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
859
860         Reviewed by Darin Adler.
861
862         - New JavaScript benchmark
863         http://bugs.webkit.org/show_bug.cgi?id=15515
864         
865         A start on a new JavaScript benchmark, with standalone and
866         browser-hosted drivers.
867         
868         The test content is still incomplete and the drivers could use
869         some more features but there is enough here to make a good start.
870         
871         The drivers compute a 95% confidence interval on the mean for the
872         whole test, each category, and each individual test to make it
873         easier to tell whether differences are statistically
874         significant. The confidence interval can be narrowed by running
875         the test more times.
876         
877         * TODO: Added. Remaining things that need to be done.
878         * sunspider: Added. Perl script that acts as the standalone test driver.
879         * resources/sunspider-standalone-driver.js: Added. JavaScript part
880         of standalone test driver.
881         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
882         analysis code.
883         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
884         * make-hosted: Added. Script to generate browser-hosted tests.
885         * hosted/sunspider.html: Added. Start page for browser-hosted test.
886         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
887         * hosted/sunspider-results.html: Added. Results page for browser-hosted
888         tests.
889         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
890         tests.
891         * tests/LIST: Added. List of tests to use.
892         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
893         * tests/bitops-bits-in-byte.js: Added. Ditto.
894         * tests/bitops-bitwise-and.js: Added. Ditto.
895         * tests/math-cordic.js: Added. Ditto.
896