Update LLVM binary drops and scripts to the latest version from SVN
[WebKit-https.git] / PerformanceTests / SunSpider / ChangeLog
1 2013-08-08  Cosmin Truta  <ctruta@blackberry.com>
2
3         SunSpider: Move the 3d-morph fix from version 1.0 to version 1.0.1
4         https://bugs.webkit.org/show_bug.cgi?id=117993
5
6         Reviewed by George Staikos.
7
8         Bump the SunSpider version to 1.0.1.
9
10         Unroll r149548 in order to restore version 1.0 to its original,
11         and add the 3d-morph fix to version 1.0.1 instead.
12
13         * hosted/sunspider.html: Updated to version 1.0.1.
14         * hosted/versions.html: Updated to version 1.0.1.
15         * make-hosted: Added support for version 1.0.1.
16         * resources/driver-TEMPLATE.html: Updated to version 1.0.1.
17         * resources/results-TEMPLATE.html: Updated to version 1.0.1.
18         * sunspider: Updated to version 1.0.1.
19         * sunspider-compare-results: Updated to version 1.0.1.
20         * tests/sunspider-1.0/3d-morph.js: Rolled back to the original version.
21         * tests/sunspider-1.0.1/LIST: Added.
22         * tests/sunspider-1.0.1/3d-cube.js: Added.
23         * tests/sunspider-1.0.1/3d-morph.js: Added.
24         * tests/sunspider-1.0.1/3d-raytrace.js: Added.
25         * tests/sunspider-1.0.1/access-binary-trees.js: Added.
26         * tests/sunspider-1.0.1/access-fannkuch.js: Added.
27         * tests/sunspider-1.0.1/access-nbody.js: Added.
28         * tests/sunspider-1.0.1/access-nsieve.js: Added.
29         * tests/sunspider-1.0.1/bitops-3bit-bits-in-byte.js: Added.
30         * tests/sunspider-1.0.1/bitops-bits-in-byte.js: Added.
31         * tests/sunspider-1.0.1/bitops-bitwise-and.js: Added.
32         * tests/sunspider-1.0.1/bitops-nsieve-bits.js: Added.
33         * tests/sunspider-1.0.1/controlflow-recursive.js: Added.
34         * tests/sunspider-1.0.1/crypto-aes.js: Added.
35         * tests/sunspider-1.0.1/crypto-md5.js: Added.
36         * tests/sunspider-1.0.1/crypto-sha1.js: Added.
37         * tests/sunspider-1.0.1/date-format-tofte.js: Added.
38         * tests/sunspider-1.0.1/date-format-xparb.js: Added.
39         * tests/sunspider-1.0.1/math-cordic.js: Added.
40         * tests/sunspider-1.0.1/math-partial-sums.js: Added.
41         * tests/sunspider-1.0.1/math-spectral-norm.js: Added.
42         * tests/sunspider-1.0.1/regexp-dna.js: Added.
43         * tests/sunspider-1.0.1/string-base64.js: Added.
44         * tests/sunspider-1.0.1/string-fasta.js: Added.
45         * tests/sunspider-1.0.1/string-tagcloud.js: Added.
46         * tests/sunspider-1.0.1/string-unpack-code.js: Added.
47         * tests/sunspider-1.0.1/string-validate-input.js: Added.
48
49 2013-05-03  Cosmin Truta  <ctruta@blackberry.com>
50
51         SunSpider 1.0: 3d-morph: use epsilon to check result
52         https://bugs.webkit.org/show_bug.cgi?id=115553
53
54         Reviewed by George Staikos.
55
56         SunSpider/3d-morph should be more lenient in validating its results, since they depend on Math.sin, which isn't formally specified.
57
58         * tests/sunspider-1.0/3d-morph.js:
59
60 2013-04-19  Filip Pizlo  <fpizlo@apple.com>
61
62         SunSpider/string-tagcloud should be more lenient in validating its results, since they depend on Math.log, which isn't formally specified
63         https://bugs.webkit.org/show_bug.cgi?id=114895
64
65         Reviewed by Michael Saboff.
66
67         * tests/sunspider-1.0/string-tagcloud.js:
68
69 2013-04-18  Filip Pizlo  <fpizlo@apple.com>
70
71         Whenever it is cheap and non-invasive, SunSpider tests should validate their results to ensure that the browser runs them correctly
72         https://bugs.webkit.org/show_bug.cgi?id=114852
73
74         Reviewed by Geoffrey Garen.
75         
76         This adds low-overhead checking of the results of each SunSpider tests. This is not
77         meant to be an exhaustive test that everything was executed correctly, but rather a
78         simple sanity check that will catch glaring mistakes. The philosophy here is that we're
79         not trying to prevent all forms of cheating, or that we're trying to prove the
80         browser's correctness. Moreover, these checks are meant to incur minimal overhead;
81         they currently clock in at <2% slow-down in SunSpider 1.0.
82         
83         The test expectations were generated using the LLInt on command-line, and I've verified
84         that Firefox 20, Chrome 26, IE 10, Safari 6, and ToT with all of the JITs agree. Note
85         that some tests cannot be precisely validated because they use Math functions, which
86         ECMAScript chooses to not formally specify - those functions like sin() and friends are
87         allowed to return implementation-dependent results. Also some tests cannot be validated
88         at all because their behavior is either intentionally random or is timezone-dependent.
89         But 23 out of 26 tests now have some kind of validation.
90         
91         I've updated the harnesses to show erroneous runs when displaying results.
92
93         * resources/TEMPLATE.html:
94         * resources/driver-TEMPLATE.html:
95         * resources/sunspider-analyze-results.js:
96         (formatResult):
97         (resultLine):
98         (printOutput):
99         * resources/sunspider-compare-results.js:
100         (.formatMean):
101         (.resultLine):
102         (.printOutput):
103         (sunspiderCompareResults):
104         * resources/sunspider-standalone-driver.js:
105         * tests/sunspider-1.0/3d-cube.js:
106         (Init):
107         * tests/sunspider-1.0/3d-morph.js:
108         * tests/sunspider-1.0/3d-raytrace.js:
109         * tests/sunspider-1.0/access-binary-trees.js:
110         * tests/sunspider-1.0/access-fannkuch.js:
111         * tests/sunspider-1.0/access-nbody.js:
112         * tests/sunspider-1.0/access-nsieve.js:
113         (sieve):
114         * tests/sunspider-1.0/bitops-3bit-bits-in-byte.js:
115         * tests/sunspider-1.0/bitops-bits-in-byte.js:
116         * tests/sunspider-1.0/bitops-bitwise-and.js:
117         * tests/sunspider-1.0/bitops-nsieve-bits.js:
118         * tests/sunspider-1.0/controlflow-recursive.js:
119         * tests/sunspider-1.0/crypto-aes.js:
120         * tests/sunspider-1.0/crypto-md5.js:
121         * tests/sunspider-1.0/crypto-sha1.js:
122         * tests/sunspider-1.0/date-format-tofte.js:
123         * tests/sunspider-1.0/date-format-xparb.js:
124         * tests/sunspider-1.0/math-cordic.js:
125         * tests/sunspider-1.0/math-partial-sums.js:
126         (partial):
127         * tests/sunspider-1.0/math-spectral-norm.js:
128         * tests/sunspider-1.0/regexp-dna.js:
129         * tests/sunspider-1.0/string-base64.js:
130         * tests/sunspider-1.0/string-fasta.js:
131         (fastaRepeat):
132         (fastaRandom):
133         * tests/sunspider-1.0/string-tagcloud.js:
134         * tests/sunspider-1.0/string-unpack-code.js:
135         * tests/sunspider-1.0/string-validate-input.js:
136
137 2013-04-11  Filip Pizlo  <fpizlo@apple.com>
138
139         Get rid of the 10ms delay between test executions
140         https://bugs.webkit.org/show_bug.cgi?id=114458
141         <rdar://problem/13631112>
142
143         Reviewed by Darin Adler and Geoffrey Garen.
144         
145         More details on this in the bug. Long story short, I don't know why the 10ms delay is
146         there, and it appears to be the root of some noisyness and unreliability in the results.
147         Removing it makes results more consistent, which is a good thing.
148
149         * resources/driver-TEMPLATE.html:
150
151 2013-01-16  Eric Seidel  <eric@webkit.org>
152
153         Remove --shark* support from sunspider/run-sunspider now that Shark is dead
154         https://bugs.webkit.org/show_bug.cgi?id=99512
155
156         Reviewed by Darin Adler.
157
158         I tried to use --instruments, but that also seems broken (in the same way before/after this patch).
159
160         * sunspider:
161         (runTestsOnce):
162
163 2012-08-02  Filip Pizlo  <fpizlo@apple.com>
164
165         Unreviewed, revert debugging stuff I landed in http://trac.webkit.org/changeset/124557
166         by accident.
167
168         * tests/v8-v6/v8-crypto.js:
169         (am1):
170         (am2):
171         (am3):
172         (am4):
173         (bnpCopyTo):
174         (bnpFromString):
175         (bnpClamp):
176
177 2012-03-11  Maciej Stachowiak  <mjs@apple.com>
178
179         Add --instruments option to sunspider to profile with Instruments
180         https://bugs.webkit.org/show_bug.cgi?id=80783
181
182         Reviewed by Filip Pizlo.
183
184         * resources/TimeProfile20us.tracetemplate: Added.
185         * sunspider:
186         (runTestsOnce):
187
188 2011-11-15  Andy Wingo  <wingo@igalia.com>
189
190         Extend sunspider driver to be able to run kraken
191         https://bugs.webkit.org/show_bug.cgi?id=71799
192
193         Reviewed by Filip Pizlo.
194
195         * resources/sunspider-standalone-driver.js: Try to load a -data
196         file.  If that succeeds, we have a kraken-like test, so we time
197         the test using `load'.  Otherwise fall back to using `run'.
198
199 2011-08-11  Mark Rowe  <mrowe@apple.com>
200
201         Fix sunspider-compare-results to default to the same suite version as the sunspider script.
202
203         Rubber-stamped by Maciej Stachowiak.
204
205         * sunspider-compare-results:
206
207 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
208
209         Update SunSpider versioning to 1.0
210         https://bugs.webkit.org/show_bug.cgi?id=63870
211
212         Reviewed by Dan Bernstein.
213
214         * hosted/sunspider.html:
215         * hosted/versions.html:
216         * resources/driver-TEMPLATE.html:
217         * resources/results-TEMPLATE.html:
218         * sunspider:
219
220 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
221
222         Sunspider 0.9.1 harness doesn't actually close() its test documents
223         https://bugs.webkit.org/show_bug.cgi?id=47045
224
225         Reviewed by Daniel Bates.
226
227         * hosted/versions.html:
228         * resources/driver-TEMPLATE.html:
229
230 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
231
232         Not Reviewed. 
233         
234         Fix obviou typo in previous commit.
235
236         * tests/sunspider-1.0/bitops-bitwise-and.js:
237
238 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
239
240         Reviewed by Anders Carlsson.
241
242         SunSpider: all four bitops benchmarks can be replaced with NOP
243         https://bugs.webkit.org/show_bug.cgi?id=38446
244
245         * tests/sunspider-1.0/bitops-3bit-bits-in-byte.js:
246         (TimeFunc): Save the result.
247         * tests/sunspider-1.0/bitops-bits-in-byte.js:
248         (TimeFunc): Save the result.
249         * tests/sunspider-1.0/bitops-bitwise-and.js: More explicitly
250         save the results.
251         * tests/sunspider-1.0/bitops-nsieve-bits.js:
252         (sieve): Save the result.
253
254 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
255
256         SunSpider: string-validate-input.js uses an undeclared variable named 'name', which is a DOM API
257         https://bugs.webkit.org/show_bug.cgi?id=60937
258
259         Reviewed by Dan Bernstein.
260
261         * tests/sunspider-1.0/string-validate-input.js:
262         (doTest): Rename the variable to username
263
264 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
265
266         Reviewed by Darin Adler.
267
268         SunSpider: The main function of math-cordic is dead code
269         https://bugs.webkit.org/show_bug.cgi?id=63863
270         
271         Try to prevent math-cordic from being eliminated as dead code or
272         compiled down to a constant.
273
274         * tests/sunspider-1.0/math-cordic.js:
275         (cordicsincos):
276         (cordic):
277
278 2011-06-30  Maciej Stachowiak  <mjs@apple.com>
279
280         Reviewed by Adam Barth.
281
282         Create sunspider-1.0 directory in preparation for fixing a bunch of bugs
283         https://bugs.webkit.org/show_bug.cgi?id=63782
284
285         * make-hosted: Learn about the new directory.
286         * tests/sunspider-1.0: Copied from PerformanceTests/SunSpider/tests/sunspider-0.9.1.
287
288 2010-11-29  Geoffrey Garen  <ggaren@apple.com>
289
290         Reviewed by Gavin Barraclough.
291
292         Improved accuracy of command-line SunSpider.
293
294         * resources/sunspider-standalone-driver.js: Use the returned number of
295         elapsed milliseconds from "run" and "checkSyntax" instead of measuring
296         ourselves, for slightly more accurate numbers.
297
298 2010-09-16  Gavin Barraclough  <barraclough@apple.com>
299
300         Reviewed by Mark Rowe.
301         https://bugs.webkit.org/show_bug.cgi?id=45924
302
303         Modify the SunSpider harness to allow a path to be passed to the --suite
304         argument, supress the normal prepend-"tests/" behaviour for suite names
305         containing a '/'.
306
307         Also wrap the code in an anonymous function to move variables out of global
308         scope (currently the harness cannot handle running tests the overwrite the
309         variable 'j').
310
311         * resources/sunspider-standalone-driver.js:
312         * sunspider:
313
314 2010-08-27  Michael Saboff  <msaboff@apple.com>
315
316         Reviewed by Stephanie Lewis.
317
318         Added version 5 and version 6 of V8 tests with modifications similar
319         to the version 4 tests so they'll work with the SunSpider test harness.
320         Note that these files are external source and therefore don't conform 
321         to WebKit coding standards.
322         https://bugs.webkit.org/show_bug.cgi?id=44638
323
324         * tests/v8-v5: Added.
325         * tests/v8-v5/LIST: Added.
326         * tests/v8-v5/v8-crypto.js: Added.
327         * tests/v8-v5/v8-deltablue.js: Added.
328         * tests/v8-v5/v8-earley-boyer.js: Added.
329         * tests/v8-v5/v8-raytrace.js: Added.
330         * tests/v8-v5/v8-regexp.js: Added.
331         * tests/v8-v5/v8-richards.js: Added.
332         * tests/v8-v5/v8-splay.js: Added.
333         * tests/v8-v6: Added.
334         * tests/v8-v6/LIST: Added.
335         * tests/v8-v6/v8-crypto.js: Added.
336         * tests/v8-v6/v8-deltablue.js: Added.
337         * tests/v8-v6/v8-earley-boyer.js: Added.
338         * tests/v8-v6/v8-raytrace.js: Added.
339         * tests/v8-v6/v8-regexp.js: Added.
340         * tests/v8-v6/v8-richards.js: Added.
341         * tests/v8-v6/v8-splay.js: Added.
342
343 2010-07-15  Stephanie Lewis  <slewis@apple.com>
344
345         Reviewed by Geoff Garen.
346
347         http://bugs.webkit.org/show_bug.cgi?id=42406
348         Output location of results file.
349
350         * sunspider:
351
352 2010-05-17  Maciej Stachowiak  <mjs@apple.com>
353
354         Reviewed by Mark Rowe.
355
356         Browser-hosted version of SunSpider runs tests twice as many times as advertised
357         https://bugs.webkit.org/show_bug.cgi?id=39201
358
359         * make-hosted: Make sure to reset test list after every test suite.
360
361 2010-05-07  Adam Roben  <aroben@apple.com>
362
363         Fix typo in sunspider-compare-results.js that caused incorrect
364         two-sample t statistics to be computed
365
366         Fixes <http://webkit.org/b/38768> SunSpider computes incorrect
367         two-sample t statistics
368
369         Reviewed by Darin Adler.
370
371         * resources/sunspider-compare-results.js:
372         (sunspiderCompareResults.resultLine): Fixed the calculation of the t
373         variable to match the definition of a two-sample t statistic. Looks
374         like this was just a simple typo.
375
376 2010-04-05  Darin Adler  <darin@apple.com>
377
378         Updated the ignore property for changes to the contents here.
379
380         * .: Modified property svn:ignore.
381
382 2010-02-20  Maciej Stachowiak  <mjs@apple.com>
383
384         Reviewed by Adam Barth.
385
386         Add sunspider-0.9.1 to the site in preparation for announcing it.
387         https://bugs.webkit.org/show_bug.cgi?id=35206
388
389         * hosted/sunspider.css: Remove tabs, which I noticed where present while
390         copying to the WebKitSite directory.
391
392 2010-01-11  Oliver Hunt  <oliver@apple.com>
393
394         Reviewed by Darin Adler.
395
396         Sunspider parse-only tests don't run
397         https://bugs.webkit.org/show_bug.cgi?id=33489
398
399         Fix parse-only test list
400
401         * tests/parse-only/LIST:
402
403 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
404
405         Reviewed by Adele Peterson.
406
407         Make SunSpider version more prominent in the title
408         https://bugs.webkit.org/show_bug.cgi?id=32574
409
410         * hosted/sunspider.html:
411         * hosted/versions.html:
412         * resources/driver-TEMPLATE.html:
413         * resources/results-TEMPLATE.html:
414
415 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
416
417         Reviewed by Darin Adler.
418
419         Make SunSpider refuse to compare results across content versions
420         https://bugs.webkit.org/show_bug.cgi?id=32573
421         
422         The results URL now includes a version indicator, and compare mode
423         will refuse to compare between versions.
424
425         * resources/driver-TEMPLATE.html:
426         * resources/results-TEMPLATE.html:
427
428 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
429
430         Reviewed by Darin Adler.
431
432         Some Browser-hosted SunSpider files are not valid HTML5
433         https://bugs.webkit.org/show_bug.cgi?id=32536
434         
435         Made various fixes to validate as HTML5 with no warnings (mainly removing bogus
436         close tags and adding a meta charset declaration).
437
438         * hosted/sunspider.html:
439         * hosted/versions.html:
440         * resources/TEMPLATE.html:
441         * resources/driver-TEMPLATE.html:
442         * resources/results-TEMPLATE.html:
443
444 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
445
446         Reviewed by Eric Seidel.
447
448         Make sunspider-0.9.1 the default content set (both command-line and hosted)
449         https://bugs.webkit.org/show_bug.cgi?id=32537
450
451         * hosted/sunspider.html: Change default suite link.
452         * sunspider: Change default suite.
453         * sunspider-compare-results: Likewise.
454
455 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
456
457         Reviewed by Sam Weinig.
458
459         in-browser SunSpider suffers excessive penalty under power management
460         https://bugs.webkit.org/show_bug.cgi?id=32505
461         
462         I have made a few changes to address this:
463         
464         1) Change how browser-hosted SunSpider loads tests - preload the content and write it in with
465         document.write to reduce triggering of progress UI.
466         2) Reduce time between tests to 10ms from 500ms, so that power management doesn't keep the CPU
467         stepped all the way down the whole time.
468         3) Run the test cycle an extra time for warmup before the runs that count.
469
470         * hosted/sunspider-record-result.js: Removed.
471         * make-hosted:
472         * resources/TEMPLATE.html:
473         * resources/driver-TEMPLATE.html:
474
475 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
476
477         Reviewed by Gavin Barraclough.
478
479         SunSpider/tests/string-base64.js does not compute a valid base64 encoded string
480         https://bugs.webkit.org/show_bug.cgi?id=16806
481
482         Based on a patch by Eric Seidel.
483         
484         Fix the base64 computation to actually compute correct results. The impact on runtime of
485         the test is pretty small, but noticeable for some browsers. But at least it's not
486         doing a wrong and meaningless computation any more.
487         
488         * tests/sunspider-0.9.1/string-base64.js:
489         ():
490         (base64ToString):
491
492 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
493
494         Fixing commit error...
495         
496         I accidentally committed my last patch in a form that broke Web-hosted SunSpider. Fixing.
497
498         * resources/driver-TEMPLATE.html:
499
500 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
501
502         Reviewed by Sam Weinig.
503
504         Use JSON.parse instead of eval for Web-hosted SunSpider results processing
505         https://bugs.webkit.org/show_bug.cgi?id=32490
506
507         * hosted/json2.js: Added. Incorporated from json.org
508         * resources/driver-TEMPLATE.html: Fix an HTML validation bug I noticed.
509         * resources/results-TEMPLATE.html: Use JSON.parse instead of eval to process
510         results.
511
512 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
513
514         Reviewed by Oliver Hunt.
515
516         Enable Web-hosted version of SunSpider to handle multiple versions
517         https://bugs.webkit.org/show_bug.cgi?id=32478
518
519         * make-hosted: Now generate the hosted version to be able to run both the
520         0.9 and the 0.9.1 test suites.
521         * hosted: Modified property svn:ignore.
522         * hosted/sunspider-driver.html: Removed.
523         * hosted/sunspider-results.html: Removed.
524         * hosted/sunspider.html:
525         * hosted/versions.html: Added.
526         * resources/TEMPLATE.html:
527         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-driver.html.
528         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-results.html.
529
530 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
531
532         Reviewed by Oliver Hunt.
533
534         Give command-line sunspider the ability to handle multiple suites and versions
535         https://bugs.webkit.org/show_bug.cgi?id=32477
536         
537         Each suite/version's set of tests are now in a separate subdirectory of tests/, with a file named LIST
538         enumerating the tests. Current suites are:
539         
540         sunspider-0.9 - riginal SunSpider content 
541         sunspider-0.9.1 - SunSpider suite with a few tests fixed (and a few more to come)
542         ubench - "ubench" microbenchmark suite
543         v8-v4 - version 4 of the v8 benchmark
544         parse-only - some parser tests
545         
546         Sunspider can now be run with the --suite= parameter to select a
547         suite. The default is --suite=sunspider-0.9.
548
549         * .: Modified property svn:ignore to ignore new results directories.
550         * make-hosted: Generate based on sunspider-0.9 suite.
551         * resources/TEMPLATE.html: Fix an HTML compliance problem.
552         * resources/sunspider-standalone-driver.js: Become aware of suite names.
553         * sunspider: Modified to handle multiple suites as described above.
554         * sunspider-compare-results: ditto
555         * tests/LIST: Moved to tests/sunspider-0.9/ and tests/sunspider-0.9.1/
556         * tests/LIST-PARSE-ONLY: Moved to parse-only/LIST
557         * tests/LIST-UBENCH: Removed.
558         * tests/LIST-V8: Removed.
559         * tests/3d-cube.js: Moved to tests/sunspider-0.9 and tests/sunspider-0.9.1
560         * tests/3d-morph.js: ditto
561         * tests/3d-raytrace.js: ditto
562         * tests/access-binary-trees.js: ditto
563         * tests/access-fannkuch.js: ditto
564         * tests/access-nbody.js: ditto
565         * tests/access-nsieve.js: ditto
566         * tests/bitops-3bit-bits-in-byte.js: ditto
567         * tests/bitops-bits-in-byte.js: ditto
568         * tests/bitops-bitwise-and.js: ditto
569         * tests/bitops-nsieve-bits.js: ditto
570         * tests/controlflow-recursive.js: ditto
571         * tests/crypto-aes.js: ditto
572         * tests/crypto-md5.js: ditto
573         * tests/crypto-sha1.js: ditto
574         * tests/date-format-tofte.js: ditto
575         * tests/date-format-xparb.js: ditto
576         * tests/math-cordic.js: ditto
577         * tests/math-partial-sums.js: ditto
578         * tests/math-spectral-norm.js: ditto
579         * tests/regexp-dna.js: ditto
580         * tests/string-base64.js: ditto
581         * tests/string-fasta.js: ditto
582         * tests/string-tagcloud.js: ditto
583         * tests/string-unpack-code.js: ditto
584         * tests/string-validate-input.js: ditto
585         * tests/sunspider-0.9/: Added
586         * tests/sunspider-0.9/*.js: Moved from one level up
587         * tests/sunspider-0.9.1: Added.
588         * tests/sunspider-0.9.1/*.js: Moved from one level up.
589         * tests/v8-crypto.js: Moved to v8-v4/ directory.
590         * tests/v8-deltablue.js: ditto
591         * tests/v8-earley-boyer.js: ditto
592         * tests/v8-raytrace.js: ditto
593         * tests/v8-regexp.js: ditto
594         * tests/v8-richards.js: ditto
595         * tests/v8-splay.js: ditto
596         * tests/v8-v4: Added.
597
598 2009-09-30  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
599
600         Reviewed by Darin Adler.
601
602         Platform specific null device replaced with a platform independent.
603         https://bugs.webkit.org/show_bug.cgi?id=29544
604
605         * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL.
606
607 2009-09-21  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
608
609         Reviewed by Maciej Stachowiak.
610
611         [Qt] Make sunspider script work on Windows platform.
612         https://bugs.webkit.org/show_bug.cgi?id=29544
613
614         * sunspider:
615         Using platform specific null device instead of /dev/null.
616
617 2009-06-19  Adam Treat  <adam.treat@torchmobile.com>
618
619         Reviewed by Oliver Hunt.
620
621         https://bugs.webkit.org/show_bug.cgi?id=26540
622         Currently the SunSpider test driver lacks an option to run a test suite that
623         will test JavaScriptCore parsing performance only.  This patch adds just such
624         a test suite and option to SunSpider as well as the jsc test shell.  I've included
625         three large javascript source files found in the wild: jquery, mootools and prototype.
626         Combined with the concatenation of all three, these form a new testsuite to measure
627         and test pure JavaScriptCore parsing performance.
628
629         * resources/sunspider-standalone-driver.js:
630           Load the js with parse-only flag if it is part of the parse-only suite.
631         * sunspider:
632           Add the parse-only suite to the list of options.
633         * sunspider-compare-results:
634           Add the parse-only suite to the list of options.
635         * tests/LIST-PARSE-ONLY: Added.
636         * tests/parse-only/concat-jquery-mootools-prototype.js: Added.
637           A very large concatenation of the scripts found below.  This js takes ~30ms to parse on my machine.
638         * tests/parse-only/jquery-1.3.2.js: Added.
639           Latest version from jquery.com.
640         * tests/parse-only/mootools-1.2.2-core-nc.js: Added.
641           Latest version from mootools.net.
642         * tests/parse-only/prototype-1.6.0.3.js: Added.
643           Latest version from prototypejs.org.
644
645 2009-06-13  Steve Falkenburg  <sfalken@apple.com>
646
647         Update V8 benchmark to version 4.
648         
649         Reviewed by Cameron Zwarich.
650
651         * tests/LIST-V8:
652         * tests/v8-crypto.js:
653         * tests/v8-deltablue.js:
654         * tests/v8-earley-boyer.js:
655         * tests/v8-raytrace.js:
656         * tests/v8-regexp.js: Added.
657         * tests/v8-richards.js:
658         * tests/v8-splay.js: Added.
659
660 2009-05-26  Olivier DOLE  <odole@pleyo.com>
661
662         Reviewed by Maciej.
663
664         Store sunspider test suite results in a specific directory for each
665         different type of benchmark (sunspider, V8 or ubench).
666
667         * sunspider:
668         * sunspider-compare-results:
669
670 2009-05-12  Steve Falkenburg  <sfalken@apple.com>
671
672         Build fix.
673
674         * SunSpider.make:
675
676 2009-05-11  Steve Falkenburg  <sfalken@apple.com>
677
678         Include SunSpider tests in production builds.
679         
680         Reviewed by Adam Roben.
681
682         * SunSpider.make: Added.
683         * xcopy.excludes: Added.
684
685 2009-03-04  Oliver Hunt  <oliver@apple.com>
686
687         Added a few more tests to ubench
688
689         RS=Gavin Barraclough
690
691         Adding a couple of test to cover too few and too many arguments.  This
692         is needed to prevent regressions in all call paths from my current refactoring.
693
694         * tests/LIST-UBENCH:
695         * tests/ubench/function-correct-args.js: Added.
696         (f):
697         * tests/ubench/function-excess-args.js: Added.
698         (f):
699
700 2008-10-30  Zoltan Horvath  <Horvath.Zoltan.6@stud.u-szeged.hu>
701
702         Fix a bug where when V8's or UBENCH's test suite list file is missing
703         the error message is suggesting that SunSpider's list file is missing.
704
705         Reviewed by Sam Weinig.
706
707         * sunspider:
708         (loadTestsList): Fix the error message to use the right list name.
709
710 2008-10-07  David Hyatt  <hyatt@apple.com>
711
712         https://bugs.webkit.org/show_bug.cgi?id=18989
713
714         Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
715         we want all browsers to be doing the same thing on the test.
716
717         Reviewed by Maciej
718
719         * tests/regexp-dna.js:
720
721 2008-09-09  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
722
723         Rubber-stamped by Maciej Stachowiak.
724
725         The bleeding edge branch of V8 now supports passing fileanmes after
726         '-f', so the SunSpider script should be changed to do this again.
727         This allows all 3 major JavaScript engines to be used with the
728         unmodified SunSpider script.
729
730         * sunspider:
731
732 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
733
734         Reviewed by Maciej Stachowiak.
735
736         Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
737         and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
738         correct the punctuation in its documentation.
739
740         * sunspider:
741
742 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
743
744         Reviewed by Oliver Hunt.
745
746         Bug 20616: Incorporate V8 benchmarks in testing
747         <https://bugs.webkit.org/show_bug.cgi?id=20616>
748
749         This is a first attempt at running the V8 benchmarks within SunSpider,
750         with the --v8 option. The number of iterations is fixed for each
751         benchmark, and was chosen to make each of the benchmarks run between
752         500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
753
754         * sunspider:
755         * tests/LIST-V8: Added.
756         * tests/v8-crypto.js: Added.
757         * tests/v8-deltablue.js: Added.
758         * tests/v8-earley-boyer.js: Added.
759         * tests/v8-raytrace.js: Added.
760         * tests/v8-richards.js: Added.
761
762 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
763
764         Not reviewed.
765
766         Remove a local change that was accidentally committed in r36034.
767
768         * resources/sunspider-standalone-driver.js:
769
770 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
771
772         Rubber-stamped by Oliver Hunt.
773
774         Make SunSpider work with JavaScript shells that don't take filenames
775         after a '-f' argument.
776
777         * sunspider:
778
779 2008-06-07  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
780
781         Reviewed by Timothy.
782
783         Remove the --squirrelfish option from SunSpider, as it is no longer needed.
784
785         * sunspider:
786         * tests/LIST-SQUIRRELFISH: Removed.
787
788 2008-06-03  Alexey Proskuryakov  <ap@webkit.org>
789
790         Rubber-stamped by Mark Rowe.
791
792         Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
793
794         * sunspider:
795
796 2008-04-15  Maciej Stachowiak  <mjs@apple.com>
797
798         Rubber stamped by Oliver.
799         
800         - add newly working tests to squirrelfish list
801
802         * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
803
804 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
805
806         Rubber stamped by Oliver.
807         
808         - move ubench tests properly.
809
810         * tests/ubench: Added.
811         * tests/ubench/function-closure.js: Added.
812         * tests/ubench/function-empty.js: Added.
813         * tests/ubench/function-missing-args.js: Added.
814         * tests/ubench/function-sum.js: Added.
815         * tests/ubench/loop-empty-resolve.js: Added.
816         * tests/ubench/loop-empty.js: Added.
817         * tests/ubench/loop-sum.js: Added.
818
819 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
820
821         Rubber stamped by Oliver.
822
823         * sunspider: Don't force --runs=1 in squirrelfish mode any more.
824
825 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
826
827         Reviewed by Oliver.
828
829         - make --squirrelfish mode use the real harness, but a reduced set of tests
830
831         Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
832
833         * sunspider:
834         * tests/LIST-SQUIRRELFISH:
835         * tests/LIST-UBENCH: Added.
836         * tests/squirrelfish: Moved to tests/ubench
837
838 2008-04-14  Geoffrey Garen  <ggaren@apple.com>
839
840         Reviewed by Maciej Stachowiak.
841         
842         Removed an unused test.
843
844         * tests/squirrelfish/loop-resolve.js: Removed.
845
846 2008-04-10  Maciej Stachowiak  <mjs@apple.com>
847
848         Reviewed by Oliver.
849         
850         Add newly runnable tests to --squirrelfish mode.
851
852         * tests/LIST-SQUIRRELFISH:
853
854 2008-04-06  Geoffrey Garen  <ggaren@apple.com>
855
856         Reviewed by Maciej Stachowiak.
857         
858         A little more love for --squirrelfish mode:
859         
860         Fixed a misplaced sort. Results properly sort now.
861         
862         Added a test list just for squirrelfish, and updated it to include
863         all currently passing SunSpider tests.
864         
865         Fixed the pruning regexp to match 3d-morph.js.
866
867         * sunspider:
868
869 2008-03-26  Geoffrey Garen  <ggaren@apple.com>
870
871         Reviewed by Oliver Hunt.
872         
873         --squirrelfish mode: pared down tests for squirrelfish to chew on.
874
875         * sunspider:
876         * tests/LIST:
877         * tests/squirrelfish: Added.
878         * tests/squirrelfish/function-closure.js: Added.
879         * tests/squirrelfish/function-empty.js: Added.
880         * tests/squirrelfish/function-missing-args.js: Added.
881         * tests/squirrelfish/function-sum.js: Added.
882         * tests/squirrelfish/loop-empty-resolve.js: Added.
883         * tests/squirrelfish/loop-empty.js: Added.
884         * tests/squirrelfish/loop-resolve.js: Added.
885         * tests/squirrelfish/loop-sum.js: Added.
886
887 2008-03-21  Alexey Proskuryakov  <ap@webkit.org>
888
889         Reviewed by Geoff.
890
891         * sunspider: Pause update daemon on Darwin to make results reliable
892         again (workaround for <rdar://problem/5811127>).
893
894 2008-02-07  Eric Seidel  <eric@webkit.org>
895
896         Reviewed by Sam.
897
898         * sunspider: add an error message when ./tests/LIST is not found
899
900 2007-12-29  Alp Toker  <alp@atoker.com>
901
902         Fix typo.
903
904         * hosted/sunspider.html:
905
906 2007-12-29  Alp Toker  <alp@atoker.com>
907
908         Reviewed by Maciej.
909
910         Provide the current URL in the SunSpider results page. Useful for
911         copying benchmark results out of browsers without a location bar or
912         where the location bar can't handle long URLs.
913
914         * hosted/sunspider-results.html:
915
916 2007-12-20  Eric Seidel  <eric@webkit.org>
917
918         Reviewed by mjs.
919
920         * sunspider: increase default number of runs for more accurate numbers
921
922 2007-12-18  Mark Rowe  <mrowe@apple.com>
923
924         Fix typo.
925
926         * hosted/sunspider.html:
927
928 2007-12-18  Maciej Stachowiak  <mjs@apple.com>
929
930         Reviewed by Eric.
931         
932         - give an extra digit of precision for small differences.
933
934         * resources/sunspider-compare-results.js:
935
936 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
937
938         Reviewed by Eric.
939         
940         - work around IE layout bugs
941
942         * hosted/sunspider.css:
943
944 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
945
946         Reviewed by Mark.
947         
948         - fix compare feature
949
950         * hosted/sunspider-results.html:
951
952 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
953
954         Reviewed by Mark.
955         
956         - Change the format of the output URL to be shorter, to meet IE constraints
957
958         * hosted/sunspider-driver.html:
959         * hosted/sunspider-results.html:
960
961 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
962
963         Reviewed by Oliver.
964         
965         - Add some explanatory test and a dumb logo to SunSpider web hosted version
966
967         * hosted/sunspider-driver.html:
968         * hosted/sunspider-results.html:
969         * hosted/sunspider.css:
970         * hosted/sunspider.html:
971
972 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
973
974         Reviewed by Oliver.
975         
976         - Make the web-hosted version of SunSpider look a little bit less drab.
977
978         * hosted/sunspider-driver.html:
979         * hosted/sunspider-results.html:
980         * hosted/sunspider.css: Added.
981         * hosted/sunspider.html:
982         * resources/TEMPLATE.html:
983
984 2007-12-12  Maciej Stachowiak  <mjs@apple.com>
985
986         Reviewed by Sam.
987         
988         - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
989         
990         A sample of what new-style results would look like:
991         
992         TEST                   COMPARISON            FROM                 TO             DETAILS
993         ...
994         ** TOTAL **:           1.41x as fast     6613.6ms +/- 0.1%   4703.0ms +/- 0.1%     significant
995         ...
996             3bit-bits-in-byte: *1.36x as slow*     88.8ms +/- 0.6%    121.1ms +/- 0.6%     significant
997         
998         * resources/sunspider-compare-results.js:
999
1000 2007-11-14  Eric Seidel  <eric@webkit.org>
1001
1002         Reviewed by Sam.
1003
1004         * sunspider: add --shark-cache for L2 Cache Miss profiling
1005
1006 2007-11-09  Alexey Proskuryakov  <ap@webkit.org>
1007
1008         Reviewed by Darin Adler.
1009
1010         http://bugs.webkit.org/show_bug.cgi?id=15925
1011         SunSpider should check for Shark being installed
1012
1013         * sunspider: Explicitly test that shark command line tool is installed.
1014
1015 2007-11-04  Darin Adler  <darin@apple.com>
1016
1017         * hosted/sunspider.html: Tweaked formatting a bit.
1018
1019 2007-11-03  Maciej Stachowiak  <mjs@apple.com>
1020
1021         Reviewed by Darin Adler.
1022
1023         - Add compare mode and a description of the benchmark to the hosted version.
1024
1025         * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
1026         * hosted/sunspider.html: Added intro text.
1027         * make-hosted: Copy new file.
1028         * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
1029         a function.
1030         * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
1031         expects.
1032         * sunspider-compare-results: Use sunspider-standalone-compare.js.
1033
1034 2007-11-02  Darin Adler  <darin@apple.com>
1035
1036         * sunspider: Changed "--base" to "--set-baseline".
1037
1038 2007-11-02  Darin Adler  <darin@apple.com>
1039
1040         Reviewed by Maciej.
1041
1042         * sunspider: Added a "--base" option that records the current test as a baseline.
1043         Moved the code to find the newest .mshark file into a function (since I needed to use
1044         it in the other script and I prefer to copy/paste a function).
1045
1046         * sunspider-compare-results: Added logic to compare the baseline with the last
1047         run when you don't pass any parameters.
1048
1049 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1050
1051         Reviewed by Eric.
1052         
1053         - Added list of ECMAScript3 features that SunSpider does not cover currently.
1054
1055         * UNCOVERED: Added.
1056
1057 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1058
1059         Reviewed by Oliver.
1060         
1061         - Give better error messages when sunspider-compare-results fails
1062
1063         * sunspider-compare-results:
1064
1065 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1066
1067         Reviewed by Darin Adler.
1068         
1069         - fix Date tests to work in command-line SpiderMonkey
1070
1071         * tests/date-format-tofte.js:
1072         * tests/date-format-xparb.js:
1073
1074 2007-10-29  Darin Adler  <darin@apple.com>
1075
1076         Reviewed by Maciej.
1077
1078         * sunspider: Added --shark20 option, to run Shark at its highest sample
1079         resolution instead of its default.
1080
1081 2007-10-28  Adam Roben  <aroben@apple.com>
1082
1083         Fix SunSpider on Windows
1084
1085         Reviewed by Eric.
1086
1087         * sunspider: Don't use colons in filenames.
1088
1089 2007-10-28  Darin Adler  <darin@apple.com>
1090
1091         Reviewed by Adam.
1092
1093         * resources/sunspider-analyze-results.js: Tweak the output format a little.
1094         Change so that when there's only one run we don't write out confidence
1095         intervals at all rather than writing "NaN" over and over again.
1096
1097         * sunspider: Use the time and date as a suffix on the results file, that way
1098         all the results are left behind in the tmp directory. This will make it easy
1099         for us to add features that compare past results in the future. Also rename
1100         the .mshark files using the same scheme.
1101
1102         * sunspider-compare-results: Relax the parsing rules so we can parse the
1103         results file exactly as it's emitted from sunspider.
1104
1105 2007-10-25  Adam Roben  <aroben@apple.com>
1106
1107         Strip carriage returns from results
1108
1109         Carriage returns were screwing up sunspider-compare-results on
1110         Windows.
1111
1112         Rubberstamped by Oliver.
1113
1114         * sunspider:
1115
1116 2007-10-24  Darin Adler  <darin@apple.com>
1117
1118         Reviewed by Eric.
1119
1120         * sunspider: Open the profile in shark after completing a run.
1121         * sunspider-compare-results: Tiny perl tweaks.
1122
1123 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1124
1125         Reviewed by Darin Adler.
1126
1127         - Don't hardcode my path to testkjs
1128         
1129         * sunspider-compare-results:
1130
1131 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1132
1133         Reviewed by Darin Adler.
1134         
1135         - Add a compare script to compare results, and improve formatting of standard results a bit.
1136
1137         * resources/sunspider-analyze-results.js:
1138         * resources/sunspider-compare-results.js: Added.
1139         * sunspider-compare-results: Added.
1140
1141 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1142
1143         Reviewed by Darin Adler.
1144
1145         * resources/sunspider-analyze-results.js: Do the error range
1146         properly, using the t-distribution instead of 1.96 (which was
1147         based on the normal distribution).
1148         
1149         * sunspider: Print results in a way that will be friendlier to the
1150         soon-to-come compare mode.
1151
1152 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
1153
1154         Reviewed by Review.
1155         
1156         - add more tests (probably the final set for now)
1157         
1158         Already balanced. Added date, regexp, control flow, and a few
1159         more string and object/array access tests.
1160         
1161         * tests/LIST:
1162         * tests/access-fannkuch.js: Added.
1163         * tests/access-nbody.js: Added.
1164         * tests/controlflow-recursive.js: Added.
1165         * tests/date-format-tofte.js: Added.
1166         * tests/date-format-xparb.js: Added.
1167         * tests/regexp-dna.js: Added.
1168         * tests/string-validate-input.js: Added.
1169
1170 2007-10-21  Eric Seidel  <eric@webkit.org>
1171
1172         Reviewed by mjs.
1173
1174         * sunspider: make --shark only sample from testkjs
1175
1176 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
1177
1178         Rubber stamped by Eric.
1179         
1180         - added crypto tests (already balanced)
1181
1182         * tests/LIST:
1183         * tests/crypto-aes.js: Added.
1184         * tests/crypto-md5.js: Added.
1185         * tests/crypto-sha1.js: Added.
1186
1187 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
1188
1189         Reviewed by Adam.
1190         
1191         - rebalance new tests
1192         
1193         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
1194         
1195         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1196
1197         This balances them with the existing tests.
1198
1199         * tests/access-binary-trees.js:
1200         * tests/access-nsieve.js:
1201         * tests/bitops-nsieve-bits.js:
1202         * tests/math-partial-sums.js:
1203         * tests/math-spectral-norm.js:
1204         * tests/string-fasta.js:
1205
1206 2007-10-20  Eric Seidel  <eric@webkit.org>
1207
1208         Reviewed by darin.
1209         
1210         Add improved argument handling to sunspider, including
1211         --runs=<number>, --tests=<pattern, --shark, and --help
1212         Also re-factor code into subroutines
1213
1214         * sunspider: improved argument handling
1215
1216 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1217
1218         Reviewed by Mark.
1219
1220         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
1221         
1222         * TODO:
1223         * tests/LIST:
1224         * tests/access-binary-trees.js: Added.
1225         * tests/access-nsieve.js: Added.
1226         * tests/bitops-nsieve-bits.js: Added.
1227         * tests/math-partial-sums.js: Added.
1228         * tests/math-spectral-norm.js: Added.
1229         * tests/string-fasta.js: Added.
1230
1231 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1232
1233         Reviewed by Darin Adler.
1234
1235         * TODO: Updated to note areas that are now well-covered.
1236         
1237         - Change the tests and the driver to avoid leaving large object
1238         graphs hanging around, since that throws off the subsequent tests.
1239         
1240         * resources/sunspider-standalone-driver.js:
1241         * tests/3d-cube.js:
1242         * tests/3d-morph.js:
1243         * tests/3d-raytrace.js:
1244         * tests/bitops-bitwise-and.js:
1245         * tests/string-base64.js:
1246         * tests/string-tagcloud.js:
1247
1248 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1249
1250         Reviewed by Nikolas.
1251         
1252         - Rebalance test complexity.
1253         
1254         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
1255         
1256         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1257
1258         However, for some tests, IE7 was a huge outlier compared to other
1259         major browsers. For those tests, I used Firefox 2.0.0.8 on the
1260         same OS and hardware as a normalization basis.
1261         
1262         * tests/3d-morph.js:
1263         * tests/3d-raytrace.js:
1264         * tests/bitops-3bit-bits-in-byte.js:
1265         * tests/bitops-bits-in-byte.js:
1266         * tests/bitops-bitwise-and.js:
1267         * tests/math-cordic.js:
1268         * tests/string-base64.js:
1269         * tests/string-tagcloud.js:
1270         * tests/string-unpack-code.js:
1271
1272 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1273
1274         Reviewed by Oliver.
1275         
1276         - Fix the browser-hosted driver to be compatible with Safari 2
1277
1278         * hosted/sunspider-driver.html:
1279
1280 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1281
1282         Rubber stamped by Hyatt.
1283         
1284         - Add BSD license notice to cordic test, the original author said to do so.
1285
1286         * tests/math-cordic.js:
1287
1288 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1289
1290         Reviewed by Eric.
1291         
1292         - Support Windows and Windows browsers.
1293
1294         * hosted/sunspider-results.html: Display results correctly in IE.
1295         * sunspider: tweaks to work on Windows, and with spaces in the path.
1296
1297 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1298
1299         Rubber stamped by Oliver.
1300
1301         * tests/string-tagcloud.js: Remove stray print()
1302
1303 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
1304
1305         Reviewed by Oliver.
1306         
1307         Add some string test cases.
1308
1309         * tests/string-base64.js: Added. Does base64 encoding and decoding.
1310         * tests/string-tagcloud.js: Added. Parses a JSON string and
1311         generates tagcloud HTML markup based on the data.        
1312         * tests/string-unpack-code.js: Added. Unpack compressed versions of
1313         four of the most popular JavaScript libraries.
1314         * tests/LIST: Added the new tests.
1315
1316 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
1317
1318         Reviewed by Anders.
1319
1320         * TODO: Updated with info on how to do the stats properly.
1321
1322         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
1323         avoid overly slowing down the benchmark.
1324
1325         Added some 3D-related test cases.
1326         
1327         * tests/3d-cube.js: Added.
1328         * tests/3d-morph.js: Added.
1329         * tests/3d-raytrace.js: Added.
1330         * tests/LIST:
1331
1332 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
1333
1334         Reviewed by Darin Adler.
1335
1336         - New JavaScript benchmark
1337         http://bugs.webkit.org/show_bug.cgi?id=15515
1338         
1339         A start on a new JavaScript benchmark, with standalone and
1340         browser-hosted drivers.
1341         
1342         The test content is still incomplete and the drivers could use
1343         some more features but there is enough here to make a good start.
1344         
1345         The drivers compute a 95% confidence interval on the mean for the
1346         whole test, each category, and each individual test to make it
1347         easier to tell whether differences are statistically
1348         significant. The confidence interval can be narrowed by running
1349         the test more times.
1350         
1351         * TODO: Added. Remaining things that need to be done.
1352         * sunspider: Added. Perl script that acts as the standalone test driver.
1353         * resources/sunspider-standalone-driver.js: Added. JavaScript part
1354         of standalone test driver.
1355         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
1356         analysis code.
1357         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
1358         * make-hosted: Added. Script to generate browser-hosted tests.
1359         * hosted/sunspider.html: Added. Start page for browser-hosted test.
1360         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
1361         * hosted/sunspider-results.html: Added. Results page for browser-hosted
1362         tests.
1363         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
1364         tests.
1365         * tests/LIST: Added. List of tests to use.
1366         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
1367         * tests/bitops-bits-in-byte.js: Added. Ditto.
1368         * tests/bitops-bitwise-and.js: Added. Ditto.
1369         * tests/math-cordic.js: Added. Ditto.
1370