Use the move assignment operator when reinserting values in the hash map
[WebKit-https.git] / PerformanceTests / SunSpider / ChangeLog
1 2013-09-26  Geoffrey Garen  <ggaren@apple.com>
2
3         Tentative SunSpider 1.0.2
4         https://bugs.webkit.org/show_bug.cgi?id=122002
5
6         Reviewed by Gavin Barraclough.
7
8         Be even more aggressive about asking for zero delay between tests by
9         setting a timeout at the beginning of a test instead of the end. This is
10         another step toward reducing noise -- particularly noise caused by
11         power management -- just like the step down from 10ms to 0ms.
12
13         Browsers typically put a 4ms floor on timers. The sooner we set
14         our timer, the sooner it will fire.
15
16         * make-hosted:
17         * resources/driver-TEMPLATE.html: Changed the driver to set the timeout
18         earlier.
19         * tests/sunspider-1.0.2: Added. These tests are unchanged from 1.0.1.
20
21 2013-09-09  Filip Pizlo  <fpizlo@apple.com>
22
23         Stress tests should test the jsc profiler (-p)
24         https://bugs.webkit.org/show_bug.cgi?id=121043
25
26         Reviewed by Mark Hahnenberg.
27         
28         Add a jsc-stress-test that tries to profile SunSpider.
29
30         * profiler-test.yaml: Added.
31
32 2013-08-08  Cosmin Truta  <ctruta@blackberry.com>
33
34         SunSpider: Move the 3d-morph fix from version 1.0 to version 1.0.1
35         https://bugs.webkit.org/show_bug.cgi?id=117993
36
37         Reviewed by George Staikos.
38
39         Bump the SunSpider version to 1.0.1.
40
41         Unroll r149548 in order to restore version 1.0 to its original,
42         and add the 3d-morph fix to version 1.0.1 instead.
43
44         * hosted/sunspider.html: Updated to version 1.0.1.
45         * hosted/versions.html: Updated to version 1.0.1.
46         * make-hosted: Added support for version 1.0.1.
47         * resources/driver-TEMPLATE.html: Updated to version 1.0.1.
48         * resources/results-TEMPLATE.html: Updated to version 1.0.1.
49         * sunspider: Updated to version 1.0.1.
50         * sunspider-compare-results: Updated to version 1.0.1.
51         * tests/sunspider-1.0/3d-morph.js: Rolled back to the original version.
52         * tests/sunspider-1.0.1/LIST: Added.
53         * tests/sunspider-1.0.1/3d-cube.js: Added.
54         * tests/sunspider-1.0.1/3d-morph.js: Added.
55         * tests/sunspider-1.0.1/3d-raytrace.js: Added.
56         * tests/sunspider-1.0.1/access-binary-trees.js: Added.
57         * tests/sunspider-1.0.1/access-fannkuch.js: Added.
58         * tests/sunspider-1.0.1/access-nbody.js: Added.
59         * tests/sunspider-1.0.1/access-nsieve.js: Added.
60         * tests/sunspider-1.0.1/bitops-3bit-bits-in-byte.js: Added.
61         * tests/sunspider-1.0.1/bitops-bits-in-byte.js: Added.
62         * tests/sunspider-1.0.1/bitops-bitwise-and.js: Added.
63         * tests/sunspider-1.0.1/bitops-nsieve-bits.js: Added.
64         * tests/sunspider-1.0.1/controlflow-recursive.js: Added.
65         * tests/sunspider-1.0.1/crypto-aes.js: Added.
66         * tests/sunspider-1.0.1/crypto-md5.js: Added.
67         * tests/sunspider-1.0.1/crypto-sha1.js: Added.
68         * tests/sunspider-1.0.1/date-format-tofte.js: Added.
69         * tests/sunspider-1.0.1/date-format-xparb.js: Added.
70         * tests/sunspider-1.0.1/math-cordic.js: Added.
71         * tests/sunspider-1.0.1/math-partial-sums.js: Added.
72         * tests/sunspider-1.0.1/math-spectral-norm.js: Added.
73         * tests/sunspider-1.0.1/regexp-dna.js: Added.
74         * tests/sunspider-1.0.1/string-base64.js: Added.
75         * tests/sunspider-1.0.1/string-fasta.js: Added.
76         * tests/sunspider-1.0.1/string-tagcloud.js: Added.
77         * tests/sunspider-1.0.1/string-unpack-code.js: Added.
78         * tests/sunspider-1.0.1/string-validate-input.js: Added.
79
80 2013-05-03  Cosmin Truta  <ctruta@blackberry.com>
81
82         SunSpider 1.0: 3d-morph: use epsilon to check result
83         https://bugs.webkit.org/show_bug.cgi?id=115553
84
85         Reviewed by George Staikos.
86
87         SunSpider/3d-morph should be more lenient in validating its results, since they depend on Math.sin, which isn't formally specified.
88
89         * tests/sunspider-1.0/3d-morph.js:
90
91 2013-04-19  Filip Pizlo  <fpizlo@apple.com>
92
93         SunSpider/string-tagcloud should be more lenient in validating its results, since they depend on Math.log, which isn't formally specified
94         https://bugs.webkit.org/show_bug.cgi?id=114895
95
96         Reviewed by Michael Saboff.
97
98         * tests/sunspider-1.0/string-tagcloud.js:
99
100 2013-04-18  Filip Pizlo  <fpizlo@apple.com>
101
102         Whenever it is cheap and non-invasive, SunSpider tests should validate their results to ensure that the browser runs them correctly
103         https://bugs.webkit.org/show_bug.cgi?id=114852
104
105         Reviewed by Geoffrey Garen.
106         
107         This adds low-overhead checking of the results of each SunSpider tests. This is not
108         meant to be an exhaustive test that everything was executed correctly, but rather a
109         simple sanity check that will catch glaring mistakes. The philosophy here is that we're
110         not trying to prevent all forms of cheating, or that we're trying to prove the
111         browser's correctness. Moreover, these checks are meant to incur minimal overhead;
112         they currently clock in at <2% slow-down in SunSpider 1.0.
113         
114         The test expectations were generated using the LLInt on command-line, and I've verified
115         that Firefox 20, Chrome 26, IE 10, Safari 6, and ToT with all of the JITs agree. Note
116         that some tests cannot be precisely validated because they use Math functions, which
117         ECMAScript chooses to not formally specify - those functions like sin() and friends are
118         allowed to return implementation-dependent results. Also some tests cannot be validated
119         at all because their behavior is either intentionally random or is timezone-dependent.
120         But 23 out of 26 tests now have some kind of validation.
121         
122         I've updated the harnesses to show erroneous runs when displaying results.
123
124         * resources/TEMPLATE.html:
125         * resources/driver-TEMPLATE.html:
126         * resources/sunspider-analyze-results.js:
127         (formatResult):
128         (resultLine):
129         (printOutput):
130         * resources/sunspider-compare-results.js:
131         (.formatMean):
132         (.resultLine):
133         (.printOutput):
134         (sunspiderCompareResults):
135         * resources/sunspider-standalone-driver.js:
136         * tests/sunspider-1.0/3d-cube.js:
137         (Init):
138         * tests/sunspider-1.0/3d-morph.js:
139         * tests/sunspider-1.0/3d-raytrace.js:
140         * tests/sunspider-1.0/access-binary-trees.js:
141         * tests/sunspider-1.0/access-fannkuch.js:
142         * tests/sunspider-1.0/access-nbody.js:
143         * tests/sunspider-1.0/access-nsieve.js:
144         (sieve):
145         * tests/sunspider-1.0/bitops-3bit-bits-in-byte.js:
146         * tests/sunspider-1.0/bitops-bits-in-byte.js:
147         * tests/sunspider-1.0/bitops-bitwise-and.js:
148         * tests/sunspider-1.0/bitops-nsieve-bits.js:
149         * tests/sunspider-1.0/controlflow-recursive.js:
150         * tests/sunspider-1.0/crypto-aes.js:
151         * tests/sunspider-1.0/crypto-md5.js:
152         * tests/sunspider-1.0/crypto-sha1.js:
153         * tests/sunspider-1.0/date-format-tofte.js:
154         * tests/sunspider-1.0/date-format-xparb.js:
155         * tests/sunspider-1.0/math-cordic.js:
156         * tests/sunspider-1.0/math-partial-sums.js:
157         (partial):
158         * tests/sunspider-1.0/math-spectral-norm.js:
159         * tests/sunspider-1.0/regexp-dna.js:
160         * tests/sunspider-1.0/string-base64.js:
161         * tests/sunspider-1.0/string-fasta.js:
162         (fastaRepeat):
163         (fastaRandom):
164         * tests/sunspider-1.0/string-tagcloud.js:
165         * tests/sunspider-1.0/string-unpack-code.js:
166         * tests/sunspider-1.0/string-validate-input.js:
167
168 2013-04-11  Filip Pizlo  <fpizlo@apple.com>
169
170         Get rid of the 10ms delay between test executions
171         https://bugs.webkit.org/show_bug.cgi?id=114458
172         <rdar://problem/13631112>
173
174         Reviewed by Darin Adler and Geoffrey Garen.
175         
176         More details on this in the bug. Long story short, I don't know why the 10ms delay is
177         there, and it appears to be the root of some noisyness and unreliability in the results.
178         Removing it makes results more consistent, which is a good thing.
179
180         * resources/driver-TEMPLATE.html:
181
182 2013-01-16  Eric Seidel  <eric@webkit.org>
183
184         Remove --shark* support from sunspider/run-sunspider now that Shark is dead
185         https://bugs.webkit.org/show_bug.cgi?id=99512
186
187         Reviewed by Darin Adler.
188
189         I tried to use --instruments, but that also seems broken (in the same way before/after this patch).
190
191         * sunspider:
192         (runTestsOnce):
193
194 2012-08-02  Filip Pizlo  <fpizlo@apple.com>
195
196         Unreviewed, revert debugging stuff I landed in http://trac.webkit.org/changeset/124557
197         by accident.
198
199         * tests/v8-v6/v8-crypto.js:
200         (am1):
201         (am2):
202         (am3):
203         (am4):
204         (bnpCopyTo):
205         (bnpFromString):
206         (bnpClamp):
207
208 2012-03-11  Maciej Stachowiak  <mjs@apple.com>
209
210         Add --instruments option to sunspider to profile with Instruments
211         https://bugs.webkit.org/show_bug.cgi?id=80783
212
213         Reviewed by Filip Pizlo.
214
215         * resources/TimeProfile20us.tracetemplate: Added.
216         * sunspider:
217         (runTestsOnce):
218
219 2011-11-15  Andy Wingo  <wingo@igalia.com>
220
221         Extend sunspider driver to be able to run kraken
222         https://bugs.webkit.org/show_bug.cgi?id=71799
223
224         Reviewed by Filip Pizlo.
225
226         * resources/sunspider-standalone-driver.js: Try to load a -data
227         file.  If that succeeds, we have a kraken-like test, so we time
228         the test using `load'.  Otherwise fall back to using `run'.
229
230 2011-08-11  Mark Rowe  <mrowe@apple.com>
231
232         Fix sunspider-compare-results to default to the same suite version as the sunspider script.
233
234         Rubber-stamped by Maciej Stachowiak.
235
236         * sunspider-compare-results:
237
238 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
239
240         Update SunSpider versioning to 1.0
241         https://bugs.webkit.org/show_bug.cgi?id=63870
242
243         Reviewed by Dan Bernstein.
244
245         * hosted/sunspider.html:
246         * hosted/versions.html:
247         * resources/driver-TEMPLATE.html:
248         * resources/results-TEMPLATE.html:
249         * sunspider:
250
251 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
252
253         Sunspider 0.9.1 harness doesn't actually close() its test documents
254         https://bugs.webkit.org/show_bug.cgi?id=47045
255
256         Reviewed by Daniel Bates.
257
258         * hosted/versions.html:
259         * resources/driver-TEMPLATE.html:
260
261 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
262
263         Not Reviewed. 
264         
265         Fix obviou typo in previous commit.
266
267         * tests/sunspider-1.0/bitops-bitwise-and.js:
268
269 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
270
271         Reviewed by Anders Carlsson.
272
273         SunSpider: all four bitops benchmarks can be replaced with NOP
274         https://bugs.webkit.org/show_bug.cgi?id=38446
275
276         * tests/sunspider-1.0/bitops-3bit-bits-in-byte.js:
277         (TimeFunc): Save the result.
278         * tests/sunspider-1.0/bitops-bits-in-byte.js:
279         (TimeFunc): Save the result.
280         * tests/sunspider-1.0/bitops-bitwise-and.js: More explicitly
281         save the results.
282         * tests/sunspider-1.0/bitops-nsieve-bits.js:
283         (sieve): Save the result.
284
285 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
286
287         SunSpider: string-validate-input.js uses an undeclared variable named 'name', which is a DOM API
288         https://bugs.webkit.org/show_bug.cgi?id=60937
289
290         Reviewed by Dan Bernstein.
291
292         * tests/sunspider-1.0/string-validate-input.js:
293         (doTest): Rename the variable to username
294
295 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
296
297         Reviewed by Darin Adler.
298
299         SunSpider: The main function of math-cordic is dead code
300         https://bugs.webkit.org/show_bug.cgi?id=63863
301         
302         Try to prevent math-cordic from being eliminated as dead code or
303         compiled down to a constant.
304
305         * tests/sunspider-1.0/math-cordic.js:
306         (cordicsincos):
307         (cordic):
308
309 2011-06-30  Maciej Stachowiak  <mjs@apple.com>
310
311         Reviewed by Adam Barth.
312
313         Create sunspider-1.0 directory in preparation for fixing a bunch of bugs
314         https://bugs.webkit.org/show_bug.cgi?id=63782
315
316         * make-hosted: Learn about the new directory.
317         * tests/sunspider-1.0: Copied from PerformanceTests/SunSpider/tests/sunspider-0.9.1.
318
319 2010-11-29  Geoffrey Garen  <ggaren@apple.com>
320
321         Reviewed by Gavin Barraclough.
322
323         Improved accuracy of command-line SunSpider.
324
325         * resources/sunspider-standalone-driver.js: Use the returned number of
326         elapsed milliseconds from "run" and "checkSyntax" instead of measuring
327         ourselves, for slightly more accurate numbers.
328
329 2010-09-16  Gavin Barraclough  <barraclough@apple.com>
330
331         Reviewed by Mark Rowe.
332         https://bugs.webkit.org/show_bug.cgi?id=45924
333
334         Modify the SunSpider harness to allow a path to be passed to the --suite
335         argument, supress the normal prepend-"tests/" behaviour for suite names
336         containing a '/'.
337
338         Also wrap the code in an anonymous function to move variables out of global
339         scope (currently the harness cannot handle running tests the overwrite the
340         variable 'j').
341
342         * resources/sunspider-standalone-driver.js:
343         * sunspider:
344
345 2010-08-27  Michael Saboff  <msaboff@apple.com>
346
347         Reviewed by Stephanie Lewis.
348
349         Added version 5 and version 6 of V8 tests with modifications similar
350         to the version 4 tests so they'll work with the SunSpider test harness.
351         Note that these files are external source and therefore don't conform 
352         to WebKit coding standards.
353         https://bugs.webkit.org/show_bug.cgi?id=44638
354
355         * tests/v8-v5: Added.
356         * tests/v8-v5/LIST: Added.
357         * tests/v8-v5/v8-crypto.js: Added.
358         * tests/v8-v5/v8-deltablue.js: Added.
359         * tests/v8-v5/v8-earley-boyer.js: Added.
360         * tests/v8-v5/v8-raytrace.js: Added.
361         * tests/v8-v5/v8-regexp.js: Added.
362         * tests/v8-v5/v8-richards.js: Added.
363         * tests/v8-v5/v8-splay.js: Added.
364         * tests/v8-v6: Added.
365         * tests/v8-v6/LIST: Added.
366         * tests/v8-v6/v8-crypto.js: Added.
367         * tests/v8-v6/v8-deltablue.js: Added.
368         * tests/v8-v6/v8-earley-boyer.js: Added.
369         * tests/v8-v6/v8-raytrace.js: Added.
370         * tests/v8-v6/v8-regexp.js: Added.
371         * tests/v8-v6/v8-richards.js: Added.
372         * tests/v8-v6/v8-splay.js: Added.
373
374 2010-07-15  Stephanie Lewis  <slewis@apple.com>
375
376         Reviewed by Geoff Garen.
377
378         http://bugs.webkit.org/show_bug.cgi?id=42406
379         Output location of results file.
380
381         * sunspider:
382
383 2010-05-17  Maciej Stachowiak  <mjs@apple.com>
384
385         Reviewed by Mark Rowe.
386
387         Browser-hosted version of SunSpider runs tests twice as many times as advertised
388         https://bugs.webkit.org/show_bug.cgi?id=39201
389
390         * make-hosted: Make sure to reset test list after every test suite.
391
392 2010-05-07  Adam Roben  <aroben@apple.com>
393
394         Fix typo in sunspider-compare-results.js that caused incorrect
395         two-sample t statistics to be computed
396
397         Fixes <http://webkit.org/b/38768> SunSpider computes incorrect
398         two-sample t statistics
399
400         Reviewed by Darin Adler.
401
402         * resources/sunspider-compare-results.js:
403         (sunspiderCompareResults.resultLine): Fixed the calculation of the t
404         variable to match the definition of a two-sample t statistic. Looks
405         like this was just a simple typo.
406
407 2010-04-05  Darin Adler  <darin@apple.com>
408
409         Updated the ignore property for changes to the contents here.
410
411         * .: Modified property svn:ignore.
412
413 2010-02-20  Maciej Stachowiak  <mjs@apple.com>
414
415         Reviewed by Adam Barth.
416
417         Add sunspider-0.9.1 to the site in preparation for announcing it.
418         https://bugs.webkit.org/show_bug.cgi?id=35206
419
420         * hosted/sunspider.css: Remove tabs, which I noticed where present while
421         copying to the WebKitSite directory.
422
423 2010-01-11  Oliver Hunt  <oliver@apple.com>
424
425         Reviewed by Darin Adler.
426
427         Sunspider parse-only tests don't run
428         https://bugs.webkit.org/show_bug.cgi?id=33489
429
430         Fix parse-only test list
431
432         * tests/parse-only/LIST:
433
434 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
435
436         Reviewed by Adele Peterson.
437
438         Make SunSpider version more prominent in the title
439         https://bugs.webkit.org/show_bug.cgi?id=32574
440
441         * hosted/sunspider.html:
442         * hosted/versions.html:
443         * resources/driver-TEMPLATE.html:
444         * resources/results-TEMPLATE.html:
445
446 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
447
448         Reviewed by Darin Adler.
449
450         Make SunSpider refuse to compare results across content versions
451         https://bugs.webkit.org/show_bug.cgi?id=32573
452         
453         The results URL now includes a version indicator, and compare mode
454         will refuse to compare between versions.
455
456         * resources/driver-TEMPLATE.html:
457         * resources/results-TEMPLATE.html:
458
459 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
460
461         Reviewed by Darin Adler.
462
463         Some Browser-hosted SunSpider files are not valid HTML5
464         https://bugs.webkit.org/show_bug.cgi?id=32536
465         
466         Made various fixes to validate as HTML5 with no warnings (mainly removing bogus
467         close tags and adding a meta charset declaration).
468
469         * hosted/sunspider.html:
470         * hosted/versions.html:
471         * resources/TEMPLATE.html:
472         * resources/driver-TEMPLATE.html:
473         * resources/results-TEMPLATE.html:
474
475 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
476
477         Reviewed by Eric Seidel.
478
479         Make sunspider-0.9.1 the default content set (both command-line and hosted)
480         https://bugs.webkit.org/show_bug.cgi?id=32537
481
482         * hosted/sunspider.html: Change default suite link.
483         * sunspider: Change default suite.
484         * sunspider-compare-results: Likewise.
485
486 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
487
488         Reviewed by Sam Weinig.
489
490         in-browser SunSpider suffers excessive penalty under power management
491         https://bugs.webkit.org/show_bug.cgi?id=32505
492         
493         I have made a few changes to address this:
494         
495         1) Change how browser-hosted SunSpider loads tests - preload the content and write it in with
496         document.write to reduce triggering of progress UI.
497         2) Reduce time between tests to 10ms from 500ms, so that power management doesn't keep the CPU
498         stepped all the way down the whole time.
499         3) Run the test cycle an extra time for warmup before the runs that count.
500
501         * hosted/sunspider-record-result.js: Removed.
502         * make-hosted:
503         * resources/TEMPLATE.html:
504         * resources/driver-TEMPLATE.html:
505
506 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
507
508         Reviewed by Gavin Barraclough.
509
510         SunSpider/tests/string-base64.js does not compute a valid base64 encoded string
511         https://bugs.webkit.org/show_bug.cgi?id=16806
512
513         Based on a patch by Eric Seidel.
514         
515         Fix the base64 computation to actually compute correct results. The impact on runtime of
516         the test is pretty small, but noticeable for some browsers. But at least it's not
517         doing a wrong and meaningless computation any more.
518         
519         * tests/sunspider-0.9.1/string-base64.js:
520         ():
521         (base64ToString):
522
523 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
524
525         Fixing commit error...
526         
527         I accidentally committed my last patch in a form that broke Web-hosted SunSpider. Fixing.
528
529         * resources/driver-TEMPLATE.html:
530
531 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
532
533         Reviewed by Sam Weinig.
534
535         Use JSON.parse instead of eval for Web-hosted SunSpider results processing
536         https://bugs.webkit.org/show_bug.cgi?id=32490
537
538         * hosted/json2.js: Added. Incorporated from json.org
539         * resources/driver-TEMPLATE.html: Fix an HTML validation bug I noticed.
540         * resources/results-TEMPLATE.html: Use JSON.parse instead of eval to process
541         results.
542
543 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
544
545         Reviewed by Oliver Hunt.
546
547         Enable Web-hosted version of SunSpider to handle multiple versions
548         https://bugs.webkit.org/show_bug.cgi?id=32478
549
550         * make-hosted: Now generate the hosted version to be able to run both the
551         0.9 and the 0.9.1 test suites.
552         * hosted: Modified property svn:ignore.
553         * hosted/sunspider-driver.html: Removed.
554         * hosted/sunspider-results.html: Removed.
555         * hosted/sunspider.html:
556         * hosted/versions.html: Added.
557         * resources/TEMPLATE.html:
558         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-driver.html.
559         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-results.html.
560
561 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
562
563         Reviewed by Oliver Hunt.
564
565         Give command-line sunspider the ability to handle multiple suites and versions
566         https://bugs.webkit.org/show_bug.cgi?id=32477
567         
568         Each suite/version's set of tests are now in a separate subdirectory of tests/, with a file named LIST
569         enumerating the tests. Current suites are:
570         
571         sunspider-0.9 - riginal SunSpider content 
572         sunspider-0.9.1 - SunSpider suite with a few tests fixed (and a few more to come)
573         ubench - "ubench" microbenchmark suite
574         v8-v4 - version 4 of the v8 benchmark
575         parse-only - some parser tests
576         
577         Sunspider can now be run with the --suite= parameter to select a
578         suite. The default is --suite=sunspider-0.9.
579
580         * .: Modified property svn:ignore to ignore new results directories.
581         * make-hosted: Generate based on sunspider-0.9 suite.
582         * resources/TEMPLATE.html: Fix an HTML compliance problem.
583         * resources/sunspider-standalone-driver.js: Become aware of suite names.
584         * sunspider: Modified to handle multiple suites as described above.
585         * sunspider-compare-results: ditto
586         * tests/LIST: Moved to tests/sunspider-0.9/ and tests/sunspider-0.9.1/
587         * tests/LIST-PARSE-ONLY: Moved to parse-only/LIST
588         * tests/LIST-UBENCH: Removed.
589         * tests/LIST-V8: Removed.
590         * tests/3d-cube.js: Moved to tests/sunspider-0.9 and tests/sunspider-0.9.1
591         * tests/3d-morph.js: ditto
592         * tests/3d-raytrace.js: ditto
593         * tests/access-binary-trees.js: ditto
594         * tests/access-fannkuch.js: ditto
595         * tests/access-nbody.js: ditto
596         * tests/access-nsieve.js: ditto
597         * tests/bitops-3bit-bits-in-byte.js: ditto
598         * tests/bitops-bits-in-byte.js: ditto
599         * tests/bitops-bitwise-and.js: ditto
600         * tests/bitops-nsieve-bits.js: ditto
601         * tests/controlflow-recursive.js: ditto
602         * tests/crypto-aes.js: ditto
603         * tests/crypto-md5.js: ditto
604         * tests/crypto-sha1.js: ditto
605         * tests/date-format-tofte.js: ditto
606         * tests/date-format-xparb.js: ditto
607         * tests/math-cordic.js: ditto
608         * tests/math-partial-sums.js: ditto
609         * tests/math-spectral-norm.js: ditto
610         * tests/regexp-dna.js: ditto
611         * tests/string-base64.js: ditto
612         * tests/string-fasta.js: ditto
613         * tests/string-tagcloud.js: ditto
614         * tests/string-unpack-code.js: ditto
615         * tests/string-validate-input.js: ditto
616         * tests/sunspider-0.9/: Added
617         * tests/sunspider-0.9/*.js: Moved from one level up
618         * tests/sunspider-0.9.1: Added.
619         * tests/sunspider-0.9.1/*.js: Moved from one level up.
620         * tests/v8-crypto.js: Moved to v8-v4/ directory.
621         * tests/v8-deltablue.js: ditto
622         * tests/v8-earley-boyer.js: ditto
623         * tests/v8-raytrace.js: ditto
624         * tests/v8-regexp.js: ditto
625         * tests/v8-richards.js: ditto
626         * tests/v8-splay.js: ditto
627         * tests/v8-v4: Added.
628
629 2009-09-30  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
630
631         Reviewed by Darin Adler.
632
633         Platform specific null device replaced with a platform independent.
634         https://bugs.webkit.org/show_bug.cgi?id=29544
635
636         * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL.
637
638 2009-09-21  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
639
640         Reviewed by Maciej Stachowiak.
641
642         [Qt] Make sunspider script work on Windows platform.
643         https://bugs.webkit.org/show_bug.cgi?id=29544
644
645         * sunspider:
646         Using platform specific null device instead of /dev/null.
647
648 2009-06-19  Adam Treat  <adam.treat@torchmobile.com>
649
650         Reviewed by Oliver Hunt.
651
652         https://bugs.webkit.org/show_bug.cgi?id=26540
653         Currently the SunSpider test driver lacks an option to run a test suite that
654         will test JavaScriptCore parsing performance only.  This patch adds just such
655         a test suite and option to SunSpider as well as the jsc test shell.  I've included
656         three large javascript source files found in the wild: jquery, mootools and prototype.
657         Combined with the concatenation of all three, these form a new testsuite to measure
658         and test pure JavaScriptCore parsing performance.
659
660         * resources/sunspider-standalone-driver.js:
661           Load the js with parse-only flag if it is part of the parse-only suite.
662         * sunspider:
663           Add the parse-only suite to the list of options.
664         * sunspider-compare-results:
665           Add the parse-only suite to the list of options.
666         * tests/LIST-PARSE-ONLY: Added.
667         * tests/parse-only/concat-jquery-mootools-prototype.js: Added.
668           A very large concatenation of the scripts found below.  This js takes ~30ms to parse on my machine.
669         * tests/parse-only/jquery-1.3.2.js: Added.
670           Latest version from jquery.com.
671         * tests/parse-only/mootools-1.2.2-core-nc.js: Added.
672           Latest version from mootools.net.
673         * tests/parse-only/prototype-1.6.0.3.js: Added.
674           Latest version from prototypejs.org.
675
676 2009-06-13  Steve Falkenburg  <sfalken@apple.com>
677
678         Update V8 benchmark to version 4.
679         
680         Reviewed by Cameron Zwarich.
681
682         * tests/LIST-V8:
683         * tests/v8-crypto.js:
684         * tests/v8-deltablue.js:
685         * tests/v8-earley-boyer.js:
686         * tests/v8-raytrace.js:
687         * tests/v8-regexp.js: Added.
688         * tests/v8-richards.js:
689         * tests/v8-splay.js: Added.
690
691 2009-05-26  Olivier DOLE  <odole@pleyo.com>
692
693         Reviewed by Maciej.
694
695         Store sunspider test suite results in a specific directory for each
696         different type of benchmark (sunspider, V8 or ubench).
697
698         * sunspider:
699         * sunspider-compare-results:
700
701 2009-05-12  Steve Falkenburg  <sfalken@apple.com>
702
703         Build fix.
704
705         * SunSpider.make:
706
707 2009-05-11  Steve Falkenburg  <sfalken@apple.com>
708
709         Include SunSpider tests in production builds.
710         
711         Reviewed by Adam Roben.
712
713         * SunSpider.make: Added.
714         * xcopy.excludes: Added.
715
716 2009-03-04  Oliver Hunt  <oliver@apple.com>
717
718         Added a few more tests to ubench
719
720         RS=Gavin Barraclough
721
722         Adding a couple of test to cover too few and too many arguments.  This
723         is needed to prevent regressions in all call paths from my current refactoring.
724
725         * tests/LIST-UBENCH:
726         * tests/ubench/function-correct-args.js: Added.
727         (f):
728         * tests/ubench/function-excess-args.js: Added.
729         (f):
730
731 2008-10-30  Zoltan Horvath  <Horvath.Zoltan.6@stud.u-szeged.hu>
732
733         Fix a bug where when V8's or UBENCH's test suite list file is missing
734         the error message is suggesting that SunSpider's list file is missing.
735
736         Reviewed by Sam Weinig.
737
738         * sunspider:
739         (loadTestsList): Fix the error message to use the right list name.
740
741 2008-10-07  David Hyatt  <hyatt@apple.com>
742
743         https://bugs.webkit.org/show_bug.cgi?id=18989
744
745         Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
746         we want all browsers to be doing the same thing on the test.
747
748         Reviewed by Maciej
749
750         * tests/regexp-dna.js:
751
752 2008-09-09  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
753
754         Rubber-stamped by Maciej Stachowiak.
755
756         The bleeding edge branch of V8 now supports passing fileanmes after
757         '-f', so the SunSpider script should be changed to do this again.
758         This allows all 3 major JavaScript engines to be used with the
759         unmodified SunSpider script.
760
761         * sunspider:
762
763 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
764
765         Reviewed by Maciej Stachowiak.
766
767         Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
768         and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
769         correct the punctuation in its documentation.
770
771         * sunspider:
772
773 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
774
775         Reviewed by Oliver Hunt.
776
777         Bug 20616: Incorporate V8 benchmarks in testing
778         <https://bugs.webkit.org/show_bug.cgi?id=20616>
779
780         This is a first attempt at running the V8 benchmarks within SunSpider,
781         with the --v8 option. The number of iterations is fixed for each
782         benchmark, and was chosen to make each of the benchmarks run between
783         500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
784
785         * sunspider:
786         * tests/LIST-V8: Added.
787         * tests/v8-crypto.js: Added.
788         * tests/v8-deltablue.js: Added.
789         * tests/v8-earley-boyer.js: Added.
790         * tests/v8-raytrace.js: Added.
791         * tests/v8-richards.js: Added.
792
793 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
794
795         Not reviewed.
796
797         Remove a local change that was accidentally committed in r36034.
798
799         * resources/sunspider-standalone-driver.js:
800
801 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
802
803         Rubber-stamped by Oliver Hunt.
804
805         Make SunSpider work with JavaScript shells that don't take filenames
806         after a '-f' argument.
807
808         * sunspider:
809
810 2008-06-07  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
811
812         Reviewed by Timothy.
813
814         Remove the --squirrelfish option from SunSpider, as it is no longer needed.
815
816         * sunspider:
817         * tests/LIST-SQUIRRELFISH: Removed.
818
819 2008-06-03  Alexey Proskuryakov  <ap@webkit.org>
820
821         Rubber-stamped by Mark Rowe.
822
823         Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
824
825         * sunspider:
826
827 2008-04-15  Maciej Stachowiak  <mjs@apple.com>
828
829         Rubber stamped by Oliver.
830         
831         - add newly working tests to squirrelfish list
832
833         * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
834
835 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
836
837         Rubber stamped by Oliver.
838         
839         - move ubench tests properly.
840
841         * tests/ubench: Added.
842         * tests/ubench/function-closure.js: Added.
843         * tests/ubench/function-empty.js: Added.
844         * tests/ubench/function-missing-args.js: Added.
845         * tests/ubench/function-sum.js: Added.
846         * tests/ubench/loop-empty-resolve.js: Added.
847         * tests/ubench/loop-empty.js: Added.
848         * tests/ubench/loop-sum.js: Added.
849
850 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
851
852         Rubber stamped by Oliver.
853
854         * sunspider: Don't force --runs=1 in squirrelfish mode any more.
855
856 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
857
858         Reviewed by Oliver.
859
860         - make --squirrelfish mode use the real harness, but a reduced set of tests
861
862         Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
863
864         * sunspider:
865         * tests/LIST-SQUIRRELFISH:
866         * tests/LIST-UBENCH: Added.
867         * tests/squirrelfish: Moved to tests/ubench
868
869 2008-04-14  Geoffrey Garen  <ggaren@apple.com>
870
871         Reviewed by Maciej Stachowiak.
872         
873         Removed an unused test.
874
875         * tests/squirrelfish/loop-resolve.js: Removed.
876
877 2008-04-10  Maciej Stachowiak  <mjs@apple.com>
878
879         Reviewed by Oliver.
880         
881         Add newly runnable tests to --squirrelfish mode.
882
883         * tests/LIST-SQUIRRELFISH:
884
885 2008-04-06  Geoffrey Garen  <ggaren@apple.com>
886
887         Reviewed by Maciej Stachowiak.
888         
889         A little more love for --squirrelfish mode:
890         
891         Fixed a misplaced sort. Results properly sort now.
892         
893         Added a test list just for squirrelfish, and updated it to include
894         all currently passing SunSpider tests.
895         
896         Fixed the pruning regexp to match 3d-morph.js.
897
898         * sunspider:
899
900 2008-03-26  Geoffrey Garen  <ggaren@apple.com>
901
902         Reviewed by Oliver Hunt.
903         
904         --squirrelfish mode: pared down tests for squirrelfish to chew on.
905
906         * sunspider:
907         * tests/LIST:
908         * tests/squirrelfish: Added.
909         * tests/squirrelfish/function-closure.js: Added.
910         * tests/squirrelfish/function-empty.js: Added.
911         * tests/squirrelfish/function-missing-args.js: Added.
912         * tests/squirrelfish/function-sum.js: Added.
913         * tests/squirrelfish/loop-empty-resolve.js: Added.
914         * tests/squirrelfish/loop-empty.js: Added.
915         * tests/squirrelfish/loop-resolve.js: Added.
916         * tests/squirrelfish/loop-sum.js: Added.
917
918 2008-03-21  Alexey Proskuryakov  <ap@webkit.org>
919
920         Reviewed by Geoff.
921
922         * sunspider: Pause update daemon on Darwin to make results reliable
923         again (workaround for <rdar://problem/5811127>).
924
925 2008-02-07  Eric Seidel  <eric@webkit.org>
926
927         Reviewed by Sam.
928
929         * sunspider: add an error message when ./tests/LIST is not found
930
931 2007-12-29  Alp Toker  <alp@atoker.com>
932
933         Fix typo.
934
935         * hosted/sunspider.html:
936
937 2007-12-29  Alp Toker  <alp@atoker.com>
938
939         Reviewed by Maciej.
940
941         Provide the current URL in the SunSpider results page. Useful for
942         copying benchmark results out of browsers without a location bar or
943         where the location bar can't handle long URLs.
944
945         * hosted/sunspider-results.html:
946
947 2007-12-20  Eric Seidel  <eric@webkit.org>
948
949         Reviewed by mjs.
950
951         * sunspider: increase default number of runs for more accurate numbers
952
953 2007-12-18  Mark Rowe  <mrowe@apple.com>
954
955         Fix typo.
956
957         * hosted/sunspider.html:
958
959 2007-12-18  Maciej Stachowiak  <mjs@apple.com>
960
961         Reviewed by Eric.
962         
963         - give an extra digit of precision for small differences.
964
965         * resources/sunspider-compare-results.js:
966
967 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
968
969         Reviewed by Eric.
970         
971         - work around IE layout bugs
972
973         * hosted/sunspider.css:
974
975 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
976
977         Reviewed by Mark.
978         
979         - fix compare feature
980
981         * hosted/sunspider-results.html:
982
983 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
984
985         Reviewed by Mark.
986         
987         - Change the format of the output URL to be shorter, to meet IE constraints
988
989         * hosted/sunspider-driver.html:
990         * hosted/sunspider-results.html:
991
992 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
993
994         Reviewed by Oliver.
995         
996         - Add some explanatory test and a dumb logo to SunSpider web hosted version
997
998         * hosted/sunspider-driver.html:
999         * hosted/sunspider-results.html:
1000         * hosted/sunspider.css:
1001         * hosted/sunspider.html:
1002
1003 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
1004
1005         Reviewed by Oliver.
1006         
1007         - Make the web-hosted version of SunSpider look a little bit less drab.
1008
1009         * hosted/sunspider-driver.html:
1010         * hosted/sunspider-results.html:
1011         * hosted/sunspider.css: Added.
1012         * hosted/sunspider.html:
1013         * resources/TEMPLATE.html:
1014
1015 2007-12-12  Maciej Stachowiak  <mjs@apple.com>
1016
1017         Reviewed by Sam.
1018         
1019         - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
1020         
1021         A sample of what new-style results would look like:
1022         
1023         TEST                   COMPARISON            FROM                 TO             DETAILS
1024         ...
1025         ** TOTAL **:           1.41x as fast     6613.6ms +/- 0.1%   4703.0ms +/- 0.1%     significant
1026         ...
1027             3bit-bits-in-byte: *1.36x as slow*     88.8ms +/- 0.6%    121.1ms +/- 0.6%     significant
1028         
1029         * resources/sunspider-compare-results.js:
1030
1031 2007-11-14  Eric Seidel  <eric@webkit.org>
1032
1033         Reviewed by Sam.
1034
1035         * sunspider: add --shark-cache for L2 Cache Miss profiling
1036
1037 2007-11-09  Alexey Proskuryakov  <ap@webkit.org>
1038
1039         Reviewed by Darin Adler.
1040
1041         http://bugs.webkit.org/show_bug.cgi?id=15925
1042         SunSpider should check for Shark being installed
1043
1044         * sunspider: Explicitly test that shark command line tool is installed.
1045
1046 2007-11-04  Darin Adler  <darin@apple.com>
1047
1048         * hosted/sunspider.html: Tweaked formatting a bit.
1049
1050 2007-11-03  Maciej Stachowiak  <mjs@apple.com>
1051
1052         Reviewed by Darin Adler.
1053
1054         - Add compare mode and a description of the benchmark to the hosted version.
1055
1056         * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
1057         * hosted/sunspider.html: Added intro text.
1058         * make-hosted: Copy new file.
1059         * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
1060         a function.
1061         * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
1062         expects.
1063         * sunspider-compare-results: Use sunspider-standalone-compare.js.
1064
1065 2007-11-02  Darin Adler  <darin@apple.com>
1066
1067         * sunspider: Changed "--base" to "--set-baseline".
1068
1069 2007-11-02  Darin Adler  <darin@apple.com>
1070
1071         Reviewed by Maciej.
1072
1073         * sunspider: Added a "--base" option that records the current test as a baseline.
1074         Moved the code to find the newest .mshark file into a function (since I needed to use
1075         it in the other script and I prefer to copy/paste a function).
1076
1077         * sunspider-compare-results: Added logic to compare the baseline with the last
1078         run when you don't pass any parameters.
1079
1080 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1081
1082         Reviewed by Eric.
1083         
1084         - Added list of ECMAScript3 features that SunSpider does not cover currently.
1085
1086         * UNCOVERED: Added.
1087
1088 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1089
1090         Reviewed by Oliver.
1091         
1092         - Give better error messages when sunspider-compare-results fails
1093
1094         * sunspider-compare-results:
1095
1096 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1097
1098         Reviewed by Darin Adler.
1099         
1100         - fix Date tests to work in command-line SpiderMonkey
1101
1102         * tests/date-format-tofte.js:
1103         * tests/date-format-xparb.js:
1104
1105 2007-10-29  Darin Adler  <darin@apple.com>
1106
1107         Reviewed by Maciej.
1108
1109         * sunspider: Added --shark20 option, to run Shark at its highest sample
1110         resolution instead of its default.
1111
1112 2007-10-28  Adam Roben  <aroben@apple.com>
1113
1114         Fix SunSpider on Windows
1115
1116         Reviewed by Eric.
1117
1118         * sunspider: Don't use colons in filenames.
1119
1120 2007-10-28  Darin Adler  <darin@apple.com>
1121
1122         Reviewed by Adam.
1123
1124         * resources/sunspider-analyze-results.js: Tweak the output format a little.
1125         Change so that when there's only one run we don't write out confidence
1126         intervals at all rather than writing "NaN" over and over again.
1127
1128         * sunspider: Use the time and date as a suffix on the results file, that way
1129         all the results are left behind in the tmp directory. This will make it easy
1130         for us to add features that compare past results in the future. Also rename
1131         the .mshark files using the same scheme.
1132
1133         * sunspider-compare-results: Relax the parsing rules so we can parse the
1134         results file exactly as it's emitted from sunspider.
1135
1136 2007-10-25  Adam Roben  <aroben@apple.com>
1137
1138         Strip carriage returns from results
1139
1140         Carriage returns were screwing up sunspider-compare-results on
1141         Windows.
1142
1143         Rubberstamped by Oliver.
1144
1145         * sunspider:
1146
1147 2007-10-24  Darin Adler  <darin@apple.com>
1148
1149         Reviewed by Eric.
1150
1151         * sunspider: Open the profile in shark after completing a run.
1152         * sunspider-compare-results: Tiny perl tweaks.
1153
1154 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1155
1156         Reviewed by Darin Adler.
1157
1158         - Don't hardcode my path to testkjs
1159         
1160         * sunspider-compare-results:
1161
1162 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1163
1164         Reviewed by Darin Adler.
1165         
1166         - Add a compare script to compare results, and improve formatting of standard results a bit.
1167
1168         * resources/sunspider-analyze-results.js:
1169         * resources/sunspider-compare-results.js: Added.
1170         * sunspider-compare-results: Added.
1171
1172 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1173
1174         Reviewed by Darin Adler.
1175
1176         * resources/sunspider-analyze-results.js: Do the error range
1177         properly, using the t-distribution instead of 1.96 (which was
1178         based on the normal distribution).
1179         
1180         * sunspider: Print results in a way that will be friendlier to the
1181         soon-to-come compare mode.
1182
1183 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
1184
1185         Reviewed by Review.
1186         
1187         - add more tests (probably the final set for now)
1188         
1189         Already balanced. Added date, regexp, control flow, and a few
1190         more string and object/array access tests.
1191         
1192         * tests/LIST:
1193         * tests/access-fannkuch.js: Added.
1194         * tests/access-nbody.js: Added.
1195         * tests/controlflow-recursive.js: Added.
1196         * tests/date-format-tofte.js: Added.
1197         * tests/date-format-xparb.js: Added.
1198         * tests/regexp-dna.js: Added.
1199         * tests/string-validate-input.js: Added.
1200
1201 2007-10-21  Eric Seidel  <eric@webkit.org>
1202
1203         Reviewed by mjs.
1204
1205         * sunspider: make --shark only sample from testkjs
1206
1207 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
1208
1209         Rubber stamped by Eric.
1210         
1211         - added crypto tests (already balanced)
1212
1213         * tests/LIST:
1214         * tests/crypto-aes.js: Added.
1215         * tests/crypto-md5.js: Added.
1216         * tests/crypto-sha1.js: Added.
1217
1218 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
1219
1220         Reviewed by Adam.
1221         
1222         - rebalance new tests
1223         
1224         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
1225         
1226         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1227
1228         This balances them with the existing tests.
1229
1230         * tests/access-binary-trees.js:
1231         * tests/access-nsieve.js:
1232         * tests/bitops-nsieve-bits.js:
1233         * tests/math-partial-sums.js:
1234         * tests/math-spectral-norm.js:
1235         * tests/string-fasta.js:
1236
1237 2007-10-20  Eric Seidel  <eric@webkit.org>
1238
1239         Reviewed by darin.
1240         
1241         Add improved argument handling to sunspider, including
1242         --runs=<number>, --tests=<pattern, --shark, and --help
1243         Also re-factor code into subroutines
1244
1245         * sunspider: improved argument handling
1246
1247 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1248
1249         Reviewed by Mark.
1250
1251         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
1252         
1253         * TODO:
1254         * tests/LIST:
1255         * tests/access-binary-trees.js: Added.
1256         * tests/access-nsieve.js: Added.
1257         * tests/bitops-nsieve-bits.js: Added.
1258         * tests/math-partial-sums.js: Added.
1259         * tests/math-spectral-norm.js: Added.
1260         * tests/string-fasta.js: Added.
1261
1262 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1263
1264         Reviewed by Darin Adler.
1265
1266         * TODO: Updated to note areas that are now well-covered.
1267         
1268         - Change the tests and the driver to avoid leaving large object
1269         graphs hanging around, since that throws off the subsequent tests.
1270         
1271         * resources/sunspider-standalone-driver.js:
1272         * tests/3d-cube.js:
1273         * tests/3d-morph.js:
1274         * tests/3d-raytrace.js:
1275         * tests/bitops-bitwise-and.js:
1276         * tests/string-base64.js:
1277         * tests/string-tagcloud.js:
1278
1279 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1280
1281         Reviewed by Nikolas.
1282         
1283         - Rebalance test complexity.
1284         
1285         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
1286         
1287         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1288
1289         However, for some tests, IE7 was a huge outlier compared to other
1290         major browsers. For those tests, I used Firefox 2.0.0.8 on the
1291         same OS and hardware as a normalization basis.
1292         
1293         * tests/3d-morph.js:
1294         * tests/3d-raytrace.js:
1295         * tests/bitops-3bit-bits-in-byte.js:
1296         * tests/bitops-bits-in-byte.js:
1297         * tests/bitops-bitwise-and.js:
1298         * tests/math-cordic.js:
1299         * tests/string-base64.js:
1300         * tests/string-tagcloud.js:
1301         * tests/string-unpack-code.js:
1302
1303 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1304
1305         Reviewed by Oliver.
1306         
1307         - Fix the browser-hosted driver to be compatible with Safari 2
1308
1309         * hosted/sunspider-driver.html:
1310
1311 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1312
1313         Rubber stamped by Hyatt.
1314         
1315         - Add BSD license notice to cordic test, the original author said to do so.
1316
1317         * tests/math-cordic.js:
1318
1319 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1320
1321         Reviewed by Eric.
1322         
1323         - Support Windows and Windows browsers.
1324
1325         * hosted/sunspider-results.html: Display results correctly in IE.
1326         * sunspider: tweaks to work on Windows, and with spaces in the path.
1327
1328 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1329
1330         Rubber stamped by Oliver.
1331
1332         * tests/string-tagcloud.js: Remove stray print()
1333
1334 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
1335
1336         Reviewed by Oliver.
1337         
1338         Add some string test cases.
1339
1340         * tests/string-base64.js: Added. Does base64 encoding and decoding.
1341         * tests/string-tagcloud.js: Added. Parses a JSON string and
1342         generates tagcloud HTML markup based on the data.        
1343         * tests/string-unpack-code.js: Added. Unpack compressed versions of
1344         four of the most popular JavaScript libraries.
1345         * tests/LIST: Added the new tests.
1346
1347 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
1348
1349         Reviewed by Anders.
1350
1351         * TODO: Updated with info on how to do the stats properly.
1352
1353         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
1354         avoid overly slowing down the benchmark.
1355
1356         Added some 3D-related test cases.
1357         
1358         * tests/3d-cube.js: Added.
1359         * tests/3d-morph.js: Added.
1360         * tests/3d-raytrace.js: Added.
1361         * tests/LIST:
1362
1363 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
1364
1365         Reviewed by Darin Adler.
1366
1367         - New JavaScript benchmark
1368         http://bugs.webkit.org/show_bug.cgi?id=15515
1369         
1370         A start on a new JavaScript benchmark, with standalone and
1371         browser-hosted drivers.
1372         
1373         The test content is still incomplete and the drivers could use
1374         some more features but there is enough here to make a good start.
1375         
1376         The drivers compute a 95% confidence interval on the mean for the
1377         whole test, each category, and each individual test to make it
1378         easier to tell whether differences are statistically
1379         significant. The confidence interval can be narrowed by running
1380         the test more times.
1381         
1382         * TODO: Added. Remaining things that need to be done.
1383         * sunspider: Added. Perl script that acts as the standalone test driver.
1384         * resources/sunspider-standalone-driver.js: Added. JavaScript part
1385         of standalone test driver.
1386         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
1387         analysis code.
1388         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
1389         * make-hosted: Added. Script to generate browser-hosted tests.
1390         * hosted/sunspider.html: Added. Start page for browser-hosted test.
1391         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
1392         * hosted/sunspider-results.html: Added. Results page for browser-hosted
1393         tests.
1394         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
1395         tests.
1396         * tests/LIST: Added. List of tests to use.
1397         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
1398         * tests/bitops-bits-in-byte.js: Added. Ditto.
1399         * tests/bitops-bitwise-and.js: Added. Ditto.
1400         * tests/math-cordic.js: Added. Ditto.
1401