CodeBlock crashes when dumping op_push_name_scope
[WebKit-https.git] / PerformanceTests / SunSpider / ChangeLog
1 2015-02-25  Benjamin Poulain  <bpoulain@apple.com>
2
3         CodeBlock crashes when dumping op_push_name_scope
4         https://bugs.webkit.org/show_bug.cgi?id=141953
5
6         Reviewed by Filip Pizlo.
7
8         * profiler-test.yaml:
9
10 2015-01-27  Csaba Osztrogon√°c  <ossy@webkit.org>
11
12         [Win] JSC profiler tests asserts in debug mode
13         https://bugs.webkit.org/show_bug.cgi?id=140931
14
15         Unreviewed gardening, skip failing tests.
16
17         * profiler-test.yaml:
18
19 2014-11-04  Michael Saboff  <msaboff@apple.com>
20
21         Disable failing v8-deltablue.js for ARM
22         https://bugs.webkit.org/show_bug.cgi?id=138382
23
24         Reviewed by Geoffrey Garen.
25
26         This test is failing on ARM 32 bit.
27
28         * tests/v8-v6/v8-deltablue.js:
29
30 2014-07-08  Gergo Balogh  <gbalogh.u-szeged@partner.samsung.com>
31
32         Add option to specify output file location in sunspider.
33         https://bugs.webkit.org/show_bug.cgi?id=134339
34
35         Reviewed by Darin Adler.
36
37         * sunspider:
38
39 2014-06-03  Eva Balazsfalvi  <evab.u-szeged@partner.samsung.com>
40
41         REGRESSION(r169092 and r169102): Skip failing JSC tests poperly on non-x86 Darwin platforms
42         https://bugs.webkit.org/show_bug.cgi?id=133149
43
44         Reviewed by Csaba Osztrogon√°c.
45
46         * profiler-test.yaml: Skip profiler tests only if the architecture isn't x86 and the host is Darwin.
47
48 2014-05-21  Filip Pizlo  <fpizlo@apple.com>
49
50         Unreviewed, roll out http://trac.webkit.org/changeset/169159.
51         
52         This was a unilateral change and wasn't properly reviewed.
53
54         * profiler-test.yaml:
55
56 2014-05-19  Filip Pizlo  <fpizlo@apple.com>
57
58         Take care of some ARM64 test failures
59         https://bugs.webkit.org/show_bug.cgi?id=133090
60
61         Reviewed by Geoffrey Garen.
62
63         * profiler-test.yaml: Skip these on not-x86.
64
65 2014-03-14  Maciej Stachowiak  <mjs@apple.com>
66
67         Replace "Apple Computer, Inc." with "Apple Inc." in copyright headers
68         https://bugs.webkit.org/show_bug.cgi?id=130276
69         <rdar://problem/16266927>
70
71         Reviewed by Simon Fraser.
72
73         * hosted/sunspider.html:
74         * hosted/versions.html:
75         * make-hosted:
76         * resources/TEMPLATE.html:
77         * resources/driver-TEMPLATE.html:
78         * resources/results-TEMPLATE.html:
79         * resources/sunspider-analyze-results.js:
80         * resources/sunspider-compare-results.js:
81         * resources/sunspider-standalone-compare.js:
82         * resources/sunspider-standalone-driver.js:
83         * sunspider:
84         * sunspider-compare-results:
85         * tests/sunspider-0.9.1/3d-morph.js:
86         * tests/sunspider-0.9.1/3d-raytrace.js:
87         * tests/sunspider-0.9.1/bitops-bitwise-and.js:
88         * tests/sunspider-0.9.1/math-cordic.js:
89         * tests/sunspider-0.9.1/string-tagcloud.js:
90         * tests/sunspider-0.9/3d-morph.js:
91         * tests/sunspider-0.9/3d-raytrace.js:
92         * tests/sunspider-0.9/bitops-bitwise-and.js:
93         * tests/sunspider-0.9/math-cordic.js:
94         * tests/sunspider-0.9/string-tagcloud.js:
95         * tests/sunspider-1.0.1/3d-morph.js:
96         * tests/sunspider-1.0.1/3d-raytrace.js:
97         * tests/sunspider-1.0.1/bitops-bitwise-and.js:
98         * tests/sunspider-1.0.1/math-cordic.js:
99         * tests/sunspider-1.0.1/string-tagcloud.js:
100         * tests/sunspider-1.0.2/3d-morph.js:
101         * tests/sunspider-1.0.2/3d-raytrace.js:
102         * tests/sunspider-1.0.2/bitops-bitwise-and.js:
103         * tests/sunspider-1.0.2/math-cordic.js:
104         * tests/sunspider-1.0.2/string-tagcloud.js:
105         * tests/sunspider-1.0/3d-morph.js:
106         * tests/sunspider-1.0/3d-raytrace.js:
107         * tests/sunspider-1.0/bitops-bitwise-and.js:
108         * tests/sunspider-1.0/math-cordic.js:
109         * tests/sunspider-1.0/string-tagcloud.js:
110
111 2014-02-10  Filip Pizlo  <fpizlo@apple.com>
112
113         Unreviewed, revert the accidental change from r163789.
114
115         * tests/v8-v6/v8-deltablue.js:
116
117 2013-12-10  Filip Pizlo  <fpizlo@apple.com>
118
119         Get rid of forward exit on DoubleAsInt32
120         https://bugs.webkit.org/show_bug.cgi?id=125552
121
122         Reviewed by Oliver Hunt.
123         
124         Use SunSpider as a kind of spot-check for the
125         no-architecture-specific-optimization paths in the compiler.
126
127         * no-architecture-specific-optimizations.yaml: Added.
128
129 2013-10-08  Geoffrey Garen  <ggaren@apple.com>
130
131         Refined power management in SunSpider 1.0.2
132         https://bugs.webkit.org/show_bug.cgi?id=122525
133
134         Reviewed by Gavin Barraclough.
135
136         * hosted/sunspider.css:
137         (#frameparent):
138         (#countdown):
139         * resources/TEMPLATE.html: Provide an explicit countdown element in the
140         parent, instead of hacking it into each child frame.
141
142         * resources/driver-TEMPLATE.html: Be more explicit about how we respond
143         to power management. Just moving setTimeout(0) inside the loop is a
144         little too subtle, and may not work across browsers.
145
146         Also, leave a little extra time after changing the countdown graphic,
147         to give the browser some time to paint.
148
149 2013-10-02  Geoffrey Garen  <ggaren@apple.com>
150
151         Improved painting behavior in SunSpider 1.0.2
152         https://bugs.webkit.org/show_bug.cgi?id=122257
153
154         Reviewed by Oliver Hunt.
155
156         Individual test names with times was a good painting strategy years
157         back, when each benchmark took hundreds of milliseconds to run. Now,
158         the whole suite can finish in a a few hundres milliseconds, and things
159         look pretty flashy.
160
161         Instead, display a countdown that indicates which iteration of the
162         test we're on.
163
164         * resources/TEMPLATE.html: Work around a bug in Firefox by specifying
165         our style inside the .html file instead of in an external stylesheet.
166         Under heavy JavaScript load, Firefox neglects to apply external
167         stylesheets -- probably due to a starved timer.
168         
169         * resources/driver-TEMPLATE.html: Delay a little between runs to ensure
170         that our countdown has enough time to paint.
171
172 2013-09-26  Geoffrey Garen  <ggaren@apple.com>
173
174         Fixed a version number string in SunSpider 1.0.2
175         https://bugs.webkit.org/show_bug.cgi?id=122004
176
177         Reviewed by Gavin Barraclough.
178
179         * resources/driver-TEMPLATE.html:
180         * resources/results-TEMPLATE.html: 1.0.2!
181
182 2013-09-26  Geoffrey Garen  <ggaren@apple.com>
183
184         Tentative SunSpider 1.0.2
185         https://bugs.webkit.org/show_bug.cgi?id=122002
186
187         Reviewed by Gavin Barraclough.
188
189         Be even more aggressive about asking for zero delay between tests by
190         setting a timeout at the beginning of a test instead of the end. This is
191         another step toward reducing noise -- particularly noise caused by
192         power management -- just like the step down from 10ms to 0ms.
193
194         Browsers typically put a 4ms floor on timers. The sooner we set
195         our timer, the sooner it will fire.
196
197         * make-hosted:
198         * resources/driver-TEMPLATE.html: Changed the driver to set the timeout
199         earlier.
200         * tests/sunspider-1.0.2: Added. These tests are unchanged from 1.0.1.
201
202 2013-09-09  Filip Pizlo  <fpizlo@apple.com>
203
204         Stress tests should test the jsc profiler (-p)
205         https://bugs.webkit.org/show_bug.cgi?id=121043
206
207         Reviewed by Mark Hahnenberg.
208         
209         Add a jsc-stress-test that tries to profile SunSpider.
210
211         * profiler-test.yaml: Added.
212
213 2013-08-08  Cosmin Truta  <ctruta@blackberry.com>
214
215         SunSpider: Move the 3d-morph fix from version 1.0 to version 1.0.1
216         https://bugs.webkit.org/show_bug.cgi?id=117993
217
218         Reviewed by George Staikos.
219
220         Bump the SunSpider version to 1.0.1.
221
222         Unroll r149548 in order to restore version 1.0 to its original,
223         and add the 3d-morph fix to version 1.0.1 instead.
224
225         * hosted/sunspider.html: Updated to version 1.0.1.
226         * hosted/versions.html: Updated to version 1.0.1.
227         * make-hosted: Added support for version 1.0.1.
228         * resources/driver-TEMPLATE.html: Updated to version 1.0.1.
229         * resources/results-TEMPLATE.html: Updated to version 1.0.1.
230         * sunspider: Updated to version 1.0.1.
231         * sunspider-compare-results: Updated to version 1.0.1.
232         * tests/sunspider-1.0/3d-morph.js: Rolled back to the original version.
233         * tests/sunspider-1.0.1/LIST: Added.
234         * tests/sunspider-1.0.1/3d-cube.js: Added.
235         * tests/sunspider-1.0.1/3d-morph.js: Added.
236         * tests/sunspider-1.0.1/3d-raytrace.js: Added.
237         * tests/sunspider-1.0.1/access-binary-trees.js: Added.
238         * tests/sunspider-1.0.1/access-fannkuch.js: Added.
239         * tests/sunspider-1.0.1/access-nbody.js: Added.
240         * tests/sunspider-1.0.1/access-nsieve.js: Added.
241         * tests/sunspider-1.0.1/bitops-3bit-bits-in-byte.js: Added.
242         * tests/sunspider-1.0.1/bitops-bits-in-byte.js: Added.
243         * tests/sunspider-1.0.1/bitops-bitwise-and.js: Added.
244         * tests/sunspider-1.0.1/bitops-nsieve-bits.js: Added.
245         * tests/sunspider-1.0.1/controlflow-recursive.js: Added.
246         * tests/sunspider-1.0.1/crypto-aes.js: Added.
247         * tests/sunspider-1.0.1/crypto-md5.js: Added.
248         * tests/sunspider-1.0.1/crypto-sha1.js: Added.
249         * tests/sunspider-1.0.1/date-format-tofte.js: Added.
250         * tests/sunspider-1.0.1/date-format-xparb.js: Added.
251         * tests/sunspider-1.0.1/math-cordic.js: Added.
252         * tests/sunspider-1.0.1/math-partial-sums.js: Added.
253         * tests/sunspider-1.0.1/math-spectral-norm.js: Added.
254         * tests/sunspider-1.0.1/regexp-dna.js: Added.
255         * tests/sunspider-1.0.1/string-base64.js: Added.
256         * tests/sunspider-1.0.1/string-fasta.js: Added.
257         * tests/sunspider-1.0.1/string-tagcloud.js: Added.
258         * tests/sunspider-1.0.1/string-unpack-code.js: Added.
259         * tests/sunspider-1.0.1/string-validate-input.js: Added.
260
261 2013-05-03  Cosmin Truta  <ctruta@blackberry.com>
262
263         SunSpider 1.0: 3d-morph: use epsilon to check result
264         https://bugs.webkit.org/show_bug.cgi?id=115553
265
266         Reviewed by George Staikos.
267
268         SunSpider/3d-morph should be more lenient in validating its results, since they depend on Math.sin, which isn't formally specified.
269
270         * tests/sunspider-1.0/3d-morph.js:
271
272 2013-04-19  Filip Pizlo  <fpizlo@apple.com>
273
274         SunSpider/string-tagcloud should be more lenient in validating its results, since they depend on Math.log, which isn't formally specified
275         https://bugs.webkit.org/show_bug.cgi?id=114895
276
277         Reviewed by Michael Saboff.
278
279         * tests/sunspider-1.0/string-tagcloud.js:
280
281 2013-04-18  Filip Pizlo  <fpizlo@apple.com>
282
283         Whenever it is cheap and non-invasive, SunSpider tests should validate their results to ensure that the browser runs them correctly
284         https://bugs.webkit.org/show_bug.cgi?id=114852
285
286         Reviewed by Geoffrey Garen.
287         
288         This adds low-overhead checking of the results of each SunSpider tests. This is not
289         meant to be an exhaustive test that everything was executed correctly, but rather a
290         simple sanity check that will catch glaring mistakes. The philosophy here is that we're
291         not trying to prevent all forms of cheating, or that we're trying to prove the
292         browser's correctness. Moreover, these checks are meant to incur minimal overhead;
293         they currently clock in at <2% slow-down in SunSpider 1.0.
294         
295         The test expectations were generated using the LLInt on command-line, and I've verified
296         that Firefox 20, Chrome 26, IE 10, Safari 6, and ToT with all of the JITs agree. Note
297         that some tests cannot be precisely validated because they use Math functions, which
298         ECMAScript chooses to not formally specify - those functions like sin() and friends are
299         allowed to return implementation-dependent results. Also some tests cannot be validated
300         at all because their behavior is either intentionally random or is timezone-dependent.
301         But 23 out of 26 tests now have some kind of validation.
302         
303         I've updated the harnesses to show erroneous runs when displaying results.
304
305         * resources/TEMPLATE.html:
306         * resources/driver-TEMPLATE.html:
307         * resources/sunspider-analyze-results.js:
308         (formatResult):
309         (resultLine):
310         (printOutput):
311         * resources/sunspider-compare-results.js:
312         (.formatMean):
313         (.resultLine):
314         (.printOutput):
315         (sunspiderCompareResults):
316         * resources/sunspider-standalone-driver.js:
317         * tests/sunspider-1.0/3d-cube.js:
318         (Init):
319         * tests/sunspider-1.0/3d-morph.js:
320         * tests/sunspider-1.0/3d-raytrace.js:
321         * tests/sunspider-1.0/access-binary-trees.js:
322         * tests/sunspider-1.0/access-fannkuch.js:
323         * tests/sunspider-1.0/access-nbody.js:
324         * tests/sunspider-1.0/access-nsieve.js:
325         (sieve):
326         * tests/sunspider-1.0/bitops-3bit-bits-in-byte.js:
327         * tests/sunspider-1.0/bitops-bits-in-byte.js:
328         * tests/sunspider-1.0/bitops-bitwise-and.js:
329         * tests/sunspider-1.0/bitops-nsieve-bits.js:
330         * tests/sunspider-1.0/controlflow-recursive.js:
331         * tests/sunspider-1.0/crypto-aes.js:
332         * tests/sunspider-1.0/crypto-md5.js:
333         * tests/sunspider-1.0/crypto-sha1.js:
334         * tests/sunspider-1.0/date-format-tofte.js:
335         * tests/sunspider-1.0/date-format-xparb.js:
336         * tests/sunspider-1.0/math-cordic.js:
337         * tests/sunspider-1.0/math-partial-sums.js:
338         (partial):
339         * tests/sunspider-1.0/math-spectral-norm.js:
340         * tests/sunspider-1.0/regexp-dna.js:
341         * tests/sunspider-1.0/string-base64.js:
342         * tests/sunspider-1.0/string-fasta.js:
343         (fastaRepeat):
344         (fastaRandom):
345         * tests/sunspider-1.0/string-tagcloud.js:
346         * tests/sunspider-1.0/string-unpack-code.js:
347         * tests/sunspider-1.0/string-validate-input.js:
348
349 2013-04-11  Filip Pizlo  <fpizlo@apple.com>
350
351         Get rid of the 10ms delay between test executions
352         https://bugs.webkit.org/show_bug.cgi?id=114458
353         <rdar://problem/13631112>
354
355         Reviewed by Darin Adler and Geoffrey Garen.
356         
357         More details on this in the bug. Long story short, I don't know why the 10ms delay is
358         there, and it appears to be the root of some noisyness and unreliability in the results.
359         Removing it makes results more consistent, which is a good thing.
360
361         * resources/driver-TEMPLATE.html:
362
363 2013-01-16  Eric Seidel  <eric@webkit.org>
364
365         Remove --shark* support from sunspider/run-sunspider now that Shark is dead
366         https://bugs.webkit.org/show_bug.cgi?id=99512
367
368         Reviewed by Darin Adler.
369
370         I tried to use --instruments, but that also seems broken (in the same way before/after this patch).
371
372         * sunspider:
373         (runTestsOnce):
374
375 2012-08-02  Filip Pizlo  <fpizlo@apple.com>
376
377         Unreviewed, revert debugging stuff I landed in http://trac.webkit.org/changeset/124557
378         by accident.
379
380         * tests/v8-v6/v8-crypto.js:
381         (am1):
382         (am2):
383         (am3):
384         (am4):
385         (bnpCopyTo):
386         (bnpFromString):
387         (bnpClamp):
388
389 2012-03-11  Maciej Stachowiak  <mjs@apple.com>
390
391         Add --instruments option to sunspider to profile with Instruments
392         https://bugs.webkit.org/show_bug.cgi?id=80783
393
394         Reviewed by Filip Pizlo.
395
396         * resources/TimeProfile20us.tracetemplate: Added.
397         * sunspider:
398         (runTestsOnce):
399
400 2011-11-15  Andy Wingo  <wingo@igalia.com>
401
402         Extend sunspider driver to be able to run kraken
403         https://bugs.webkit.org/show_bug.cgi?id=71799
404
405         Reviewed by Filip Pizlo.
406
407         * resources/sunspider-standalone-driver.js: Try to load a -data
408         file.  If that succeeds, we have a kraken-like test, so we time
409         the test using `load'.  Otherwise fall back to using `run'.
410
411 2011-08-11  Mark Rowe  <mrowe@apple.com>
412
413         Fix sunspider-compare-results to default to the same suite version as the sunspider script.
414
415         Rubber-stamped by Maciej Stachowiak.
416
417         * sunspider-compare-results:
418
419 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
420
421         Update SunSpider versioning to 1.0
422         https://bugs.webkit.org/show_bug.cgi?id=63870
423
424         Reviewed by Dan Bernstein.
425
426         * hosted/sunspider.html:
427         * hosted/versions.html:
428         * resources/driver-TEMPLATE.html:
429         * resources/results-TEMPLATE.html:
430         * sunspider:
431
432 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
433
434         Sunspider 0.9.1 harness doesn't actually close() its test documents
435         https://bugs.webkit.org/show_bug.cgi?id=47045
436
437         Reviewed by Daniel Bates.
438
439         * hosted/versions.html:
440         * resources/driver-TEMPLATE.html:
441
442 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
443
444         Not Reviewed. 
445         
446         Fix obviou typo in previous commit.
447
448         * tests/sunspider-1.0/bitops-bitwise-and.js:
449
450 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
451
452         Reviewed by Anders Carlsson.
453
454         SunSpider: all four bitops benchmarks can be replaced with NOP
455         https://bugs.webkit.org/show_bug.cgi?id=38446
456
457         * tests/sunspider-1.0/bitops-3bit-bits-in-byte.js:
458         (TimeFunc): Save the result.
459         * tests/sunspider-1.0/bitops-bits-in-byte.js:
460         (TimeFunc): Save the result.
461         * tests/sunspider-1.0/bitops-bitwise-and.js: More explicitly
462         save the results.
463         * tests/sunspider-1.0/bitops-nsieve-bits.js:
464         (sieve): Save the result.
465
466 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
467
468         SunSpider: string-validate-input.js uses an undeclared variable named 'name', which is a DOM API
469         https://bugs.webkit.org/show_bug.cgi?id=60937
470
471         Reviewed by Dan Bernstein.
472
473         * tests/sunspider-1.0/string-validate-input.js:
474         (doTest): Rename the variable to username
475
476 2011-07-02  Maciej Stachowiak  <mjs@apple.com>
477
478         Reviewed by Darin Adler.
479
480         SunSpider: The main function of math-cordic is dead code
481         https://bugs.webkit.org/show_bug.cgi?id=63863
482         
483         Try to prevent math-cordic from being eliminated as dead code or
484         compiled down to a constant.
485
486         * tests/sunspider-1.0/math-cordic.js:
487         (cordicsincos):
488         (cordic):
489
490 2011-06-30  Maciej Stachowiak  <mjs@apple.com>
491
492         Reviewed by Adam Barth.
493
494         Create sunspider-1.0 directory in preparation for fixing a bunch of bugs
495         https://bugs.webkit.org/show_bug.cgi?id=63782
496
497         * make-hosted: Learn about the new directory.
498         * tests/sunspider-1.0: Copied from PerformanceTests/SunSpider/tests/sunspider-0.9.1.
499
500 2010-11-29  Geoffrey Garen  <ggaren@apple.com>
501
502         Reviewed by Gavin Barraclough.
503
504         Improved accuracy of command-line SunSpider.
505
506         * resources/sunspider-standalone-driver.js: Use the returned number of
507         elapsed milliseconds from "run" and "checkSyntax" instead of measuring
508         ourselves, for slightly more accurate numbers.
509
510 2010-09-16  Gavin Barraclough  <barraclough@apple.com>
511
512         Reviewed by Mark Rowe.
513         https://bugs.webkit.org/show_bug.cgi?id=45924
514
515         Modify the SunSpider harness to allow a path to be passed to the --suite
516         argument, supress the normal prepend-"tests/" behaviour for suite names
517         containing a '/'.
518
519         Also wrap the code in an anonymous function to move variables out of global
520         scope (currently the harness cannot handle running tests the overwrite the
521         variable 'j').
522
523         * resources/sunspider-standalone-driver.js:
524         * sunspider:
525
526 2010-08-27  Michael Saboff  <msaboff@apple.com>
527
528         Reviewed by Stephanie Lewis.
529
530         Added version 5 and version 6 of V8 tests with modifications similar
531         to the version 4 tests so they'll work with the SunSpider test harness.
532         Note that these files are external source and therefore don't conform 
533         to WebKit coding standards.
534         https://bugs.webkit.org/show_bug.cgi?id=44638
535
536         * tests/v8-v5: Added.
537         * tests/v8-v5/LIST: Added.
538         * tests/v8-v5/v8-crypto.js: Added.
539         * tests/v8-v5/v8-deltablue.js: Added.
540         * tests/v8-v5/v8-earley-boyer.js: Added.
541         * tests/v8-v5/v8-raytrace.js: Added.
542         * tests/v8-v5/v8-regexp.js: Added.
543         * tests/v8-v5/v8-richards.js: Added.
544         * tests/v8-v5/v8-splay.js: Added.
545         * tests/v8-v6: Added.
546         * tests/v8-v6/LIST: Added.
547         * tests/v8-v6/v8-crypto.js: Added.
548         * tests/v8-v6/v8-deltablue.js: Added.
549         * tests/v8-v6/v8-earley-boyer.js: Added.
550         * tests/v8-v6/v8-raytrace.js: Added.
551         * tests/v8-v6/v8-regexp.js: Added.
552         * tests/v8-v6/v8-richards.js: Added.
553         * tests/v8-v6/v8-splay.js: Added.
554
555 2010-07-15  Stephanie Lewis  <slewis@apple.com>
556
557         Reviewed by Geoff Garen.
558
559         http://bugs.webkit.org/show_bug.cgi?id=42406
560         Output location of results file.
561
562         * sunspider:
563
564 2010-05-17  Maciej Stachowiak  <mjs@apple.com>
565
566         Reviewed by Mark Rowe.
567
568         Browser-hosted version of SunSpider runs tests twice as many times as advertised
569         https://bugs.webkit.org/show_bug.cgi?id=39201
570
571         * make-hosted: Make sure to reset test list after every test suite.
572
573 2010-05-07  Adam Roben  <aroben@apple.com>
574
575         Fix typo in sunspider-compare-results.js that caused incorrect
576         two-sample t statistics to be computed
577
578         Fixes <http://webkit.org/b/38768> SunSpider computes incorrect
579         two-sample t statistics
580
581         Reviewed by Darin Adler.
582
583         * resources/sunspider-compare-results.js:
584         (sunspiderCompareResults.resultLine): Fixed the calculation of the t
585         variable to match the definition of a two-sample t statistic. Looks
586         like this was just a simple typo.
587
588 2010-04-05  Darin Adler  <darin@apple.com>
589
590         Updated the ignore property for changes to the contents here.
591
592         * .: Modified property svn:ignore.
593
594 2010-02-20  Maciej Stachowiak  <mjs@apple.com>
595
596         Reviewed by Adam Barth.
597
598         Add sunspider-0.9.1 to the site in preparation for announcing it.
599         https://bugs.webkit.org/show_bug.cgi?id=35206
600
601         * hosted/sunspider.css: Remove tabs, which I noticed where present while
602         copying to the WebKitSite directory.
603
604 2010-01-11  Oliver Hunt  <oliver@apple.com>
605
606         Reviewed by Darin Adler.
607
608         Sunspider parse-only tests don't run
609         https://bugs.webkit.org/show_bug.cgi?id=33489
610
611         Fix parse-only test list
612
613         * tests/parse-only/LIST:
614
615 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
616
617         Reviewed by Adele Peterson.
618
619         Make SunSpider version more prominent in the title
620         https://bugs.webkit.org/show_bug.cgi?id=32574
621
622         * hosted/sunspider.html:
623         * hosted/versions.html:
624         * resources/driver-TEMPLATE.html:
625         * resources/results-TEMPLATE.html:
626
627 2009-12-15  Maciej Stachowiak  <mjs@apple.com>
628
629         Reviewed by Darin Adler.
630
631         Make SunSpider refuse to compare results across content versions
632         https://bugs.webkit.org/show_bug.cgi?id=32573
633         
634         The results URL now includes a version indicator, and compare mode
635         will refuse to compare between versions.
636
637         * resources/driver-TEMPLATE.html:
638         * resources/results-TEMPLATE.html:
639
640 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
641
642         Reviewed by Darin Adler.
643
644         Some Browser-hosted SunSpider files are not valid HTML5
645         https://bugs.webkit.org/show_bug.cgi?id=32536
646         
647         Made various fixes to validate as HTML5 with no warnings (mainly removing bogus
648         close tags and adding a meta charset declaration).
649
650         * hosted/sunspider.html:
651         * hosted/versions.html:
652         * resources/TEMPLATE.html:
653         * resources/driver-TEMPLATE.html:
654         * resources/results-TEMPLATE.html:
655
656 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
657
658         Reviewed by Eric Seidel.
659
660         Make sunspider-0.9.1 the default content set (both command-line and hosted)
661         https://bugs.webkit.org/show_bug.cgi?id=32537
662
663         * hosted/sunspider.html: Change default suite link.
664         * sunspider: Change default suite.
665         * sunspider-compare-results: Likewise.
666
667 2009-12-14  Maciej Stachowiak  <mjs@apple.com>
668
669         Reviewed by Sam Weinig.
670
671         in-browser SunSpider suffers excessive penalty under power management
672         https://bugs.webkit.org/show_bug.cgi?id=32505
673         
674         I have made a few changes to address this:
675         
676         1) Change how browser-hosted SunSpider loads tests - preload the content and write it in with
677         document.write to reduce triggering of progress UI.
678         2) Reduce time between tests to 10ms from 500ms, so that power management doesn't keep the CPU
679         stepped all the way down the whole time.
680         3) Run the test cycle an extra time for warmup before the runs that count.
681
682         * hosted/sunspider-record-result.js: Removed.
683         * make-hosted:
684         * resources/TEMPLATE.html:
685         * resources/driver-TEMPLATE.html:
686
687 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
688
689         Reviewed by Gavin Barraclough.
690
691         SunSpider/tests/string-base64.js does not compute a valid base64 encoded string
692         https://bugs.webkit.org/show_bug.cgi?id=16806
693
694         Based on a patch by Eric Seidel.
695         
696         Fix the base64 computation to actually compute correct results. The impact on runtime of
697         the test is pretty small, but noticeable for some browsers. But at least it's not
698         doing a wrong and meaningless computation any more.
699         
700         * tests/sunspider-0.9.1/string-base64.js:
701         ():
702         (base64ToString):
703
704 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
705
706         Fixing commit error...
707         
708         I accidentally committed my last patch in a form that broke Web-hosted SunSpider. Fixing.
709
710         * resources/driver-TEMPLATE.html:
711
712 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
713
714         Reviewed by Sam Weinig.
715
716         Use JSON.parse instead of eval for Web-hosted SunSpider results processing
717         https://bugs.webkit.org/show_bug.cgi?id=32490
718
719         * hosted/json2.js: Added. Incorporated from json.org
720         * resources/driver-TEMPLATE.html: Fix an HTML validation bug I noticed.
721         * resources/results-TEMPLATE.html: Use JSON.parse instead of eval to process
722         results.
723
724 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
725
726         Reviewed by Oliver Hunt.
727
728         Enable Web-hosted version of SunSpider to handle multiple versions
729         https://bugs.webkit.org/show_bug.cgi?id=32478
730
731         * make-hosted: Now generate the hosted version to be able to run both the
732         0.9 and the 0.9.1 test suites.
733         * hosted: Modified property svn:ignore.
734         * hosted/sunspider-driver.html: Removed.
735         * hosted/sunspider-results.html: Removed.
736         * hosted/sunspider.html:
737         * hosted/versions.html: Added.
738         * resources/TEMPLATE.html:
739         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-driver.html.
740         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-results.html.
741
742 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
743
744         Reviewed by Oliver Hunt.
745
746         Give command-line sunspider the ability to handle multiple suites and versions
747         https://bugs.webkit.org/show_bug.cgi?id=32477
748         
749         Each suite/version's set of tests are now in a separate subdirectory of tests/, with a file named LIST
750         enumerating the tests. Current suites are:
751         
752         sunspider-0.9 - riginal SunSpider content 
753         sunspider-0.9.1 - SunSpider suite with a few tests fixed (and a few more to come)
754         ubench - "ubench" microbenchmark suite
755         v8-v4 - version 4 of the v8 benchmark
756         parse-only - some parser tests
757         
758         Sunspider can now be run with the --suite= parameter to select a
759         suite. The default is --suite=sunspider-0.9.
760
761         * .: Modified property svn:ignore to ignore new results directories.
762         * make-hosted: Generate based on sunspider-0.9 suite.
763         * resources/TEMPLATE.html: Fix an HTML compliance problem.
764         * resources/sunspider-standalone-driver.js: Become aware of suite names.
765         * sunspider: Modified to handle multiple suites as described above.
766         * sunspider-compare-results: ditto
767         * tests/LIST: Moved to tests/sunspider-0.9/ and tests/sunspider-0.9.1/
768         * tests/LIST-PARSE-ONLY: Moved to parse-only/LIST
769         * tests/LIST-UBENCH: Removed.
770         * tests/LIST-V8: Removed.
771         * tests/3d-cube.js: Moved to tests/sunspider-0.9 and tests/sunspider-0.9.1
772         * tests/3d-morph.js: ditto
773         * tests/3d-raytrace.js: ditto
774         * tests/access-binary-trees.js: ditto
775         * tests/access-fannkuch.js: ditto
776         * tests/access-nbody.js: ditto
777         * tests/access-nsieve.js: ditto
778         * tests/bitops-3bit-bits-in-byte.js: ditto
779         * tests/bitops-bits-in-byte.js: ditto
780         * tests/bitops-bitwise-and.js: ditto
781         * tests/bitops-nsieve-bits.js: ditto
782         * tests/controlflow-recursive.js: ditto
783         * tests/crypto-aes.js: ditto
784         * tests/crypto-md5.js: ditto
785         * tests/crypto-sha1.js: ditto
786         * tests/date-format-tofte.js: ditto
787         * tests/date-format-xparb.js: ditto
788         * tests/math-cordic.js: ditto
789         * tests/math-partial-sums.js: ditto
790         * tests/math-spectral-norm.js: ditto
791         * tests/regexp-dna.js: ditto
792         * tests/string-base64.js: ditto
793         * tests/string-fasta.js: ditto
794         * tests/string-tagcloud.js: ditto
795         * tests/string-unpack-code.js: ditto
796         * tests/string-validate-input.js: ditto
797         * tests/sunspider-0.9/: Added
798         * tests/sunspider-0.9/*.js: Moved from one level up
799         * tests/sunspider-0.9.1: Added.
800         * tests/sunspider-0.9.1/*.js: Moved from one level up.
801         * tests/v8-crypto.js: Moved to v8-v4/ directory.
802         * tests/v8-deltablue.js: ditto
803         * tests/v8-earley-boyer.js: ditto
804         * tests/v8-raytrace.js: ditto
805         * tests/v8-regexp.js: ditto
806         * tests/v8-richards.js: ditto
807         * tests/v8-splay.js: ditto
808         * tests/v8-v4: Added.
809
810 2009-09-30  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
811
812         Reviewed by Darin Adler.
813
814         Platform specific null device replaced with a platform independent.
815         https://bugs.webkit.org/show_bug.cgi?id=29544
816
817         * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL.
818
819 2009-09-21  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
820
821         Reviewed by Maciej Stachowiak.
822
823         [Qt] Make sunspider script work on Windows platform.
824         https://bugs.webkit.org/show_bug.cgi?id=29544
825
826         * sunspider:
827         Using platform specific null device instead of /dev/null.
828
829 2009-06-19  Adam Treat  <adam.treat@torchmobile.com>
830
831         Reviewed by Oliver Hunt.
832
833         https://bugs.webkit.org/show_bug.cgi?id=26540
834         Currently the SunSpider test driver lacks an option to run a test suite that
835         will test JavaScriptCore parsing performance only.  This patch adds just such
836         a test suite and option to SunSpider as well as the jsc test shell.  I've included
837         three large javascript source files found in the wild: jquery, mootools and prototype.
838         Combined with the concatenation of all three, these form a new testsuite to measure
839         and test pure JavaScriptCore parsing performance.
840
841         * resources/sunspider-standalone-driver.js:
842           Load the js with parse-only flag if it is part of the parse-only suite.
843         * sunspider:
844           Add the parse-only suite to the list of options.
845         * sunspider-compare-results:
846           Add the parse-only suite to the list of options.
847         * tests/LIST-PARSE-ONLY: Added.
848         * tests/parse-only/concat-jquery-mootools-prototype.js: Added.
849           A very large concatenation of the scripts found below.  This js takes ~30ms to parse on my machine.
850         * tests/parse-only/jquery-1.3.2.js: Added.
851           Latest version from jquery.com.
852         * tests/parse-only/mootools-1.2.2-core-nc.js: Added.
853           Latest version from mootools.net.
854         * tests/parse-only/prototype-1.6.0.3.js: Added.
855           Latest version from prototypejs.org.
856
857 2009-06-13  Steve Falkenburg  <sfalken@apple.com>
858
859         Update V8 benchmark to version 4.
860         
861         Reviewed by Cameron Zwarich.
862
863         * tests/LIST-V8:
864         * tests/v8-crypto.js:
865         * tests/v8-deltablue.js:
866         * tests/v8-earley-boyer.js:
867         * tests/v8-raytrace.js:
868         * tests/v8-regexp.js: Added.
869         * tests/v8-richards.js:
870         * tests/v8-splay.js: Added.
871
872 2009-05-26  Olivier DOLE  <odole@pleyo.com>
873
874         Reviewed by Maciej.
875
876         Store sunspider test suite results in a specific directory for each
877         different type of benchmark (sunspider, V8 or ubench).
878
879         * sunspider:
880         * sunspider-compare-results:
881
882 2009-05-12  Steve Falkenburg  <sfalken@apple.com>
883
884         Build fix.
885
886         * SunSpider.make:
887
888 2009-05-11  Steve Falkenburg  <sfalken@apple.com>
889
890         Include SunSpider tests in production builds.
891         
892         Reviewed by Adam Roben.
893
894         * SunSpider.make: Added.
895         * xcopy.excludes: Added.
896
897 2009-03-04  Oliver Hunt  <oliver@apple.com>
898
899         Added a few more tests to ubench
900
901         RS=Gavin Barraclough
902
903         Adding a couple of test to cover too few and too many arguments.  This
904         is needed to prevent regressions in all call paths from my current refactoring.
905
906         * tests/LIST-UBENCH:
907         * tests/ubench/function-correct-args.js: Added.
908         (f):
909         * tests/ubench/function-excess-args.js: Added.
910         (f):
911
912 2008-10-30  Zoltan Horvath  <Horvath.Zoltan.6@stud.u-szeged.hu>
913
914         Fix a bug where when V8's or UBENCH's test suite list file is missing
915         the error message is suggesting that SunSpider's list file is missing.
916
917         Reviewed by Sam Weinig.
918
919         * sunspider:
920         (loadTestsList): Fix the error message to use the right list name.
921
922 2008-10-07  David Hyatt  <hyatt@apple.com>
923
924         https://bugs.webkit.org/show_bug.cgi?id=18989
925
926         Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
927         we want all browsers to be doing the same thing on the test.
928
929         Reviewed by Maciej
930
931         * tests/regexp-dna.js:
932
933 2008-09-09  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
934
935         Rubber-stamped by Maciej Stachowiak.
936
937         The bleeding edge branch of V8 now supports passing fileanmes after
938         '-f', so the SunSpider script should be changed to do this again.
939         This allows all 3 major JavaScript engines to be used with the
940         unmodified SunSpider script.
941
942         * sunspider:
943
944 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
945
946         Reviewed by Maciej Stachowiak.
947
948         Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
949         and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
950         correct the punctuation in its documentation.
951
952         * sunspider:
953
954 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
955
956         Reviewed by Oliver Hunt.
957
958         Bug 20616: Incorporate V8 benchmarks in testing
959         <https://bugs.webkit.org/show_bug.cgi?id=20616>
960
961         This is a first attempt at running the V8 benchmarks within SunSpider,
962         with the --v8 option. The number of iterations is fixed for each
963         benchmark, and was chosen to make each of the benchmarks run between
964         500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
965
966         * sunspider:
967         * tests/LIST-V8: Added.
968         * tests/v8-crypto.js: Added.
969         * tests/v8-deltablue.js: Added.
970         * tests/v8-earley-boyer.js: Added.
971         * tests/v8-raytrace.js: Added.
972         * tests/v8-richards.js: Added.
973
974 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
975
976         Not reviewed.
977
978         Remove a local change that was accidentally committed in r36034.
979
980         * resources/sunspider-standalone-driver.js:
981
982 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
983
984         Rubber-stamped by Oliver Hunt.
985
986         Make SunSpider work with JavaScript shells that don't take filenames
987         after a '-f' argument.
988
989         * sunspider:
990
991 2008-06-07  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
992
993         Reviewed by Timothy.
994
995         Remove the --squirrelfish option from SunSpider, as it is no longer needed.
996
997         * sunspider:
998         * tests/LIST-SQUIRRELFISH: Removed.
999
1000 2008-06-03  Alexey Proskuryakov  <ap@webkit.org>
1001
1002         Rubber-stamped by Mark Rowe.
1003
1004         Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
1005
1006         * sunspider:
1007
1008 2008-04-15  Maciej Stachowiak  <mjs@apple.com>
1009
1010         Rubber stamped by Oliver.
1011         
1012         - add newly working tests to squirrelfish list
1013
1014         * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
1015
1016 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
1017
1018         Rubber stamped by Oliver.
1019         
1020         - move ubench tests properly.
1021
1022         * tests/ubench: Added.
1023         * tests/ubench/function-closure.js: Added.
1024         * tests/ubench/function-empty.js: Added.
1025         * tests/ubench/function-missing-args.js: Added.
1026         * tests/ubench/function-sum.js: Added.
1027         * tests/ubench/loop-empty-resolve.js: Added.
1028         * tests/ubench/loop-empty.js: Added.
1029         * tests/ubench/loop-sum.js: Added.
1030
1031 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
1032
1033         Rubber stamped by Oliver.
1034
1035         * sunspider: Don't force --runs=1 in squirrelfish mode any more.
1036
1037 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
1038
1039         Reviewed by Oliver.
1040
1041         - make --squirrelfish mode use the real harness, but a reduced set of tests
1042
1043         Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
1044
1045         * sunspider:
1046         * tests/LIST-SQUIRRELFISH:
1047         * tests/LIST-UBENCH: Added.
1048         * tests/squirrelfish: Moved to tests/ubench
1049
1050 2008-04-14  Geoffrey Garen  <ggaren@apple.com>
1051
1052         Reviewed by Maciej Stachowiak.
1053         
1054         Removed an unused test.
1055
1056         * tests/squirrelfish/loop-resolve.js: Removed.
1057
1058 2008-04-10  Maciej Stachowiak  <mjs@apple.com>
1059
1060         Reviewed by Oliver.
1061         
1062         Add newly runnable tests to --squirrelfish mode.
1063
1064         * tests/LIST-SQUIRRELFISH:
1065
1066 2008-04-06  Geoffrey Garen  <ggaren@apple.com>
1067
1068         Reviewed by Maciej Stachowiak.
1069         
1070         A little more love for --squirrelfish mode:
1071         
1072         Fixed a misplaced sort. Results properly sort now.
1073         
1074         Added a test list just for squirrelfish, and updated it to include
1075         all currently passing SunSpider tests.
1076         
1077         Fixed the pruning regexp to match 3d-morph.js.
1078
1079         * sunspider:
1080
1081 2008-03-26  Geoffrey Garen  <ggaren@apple.com>
1082
1083         Reviewed by Oliver Hunt.
1084         
1085         --squirrelfish mode: pared down tests for squirrelfish to chew on.
1086
1087         * sunspider:
1088         * tests/LIST:
1089         * tests/squirrelfish: Added.
1090         * tests/squirrelfish/function-closure.js: Added.
1091         * tests/squirrelfish/function-empty.js: Added.
1092         * tests/squirrelfish/function-missing-args.js: Added.
1093         * tests/squirrelfish/function-sum.js: Added.
1094         * tests/squirrelfish/loop-empty-resolve.js: Added.
1095         * tests/squirrelfish/loop-empty.js: Added.
1096         * tests/squirrelfish/loop-resolve.js: Added.
1097         * tests/squirrelfish/loop-sum.js: Added.
1098
1099 2008-03-21  Alexey Proskuryakov  <ap@webkit.org>
1100
1101         Reviewed by Geoff.
1102
1103         * sunspider: Pause update daemon on Darwin to make results reliable
1104         again (workaround for <rdar://problem/5811127>).
1105
1106 2008-02-07  Eric Seidel  <eric@webkit.org>
1107
1108         Reviewed by Sam.
1109
1110         * sunspider: add an error message when ./tests/LIST is not found
1111
1112 2007-12-29  Alp Toker  <alp@atoker.com>
1113
1114         Fix typo.
1115
1116         * hosted/sunspider.html:
1117
1118 2007-12-29  Alp Toker  <alp@atoker.com>
1119
1120         Reviewed by Maciej.
1121
1122         Provide the current URL in the SunSpider results page. Useful for
1123         copying benchmark results out of browsers without a location bar or
1124         where the location bar can't handle long URLs.
1125
1126         * hosted/sunspider-results.html:
1127
1128 2007-12-20  Eric Seidel  <eric@webkit.org>
1129
1130         Reviewed by mjs.
1131
1132         * sunspider: increase default number of runs for more accurate numbers
1133
1134 2007-12-18  Mark Rowe  <mrowe@apple.com>
1135
1136         Fix typo.
1137
1138         * hosted/sunspider.html:
1139
1140 2007-12-18  Maciej Stachowiak  <mjs@apple.com>
1141
1142         Reviewed by Eric.
1143         
1144         - give an extra digit of precision for small differences.
1145
1146         * resources/sunspider-compare-results.js:
1147
1148 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
1149
1150         Reviewed by Eric.
1151         
1152         - work around IE layout bugs
1153
1154         * hosted/sunspider.css:
1155
1156 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
1157
1158         Reviewed by Mark.
1159         
1160         - fix compare feature
1161
1162         * hosted/sunspider-results.html:
1163
1164 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
1165
1166         Reviewed by Mark.
1167         
1168         - Change the format of the output URL to be shorter, to meet IE constraints
1169
1170         * hosted/sunspider-driver.html:
1171         * hosted/sunspider-results.html:
1172
1173 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
1174
1175         Reviewed by Oliver.
1176         
1177         - Add some explanatory test and a dumb logo to SunSpider web hosted version
1178
1179         * hosted/sunspider-driver.html:
1180         * hosted/sunspider-results.html:
1181         * hosted/sunspider.css:
1182         * hosted/sunspider.html:
1183
1184 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
1185
1186         Reviewed by Oliver.
1187         
1188         - Make the web-hosted version of SunSpider look a little bit less drab.
1189
1190         * hosted/sunspider-driver.html:
1191         * hosted/sunspider-results.html:
1192         * hosted/sunspider.css: Added.
1193         * hosted/sunspider.html:
1194         * resources/TEMPLATE.html:
1195
1196 2007-12-12  Maciej Stachowiak  <mjs@apple.com>
1197
1198         Reviewed by Sam.
1199         
1200         - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
1201         
1202         A sample of what new-style results would look like:
1203         
1204         TEST                   COMPARISON            FROM                 TO             DETAILS
1205         ...
1206         ** TOTAL **:           1.41x as fast     6613.6ms +/- 0.1%   4703.0ms +/- 0.1%     significant
1207         ...
1208             3bit-bits-in-byte: *1.36x as slow*     88.8ms +/- 0.6%    121.1ms +/- 0.6%     significant
1209         
1210         * resources/sunspider-compare-results.js:
1211
1212 2007-11-14  Eric Seidel  <eric@webkit.org>
1213
1214         Reviewed by Sam.
1215
1216         * sunspider: add --shark-cache for L2 Cache Miss profiling
1217
1218 2007-11-09  Alexey Proskuryakov  <ap@webkit.org>
1219
1220         Reviewed by Darin Adler.
1221
1222         http://bugs.webkit.org/show_bug.cgi?id=15925
1223         SunSpider should check for Shark being installed
1224
1225         * sunspider: Explicitly test that shark command line tool is installed.
1226
1227 2007-11-04  Darin Adler  <darin@apple.com>
1228
1229         * hosted/sunspider.html: Tweaked formatting a bit.
1230
1231 2007-11-03  Maciej Stachowiak  <mjs@apple.com>
1232
1233         Reviewed by Darin Adler.
1234
1235         - Add compare mode and a description of the benchmark to the hosted version.
1236
1237         * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
1238         * hosted/sunspider.html: Added intro text.
1239         * make-hosted: Copy new file.
1240         * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
1241         a function.
1242         * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
1243         expects.
1244         * sunspider-compare-results: Use sunspider-standalone-compare.js.
1245
1246 2007-11-02  Darin Adler  <darin@apple.com>
1247
1248         * sunspider: Changed "--base" to "--set-baseline".
1249
1250 2007-11-02  Darin Adler  <darin@apple.com>
1251
1252         Reviewed by Maciej.
1253
1254         * sunspider: Added a "--base" option that records the current test as a baseline.
1255         Moved the code to find the newest .mshark file into a function (since I needed to use
1256         it in the other script and I prefer to copy/paste a function).
1257
1258         * sunspider-compare-results: Added logic to compare the baseline with the last
1259         run when you don't pass any parameters.
1260
1261 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1262
1263         Reviewed by Eric.
1264         
1265         - Added list of ECMAScript3 features that SunSpider does not cover currently.
1266
1267         * UNCOVERED: Added.
1268
1269 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1270
1271         Reviewed by Oliver.
1272         
1273         - Give better error messages when sunspider-compare-results fails
1274
1275         * sunspider-compare-results:
1276
1277 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
1278
1279         Reviewed by Darin Adler.
1280         
1281         - fix Date tests to work in command-line SpiderMonkey
1282
1283         * tests/date-format-tofte.js:
1284         * tests/date-format-xparb.js:
1285
1286 2007-10-29  Darin Adler  <darin@apple.com>
1287
1288         Reviewed by Maciej.
1289
1290         * sunspider: Added --shark20 option, to run Shark at its highest sample
1291         resolution instead of its default.
1292
1293 2007-10-28  Adam Roben  <aroben@apple.com>
1294
1295         Fix SunSpider on Windows
1296
1297         Reviewed by Eric.
1298
1299         * sunspider: Don't use colons in filenames.
1300
1301 2007-10-28  Darin Adler  <darin@apple.com>
1302
1303         Reviewed by Adam.
1304
1305         * resources/sunspider-analyze-results.js: Tweak the output format a little.
1306         Change so that when there's only one run we don't write out confidence
1307         intervals at all rather than writing "NaN" over and over again.
1308
1309         * sunspider: Use the time and date as a suffix on the results file, that way
1310         all the results are left behind in the tmp directory. This will make it easy
1311         for us to add features that compare past results in the future. Also rename
1312         the .mshark files using the same scheme.
1313
1314         * sunspider-compare-results: Relax the parsing rules so we can parse the
1315         results file exactly as it's emitted from sunspider.
1316
1317 2007-10-25  Adam Roben  <aroben@apple.com>
1318
1319         Strip carriage returns from results
1320
1321         Carriage returns were screwing up sunspider-compare-results on
1322         Windows.
1323
1324         Rubberstamped by Oliver.
1325
1326         * sunspider:
1327
1328 2007-10-24  Darin Adler  <darin@apple.com>
1329
1330         Reviewed by Eric.
1331
1332         * sunspider: Open the profile in shark after completing a run.
1333         * sunspider-compare-results: Tiny perl tweaks.
1334
1335 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1336
1337         Reviewed by Darin Adler.
1338
1339         - Don't hardcode my path to testkjs
1340         
1341         * sunspider-compare-results:
1342
1343 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1344
1345         Reviewed by Darin Adler.
1346         
1347         - Add a compare script to compare results, and improve formatting of standard results a bit.
1348
1349         * resources/sunspider-analyze-results.js:
1350         * resources/sunspider-compare-results.js: Added.
1351         * sunspider-compare-results: Added.
1352
1353 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
1354
1355         Reviewed by Darin Adler.
1356
1357         * resources/sunspider-analyze-results.js: Do the error range
1358         properly, using the t-distribution instead of 1.96 (which was
1359         based on the normal distribution).
1360         
1361         * sunspider: Print results in a way that will be friendlier to the
1362         soon-to-come compare mode.
1363
1364 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
1365
1366         Reviewed by Review.
1367         
1368         - add more tests (probably the final set for now)
1369         
1370         Already balanced. Added date, regexp, control flow, and a few
1371         more string and object/array access tests.
1372         
1373         * tests/LIST:
1374         * tests/access-fannkuch.js: Added.
1375         * tests/access-nbody.js: Added.
1376         * tests/controlflow-recursive.js: Added.
1377         * tests/date-format-tofte.js: Added.
1378         * tests/date-format-xparb.js: Added.
1379         * tests/regexp-dna.js: Added.
1380         * tests/string-validate-input.js: Added.
1381
1382 2007-10-21  Eric Seidel  <eric@webkit.org>
1383
1384         Reviewed by mjs.
1385
1386         * sunspider: make --shark only sample from testkjs
1387
1388 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
1389
1390         Rubber stamped by Eric.
1391         
1392         - added crypto tests (already balanced)
1393
1394         * tests/LIST:
1395         * tests/crypto-aes.js: Added.
1396         * tests/crypto-md5.js: Added.
1397         * tests/crypto-sha1.js: Added.
1398
1399 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
1400
1401         Reviewed by Adam.
1402         
1403         - rebalance new tests
1404         
1405         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
1406         
1407         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1408
1409         This balances them with the existing tests.
1410
1411         * tests/access-binary-trees.js:
1412         * tests/access-nsieve.js:
1413         * tests/bitops-nsieve-bits.js:
1414         * tests/math-partial-sums.js:
1415         * tests/math-spectral-norm.js:
1416         * tests/string-fasta.js:
1417
1418 2007-10-20  Eric Seidel  <eric@webkit.org>
1419
1420         Reviewed by darin.
1421         
1422         Add improved argument handling to sunspider, including
1423         --runs=<number>, --tests=<pattern, --shark, and --help
1424         Also re-factor code into subroutines
1425
1426         * sunspider: improved argument handling
1427
1428 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1429
1430         Reviewed by Mark.
1431
1432         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
1433         
1434         * TODO:
1435         * tests/LIST:
1436         * tests/access-binary-trees.js: Added.
1437         * tests/access-nsieve.js: Added.
1438         * tests/bitops-nsieve-bits.js: Added.
1439         * tests/math-partial-sums.js: Added.
1440         * tests/math-spectral-norm.js: Added.
1441         * tests/string-fasta.js: Added.
1442
1443 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1444
1445         Reviewed by Darin Adler.
1446
1447         * TODO: Updated to note areas that are now well-covered.
1448         
1449         - Change the tests and the driver to avoid leaving large object
1450         graphs hanging around, since that throws off the subsequent tests.
1451         
1452         * resources/sunspider-standalone-driver.js:
1453         * tests/3d-cube.js:
1454         * tests/3d-morph.js:
1455         * tests/3d-raytrace.js:
1456         * tests/bitops-bitwise-and.js:
1457         * tests/string-base64.js:
1458         * tests/string-tagcloud.js:
1459
1460 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1461
1462         Reviewed by Nikolas.
1463         
1464         - Rebalance test complexity.
1465         
1466         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
1467         
1468         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1469
1470         However, for some tests, IE7 was a huge outlier compared to other
1471         major browsers. For those tests, I used Firefox 2.0.0.8 on the
1472         same OS and hardware as a normalization basis.
1473         
1474         * tests/3d-morph.js:
1475         * tests/3d-raytrace.js:
1476         * tests/bitops-3bit-bits-in-byte.js:
1477         * tests/bitops-bits-in-byte.js:
1478         * tests/bitops-bitwise-and.js:
1479         * tests/math-cordic.js:
1480         * tests/string-base64.js:
1481         * tests/string-tagcloud.js:
1482         * tests/string-unpack-code.js:
1483
1484 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1485
1486         Reviewed by Oliver.
1487         
1488         - Fix the browser-hosted driver to be compatible with Safari 2
1489
1490         * hosted/sunspider-driver.html:
1491
1492 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
1493
1494         Rubber stamped by Hyatt.
1495         
1496         - Add BSD license notice to cordic test, the original author said to do so.
1497
1498         * tests/math-cordic.js:
1499
1500 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1501
1502         Reviewed by Eric.
1503         
1504         - Support Windows and Windows browsers.
1505
1506         * hosted/sunspider-results.html: Display results correctly in IE.
1507         * sunspider: tweaks to work on Windows, and with spaces in the path.
1508
1509 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
1510
1511         Rubber stamped by Oliver.
1512
1513         * tests/string-tagcloud.js: Remove stray print()
1514
1515 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
1516
1517         Reviewed by Oliver.
1518         
1519         Add some string test cases.
1520
1521         * tests/string-base64.js: Added. Does base64 encoding and decoding.
1522         * tests/string-tagcloud.js: Added. Parses a JSON string and
1523         generates tagcloud HTML markup based on the data.        
1524         * tests/string-unpack-code.js: Added. Unpack compressed versions of
1525         four of the most popular JavaScript libraries.
1526         * tests/LIST: Added the new tests.
1527
1528 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
1529
1530         Reviewed by Anders.
1531
1532         * TODO: Updated with info on how to do the stats properly.
1533
1534         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
1535         avoid overly slowing down the benchmark.
1536
1537         Added some 3D-related test cases.
1538         
1539         * tests/3d-cube.js: Added.
1540         * tests/3d-morph.js: Added.
1541         * tests/3d-raytrace.js: Added.
1542         * tests/LIST:
1543
1544 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
1545
1546         Reviewed by Darin Adler.
1547
1548         - New JavaScript benchmark
1549         http://bugs.webkit.org/show_bug.cgi?id=15515
1550         
1551         A start on a new JavaScript benchmark, with standalone and
1552         browser-hosted drivers.
1553         
1554         The test content is still incomplete and the drivers could use
1555         some more features but there is enough here to make a good start.
1556         
1557         The drivers compute a 95% confidence interval on the mean for the
1558         whole test, each category, and each individual test to make it
1559         easier to tell whether differences are statistically
1560         significant. The confidence interval can be narrowed by running
1561         the test more times.
1562         
1563         * TODO: Added. Remaining things that need to be done.
1564         * sunspider: Added. Perl script that acts as the standalone test driver.
1565         * resources/sunspider-standalone-driver.js: Added. JavaScript part
1566         of standalone test driver.
1567         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
1568         analysis code.
1569         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
1570         * make-hosted: Added. Script to generate browser-hosted tests.
1571         * hosted/sunspider.html: Added. Start page for browser-hosted test.
1572         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
1573         * hosted/sunspider-results.html: Added. Results page for browser-hosted
1574         tests.
1575         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
1576         tests.
1577         * tests/LIST: Added. List of tests to use.
1578         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
1579         * tests/bitops-bits-in-byte.js: Added. Ditto.
1580         * tests/bitops-bitwise-and.js: Added. Ditto.
1581         * tests/math-cordic.js: Added. Ditto.
1582