1 2011-07-02 Maciej Stachowiak <mjs@apple.com>
3 Reviewed by Anders Carlsson.
5 SunSpider: all four bitops benchmarks can be replaced with NOP
6 https://bugs.webkit.org/show_bug.cgi?id=38446
8 * tests/sunspider-1.0/bitops-3bit-bits-in-byte.js:
9 (TimeFunc): Save the result.
10 * tests/sunspider-1.0/bitops-bits-in-byte.js:
11 (TimeFunc): Save the result.
12 * tests/sunspider-1.0/bitops-bitwise-and.js: More explicitly
14 * tests/sunspider-1.0/bitops-nsieve-bits.js:
15 (sieve): Save the result.
17 2011-07-02 Maciej Stachowiak <mjs@apple.com>
19 SunSpider: string-validate-input.js uses an undeclared variable named 'name', which is a DOM API
20 https://bugs.webkit.org/show_bug.cgi?id=60937
22 Reviewed by Dan Bernstein.
24 * tests/sunspider-1.0/string-validate-input.js:
25 (doTest): Rename the variable to username
27 2011-07-02 Maciej Stachowiak <mjs@apple.com>
29 Reviewed by Darin Adler.
31 SunSpider: The main function of math-cordic is dead code
32 https://bugs.webkit.org/show_bug.cgi?id=63863
34 Try to prevent math-cordic from being eliminated as dead code or
35 compiled down to a constant.
37 * tests/sunspider-1.0/math-cordic.js:
41 2011-06-30 Maciej Stachowiak <mjs@apple.com>
43 Reviewed by Adam Barth.
45 Create sunspider-1.0 directory in preparation for fixing a bunch of bugs
46 https://bugs.webkit.org/show_bug.cgi?id=63782
48 * make-hosted: Learn about the new directory.
49 * tests/sunspider-1.0: Copied from PerformanceTests/SunSpider/tests/sunspider-0.9.1.
51 2010-11-29 Geoffrey Garen <ggaren@apple.com>
53 Reviewed by Gavin Barraclough.
55 Improved accuracy of command-line SunSpider.
57 * resources/sunspider-standalone-driver.js: Use the returned number of
58 elapsed milliseconds from "run" and "checkSyntax" instead of measuring
59 ourselves, for slightly more accurate numbers.
61 2010-09-16 Gavin Barraclough <barraclough@apple.com>
63 Reviewed by Mark Rowe.
64 https://bugs.webkit.org/show_bug.cgi?id=45924
66 Modify the SunSpider harness to allow a path to be passed to the --suite
67 argument, supress the normal prepend-"tests/" behaviour for suite names
70 Also wrap the code in an anonymous function to move variables out of global
71 scope (currently the harness cannot handle running tests the overwrite the
74 * resources/sunspider-standalone-driver.js:
77 2010-08-27 Michael Saboff <msaboff@apple.com>
79 Reviewed by Stephanie Lewis.
81 Added version 5 and version 6 of V8 tests with modifications similar
82 to the version 4 tests so they'll work with the SunSpider test harness.
83 Note that these files are external source and therefore don't conform
84 to WebKit coding standards.
85 https://bugs.webkit.org/show_bug.cgi?id=44638
88 * tests/v8-v5/LIST: Added.
89 * tests/v8-v5/v8-crypto.js: Added.
90 * tests/v8-v5/v8-deltablue.js: Added.
91 * tests/v8-v5/v8-earley-boyer.js: Added.
92 * tests/v8-v5/v8-raytrace.js: Added.
93 * tests/v8-v5/v8-regexp.js: Added.
94 * tests/v8-v5/v8-richards.js: Added.
95 * tests/v8-v5/v8-splay.js: Added.
97 * tests/v8-v6/LIST: Added.
98 * tests/v8-v6/v8-crypto.js: Added.
99 * tests/v8-v6/v8-deltablue.js: Added.
100 * tests/v8-v6/v8-earley-boyer.js: Added.
101 * tests/v8-v6/v8-raytrace.js: Added.
102 * tests/v8-v6/v8-regexp.js: Added.
103 * tests/v8-v6/v8-richards.js: Added.
104 * tests/v8-v6/v8-splay.js: Added.
106 2010-07-15 Stephanie Lewis <slewis@apple.com>
108 Reviewed by Geoff Garen.
110 http://bugs.webkit.org/show_bug.cgi?id=42406
111 Output location of results file.
115 2010-05-17 Maciej Stachowiak <mjs@apple.com>
117 Reviewed by Mark Rowe.
119 Browser-hosted version of SunSpider runs tests twice as many times as advertised
120 https://bugs.webkit.org/show_bug.cgi?id=39201
122 * make-hosted: Make sure to reset test list after every test suite.
124 2010-05-07 Adam Roben <aroben@apple.com>
126 Fix typo in sunspider-compare-results.js that caused incorrect
127 two-sample t statistics to be computed
129 Fixes <http://webkit.org/b/38768> SunSpider computes incorrect
130 two-sample t statistics
132 Reviewed by Darin Adler.
134 * resources/sunspider-compare-results.js:
135 (sunspiderCompareResults.resultLine): Fixed the calculation of the t
136 variable to match the definition of a two-sample t statistic. Looks
137 like this was just a simple typo.
139 2010-04-05 Darin Adler <darin@apple.com>
141 Updated the ignore property for changes to the contents here.
143 * .: Modified property svn:ignore.
145 2010-02-20 Maciej Stachowiak <mjs@apple.com>
147 Reviewed by Adam Barth.
149 Add sunspider-0.9.1 to the site in preparation for announcing it.
150 https://bugs.webkit.org/show_bug.cgi?id=35206
152 * hosted/sunspider.css: Remove tabs, which I noticed where present while
153 copying to the WebKitSite directory.
155 2010-01-11 Oliver Hunt <oliver@apple.com>
157 Reviewed by Darin Adler.
159 Sunspider parse-only tests don't run
160 https://bugs.webkit.org/show_bug.cgi?id=33489
162 Fix parse-only test list
164 * tests/parse-only/LIST:
166 2009-12-15 Maciej Stachowiak <mjs@apple.com>
168 Reviewed by Adele Peterson.
170 Make SunSpider version more prominent in the title
171 https://bugs.webkit.org/show_bug.cgi?id=32574
173 * hosted/sunspider.html:
174 * hosted/versions.html:
175 * resources/driver-TEMPLATE.html:
176 * resources/results-TEMPLATE.html:
178 2009-12-15 Maciej Stachowiak <mjs@apple.com>
180 Reviewed by Darin Adler.
182 Make SunSpider refuse to compare results across content versions
183 https://bugs.webkit.org/show_bug.cgi?id=32573
185 The results URL now includes a version indicator, and compare mode
186 will refuse to compare between versions.
188 * resources/driver-TEMPLATE.html:
189 * resources/results-TEMPLATE.html:
191 2009-12-14 Maciej Stachowiak <mjs@apple.com>
193 Reviewed by Darin Adler.
195 Some Browser-hosted SunSpider files are not valid HTML5
196 https://bugs.webkit.org/show_bug.cgi?id=32536
198 Made various fixes to validate as HTML5 with no warnings (mainly removing bogus
199 close tags and adding a meta charset declaration).
201 * hosted/sunspider.html:
202 * hosted/versions.html:
203 * resources/TEMPLATE.html:
204 * resources/driver-TEMPLATE.html:
205 * resources/results-TEMPLATE.html:
207 2009-12-14 Maciej Stachowiak <mjs@apple.com>
209 Reviewed by Eric Seidel.
211 Make sunspider-0.9.1 the default content set (both command-line and hosted)
212 https://bugs.webkit.org/show_bug.cgi?id=32537
214 * hosted/sunspider.html: Change default suite link.
215 * sunspider: Change default suite.
216 * sunspider-compare-results: Likewise.
218 2009-12-14 Maciej Stachowiak <mjs@apple.com>
220 Reviewed by Sam Weinig.
222 in-browser SunSpider suffers excessive penalty under power management
223 https://bugs.webkit.org/show_bug.cgi?id=32505
225 I have made a few changes to address this:
227 1) Change how browser-hosted SunSpider loads tests - preload the content and write it in with
228 document.write to reduce triggering of progress UI.
229 2) Reduce time between tests to 10ms from 500ms, so that power management doesn't keep the CPU
230 stepped all the way down the whole time.
231 3) Run the test cycle an extra time for warmup before the runs that count.
233 * hosted/sunspider-record-result.js: Removed.
235 * resources/TEMPLATE.html:
236 * resources/driver-TEMPLATE.html:
238 2009-12-13 Maciej Stachowiak <mjs@apple.com>
240 Reviewed by Gavin Barraclough.
242 SunSpider/tests/string-base64.js does not compute a valid base64 encoded string
243 https://bugs.webkit.org/show_bug.cgi?id=16806
245 Based on a patch by Eric Seidel.
247 Fix the base64 computation to actually compute correct results. The impact on runtime of
248 the test is pretty small, but noticeable for some browsers. But at least it's not
249 doing a wrong and meaningless computation any more.
251 * tests/sunspider-0.9.1/string-base64.js:
255 2009-12-13 Maciej Stachowiak <mjs@apple.com>
257 Fixing commit error...
259 I accidentally committed my last patch in a form that broke Web-hosted SunSpider. Fixing.
261 * resources/driver-TEMPLATE.html:
263 2009-12-13 Maciej Stachowiak <mjs@apple.com>
265 Reviewed by Sam Weinig.
267 Use JSON.parse instead of eval for Web-hosted SunSpider results processing
268 https://bugs.webkit.org/show_bug.cgi?id=32490
270 * hosted/json2.js: Added. Incorporated from json.org
271 * resources/driver-TEMPLATE.html: Fix an HTML validation bug I noticed.
272 * resources/results-TEMPLATE.html: Use JSON.parse instead of eval to process
275 2009-12-12 Maciej Stachowiak <mjs@apple.com>
277 Reviewed by Oliver Hunt.
279 Enable Web-hosted version of SunSpider to handle multiple versions
280 https://bugs.webkit.org/show_bug.cgi?id=32478
282 * make-hosted: Now generate the hosted version to be able to run both the
283 0.9 and the 0.9.1 test suites.
284 * hosted: Modified property svn:ignore.
285 * hosted/sunspider-driver.html: Removed.
286 * hosted/sunspider-results.html: Removed.
287 * hosted/sunspider.html:
288 * hosted/versions.html: Added.
289 * resources/TEMPLATE.html:
290 * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-driver.html.
291 * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-results.html.
293 2009-12-12 Maciej Stachowiak <mjs@apple.com>
295 Reviewed by Oliver Hunt.
297 Give command-line sunspider the ability to handle multiple suites and versions
298 https://bugs.webkit.org/show_bug.cgi?id=32477
300 Each suite/version's set of tests are now in a separate subdirectory of tests/, with a file named LIST
301 enumerating the tests. Current suites are:
303 sunspider-0.9 - riginal SunSpider content
304 sunspider-0.9.1 - SunSpider suite with a few tests fixed (and a few more to come)
305 ubench - "ubench" microbenchmark suite
306 v8-v4 - version 4 of the v8 benchmark
307 parse-only - some parser tests
309 Sunspider can now be run with the --suite= parameter to select a
310 suite. The default is --suite=sunspider-0.9.
312 * .: Modified property svn:ignore to ignore new results directories.
313 * make-hosted: Generate based on sunspider-0.9 suite.
314 * resources/TEMPLATE.html: Fix an HTML compliance problem.
315 * resources/sunspider-standalone-driver.js: Become aware of suite names.
316 * sunspider: Modified to handle multiple suites as described above.
317 * sunspider-compare-results: ditto
318 * tests/LIST: Moved to tests/sunspider-0.9/ and tests/sunspider-0.9.1/
319 * tests/LIST-PARSE-ONLY: Moved to parse-only/LIST
320 * tests/LIST-UBENCH: Removed.
321 * tests/LIST-V8: Removed.
322 * tests/3d-cube.js: Moved to tests/sunspider-0.9 and tests/sunspider-0.9.1
323 * tests/3d-morph.js: ditto
324 * tests/3d-raytrace.js: ditto
325 * tests/access-binary-trees.js: ditto
326 * tests/access-fannkuch.js: ditto
327 * tests/access-nbody.js: ditto
328 * tests/access-nsieve.js: ditto
329 * tests/bitops-3bit-bits-in-byte.js: ditto
330 * tests/bitops-bits-in-byte.js: ditto
331 * tests/bitops-bitwise-and.js: ditto
332 * tests/bitops-nsieve-bits.js: ditto
333 * tests/controlflow-recursive.js: ditto
334 * tests/crypto-aes.js: ditto
335 * tests/crypto-md5.js: ditto
336 * tests/crypto-sha1.js: ditto
337 * tests/date-format-tofte.js: ditto
338 * tests/date-format-xparb.js: ditto
339 * tests/math-cordic.js: ditto
340 * tests/math-partial-sums.js: ditto
341 * tests/math-spectral-norm.js: ditto
342 * tests/regexp-dna.js: ditto
343 * tests/string-base64.js: ditto
344 * tests/string-fasta.js: ditto
345 * tests/string-tagcloud.js: ditto
346 * tests/string-unpack-code.js: ditto
347 * tests/string-validate-input.js: ditto
348 * tests/sunspider-0.9/: Added
349 * tests/sunspider-0.9/*.js: Moved from one level up
350 * tests/sunspider-0.9.1: Added.
351 * tests/sunspider-0.9.1/*.js: Moved from one level up.
352 * tests/v8-crypto.js: Moved to v8-v4/ directory.
353 * tests/v8-deltablue.js: ditto
354 * tests/v8-earley-boyer.js: ditto
355 * tests/v8-raytrace.js: ditto
356 * tests/v8-regexp.js: ditto
357 * tests/v8-richards.js: ditto
358 * tests/v8-splay.js: ditto
359 * tests/v8-v4: Added.
361 2009-09-30 Csaba Osztrogonac <oszi@inf.u-szeged.hu>
363 Reviewed by Darin Adler.
365 Platform specific null device replaced with a platform independent.
366 https://bugs.webkit.org/show_bug.cgi?id=29544
368 * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL.
370 2009-09-21 Csaba Osztrogonac <oszi@inf.u-szeged.hu>
372 Reviewed by Maciej Stachowiak.
374 [Qt] Make sunspider script work on Windows platform.
375 https://bugs.webkit.org/show_bug.cgi?id=29544
378 Using platform specific null device instead of /dev/null.
380 2009-06-19 Adam Treat <adam.treat@torchmobile.com>
382 Reviewed by Oliver Hunt.
384 https://bugs.webkit.org/show_bug.cgi?id=26540
385 Currently the SunSpider test driver lacks an option to run a test suite that
386 will test JavaScriptCore parsing performance only. This patch adds just such
387 a test suite and option to SunSpider as well as the jsc test shell. I've included
388 three large javascript source files found in the wild: jquery, mootools and prototype.
389 Combined with the concatenation of all three, these form a new testsuite to measure
390 and test pure JavaScriptCore parsing performance.
392 * resources/sunspider-standalone-driver.js:
393 Load the js with parse-only flag if it is part of the parse-only suite.
395 Add the parse-only suite to the list of options.
396 * sunspider-compare-results:
397 Add the parse-only suite to the list of options.
398 * tests/LIST-PARSE-ONLY: Added.
399 * tests/parse-only/concat-jquery-mootools-prototype.js: Added.
400 A very large concatenation of the scripts found below. This js takes ~30ms to parse on my machine.
401 * tests/parse-only/jquery-1.3.2.js: Added.
402 Latest version from jquery.com.
403 * tests/parse-only/mootools-1.2.2-core-nc.js: Added.
404 Latest version from mootools.net.
405 * tests/parse-only/prototype-1.6.0.3.js: Added.
406 Latest version from prototypejs.org.
408 2009-06-13 Steve Falkenburg <sfalken@apple.com>
410 Update V8 benchmark to version 4.
412 Reviewed by Cameron Zwarich.
415 * tests/v8-crypto.js:
416 * tests/v8-deltablue.js:
417 * tests/v8-earley-boyer.js:
418 * tests/v8-raytrace.js:
419 * tests/v8-regexp.js: Added.
420 * tests/v8-richards.js:
421 * tests/v8-splay.js: Added.
423 2009-05-26 Olivier DOLE <odole@pleyo.com>
427 Store sunspider test suite results in a specific directory for each
428 different type of benchmark (sunspider, V8 or ubench).
431 * sunspider-compare-results:
433 2009-05-12 Steve Falkenburg <sfalken@apple.com>
439 2009-05-11 Steve Falkenburg <sfalken@apple.com>
441 Include SunSpider tests in production builds.
443 Reviewed by Adam Roben.
445 * SunSpider.make: Added.
446 * xcopy.excludes: Added.
448 2009-03-04 Oliver Hunt <oliver@apple.com>
450 Added a few more tests to ubench
454 Adding a couple of test to cover too few and too many arguments. This
455 is needed to prevent regressions in all call paths from my current refactoring.
458 * tests/ubench/function-correct-args.js: Added.
460 * tests/ubench/function-excess-args.js: Added.
463 2008-10-30 Zoltan Horvath <Horvath.Zoltan.6@stud.u-szeged.hu>
465 Fix a bug where when V8's or UBENCH's test suite list file is missing
466 the error message is suggesting that SunSpider's list file is missing.
468 Reviewed by Sam Weinig.
471 (loadTestsList): Fix the error message to use the right list name.
473 2008-10-07 David Hyatt <hyatt@apple.com>
475 https://bugs.webkit.org/show_bug.cgi?id=18989
477 Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
478 we want all browsers to be doing the same thing on the test.
482 * tests/regexp-dna.js:
484 2008-09-09 Cameron Zwarich <cwzwarich@uwaterloo.ca>
486 Rubber-stamped by Maciej Stachowiak.
488 The bleeding edge branch of V8 now supports passing fileanmes after
489 '-f', so the SunSpider script should be changed to do this again.
490 This allows all 3 major JavaScript engines to be used with the
491 unmodified SunSpider script.
495 2008-09-04 Cameron Zwarich <cwzwarich@uwaterloo.ca>
497 Reviewed by Maciej Stachowiak.
499 Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
500 and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
501 correct the punctuation in its documentation.
505 2008-09-04 Cameron Zwarich <cwzwarich@uwaterloo.ca>
507 Reviewed by Oliver Hunt.
509 Bug 20616: Incorporate V8 benchmarks in testing
510 <https://bugs.webkit.org/show_bug.cgi?id=20616>
512 This is a first attempt at running the V8 benchmarks within SunSpider,
513 with the --v8 option. The number of iterations is fixed for each
514 benchmark, and was chosen to make each of the benchmarks run between
515 500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
518 * tests/LIST-V8: Added.
519 * tests/v8-crypto.js: Added.
520 * tests/v8-deltablue.js: Added.
521 * tests/v8-earley-boyer.js: Added.
522 * tests/v8-raytrace.js: Added.
523 * tests/v8-richards.js: Added.
525 2008-09-02 Cameron Zwarich <cwzwarich@uwaterloo.ca>
529 Remove a local change that was accidentally committed in r36034.
531 * resources/sunspider-standalone-driver.js:
533 2008-09-02 Cameron Zwarich <cwzwarich@uwaterloo.ca>
535 Rubber-stamped by Oliver Hunt.
537 Make SunSpider work with JavaScript shells that don't take filenames
538 after a '-f' argument.
542 2008-06-07 Cameron Zwarich <cwzwarich@uwaterloo.ca>
546 Remove the --squirrelfish option from SunSpider, as it is no longer needed.
549 * tests/LIST-SQUIRRELFISH: Removed.
551 2008-06-03 Alexey Proskuryakov <ap@webkit.org>
553 Rubber-stamped by Mark Rowe.
555 Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
559 2008-04-15 Maciej Stachowiak <mjs@apple.com>
561 Rubber stamped by Oliver.
563 - add newly working tests to squirrelfish list
565 * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
567 2008-04-14 Maciej Stachowiak <mjs@apple.com>
569 Rubber stamped by Oliver.
571 - move ubench tests properly.
573 * tests/ubench: Added.
574 * tests/ubench/function-closure.js: Added.
575 * tests/ubench/function-empty.js: Added.
576 * tests/ubench/function-missing-args.js: Added.
577 * tests/ubench/function-sum.js: Added.
578 * tests/ubench/loop-empty-resolve.js: Added.
579 * tests/ubench/loop-empty.js: Added.
580 * tests/ubench/loop-sum.js: Added.
582 2008-04-14 Maciej Stachowiak <mjs@apple.com>
584 Rubber stamped by Oliver.
586 * sunspider: Don't force --runs=1 in squirrelfish mode any more.
588 2008-04-14 Maciej Stachowiak <mjs@apple.com>
592 - make --squirrelfish mode use the real harness, but a reduced set of tests
594 Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
597 * tests/LIST-SQUIRRELFISH:
598 * tests/LIST-UBENCH: Added.
599 * tests/squirrelfish: Moved to tests/ubench
601 2008-04-14 Geoffrey Garen <ggaren@apple.com>
603 Reviewed by Maciej Stachowiak.
605 Removed an unused test.
607 * tests/squirrelfish/loop-resolve.js: Removed.
609 2008-04-10 Maciej Stachowiak <mjs@apple.com>
613 Add newly runnable tests to --squirrelfish mode.
615 * tests/LIST-SQUIRRELFISH:
617 2008-04-06 Geoffrey Garen <ggaren@apple.com>
619 Reviewed by Maciej Stachowiak.
621 A little more love for --squirrelfish mode:
623 Fixed a misplaced sort. Results properly sort now.
625 Added a test list just for squirrelfish, and updated it to include
626 all currently passing SunSpider tests.
628 Fixed the pruning regexp to match 3d-morph.js.
632 2008-03-26 Geoffrey Garen <ggaren@apple.com>
634 Reviewed by Oliver Hunt.
636 --squirrelfish mode: pared down tests for squirrelfish to chew on.
640 * tests/squirrelfish: Added.
641 * tests/squirrelfish/function-closure.js: Added.
642 * tests/squirrelfish/function-empty.js: Added.
643 * tests/squirrelfish/function-missing-args.js: Added.
644 * tests/squirrelfish/function-sum.js: Added.
645 * tests/squirrelfish/loop-empty-resolve.js: Added.
646 * tests/squirrelfish/loop-empty.js: Added.
647 * tests/squirrelfish/loop-resolve.js: Added.
648 * tests/squirrelfish/loop-sum.js: Added.
650 2008-03-21 Alexey Proskuryakov <ap@webkit.org>
654 * sunspider: Pause update daemon on Darwin to make results reliable
655 again (workaround for <rdar://problem/5811127>).
657 2008-02-07 Eric Seidel <eric@webkit.org>
661 * sunspider: add an error message when ./tests/LIST is not found
663 2007-12-29 Alp Toker <alp@atoker.com>
667 * hosted/sunspider.html:
669 2007-12-29 Alp Toker <alp@atoker.com>
673 Provide the current URL in the SunSpider results page. Useful for
674 copying benchmark results out of browsers without a location bar or
675 where the location bar can't handle long URLs.
677 * hosted/sunspider-results.html:
679 2007-12-20 Eric Seidel <eric@webkit.org>
683 * sunspider: increase default number of runs for more accurate numbers
685 2007-12-18 Mark Rowe <mrowe@apple.com>
689 * hosted/sunspider.html:
691 2007-12-18 Maciej Stachowiak <mjs@apple.com>
695 - give an extra digit of precision for small differences.
697 * resources/sunspider-compare-results.js:
699 2007-12-17 Maciej Stachowiak <mjs@apple.com>
703 - work around IE layout bugs
705 * hosted/sunspider.css:
707 2007-12-17 Maciej Stachowiak <mjs@apple.com>
711 - fix compare feature
713 * hosted/sunspider-results.html:
715 2007-12-17 Maciej Stachowiak <mjs@apple.com>
719 - Change the format of the output URL to be shorter, to meet IE constraints
721 * hosted/sunspider-driver.html:
722 * hosted/sunspider-results.html:
724 2007-12-13 Maciej Stachowiak <mjs@apple.com>
728 - Add some explanatory test and a dumb logo to SunSpider web hosted version
730 * hosted/sunspider-driver.html:
731 * hosted/sunspider-results.html:
732 * hosted/sunspider.css:
733 * hosted/sunspider.html:
735 2007-12-13 Maciej Stachowiak <mjs@apple.com>
739 - Make the web-hosted version of SunSpider look a little bit less drab.
741 * hosted/sunspider-driver.html:
742 * hosted/sunspider-results.html:
743 * hosted/sunspider.css: Added.
744 * hosted/sunspider.html:
745 * resources/TEMPLATE.html:
747 2007-12-12 Maciej Stachowiak <mjs@apple.com>
751 - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
753 A sample of what new-style results would look like:
755 TEST COMPARISON FROM TO DETAILS
757 ** TOTAL **: 1.41x as fast 6613.6ms +/- 0.1% 4703.0ms +/- 0.1% significant
759 3bit-bits-in-byte: *1.36x as slow* 88.8ms +/- 0.6% 121.1ms +/- 0.6% significant
761 * resources/sunspider-compare-results.js:
763 2007-11-14 Eric Seidel <eric@webkit.org>
767 * sunspider: add --shark-cache for L2 Cache Miss profiling
769 2007-11-09 Alexey Proskuryakov <ap@webkit.org>
771 Reviewed by Darin Adler.
773 http://bugs.webkit.org/show_bug.cgi?id=15925
774 SunSpider should check for Shark being installed
776 * sunspider: Explicitly test that shark command line tool is installed.
778 2007-11-04 Darin Adler <darin@apple.com>
780 * hosted/sunspider.html: Tweaked formatting a bit.
782 2007-11-03 Maciej Stachowiak <mjs@apple.com>
784 Reviewed by Darin Adler.
786 - Add compare mode and a description of the benchmark to the hosted version.
788 * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
789 * hosted/sunspider.html: Added intro text.
790 * make-hosted: Copy new file.
791 * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
793 * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
795 * sunspider-compare-results: Use sunspider-standalone-compare.js.
797 2007-11-02 Darin Adler <darin@apple.com>
799 * sunspider: Changed "--base" to "--set-baseline".
801 2007-11-02 Darin Adler <darin@apple.com>
805 * sunspider: Added a "--base" option that records the current test as a baseline.
806 Moved the code to find the newest .mshark file into a function (since I needed to use
807 it in the other script and I prefer to copy/paste a function).
809 * sunspider-compare-results: Added logic to compare the baseline with the last
810 run when you don't pass any parameters.
812 2007-10-29 Maciej Stachowiak <mjs@apple.com>
816 - Added list of ECMAScript3 features that SunSpider does not cover currently.
820 2007-10-29 Maciej Stachowiak <mjs@apple.com>
824 - Give better error messages when sunspider-compare-results fails
826 * sunspider-compare-results:
828 2007-10-29 Maciej Stachowiak <mjs@apple.com>
830 Reviewed by Darin Adler.
832 - fix Date tests to work in command-line SpiderMonkey
834 * tests/date-format-tofte.js:
835 * tests/date-format-xparb.js:
837 2007-10-29 Darin Adler <darin@apple.com>
841 * sunspider: Added --shark20 option, to run Shark at its highest sample
842 resolution instead of its default.
844 2007-10-28 Adam Roben <aroben@apple.com>
846 Fix SunSpider on Windows
850 * sunspider: Don't use colons in filenames.
852 2007-10-28 Darin Adler <darin@apple.com>
856 * resources/sunspider-analyze-results.js: Tweak the output format a little.
857 Change so that when there's only one run we don't write out confidence
858 intervals at all rather than writing "NaN" over and over again.
860 * sunspider: Use the time and date as a suffix on the results file, that way
861 all the results are left behind in the tmp directory. This will make it easy
862 for us to add features that compare past results in the future. Also rename
863 the .mshark files using the same scheme.
865 * sunspider-compare-results: Relax the parsing rules so we can parse the
866 results file exactly as it's emitted from sunspider.
868 2007-10-25 Adam Roben <aroben@apple.com>
870 Strip carriage returns from results
872 Carriage returns were screwing up sunspider-compare-results on
875 Rubberstamped by Oliver.
879 2007-10-24 Darin Adler <darin@apple.com>
883 * sunspider: Open the profile in shark after completing a run.
884 * sunspider-compare-results: Tiny perl tweaks.
886 2007-10-23 Maciej Stachowiak <mjs@apple.com>
888 Reviewed by Darin Adler.
890 - Don't hardcode my path to testkjs
892 * sunspider-compare-results:
894 2007-10-23 Maciej Stachowiak <mjs@apple.com>
896 Reviewed by Darin Adler.
898 - Add a compare script to compare results, and improve formatting of standard results a bit.
900 * resources/sunspider-analyze-results.js:
901 * resources/sunspider-compare-results.js: Added.
902 * sunspider-compare-results: Added.
904 2007-10-23 Maciej Stachowiak <mjs@apple.com>
906 Reviewed by Darin Adler.
908 * resources/sunspider-analyze-results.js: Do the error range
909 properly, using the t-distribution instead of 1.96 (which was
910 based on the normal distribution).
912 * sunspider: Print results in a way that will be friendlier to the
913 soon-to-come compare mode.
915 2007-10-22 Maciej Stachowiak <mjs@apple.com>
919 - add more tests (probably the final set for now)
921 Already balanced. Added date, regexp, control flow, and a few
922 more string and object/array access tests.
925 * tests/access-fannkuch.js: Added.
926 * tests/access-nbody.js: Added.
927 * tests/controlflow-recursive.js: Added.
928 * tests/date-format-tofte.js: Added.
929 * tests/date-format-xparb.js: Added.
930 * tests/regexp-dna.js: Added.
931 * tests/string-validate-input.js: Added.
933 2007-10-21 Eric Seidel <eric@webkit.org>
937 * sunspider: make --shark only sample from testkjs
939 2007-10-21 Maciej Stachowiak <mjs@apple.com>
941 Rubber stamped by Eric.
943 - added crypto tests (already balanced)
946 * tests/crypto-aes.js: Added.
947 * tests/crypto-md5.js: Added.
948 * tests/crypto-sha1.js: Added.
950 2007-10-21 Maciej Stachowiak <mjs@apple.com>
954 - rebalance new tests
956 Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
958 Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
960 This balances them with the existing tests.
962 * tests/access-binary-trees.js:
963 * tests/access-nsieve.js:
964 * tests/bitops-nsieve-bits.js:
965 * tests/math-partial-sums.js:
966 * tests/math-spectral-norm.js:
967 * tests/string-fasta.js:
969 2007-10-20 Eric Seidel <eric@webkit.org>
973 Add improved argument handling to sunspider, including
974 --runs=<number>, --tests=<pattern, --shark, and --help
975 Also re-factor code into subroutines
977 * sunspider: improved argument handling
979 2007-10-20 Maciej Stachowiak <mjs@apple.com>
983 - Add more new tests, mostly from the computer language shootout. Not normalized yet.
987 * tests/access-binary-trees.js: Added.
988 * tests/access-nsieve.js: Added.
989 * tests/bitops-nsieve-bits.js: Added.
990 * tests/math-partial-sums.js: Added.
991 * tests/math-spectral-norm.js: Added.
992 * tests/string-fasta.js: Added.
994 2007-10-20 Maciej Stachowiak <mjs@apple.com>
996 Reviewed by Darin Adler.
998 * TODO: Updated to note areas that are now well-covered.
1000 - Change the tests and the driver to avoid leaving large object
1001 graphs hanging around, since that throws off the subsequent tests.
1003 * resources/sunspider-standalone-driver.js:
1005 * tests/3d-morph.js:
1006 * tests/3d-raytrace.js:
1007 * tests/bitops-bitwise-and.js:
1008 * tests/string-base64.js:
1009 * tests/string-tagcloud.js:
1011 2007-10-20 Maciej Stachowiak <mjs@apple.com>
1013 Reviewed by Nikolas.
1015 - Rebalance test complexity.
1017 Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
1019 Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1021 However, for some tests, IE7 was a huge outlier compared to other
1022 major browsers. For those tests, I used Firefox 2.0.0.8 on the
1023 same OS and hardware as a normalization basis.
1025 * tests/3d-morph.js:
1026 * tests/3d-raytrace.js:
1027 * tests/bitops-3bit-bits-in-byte.js:
1028 * tests/bitops-bits-in-byte.js:
1029 * tests/bitops-bitwise-and.js:
1030 * tests/math-cordic.js:
1031 * tests/string-base64.js:
1032 * tests/string-tagcloud.js:
1033 * tests/string-unpack-code.js:
1035 2007-10-20 Maciej Stachowiak <mjs@apple.com>
1039 - Fix the browser-hosted driver to be compatible with Safari 2
1041 * hosted/sunspider-driver.html:
1043 2007-10-20 Maciej Stachowiak <mjs@apple.com>
1045 Rubber stamped by Hyatt.
1047 - Add BSD license notice to cordic test, the original author said to do so.
1049 * tests/math-cordic.js:
1051 2007-10-18 Maciej Stachowiak <mjs@apple.com>
1055 - Support Windows and Windows browsers.
1057 * hosted/sunspider-results.html: Display results correctly in IE.
1058 * sunspider: tweaks to work on Windows, and with spaces in the path.
1060 2007-10-18 Maciej Stachowiak <mjs@apple.com>
1062 Rubber stamped by Oliver.
1064 * tests/string-tagcloud.js: Remove stray print()
1066 2007-10-17 Maciej Stachowiak <mjs@apple.com>
1070 Add some string test cases.
1072 * tests/string-base64.js: Added. Does base64 encoding and decoding.
1073 * tests/string-tagcloud.js: Added. Parses a JSON string and
1074 generates tagcloud HTML markup based on the data.
1075 * tests/string-unpack-code.js: Added. Unpack compressed versions of
1076 four of the most popular JavaScript libraries.
1077 * tests/LIST: Added the new tests.
1079 2007-10-16 Maciej Stachowiak <mjs@apple.com>
1083 * TODO: Updated with info on how to do the stats properly.
1085 * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
1086 avoid overly slowing down the benchmark.
1088 Added some 3D-related test cases.
1090 * tests/3d-cube.js: Added.
1091 * tests/3d-morph.js: Added.
1092 * tests/3d-raytrace.js: Added.
1095 2007-10-14 Maciej Stachowiak <mjs@apple.com>
1097 Reviewed by Darin Adler.
1099 - New JavaScript benchmark
1100 http://bugs.webkit.org/show_bug.cgi?id=15515
1102 A start on a new JavaScript benchmark, with standalone and
1103 browser-hosted drivers.
1105 The test content is still incomplete and the drivers could use
1106 some more features but there is enough here to make a good start.
1108 The drivers compute a 95% confidence interval on the mean for the
1109 whole test, each category, and each individual test to make it
1110 easier to tell whether differences are statistically
1111 significant. The confidence interval can be narrowed by running
1112 the test more times.
1114 * TODO: Added. Remaining things that need to be done.
1115 * sunspider: Added. Perl script that acts as the standalone test driver.
1116 * resources/sunspider-standalone-driver.js: Added. JavaScript part
1117 of standalone test driver.
1118 * resources/sunspider-analyze-results.js: Added. JavaScript statistical
1120 * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
1121 * make-hosted: Added. Script to generate browser-hosted tests.
1122 * hosted/sunspider.html: Added. Start page for browser-hosted test.
1123 * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
1124 * hosted/sunspider-results.html: Added. Results page for browser-hosted
1126 * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
1128 * tests/LIST: Added. List of tests to use.
1129 * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
1130 * tests/bitops-bits-in-byte.js: Added. Ditto.
1131 * tests/bitops-bitwise-and.js: Added. Ditto.
1132 * tests/math-cordic.js: Added. Ditto.