d963b226917581baf0ec5aeeaee56b3679b734de
[WebKit-https.git] / SunSpider / ChangeLog
1 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
2
3         Reviewed by Adam.
4         
5         - rebalance new tests
6         
7         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
8         
9         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
10
11         This balances them with the existing tests.
12
13         * tests/access-binary-trees.js:
14         * tests/access-nsieve.js:
15         * tests/bitops-nsieve-bits.js:
16         * tests/math-partial-sums.js:
17         * tests/math-spectral-norm.js:
18         * tests/string-fasta.js:
19
20 2007-10-20  Eric Seidel  <eric@webkit.org>
21
22         Reviewed by darin.
23         
24         Add improved argument handling to sunspider, including
25         --runs=<number>, --tests=<pattern, --shark, and --help
26         Also re-factor code into subroutines
27
28         * sunspider: improved argument handling
29
30 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
31
32         Reviewed by Mark.
33
34         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
35         
36         * TODO:
37         * tests/LIST:
38         * tests/access-binary-trees.js: Added.
39         * tests/access-nsieve.js: Added.
40         * tests/bitops-nsieve-bits.js: Added.
41         * tests/math-partial-sums.js: Added.
42         * tests/math-spectral-norm.js: Added.
43         * tests/string-fasta.js: Added.
44
45 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
46
47         Reviewed by Darin.
48
49         * TODO: Updated to note areas that are now well-covered.
50         
51         - Change the tests and the driver to avoid leaving large object
52         graphs hanging around, since that throws off the subsequent tests.
53         
54         * resources/sunspider-standalone-driver.js:
55         * tests/3d-cube.js:
56         * tests/3d-morph.js:
57         * tests/3d-raytrace.js:
58         * tests/bitops-bitwise-and.js:
59         * tests/string-base64.js:
60         * tests/string-tagcloud.js:
61
62 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
63
64         Reviewed by Nikolas.
65         
66         - Rebalance test complexity.
67         
68         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
69         
70         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
71
72         However, for some tests, IE7 was a huge outlier compared to other
73         major browsers. For those tests, I used Firefox 2.0.0.8 on the
74         same OS and hardware as a normalization basis.
75         
76         * tests/3d-morph.js:
77         * tests/3d-raytrace.js:
78         * tests/bitops-3bit-bits-in-byte.js:
79         * tests/bitops-bits-in-byte.js:
80         * tests/bitops-bitwise-and.js:
81         * tests/math-cordic.js:
82         * tests/string-base64.js:
83         * tests/string-tagcloud.js:
84         * tests/string-unpack-code.js:
85
86 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
87
88         Reviewed by Oliver.
89         
90         - Fix the browser-hosted driver to be compatible with Safari 2
91
92         * hosted/sunspider-driver.html:
93
94 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
95
96         Rubber stamped by Hyatt.
97         
98         - Add BSD license notice to cordic test, the original author said to do so.
99
100         * tests/math-cordic.js:
101
102 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
103
104         Reviewed by Eric.
105         
106         - Support Windows and Windows browsers.
107
108         * hosted/sunspider-results.html: Display results correctly in IE.
109         * sunspider: tweaks to work on Windows, and with spaces in the path.
110
111 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
112
113         Rubber stamped by Oliver.
114
115         * tests/string-tagcloud.js: Remove stray print()
116
117 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
118
119         Reviewed by Oliver.
120         
121         Add some string test cases.
122
123         * tests/string-base64.js: Added. Does base64 encoding and decoding.
124         * tests/string-tagcloud.js: Added. Parses a JSON string and
125         generates tagcloud HTML markup based on the data.        
126         * tests/string-unpack-code.js: Added. Unpack compressed versions of
127         four of the most popular JavaScript libraries.
128         * tests/LIST: Added the new tests.
129
130 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
131
132         Reviewed by Anders.
133
134         * TODO: Updated with info on how to do the stats properly.
135
136         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
137         avoid overly slowing down the benchmark.
138
139         Added some 3D-related test cases.
140         
141         * tests/3d-cube.js: Added.
142         * tests/3d-morph.js: Added.
143         * tests/3d-raytrace.js: Added.
144         * tests/LIST:
145
146 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
147
148         Reviewed by Darin.
149
150         - New JavaScript benchmark
151         http://bugs.webkit.org/show_bug.cgi?id=15515
152         
153         A start on a new JavaScript benchmark, with standalone and
154         browser-hosted drivers.
155         
156         The test content is still incomplete and the drivers could use
157         some more features but there is enough here to make a good start.
158         
159         The drivers compute a 95% confidence interval on the mean for the
160         whole test, each category, and each individual test to make it
161         easier to tell whether differences are statistically
162         significant. The confidence interval can be narrowed by running
163         the test more times.
164         
165         * TODO: Added. Remaining things that need to be done.
166         * sunspider: Added. Perl script that acts as the standalone test driver.
167         * resources/sunspider-standalone-driver.js: Added. JavaScript part
168         of standalone test driver.
169         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
170         analysis code.
171         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
172         * make-hosted: Added. Script to generate browser-hosted tests.
173         * hosted/sunspider.html: Added. Start page for browser-hosted test.
174         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
175         * hosted/sunspider-results.html: Added. Results page for browser-hosted
176         tests.
177         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
178         tests.
179         * tests/LIST: Added. List of tests to use.
180         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
181         * tests/bitops-bits-in-byte.js: Added. Ditto.
182         * tests/bitops-bitwise-and.js: Added. Ditto.
183         * tests/math-cordic.js: Added. Ditto.
184