Add "-o/--output" option to startup.py and new_tab.py benchmark scripts to save the...
[WebKit-https.git] / PerformanceTests / ChangeLog
index 8eb2fdb..704dec4 100644 (file)
@@ -1,3 +1,254 @@
+2018-12-17  Suresh Koppisetty  <skoppisetty@apple.com>
+
+        Add "-o/--output" option to startup.py and new_tab.py benchmark scripts to save the results in json format.
+        https://bugs.webkit.org/show_bug.cgi?id=192385
+
+        Reviewed by Ryosuke Niwa.
+
+        Sample json output for new tab benchmark script after running for 2 iterations and 2 groups. Values are in milliseconds.
+        {
+                "NewTabBenchmark": {
+                        "metrics": {
+                                "Time": {
+                                        "current": [
+                                                [
+                                                        410.2939453125,
+                                                        307.81494140625
+                                                ],
+                                                [
+                                                        340.616943359375,
+                                                        265.94384765625
+                                                ]
+                                        ]
+                                }
+                        }
+                }
+        }
+
+        Sample json output for startup time benchmark script after running for 2 iterations. Values are in milliseconds.
+        {
+                "StartupBenchmark": {
+                        "metrics": {
+                                "Time": {
+                                        "current": [
+                                                [
+                                                        1415.2099609375,
+                                                        1439.552978515625
+                                                ]
+                                        ]
+                                }
+                        }
+                }
+        }
+
+        * LaunchTime/launch_time.py:
+        * LaunchTime/new_tab.py:
+        (NewTabBenchmark.get_test_name):
+        * LaunchTime/startup.py:
+        (StartupBenchmark.get_test_name):
+
+2018-12-17  Suresh Koppisetty  <skoppisetty@apple.com>
+
+        Import FeedbackServer only if "-f/--feedback-in-browser" option is enabled.
+        https://bugs.webkit.org/show_bug.cgi?id=192378
+
+        Reviewed by Ryosuke Niwa.
+
+        FeedbackServer currently depends on Tornado-5.1, which further adds
+        dependency of "singledispatch", "backports-abc" and "futures" python libraries.
+        Importing FeedbackServer only if "-f/--feedback-in-browser" option is enabled
+        will let us run the benchmark scripts without installing any new python libraries.
+
+        * LaunchTime/launch_time.py:
+        * LaunchTime/new_tab.py:
+
+2018-12-13  Caio Lima  <ticaiolima@gmail.com>
+
+        [BigInt] Add ValueDiv into DFG
+        https://bugs.webkit.org/show_bug.cgi?id=186178
+
+        Reviewed by Yusuke Suzuki.
+
+        * BigIntBench/big-int-simple-div.js: Added.
+        * BigIntBench/value-div-type-propagation.js: Added.
+
+2018-12-10  Caio Lima  <ticaiolima@gmail.com>
+
+        [BigInt] Add ValueMul into DFG
+        https://bugs.webkit.org/show_bug.cgi?id=186175
+
+        Reviewed by Yusuke Suzuki.
+
+        * BigIntBench/big-int-simple-mul.js: Added.
+        * BigIntBench/value-mul-type-propagation.js: Added.
+
+2018-11-07  Caio Lima  <ticaiolima@gmail.com>
+
+        [BigInt] Add support to BigInt into ValueAdd
+        https://bugs.webkit.org/show_bug.cgi?id=186177
+
+        Reviewed by Keith Miller.
+
+        The idea of BigIntBench is to provide a set of microbenchmarks and
+        benchmarks to evaluate how fast BigInt computations are happening on
+        JSC implementation.
+
+        Now, we are adding microbenchmarks in this set,
+        but the plan is to move these tests to "JSTest/microbenchmarks" when
+        BigInt is enabled by default. After that, the focus of Bigint bench is
+        to provide a set of tests that represents real use cases of BigInt in
+        JS programs.
+
+        * BigIntBench/big-int-add-prediction-propagation.js: Added.
+        * BigIntBench/big-int-simple-add.js: Added.
+        * BigIntBench/big-int-simple-sub.js: Added.
+
+2018-11-07  Tadeu Zagallo  <tzagallo@apple.com>
+
+        REGRESSION(r237547): Test failures on 32-bit JSC since the JIT was disabled
+        https://bugs.webkit.org/show_bug.cgi?id=191184
+
+        Reviewed by Saam Barati.
+
+        Skip test when the JIT is disabled, it takes too long to run on CLoop.
+
+        * JetStream/cdjs/main.js:
+
+2018-11-05  Myles C. Maxfield  <mmaxfield@apple.com>
+
+        Cache glyph paths and share underline skipping code between all the ports
+        https://bugs.webkit.org/show_bug.cgi?id=191239
+
+        Reviewed by Alex Christensen.
+
+        Measures the performance of drawing a whole lot of underlines
+
+        * Layout/underline.html: Added.
+
+2018-10-25  Saam Barati  <sbarati@apple.com>
+
+        Check in corresponding C code in JetStream 2
+        https://bugs.webkit.org/show_bug.cgi?id=190733
+
+        Rubber-stamped by Filip Pizlo.
+
+        * JetStream2/simple/float-mm.c: Added.
+        * JetStream2/wasm/HashSet.cpp: Added.
+        * JetStream2/wasm/gcc-loops.cpp: Added.
+        * JetStream2/wasm/quicksort.c: Added.
+        * JetStream2/wasm/TSF: Added.
+        * JetStream2/wasm/TSF/build.sh: Added.
+        * JetStream2/wasm/TSF/config.h: Added.
+        * JetStream2/wasm/TSF/gpc.h: Added.
+        * JetStream2/wasm/TSF/gpc_code_gen_util.c: Added.
+        * JetStream2/wasm/TSF/gpc_instruction.c: Added.
+        * JetStream2/wasm/TSF/gpc_instruction_dispatch.gen: Added.
+        * JetStream2/wasm/TSF/gpc_instruction_size.gen: Added.
+        * JetStream2/wasm/TSF/gpc_instruction_stack_effects.gen: Added.
+        * JetStream2/wasm/TSF/gpc_instruction_static_size.gen: Added.
+        * JetStream2/wasm/TSF/gpc_instruction_to_string.gen: Added.
+        * JetStream2/wasm/TSF/gpc_int_common.h: Added.
+        * JetStream2/wasm/TSF/gpc_intable.c: Added.
+        * JetStream2/wasm/TSF/gpc_internal.h: Added.
+        * JetStream2/wasm/TSF/gpc_interpreter.gen: Added.
+        * JetStream2/wasm/TSF/gpc_program.c: Added.
+        * JetStream2/wasm/TSF/gpc_proto.c: Added.
+        * JetStream2/wasm/TSF/gpc_stack_height.c: Added.
+        * JetStream2/wasm/TSF/gpc_threaded.c: Added.
+        * JetStream2/wasm/TSF/gpc_worklist.h: Added.
+        * JetStream2/wasm/TSF/tsf.h: Added.
+        * JetStream2/wasm/TSF/tsf_adaptive_reader.c: Added.
+        * JetStream2/wasm/TSF/tsf_asprintf.c: Added.
+        * JetStream2/wasm/TSF/tsf_atomics.h: Added.
+        * JetStream2/wasm/TSF/tsf_buf_reader.c: Added.
+        * JetStream2/wasm/TSF/tsf_buf_writer.c: Added.
+        * JetStream2/wasm/TSF/tsf_buffer.c: Added.
+        * JetStream2/wasm/TSF/tsf_build_defines.h: Added.
+        * JetStream2/wasm/TSF/tsf_config.h: Added.
+        * JetStream2/wasm/TSF/tsf_config_stub.h: Added.
+        * JetStream2/wasm/TSF/tsf_copier.c: Added.
+        * JetStream2/wasm/TSF/tsf_define_helpers.c: Added.
+        * JetStream2/wasm/TSF/tsf_define_helpers.h: Added.
+        * JetStream2/wasm/TSF/tsf_destructor.c: Added.
+        * JetStream2/wasm/TSF/tsf_error.c: Added.
+        * JetStream2/wasm/TSF/tsf_format.h: Added.
+        * JetStream2/wasm/TSF/tsf_fsdb.c: Added.
+        * JetStream2/wasm/TSF/tsf_fsdb_protocol.c: Added.
+        * JetStream2/wasm/TSF/tsf_fsdb_protocol.h: Added.
+        * JetStream2/wasm/TSF/tsf_generator.c: Added.
+        * JetStream2/wasm/TSF/tsf_gpc_code_gen.c: Added.
+        * JetStream2/wasm/TSF/tsf_indent.h: Added.
+        * JetStream2/wasm/TSF/tsf_internal.h: Added.
+        * JetStream2/wasm/TSF/tsf_internal_config.h: Added.
+        * JetStream2/wasm/TSF/tsf_internal_config_stub.h: Added.
+        * JetStream2/wasm/TSF/tsf_inttypes.h: Added.
+        * JetStream2/wasm/TSF/tsf_io.c: Added.
+        * JetStream2/wasm/TSF/tsf_io_utils.c: Added.
+        * JetStream2/wasm/TSF/tsf_ir.c: Added.
+        * JetStream2/wasm/TSF/tsf_ir.h: Added.
+        * JetStream2/wasm/TSF/tsf_ir_different.c: Added.
+        * JetStream2/wasm/TSF/tsf_ir_different.h: Added.
+        * JetStream2/wasm/TSF/tsf_ir_speed.c: Added.
+        * JetStream2/wasm/TSF/tsf_limits.c: Added.
+        * JetStream2/wasm/TSF/tsf_named_type.c: Added.
+        * JetStream2/wasm/TSF/tsf_native.c: Added.
+        * JetStream2/wasm/TSF/tsf_parser.c: Added.
+        * JetStream2/wasm/TSF/tsf_primitive.c: Added.
+        * JetStream2/wasm/TSF/tsf_ra_type_man.c: Added.
+        * JetStream2/wasm/TSF/tsf_reflect.c: Added.
+        * JetStream2/wasm/TSF/tsf_region.h: Added.
+        * JetStream2/wasm/TSF/tsf_serial_in_man.c: Added.
+        * JetStream2/wasm/TSF/tsf_serial_out_man.c: Added.
+        * JetStream2/wasm/TSF/tsf_serial_protocol.h: Added.
+        * JetStream2/wasm/TSF/tsf_sha1.c: Added.
+        * JetStream2/wasm/TSF/tsf_sha1.h: Added.
+        * JetStream2/wasm/TSF/tsf_sha1_writer.c: Added.
+        * JetStream2/wasm/TSF/tsf_sort.c: Added.
+        * JetStream2/wasm/TSF/tsf_st.c: Added.
+        * JetStream2/wasm/TSF/tsf_st.h: Added.
+        * JetStream2/wasm/TSF/tsf_st_typetable.c: Added.
+        * JetStream2/wasm/TSF/tsf_stream_file_input.c: Added.
+        * JetStream2/wasm/TSF/tsf_stream_file_output.c: Added.
+        * JetStream2/wasm/TSF/tsf_type.c: Added.
+        * JetStream2/wasm/TSF/tsf_type_in_map.c: Added.
+        * JetStream2/wasm/TSF/tsf_type_out_map.c: Added.
+        * JetStream2/wasm/TSF/tsf_type_table.c: Added.
+        * JetStream2/wasm/TSF/tsf_types.h: Added.
+        * JetStream2/wasm/TSF/tsf_util.h: Added.
+        * JetStream2/wasm/TSF/tsf_version.c: Added.
+        * JetStream2/wasm/TSF/tsf_zip_abstract.c: Added.
+        * JetStream2/wasm/TSF/tsf_zip_abstract.h: Added.
+        * JetStream2/wasm/TSF/tsf_zip_attr.c: Added.
+        * JetStream2/wasm/TSF/tsf_zip_reader.c: Added.
+        * JetStream2/wasm/TSF/tsf_zip_writer.c: Added.
+
+2018-10-18  Saam Barati  <sbarati@apple.com>
+
+        Make JetStream 2
+        https://bugs.webkit.org/show_bug.cgi?id=187829
+
+        Rubber-stamped by Mark Lam.
+
+        This patch checks in the new JetStream 2 benchmark. JetStream 2 is
+        a new JavaScript and Web Assembly benchmark. JetStream 2's goal
+        is to measure the startup, worst case, and peak throughput performance
+        of the JavaScript engine. JetStream 2 incorporates these previous
+        benchmarks:
+        - JetStream
+        - ARES-6
+        - Kraken
+        - Web Tooling Benchmark
+        - WasmBench
+        - RexBench
+        
+        JetStream 2 also adds some new benchmarks:
+        - Two tests emphasizing web worker performance.
+        - One test emphasizing Promise, async iteration, and DataView performance.
+        - Two new code load tests.
+        - WSL: a test measuring all kinds of things, especially emphasizing exception performance.
+
+        * JetStream2: Added.
+
 2018-10-02  Chris Dumez  <cdumez@apple.com>
 
         Regression(r236613): Parser/html-parser.html performance test is failing