flutter/dev/devicelab/lib/tasks
Jackson Gardner e8f4d803ba
Improve web benchmarks measurements (#127900)
By default, the browser fuzzes the timer APIs such that they have a granularity of approximately 100 microseconds (this is due to Spectre mitigation techniques). However, many of the thing we are trying to measure actually have a much finer granularity than 100 microseconds. As a result, many of our benchmarks are extremely noisy and don't provide accurate data.

By serving the initial script files with the `Cross-Origin-Opener-Policy: same-origin` and `Cross-Origin-Embedder-Policy: require-corp` HTTP headers, the browser runs the benchmarks in a `crossOriginIsolated` context, which restores the fine granularity of APIs such as `performance.now()` to microsecond precision.

Also, we were considering anything an outlier that was more than one standard deviation away from the mean. In a normal distribution, that means we are only capturing 68% of the data and the rest are considered outliers. This is not ideal. Doing two standard deviations away captures 95% of the data, and the outliers are in the remaining 5%, which seems much more reasonable.
2023-05-31 02:29:02 +00:00
..
analysis.dart Prepare dev (minus flutter_gallery) for use_super_parameters (#100516) 2022-03-29 12:52:42 -07:00
android_choreographer_do_frame_test.dart Funnel devicelab tests through utils process methods (#122161) 2023-03-08 19:44:40 +00:00
android_lifecycles_test.dart Funnel devicelab tests through utils process methods (#122161) 2023-03-08 19:44:40 +00:00
build_test_task.dart Copy artifacts to applicationBinaryPath when specified for build+test separation (#109879) 2022-08-23 16:32:39 +00:00
dart_plugin_registry_tests.dart Funnel devicelab tests through utils process methods (#122161) 2023-03-08 19:44:40 +00:00
entrypoint_dart_registrant.dart enable combinators_ordering (#107847) 2022-07-18 22:04:07 +00:00
flutter_tool_startup.dart Fix typos (#121171) 2023-02-23 19:43:21 +00:00
gallery.dart Migrate gallery ios tests to build+test (#111164) 2023-05-10 00:50:11 +00:00
hot_mode_tests.dart Funnel devicelab tests through utils process methods (#122161) 2023-03-08 19:44:40 +00:00
integration_tests.dart Migrates android semanitcs integration to integration test (#127128) 2023-05-23 22:33:19 +00:00
microbenchmarks.dart Add back one Skia test on iOS (#125663) 2023-04-28 10:41:33 -07:00
new_gallery.dart Add back one Skia test on iOS (#125663) 2023-04-28 10:41:33 -07:00
perf_tests.dart [devicelab] add drawPoints benchmark (#126728) 2023-05-15 19:14:58 +00:00
platform_channels_benchmarks.dart Funnel devicelab tests through utils process methods (#122161) 2023-03-08 19:44:40 +00:00
plugin_tests.dart Add spaces after flow control statements (#126320) 2023-05-15 11:07:30 +02:00
run_tests.dart [Tool] [Windows] Output app path on build completion (#122928) 2023-03-20 20:11:07 +00:00
web_benchmarks.dart Improve web benchmarks measurements (#127900) 2023-05-31 02:29:02 +00:00
web_dev_mode_tests.dart Funnel devicelab tests through utils process methods (#122161) 2023-03-08 19:44:40 +00:00