Phil Quitslund
61c30c41b2
fix sort_directives violations ( #80817 )
2021-04-21 13:49:03 -07:00
Jenn Magder
1f19fd7108
Take screenshot when startup perf test fails to run ( #79514 )
2021-03-31 21:32:49 -07:00
Kaushik Iska
e6920662ad
Add a test to exercise multiple async microtasks in frame workload ( #79163 )
2021-03-29 20:49:05 -07:00
Dan Field
374993ce88
fix tree ( #79329 )
2021-03-29 18:52:36 -07:00
Dan Field
750fd1d536
Avoid hard coding "build" for test output files ( #79322 )
2021-03-29 17:36:34 -07:00
Jenn Magder
3463946448
Take screenshot when drive fails ( #78822 )
2021-03-22 19:06:28 -07:00
Zachary Anderson
9167083d09
Explain why devtools in pinned ( #77657 )
2021-03-09 08:34:03 -08:00
Jenn Magder
85e2c52b39
Increase activated devtools version to 2.0 ( #77637 )
2021-03-08 13:17:21 -08:00
Michael Goderbauer
cb867bbedc
Enable unnecessary_await_in_return lint ( #77434 )
2021-03-05 18:38:15 -08:00
Jenn Magder
e9e8ca7640
Add debug_second_compile_millis benchmark metric ( #77420 )
2021-03-05 15:33:28 -08:00
chunhtai
815976a8e4
change stack size test to test arm device ( #75814 )
2021-02-17 12:46:03 -08:00
Jenn Magder
d35058f5b8
Do not fail if 9xth_percentile_memory_usage is not recorded ( #76153 )
2021-02-16 15:56:02 -08:00
chunhtai
713fa8e360
Reland "add a benchmark test for stack size ( #75039 )" ( #75434 )
...
* Reland "add a benchmark test for stack size (#75039 )"
This reverts commit de683de9d5
2021-02-04 12:16:31 -08:00
Shi-Hao Hong
de683de9d5
Revert "add a benchmark test for stack size ( #75039 )" ( #75383 )
...
This reverts commit 9d9109aa6f
2021-02-04 10:26:04 +08:00
chunhtai
9d9109aa6f
add a benchmark test for stack size ( #75039 )
2021-02-03 15:16:03 -08:00
Jenn Magder
91aad2bb06
Avoid iOS local networking dialog in integration tests ( #75163 )
2021-02-01 13:33:25 -08:00
Yuqian Li
c4114a7527
Remove more flaky non-e2e tests ( #74062 )
...
Fixes https://github.com/flutter/flutter/issues/73873
2021-01-15 13:22:26 -08:00
LongCatIsLooong
cbe72db135
macrobenchmark: TextField with complex paragraph ( #73374 )
2021-01-12 15:44:01 -08:00
xster
ca82c572b7
Revert "let NOTICES be double gzip wrapped to reduce on-disk installed space ( #71899 )" ( #72438 )
2020-12-16 10:58:19 -08:00
xster
4ed3432e8f
let NOTICES be double gzip wrapped to reduce on-disk installed space ( #71899 )
2020-12-15 13:29:14 -08:00
Jim Graham
61460d255a
preserve detailFiles entry in TaskResult JSON ( #70668 )
...
* preserve detailFiles entry in TaskResult JSON
2020-11-17 16:05:54 -08:00
Yuqian Li
f7811ea541
e2e perf tests don't have CPU/GPU/memory metrics ( #70439 )
...
Address comment in https://github.com/flutter/flutter/pull/66386/files#r522671103
2020-11-13 11:16:50 -08:00
Jenn Magder
bb495ba90c
Do not fail if average_memory_usage is not recorded ( #69339 )
2020-10-29 16:09:50 -07:00
Jonah Williams
31c96b5d83
[devicelab] do not fail test if CPU measurement is not recorded ( #69268 )
2020-10-29 09:32:34 -07:00
Jonah Williams
18341efa2f
[devicelab] retry startup of start up test ( #69272 )
2020-10-29 09:19:07 -07:00
Jonah Williams
83d4351e0c
[devicelab] work around occasional null values for devtools ( #69273 )
...
* [devicelab] work around occasional null values for devtools
* Update perf_tests.dart
2020-10-29 09:18:38 -07:00
Jenn Magder
13896b3bd1
Decrease device discovery timeout from 10 to 5 seconds ( #69266 )
2020-10-28 19:43:19 -07:00
Jenn Magder
135aab9cf5
Increase device run perf test timeout ( #69260 )
2020-10-28 18:29:04 -07:00
Jonah Williams
2c12a8d917
[devicelab] remove twc enabled test and uncaught image test ( #68518 )
2020-10-24 13:19:51 -07:00
Jonah Williams
ab20ae782a
[devicelab] uinstall during memory test ( #68548 )
2020-10-20 09:49:50 -07:00
Jonah Williams
938fae9c99
remove --machine flag ( #68538 )
2020-10-19 17:06:28 -07:00
Jonah Williams
a152c0f429
[devicelab] reland: reduce iterations of startup test, use application binary ( #68532 )
...
These devicelab tests are incredibly flaky. Currently they will build & install the same application 15 times. This causes the temp storage to fill up on android, and has a good chance of flaking on iOS due to install issues.
The change from 3 to 15 increased total test time for 2 -> 12 minutes on iOS, or roughly 5 more test equivalents for every single iOS test. Reduce the iteration count back to 5
Uninstall the app after each run so temp storage does not fill up.
2020-10-19 16:51:28 -07:00
Jonah Williams
4a3e2a1af5
Revert "[devicelab] reduce iterations, uninstall at end, and use --application-binary in all startup tests ( #68516 )" ( #68531 )
...
This reverts commit a4c2075a45
2020-10-19 15:05:46 -07:00
Jonah Williams
8262f808ba
Revert "[devicelab] fix flutter gallery app name ( #68528 )" ( #68530 )
...
This reverts commit 0f69f8e53b
2020-10-19 15:05:10 -07:00
Jonah Williams
0f69f8e53b
[devicelab] fix flutter gallery app name ( #68528 )
2020-10-19 14:48:05 -07:00
Jonah Williams
a4c2075a45
[devicelab] reduce iterations, uninstall at end, and use --application-binary in all startup tests ( #68516 )
...
These devicelab tests are incredibly flaky. Currently they will build & install the same application 15 times. This causes the temp storage to fill up on android, and has a good chance of flaking on iOS due to install issues.
The change from 3 to 15 increased total test time for 2 -> 12 minutes on iOS, or roughly 5 more test equivalents for every single iOS test. Reduce the iteration count back to 5
Uninstall the app after each run so temp storage does not fill up.
2020-10-19 14:16:04 -07:00
Jonah Williams
e422d5c724
[flutter_tools] reland: --no-android-gradle-daemon in devicelab ( #68491 )
...
Remove devicelab specific code for shutting down gradle daemon, add --android-gradle-daemon option to build/run/drive`. Avoids need for un-tested devicelab specific handler. There are also some feature requests for this, so 2 birds one stone.
Example:
flutter build apk --no-android-gradle-daemon will pass --no-daemon on to gradle
2020-10-19 10:27:58 -07:00
Jonah Williams
ed5482de19
Revert "[flutter_tools] add --android-gradle-daemon option, use in devicelab ( #68409 )" ( #68489 )
...
This reverts commit ddab72e79f
2020-10-19 09:33:52 -07:00
Jonah Williams
ddab72e79f
[flutter_tools] add --android-gradle-daemon option, use in devicelab ( #68409 )
...
Remove devicelab specific code for shutting down gradle daemon, add --android-gradle-daemon option to build/run/drive`. Avoids need for un-tested devicelab specific handler. There are also some feature requests for this, so 2 birds one stone.
Example:
flutter build apk --no-android-gradle-daemon will pass --no-daemon on to gradle
2020-10-19 09:12:21 -07:00
Alexandre Ardhuin
c0176c9ee5
use_is_even_rather_than_modulo ( #68301 )
2020-10-16 20:20:00 +02:00
Jonah Williams
33903c17e1
[devicelab] delete disabled or not useful benchmarks ( #68107 )
...
- run_without_leak_tests: have been disabled for months
- build_benchmark: the tooling work here is mostly done and we're not tracking further improvements, free up more devicelab capacity
- system_debug_ios: does not work post iOS13
- mac_enable_twc: not adding more mac tests to devicelab
- hello_world_start_up: disabled
Any tests that we think will be valuable in the future can be resurrected from the git history.
2020-10-14 10:30:10 -07:00
Jonah Williams
751459df24
[flutter_tool] support --use-application-binary in flutter drive ( #68060 )
...
--use-application-binary allows running with an already built APK. This can be useful for speeding up CI test cases, or in our case eventually supporting some sort of build server. Demonstrate that this works by updating the old gallery test to use it. Fixes #56604
Co-authored-by: Jenn Magder <magder@google.com>
2020-10-13 19:27:30 -07:00
Yuqian Li
98d1ad0195
Purge persistent cache for perf test runs ( #67697 )
2020-10-08 19:17:02 -07:00
Casey Hillers
9e206a0c93
Refactor devicelab logic to use TaskResult instead of JSON ( #67550 )
2020-10-07 16:37:09 -07:00
Ming Lyu (CareF)
76c0d69b14
migrate textfield_perf to e2e ( #64503 )
2020-10-02 14:47:03 -07:00
Yuqian Li
e45157fc08
5x startup test repitition to reduce noise ( #67147 )
2020-10-02 12:22:05 -07:00
Ming Lyu (CareF)
db2532a949
migrate color_filter_and_fade_perf ( #64484 )
2020-10-01 17:32:02 -07:00
Yuqian Li
b92d250116
Let perf tests measure memory by default ( #66570 )
...
Fixes https://github.com/flutter/flutter/issues/66569
2020-10-01 15:20:17 -07:00
Chris Yang
2d26bafec2
remove --trace-startup ( #66568 )
2020-09-29 17:22:04 -07:00
Yuqian Li
54ac7bc936
Reland "Default measureCpuGpu to true ( #66386 )" ( #66604 )
...
This reverts commit 2d9e500523
2020-09-28 10:26:35 -07:00
Yuqian Li
2d9e500523
Revert "Default measureCpuGpu to true ( #66386 )" ( #66594 )
...
This reverts commit 48ce83a833
2020-09-24 15:17:57 -07:00
Yuqian Li
48ce83a833
Default measureCpuGpu to true ( #66386 )
2020-09-24 13:42:03 -07:00
Ming Lyu (CareF)
f681fcf32b
migrate backdrop_filter_perf ( #64482 )
2020-09-22 19:52:02 -07:00
Ming Lyu (CareF)
b3f19a3e1a
migrate animated_placeholder_perf ( #64478 )
2020-09-16 07:47:03 -07:00
Yuqian Li
b8a39c15f8
Collect memory metrics ( #65798 )
2020-09-15 12:47:05 -07:00
Ming Lyu (CareF)
51f1c98490
migrate cubic_bezier_perf to e2e ( #64487 )
2020-09-11 20:02:03 -07:00
Yuqian Li
e1eddb401d
Revert the revert ( #65602 )
2020-09-11 16:20:03 -07:00
gaaclarke
37de94d7d2
devicelab: started averaging startup time for ios test ( #64978 )
2020-09-02 16:35:03 -07:00
Ming Lyu (CareF)
28de49e358
Revert "Reland #61998 and update complex_layout ios files ( #64885 )" ( #64990 )
...
This reverts commit df83398687
2020-08-31 18:47:08 -07:00
Ming Lyu (CareF)
df83398687
Reland #61998 and update complex_layout ios files ( #64885 )
2020-08-31 17:23:06 -07:00
Dan Field
b5ed913ecc
Memory/cpu/gpu benchmark for showing large images in succession ( #64762 )
2020-08-31 10:03:57 -07:00
Shi-Hao Hong
34541c3073
Revert "A benchmark test case for measuring scroll smoothness ( #61998 )" ( #64883 )
...
This reverts commit 12b7355da1
2020-08-30 18:42:10 +08:00
Ming Lyu (CareF)
12b7355da1
A benchmark test case for measuring scroll smoothness ( #61998 )
2020-08-29 04:28:03 -07:00
Ming Lyu (CareF)
d30e36ba8c
migrate flutter_gallery_sksl_warmup__transition_perf to e2e ( #64275 )
2020-08-21 19:36:03 -07:00
Jim Graham
9e86e9fb1e
report list of detail files so devicelab can save them ( #64009 )
2020-08-20 10:58:25 -07:00
Yuqian Li
6eb45d35da
Rename needsMeasureCpuGpu to measureCpuGpu ( #64000 )
2020-08-19 13:26:07 -07:00
Ming Lyu (CareF)
0629030a05
WidgetTester.drag with time duration ( #63410 )
2020-08-12 21:01:03 -07:00
Yuqian Li
2296bb154b
Measure CPU/GPU with the simple animation test ( #63124 )
2020-08-07 20:41:07 -07:00
Yuqian Li
6d487355a3
Remove cubic_bezier_perf.dart ( #63028 )
2020-08-05 20:21:02 -07:00
Ming Lyu (CareF)
1d329d2cc9
migrate macrobenchmark/multi_widget_construction test to e2e ( #62539 )
2020-08-04 18:56:03 -07:00
Yuqian Li
e6bc56f25a
Reland "Add Crane test to the new Gallery app ( #62162 )" ( #62544 )
2020-07-31 09:56:04 -07:00
Jonah Williams
27e13dd53e
Revert "Add Crane test to the new Gallery app ( #62162 )" ( #62430 )
...
This reverts commit 1ffdfa81d6
2020-07-28 11:32:34 -07:00
Yuqian Li
1ffdfa81d6
Add Crane test to the new Gallery app ( #62162 )
2020-07-28 10:56:05 -07:00
Ming Lyu (CareF)
056e455e94
Add a E2E based performance test case ( #61509 )
2020-07-23 08:31:04 -07:00
Chris Yang
c5a69b9b8a
Reland "Branch out android platform view perf testing #60238 " 2nd time ( #61748 )
2020-07-22 18:36:11 -07:00
Ming Lyu (CareF)
54c9441723
benchmarkLive: a new LiveTestWidgetsFlutterBindingFramePolicy for benchmark on device ( #61388 )
...
* add benchmarkLive flag and tests
* update handlePointerEventRecord doc
* using e2e 0.6.1
2020-07-17 18:56:12 -04:00
Ming Lyu (CareF)
7bef51acc9
cleanup macrobenchmark duplicate files ( #61621 )
...
* cleanup macrobenchmark duplicate files
2020-07-17 14:34:33 -04:00
Chris Yang
6a525b9aa5
Revert "Reland "Branch out android platform view perf testing ( #60238 )" ( #61554 )" ( #61642 )
2020-07-16 13:14:52 -07:00
Chris Yang
63ceeb8f15
Reland "Branch out android platform view perf testing ( #60238 )" ( #61554 )
2020-07-16 11:23:52 -07:00
Chris Yang
77efc00af0
Revert "Branch out android platform view perf testing ( #60238 )" ( #61482 )
...
This reverts commit 9f4499f431
2020-07-14 15:10:21 -07:00
Chris Yang
9f4499f431
Branch out android platform view perf testing ( #60238 )
2020-07-14 13:07:41 -07:00
Ming Lyu (CareF)
025463f463
Heavy Widget construction and destruction performance test ( #60336 )
...
* Add widget construction benchmark
* Add to device lab
2020-06-26 17:38:26 -04:00
Ming Lyu (CareF)
99f5eebc6b
Add --device-id option for devicelab/bin/run.dart ( #59276 )
...
* Implement device selection for devicelab/run.dart
* Add test to --device-id option for devicelab/run
* Update dev/devicelab/bin/run.dart by jonahwilliam
* Rename deviceOperatingSystem enum mock -> fake
Co-authored-by: Jonah Williams <jonahwilliams@google.com>
2020-06-26 09:29:46 -04:00
liyuqian
850ea6d29d
Add SkSL shader warm-up tests to Flutter gallery ( #59932 )
2020-06-23 17:48:02 -07:00
liyuqian
9dad2d98df
Perf test with SkSL warm-up ( #56638 )
2020-06-06 14:43:02 -07:00
Jim Graham
7261b98e81
Enabling the ImageFiltered(ImageFilter.matrix) page of macrobenchmark ( #58277 )
2020-05-30 18:53:01 -07:00
Jonah Williams
d9144bf8fc
[flutter_tools] rename output LICENSE file to NOTICES and support loading either ( #57871 )
...
Work towards #16723
This is only safe to land after #58131 lands in google3. Only build NOTICES in asset manfiest, and load either LICENSE or NOTICES from pubspec dependencies.
2020-05-29 11:55:02 -07:00
liyuqian
721927efd3
Use pub inside the Flutter directory ( #57704 )
2020-05-21 17:52:02 -07:00
liyuqian
a635765116
Reland "Add DevTools memory test ( #55486 )" ( #57340 )
2020-05-19 18:02:03 -07:00
Zachary Anderson
19967e2463
Revert "Add DevTools memory test ( #55486 )" ( #56445 )
...
This reverts commit 9ee6763a66
2020-05-06 07:53:26 -07:00
liyuqian
9ee6763a66
Add DevTools memory test ( #55486 )
2020-05-05 15:12:01 -07:00
Jonah Williams
f04d61944a
[devicelab] enable macOS, windows, linux, and web on devicelab bots ( #56336 )
...
* enable macOS desktop
* enable all configs on CI
* Update track_widget_creation_enabled_task.dart
* Update framework.dart
* remove FLUTTER_WEB
* remove config environment variables
* configure in correct spot
2020-05-04 18:49:28 -07:00
Jenn Magder
c8c55b4098
Check Xcode build setting FULL_PRODUCT_NAME for bundle name ( #55799 )
2020-05-04 11:31:08 -07:00
Emmanuel Garcia
9d106bdead
Read correct file for android view benchmark ( #55935 )
2020-04-28 23:09:50 -07:00
Emmanuel Garcia
b176042c1a
Add benchmark for hybrid composition on Android ( #55609 )
2020-04-28 19:24:15 -07:00
Tianguang
fbf4fa0a05
Devicelab tests (Chrome run, Web compile) for New Flutter Gallery ( #53096 )
2020-04-21 11:48:03 -07:00
Jim Graham
77ea2da746
benchmark animation performance of Opacity widget ( #54903 )
2020-04-17 18:34:10 -07:00
Jonah Williams
6cb74eeac8
fix apk location for devicelab ( #54697 )
2020-04-13 16:56:27 -07:00
Kaushik Iska
7b9aeb2ff2
[flutter_driver] Reland add SceneDisplayLag stats to timeline summary ( #54490 )
2020-04-11 15:30:01 -07:00
Kaushik Iska
50b4c39c5d
Revert "[flutter_driver] Add SceneDisplayLag stats to timeline summary ( #54218 )" ( #54480 )
...
This reverts commit ce92333bf7
2020-04-10 12:48:48 -07:00
