yaakovschectman
bba2ac83b1
Add Compilation DeviceLab test for Windows ( #109540 )
...
* Add Windows compilation test (hello_world_windows__compile)
* Add devicelab target to .ci.yaml
* Bringup on new target
* Add license to generated files
* Indicate test ownership
* Delete asset from repo
* Add Windows compilation test (hello_world_windows__compile)
* Add devicelab target to .ci.yaml
* Bringup on new target
* Add license to generated files
* Indicate test ownership
* Delete icon
* Use path.basename
Re triggering tests
* Update test owner to desktop team
2022-08-15 16:26:02 -04:00
Michael Goderbauer
10a7c9ba22
Unify analysis options ( #108462 )
2022-07-28 09:07:49 -07:00
Kaushik Iska
f7504f0380
[openpay] Create an OpenPay benchmark ( #107838 )
2022-07-21 20:01:06 +00:00
ColdPaleLight
1919167540
Added benchmark for early removal of unused raster cache entris mecha… ( #107918 )
2022-07-20 19:13:06 +00:00
Alexander Aprelev
9d00787791
Add build-after-edit benchmark ( #107192 )
...
* Add build-after-edit benchmark
* Clean up analyzer warnings
* Restore line break
2022-07-06 19:19:07 -07:00
JsouLiang
f0200f0106
Add benchmark case for RasterCache ( #103338 )
2022-06-29 23:54:10 +00:00
Dan Field
be7a4227c7
Add a macrobenchmark for laying out text in a list ( #104736 )
2022-05-26 15:25:10 -07:00
wangying
b3d7a691f6
Add benchmark for clipper layers raster cache ( #102495 )
...
* Add clipper raster cache benchmarks
* fix ci test error
* Add PhysicalModel widget to test
* Set top margin adaptive screen height
* Remove PhysicalModel
2022-05-13 14:04:06 +08:00
Zachary Anderson
7be261a1bb
Wait longer for the vmservice out file to appear ( #103513 )
...
An hour is likely longer than the CI timeout.
Fixes https://github.com/flutter/flutter/issues/103504
2022-05-11 12:37:35 -07:00
Jenn Magder
c6ced845e3
Remove custom unawaited, prefer dart:async version ( #103212 )
2022-05-07 08:49:04 -07:00
Jonah Williams
63574cf76a
add benchmark for animated complex opacity ( #102532 )
2022-04-25 18:14:06 -07:00
Jim Graham
493323506f
add gradient benchmarks ( #101549 )
2022-04-08 17:20:22 -07:00
Michael Goderbauer
195a1cc413
Prepare dev (minus flutter_gallery) for use_super_parameters ( #100516 )
2022-03-29 12:52:42 -07:00
wangying
712abb08e2
Add benchmark for ShaderMask RasterCache ( #100127 )
2022-03-28 00:15:07 -07:00
Zachary Anderson
8acbf54930
Adds an impeller variant of the new gallery transition perf benchmark ( #100837 )
2022-03-26 22:12:48 -07:00
Chris Bracken
4b819782fb
[macOS] Add run release test in devicelab ( #100526 )
...
Adds a test that invokes flutter run in release mode on macOS desktop,
waits for successful launch and the flutter command list, then sends the
'q' command to quit the running app.
This adds an integration test for https://github.com/flutter/flutter/pull/100504 .
Issue: https://github.com/flutter/flutter/issues/100348 (fix)
Issue: https://github.com/flutter/flutter/issues/97978 (partial fix)
Issue: https://github.com/flutter/flutter/issues/97977 (partial fix)
Umbrella issue: https://github.com/flutter/flutter/issues/60113
2022-03-22 14:12:59 -07:00
Jenn Magder
a165da236d
Remove device unlock from hostonly compile test ( #100571 )
2022-03-22 13:55:17 -07:00
Chris Yang
e6bd208196
Reland "Add the refresh rate fields to perf_test #99710 " ( #99854 )
2022-03-21 15:55:13 -07:00
wangying
b4040c867b
Add benchmark for ColorFilter raster cache ( #99542 )
2022-03-16 19:15:13 -07:00
Zachary Anderson
5f76ac35bc
Revert "Add the refresh rate fields to perf_test ( #99710 )" ( #99801 )
...
This reverts commit a7c85996b8
2022-03-08 23:04:49 -08:00
Chris Yang
a7c85996b8
Add the refresh rate fields to perf_test ( #99710 )
2022-03-08 17:25:15 -08:00
Jonah Williams
59859df126
Add Windows performance benchmark ( #99564 )
2022-03-04 15:41:14 -08:00
George Wright
ff1e9b7b9e
Add a benchmark for simple DisplayLists to exercise the Raster Cache's cache admission algorithm ( #97992 )
2022-02-07 21:01:01 -08:00
Jim Graham
9c934041bd
Add benchmarks to measure impact of alpha saveLayers in DisplayLists ( #97336 )
2022-01-27 13:25:17 -08:00
Ian Hickson
57f097b532
Refactor devicelab bin/run.dart and other cleanup ( #96320 )
2022-01-10 13:40:17 -08:00
Zachary Anderson
764c3c18d4
Revert "Add total_ui_gc_time to benchmarks captured ( #96125 )" ( #96137 )
2022-01-04 12:14:36 -08:00
Kaushik Iska
da9e87021d
Add total_ui_gc_time to benchmarks captured ( #96125 )
2022-01-04 10:02:21 -08:00
Jim Graham
ee204880a5
Opacity Peephole optimization benchmarks ( #94447 )
2021-12-01 01:39:02 -08:00
Jason Simmons
0bf2c9b3b7
Add local engine flag support to the SkSL caching performance benchmark scripts ( #91773 )
2021-10-14 10:57:32 -07:00
Ian Hickson
f90b019c68
Enable prefer_relative_imports and fix files. ( #91573 )
2021-10-11 10:28:07 -07:00
Dan Field
22c1ca769b
Add a startup test that delays runApp ( #91346 )
2021-10-06 09:43:02 -07:00
Jim Graham
abfb889fff
Add raster cache metrics to timeline summaries ( #89393 )
2021-09-04 18:31:03 -07:00
Darren Austin
ef5ffd08f6
Migrate devicelab framework code to null safety. ( #86325 )
...
(Attempt to reland #85993 )
2021-07-13 12:14:50 -07:00
Darren Austin
08ef7752d5
Revert "Migrate core devicelab framework to null safety. ( #85993 )" ( #86269 )
...
This reverts commit 2175e64e4f
2021-07-11 23:25:25 -07:00
Darren Austin
2175e64e4f
Migrate core devicelab framework to null safety. ( #85993 )
...
Migrate core devicelab framework to null safety.
2021-07-11 18:36:30 -07:00
Jenn Magder
03034e9e4a
Audit devicelab log streaming for nullability ( #84820 )
2021-06-18 00:14:03 -07:00
Greg Spencer
ec5cfc001d
Fix build failure ( #84597 )
...
Fixes an incorrect cast that caused a build failure.
Landing on red to fix the build.
2021-06-14 15:17:25 -07:00
Greg Spencer
88f3811055
Turn on avoid_dynamic_calls lint, except packages/flutter tests, make appropriate changes. ( #84476 )
...
This adds avoid_dynamic_calls to the list of lints, and fixes all instances where it was violated.
Importantly, this lint is NOT turned on for flutter/packages/test, because those changes are happening in another PR: #84478
2021-06-14 14:16:57 -07:00
Dan Field
5cc7b6c3ea
Add option to stream logs to file for flutter logs and way to use it in devicelab runs ( #84008 )
2021-06-07 10:33:00 -07:00
Jenn Magder
94a41cde83
Mixed null safety in dev/devicelab ( #84017 )
2021-06-05 02:29:03 -07:00
Dan Field
83d51ecd1a
Delete obsolete TODO ( #83966 )
2021-06-03 23:29:05 -07:00
Jonah Williams
85df73d0e3
[flutter] ensure vmservice binding is registered in profile mode ( #83913 )
2021-06-03 17:59:03 -07:00
Anis Alibegić
c99ed373b3
Fixed large amount of spelling errors ( #83744 )
2021-06-02 10:14:06 -07:00
Alexandre Ardhuin
34059eec2c
enable lint prefer_interpolation_to_compose_strings ( #83407 )
2021-06-01 11:14:06 -07:00
Jonah Williams
a3863b6592
[flutter_tools] support memory profiles from flutter drive ( #82739 )
2021-05-17 17:39:03 -07:00
Christopher Fujino
d6d3f0e0a8
add --verbose flag to pub global activate ( #82719 )
2021-05-17 11:39:28 -07:00
Dan Field
304b9c668e
Reland GC tracking benchmarks ( #82069 )
2021-05-14 19:59:24 -07:00
Christopher Fujino
855ada1d95
pub global deactivate devtools before installing ( #82491 )
...
* pub global deactivate devtools before installing
* upgrade devtools to latest
2021-05-13 17:13:03 -07:00
Jacob Richman
f82dedd5b9
Update perf_tests to use devtools 2.2.2 ( #81869 )
2021-05-10 15:22:50 -07:00
Dan Field
3101374f60
Revert "Reland GC benchmark changes again ( #82042 )" ( #82059 )
...
This reverts commit 99a947c3e5
2021-05-07 13:19:56 -07:00
Dan Field
99a947c3e5
Reland GC benchmark changes again ( #82042 )
2021-05-07 12:29:01 -07:00
Zachary Anderson
4056ac057d
Revert "Reland GC related bench update ( #81794 )" ( #82005 )
...
This reverts commit 714dea5e03
2021-05-06 19:03:59 -07:00
Dan Field
714dea5e03
Reland GC related bench update ( #81794 )
2021-05-06 16:49:04 -07:00
Kate Lovett
2d89ebb929
Revert "Fix benchmark ( #81449 )" ( #81696 )
...
This reverts commit a3893aea04
2021-05-03 12:22:46 -05:00
Dan Field
a3893aea04
Fix benchmark ( #81449 )
2021-05-03 10:02:09 -07:00
Michael Goderbauer
3cbfe82d9d
Rev DevTools to 2.1.1 for tests ( #81515 )
2021-04-29 16:47:42 -07:00
xster
ff2dde2c7f
Reland double gzip wrapping NOTICES to reduce on-disk installed space ( #80897 )
2021-04-26 22:35:45 -07:00
Jonah Williams
63ba1b23ca
[flutter_tools] add support for --bundle-sksl-path to flutter run / flutter drive ( #80885 )
2021-04-21 13:59:02 -07:00
Phil Quitslund
61c30c41b2
fix sort_directives violations ( #80817 )
2021-04-21 13:49:03 -07:00
Jenn Magder
1f19fd7108
Take screenshot when startup perf test fails to run ( #79514 )
2021-03-31 21:32:49 -07:00
Kaushik Iska
e6920662ad
Add a test to exercise multiple async microtasks in frame workload ( #79163 )
2021-03-29 20:49:05 -07:00
Dan Field
374993ce88
fix tree ( #79329 )
2021-03-29 18:52:36 -07:00
Dan Field
750fd1d536
Avoid hard coding "build" for test output files ( #79322 )
2021-03-29 17:36:34 -07:00
Jenn Magder
3463946448
Take screenshot when drive fails ( #78822 )
2021-03-22 19:06:28 -07:00
Zachary Anderson
9167083d09
Explain why devtools in pinned ( #77657 )
2021-03-09 08:34:03 -08:00
Jenn Magder
85e2c52b39
Increase activated devtools version to 2.0 ( #77637 )
2021-03-08 13:17:21 -08:00
Michael Goderbauer
cb867bbedc
Enable unnecessary_await_in_return lint ( #77434 )
2021-03-05 18:38:15 -08:00
Jenn Magder
e9e8ca7640
Add debug_second_compile_millis benchmark metric ( #77420 )
2021-03-05 15:33:28 -08:00
chunhtai
815976a8e4
change stack size test to test arm device ( #75814 )
2021-02-17 12:46:03 -08:00
Jenn Magder
d35058f5b8
Do not fail if 9xth_percentile_memory_usage is not recorded ( #76153 )
2021-02-16 15:56:02 -08:00
chunhtai
713fa8e360
Reland "add a benchmark test for stack size ( #75039 )" ( #75434 )
...
* Reland "add a benchmark test for stack size (#75039 )"
This reverts commit de683de9d5
2021-02-04 12:16:31 -08:00
Shi-Hao Hong
de683de9d5
Revert "add a benchmark test for stack size ( #75039 )" ( #75383 )
...
This reverts commit 9d9109aa6f
2021-02-04 10:26:04 +08:00
chunhtai
9d9109aa6f
add a benchmark test for stack size ( #75039 )
2021-02-03 15:16:03 -08:00
Jenn Magder
91aad2bb06
Avoid iOS local networking dialog in integration tests ( #75163 )
2021-02-01 13:33:25 -08:00
Yuqian Li
c4114a7527
Remove more flaky non-e2e tests ( #74062 )
...
Fixes https://github.com/flutter/flutter/issues/73873
2021-01-15 13:22:26 -08:00
LongCatIsLooong
cbe72db135
macrobenchmark: TextField with complex paragraph ( #73374 )
2021-01-12 15:44:01 -08:00
xster
ca82c572b7
Revert "let NOTICES be double gzip wrapped to reduce on-disk installed space ( #71899 )" ( #72438 )
2020-12-16 10:58:19 -08:00
xster
4ed3432e8f
let NOTICES be double gzip wrapped to reduce on-disk installed space ( #71899 )
2020-12-15 13:29:14 -08:00
Jim Graham
61460d255a
preserve detailFiles entry in TaskResult JSON ( #70668 )
...
* preserve detailFiles entry in TaskResult JSON
2020-11-17 16:05:54 -08:00
Yuqian Li
f7811ea541
e2e perf tests don't have CPU/GPU/memory metrics ( #70439 )
...
Address comment in https://github.com/flutter/flutter/pull/66386/files#r522671103
2020-11-13 11:16:50 -08:00
Jenn Magder
bb495ba90c
Do not fail if average_memory_usage is not recorded ( #69339 )
2020-10-29 16:09:50 -07:00
Jonah Williams
31c96b5d83
[devicelab] do not fail test if CPU measurement is not recorded ( #69268 )
2020-10-29 09:32:34 -07:00
Jonah Williams
18341efa2f
[devicelab] retry startup of start up test ( #69272 )
2020-10-29 09:19:07 -07:00
Jonah Williams
83d4351e0c
[devicelab] work around occasional null values for devtools ( #69273 )
...
* [devicelab] work around occasional null values for devtools
* Update perf_tests.dart
2020-10-29 09:18:38 -07:00
Jenn Magder
13896b3bd1
Decrease device discovery timeout from 10 to 5 seconds ( #69266 )
2020-10-28 19:43:19 -07:00
Jenn Magder
135aab9cf5
Increase device run perf test timeout ( #69260 )
2020-10-28 18:29:04 -07:00
Jonah Williams
2c12a8d917
[devicelab] remove twc enabled test and uncaught image test ( #68518 )
2020-10-24 13:19:51 -07:00
Jonah Williams
ab20ae782a
[devicelab] uinstall during memory test ( #68548 )
2020-10-20 09:49:50 -07:00
Jonah Williams
938fae9c99
remove --machine flag ( #68538 )
2020-10-19 17:06:28 -07:00
Jonah Williams
a152c0f429
[devicelab] reland: reduce iterations of startup test, use application binary ( #68532 )
...
These devicelab tests are incredibly flaky. Currently they will build & install the same application 15 times. This causes the temp storage to fill up on android, and has a good chance of flaking on iOS due to install issues.
The change from 3 to 15 increased total test time for 2 -> 12 minutes on iOS, or roughly 5 more test equivalents for every single iOS test. Reduce the iteration count back to 5
Uninstall the app after each run so temp storage does not fill up.
2020-10-19 16:51:28 -07:00
Jonah Williams
4a3e2a1af5
Revert "[devicelab] reduce iterations, uninstall at end, and use --application-binary in all startup tests ( #68516 )" ( #68531 )
...
This reverts commit a4c2075a45
2020-10-19 15:05:46 -07:00
Jonah Williams
8262f808ba
Revert "[devicelab] fix flutter gallery app name ( #68528 )" ( #68530 )
...
This reverts commit 0f69f8e53b
2020-10-19 15:05:10 -07:00
Jonah Williams
0f69f8e53b
[devicelab] fix flutter gallery app name ( #68528 )
2020-10-19 14:48:05 -07:00
Jonah Williams
a4c2075a45
[devicelab] reduce iterations, uninstall at end, and use --application-binary in all startup tests ( #68516 )
...
These devicelab tests are incredibly flaky. Currently they will build & install the same application 15 times. This causes the temp storage to fill up on android, and has a good chance of flaking on iOS due to install issues.
The change from 3 to 15 increased total test time for 2 -> 12 minutes on iOS, or roughly 5 more test equivalents for every single iOS test. Reduce the iteration count back to 5
Uninstall the app after each run so temp storage does not fill up.
2020-10-19 14:16:04 -07:00
Jonah Williams
e422d5c724
[flutter_tools] reland: --no-android-gradle-daemon in devicelab ( #68491 )
...
Remove devicelab specific code for shutting down gradle daemon, add --android-gradle-daemon option to build/run/drive`. Avoids need for un-tested devicelab specific handler. There are also some feature requests for this, so 2 birds one stone.
Example:
flutter build apk --no-android-gradle-daemon will pass --no-daemon on to gradle
2020-10-19 10:27:58 -07:00
Jonah Williams
ed5482de19
Revert "[flutter_tools] add --android-gradle-daemon option, use in devicelab ( #68409 )" ( #68489 )
...
This reverts commit ddab72e79f
2020-10-19 09:33:52 -07:00
Jonah Williams
ddab72e79f
[flutter_tools] add --android-gradle-daemon option, use in devicelab ( #68409 )
...
Remove devicelab specific code for shutting down gradle daemon, add --android-gradle-daemon option to build/run/drive`. Avoids need for un-tested devicelab specific handler. There are also some feature requests for this, so 2 birds one stone.
Example:
flutter build apk --no-android-gradle-daemon will pass --no-daemon on to gradle
2020-10-19 09:12:21 -07:00
Alexandre Ardhuin
c0176c9ee5
use_is_even_rather_than_modulo ( #68301 )
2020-10-16 20:20:00 +02:00
Jonah Williams
33903c17e1
[devicelab] delete disabled or not useful benchmarks ( #68107 )
...
- run_without_leak_tests: have been disabled for months
- build_benchmark: the tooling work here is mostly done and we're not tracking further improvements, free up more devicelab capacity
- system_debug_ios: does not work post iOS13
- mac_enable_twc: not adding more mac tests to devicelab
- hello_world_start_up: disabled
Any tests that we think will be valuable in the future can be resurrected from the git history.
2020-10-14 10:30:10 -07:00
Jonah Williams
751459df24
[flutter_tool] support --use-application-binary in flutter drive ( #68060 )
...
--use-application-binary allows running with an already built APK. This can be useful for speeding up CI test cases, or in our case eventually supporting some sort of build server. Demonstrate that this works by updating the old gallery test to use it. Fixes #56604
Co-authored-by: Jenn Magder <magder@google.com>
2020-10-13 19:27:30 -07:00
