stuartmorgan
2df7dca858
Fully support Dart-only mobile and macOS plugins ( #96183 )
2022-01-13 08:30:22 -08:00
Ian Hickson
57f097b532
Refactor devicelab bin/run.dart and other cleanup ( #96320 )
2022-01-10 13:40:17 -08:00
Zachary Anderson
764c3c18d4
Revert "Add total_ui_gc_time to benchmarks captured ( #96125 )" ( #96137 )
2022-01-04 12:14:36 -08:00
Kaushik Iska
da9e87021d
Add total_ui_gc_time to benchmarks captured ( #96125 )
2022-01-04 10:02:21 -08:00
Jim Graham
ee204880a5
Opacity Peephole optimization benchmarks ( #94447 )
2021-12-01 01:39:02 -08:00
Core
d8034538bd
feat: enable flavor option on test command ( #89045 )
2021-11-11 09:23:02 -08:00
Ian Hickson
7f7f487abc
Feature/cpu gpu memory gallery transition tests ( #92626 )
2021-10-28 16:03:03 -07:00
Jason Simmons
0bf2c9b3b7
Add local engine flag support to the SkSL caching performance benchmark scripts ( #91773 )
2021-10-14 10:57:32 -07:00
Ian Hickson
f90b019c68
Enable prefer_relative_imports and fix files. ( #91573 )
2021-10-11 10:28:07 -07:00
Ian Hickson
61a0add286
Enable avoid_redundant_argument_values lint ( #91409 ) ( #91462 )
2021-10-08 09:25:14 -07:00
Zachary Anderson
b9d2177da0
Revert "Enable avoid_redundant_argument_values lint ( #91409 )" ( #91461 )
...
This reverts commit 5fd259be24
2021-10-07 21:11:07 -07:00
Ian Hickson
5fd259be24
Enable avoid_redundant_argument_values lint ( #91409 )
2021-10-07 20:13:02 -07:00
Jenn Magder
4ef6fc1833
Update number of IPHONEOS_DEPLOYMENT_TARGET in plugin_test_ios ( #91324 )
2021-10-07 10:13:04 -07:00
Dan Field
22c1ca769b
Add a startup test that delays runApp ( #91346 )
2021-10-06 09:43:02 -07:00
stuartmorgan
8231592d71
Update minimum iOS version in plugin_test ( #91099 )
2021-10-05 10:33:04 -07:00
Alexander Aprelev
98120d19d3
Add a microbenchmark that measures performance of flutter compute. ( #91257 )
...
* Add a microbenchmark that measures performance of flutter compute.
This benchmark should show performance improvements when compute is switched to Isolate.exit
* Fix analyzer warnings, increase warmup iterations
* Fix license header
2021-10-04 14:16:23 -07:00
Jim Graham
abfb889fff
Add raster cache metrics to timeline summaries ( #89393 )
2021-09-04 18:31:03 -07:00
Jenn Magder
413f88f209
Do not try to codesign during plugin_test_ios ( #88834 )
2021-08-24 21:36:36 -07:00
Jonah Williams
060e4608b1
clean up stale or unnecessary TODOS ( #88308 )
2021-08-16 21:37:03 -07:00
Jenn Magder
f673c5c58f
Remove obsolete codegen_integration tests ( #86962 )
2021-07-23 14:56:04 -07:00
Jenn Magder
6881fca7b7
Respect plugin excluded iOS architectures ( #86905 )
2021-07-23 13:56:03 -07:00
Jenn Magder
81aeb33ce3
Increase Flutter framework minimum iOS version to 9.0 ( #86840 )
2021-07-22 13:21:05 -07:00
Kaushik Iska
df3fe587e8
Validate that min frame number is numeric ( #86498 )
2021-07-15 17:11:09 -07:00
Darren Austin
4c96cb26d2
Fixed a cast issue with host_mode_tests.dart. ( #86392 )
2021-07-13 17:31:02 -07:00
Darren Austin
ef5ffd08f6
Migrate devicelab framework code to null safety. ( #86325 )
...
(Attempt to reland #85993 )
2021-07-13 12:14:50 -07:00
Darren Austin
08ef7752d5
Revert "Migrate core devicelab framework to null safety. ( #85993 )" ( #86269 )
...
This reverts commit 2175e64e4f
2021-07-11 23:25:25 -07:00
Darren Austin
2175e64e4f
Migrate core devicelab framework to null safety. ( #85993 )
...
Migrate core devicelab framework to null safety.
2021-07-11 18:36:30 -07:00
gaaclarke
66fd0b28b0
replaced unawaited with synchronous / await calls where needed ( #82839 )
2021-06-24 16:22:43 -07:00
Jenn Magder
1d2f6c5296
Revert "Set up iOS native integration_tests in ui example project ( #84890 )" ( #84892 )
...
This reverts commit 05d5515732
2021-06-18 18:05:00 -07:00
Jenn Magder
05d5515732
Set up iOS native integration_tests in ui example project ( #84890 )
2021-06-18 17:45:11 -07:00
Jenn Magder
03034e9e4a
Audit devicelab log streaming for nullability ( #84820 )
2021-06-18 00:14:03 -07:00
Jenn Magder
697928d21f
Revert "Set up iOS native integration_tests in ui example project ( #84596 )" ( #84641 )
...
This reverts commit ef2879a46f
2021-06-15 10:09:41 -07:00
Jenn Magder
ef2879a46f
Set up iOS native integration_tests in ui example project ( #84596 )
2021-06-14 18:04:02 -07:00
Greg Spencer
ec5cfc001d
Fix build failure ( #84597 )
...
Fixes an incorrect cast that caused a build failure.
Landing on red to fix the build.
2021-06-14 15:17:25 -07:00
Greg Spencer
88f3811055
Turn on avoid_dynamic_calls lint, except packages/flutter tests, make appropriate changes. ( #84476 )
...
This adds avoid_dynamic_calls to the list of lints, and fixes all instances where it was violated.
Importantly, this lint is NOT turned on for flutter/packages/test, because those changes are happening in another PR: #84478
2021-06-14 14:16:57 -07:00
Dan Field
5cc7b6c3ea
Add option to stream logs to file for flutter logs and way to use it in devicelab runs ( #84008 )
2021-06-07 10:33:00 -07:00
Jenn Magder
94a41cde83
Mixed null safety in dev/devicelab ( #84017 )
2021-06-05 02:29:03 -07:00
Dan Field
83d51ecd1a
Delete obsolete TODO ( #83966 )
2021-06-03 23:29:05 -07:00
Jonah Williams
85df73d0e3
[flutter] ensure vmservice binding is registered in profile mode ( #83913 )
2021-06-03 17:59:03 -07:00
Anis Alibegić
c99ed373b3
Fixed large amount of spelling errors ( #83744 )
2021-06-02 10:14:06 -07:00
Alexandre Ardhuin
34059eec2c
enable lint prefer_interpolation_to_compose_strings ( #83407 )
2021-06-01 11:14:06 -07:00
gaaclarke
7cdd33fe99
added unawaited function for devicelab and turned on unawaited_futures linter ( #82833 )
2021-05-18 14:19:03 -07:00
Jonah Williams
d6fa9bbf91
[devicelab] await flutter create call in platform channels benchmark ( #82762 )
2021-05-18 08:55:38 -07:00
Jonah Williams
a3863b6592
[flutter_tools] support memory profiles from flutter drive ( #82739 )
2021-05-17 17:39:03 -07:00
Christopher Fujino
d6d3f0e0a8
add --verbose flag to pub global activate ( #82719 )
2021-05-17 11:39:28 -07:00
Dan Field
304b9c668e
Reland GC tracking benchmarks ( #82069 )
2021-05-14 19:59:24 -07:00
Christopher Fujino
855ada1d95
pub global deactivate devtools before installing ( #82491 )
...
* pub global deactivate devtools before installing
* upgrade devtools to latest
2021-05-13 17:13:03 -07:00
Jacob Richman
f82dedd5b9
Update perf_tests to use devtools 2.2.2 ( #81869 )
2021-05-10 15:22:50 -07:00
Dan Field
3101374f60
Revert "Reland GC benchmark changes again ( #82042 )" ( #82059 )
...
This reverts commit 99a947c3e5
2021-05-07 13:19:56 -07:00
Dan Field
99a947c3e5
Reland GC benchmark changes again ( #82042 )
2021-05-07 12:29:01 -07:00
gaaclarke
a5f57b9e64
Added performance benchmarks for platform channels ( #81414 )
2021-05-07 10:24:03 -07:00
Zachary Anderson
4056ac057d
Revert "Reland GC related bench update ( #81794 )" ( #82005 )
...
This reverts commit 714dea5e03
2021-05-06 19:03:59 -07:00
Dan Field
714dea5e03
Reland GC related bench update ( #81794 )
2021-05-06 16:49:04 -07:00
Kate Lovett
2d89ebb929
Revert "Fix benchmark ( #81449 )" ( #81696 )
...
This reverts commit a3893aea04
2021-05-03 12:22:46 -05:00
Dan Field
a3893aea04
Fix benchmark ( #81449 )
2021-05-03 10:02:09 -07:00
Michael Goderbauer
3cbfe82d9d
Rev DevTools to 2.1.1 for tests ( #81515 )
2021-04-29 16:47:42 -07:00
Ian Hickson
6beafa7b16
Apply style guide regarding createTempSync pattern ( #81090 )
2021-04-27 14:59:03 -07:00
Phil Quitslund
08d7811f7f
sort directives ( #81210 )
2021-04-27 10:09:02 -07:00
xster
ff2dde2c7f
Reland double gzip wrapping NOTICES to reduce on-disk installed space ( #80897 )
2021-04-26 22:35:45 -07:00
Emmanuel Garcia
b0a63c4ffe
Reland the Dart plugin registry ( #79669 )
2021-04-23 15:34:04 -07:00
Jonah Williams
63ba1b23ca
[flutter_tools] add support for --bundle-sksl-path to flutter run / flutter drive ( #80885 )
2021-04-21 13:59:02 -07:00
Phil Quitslund
61c30c41b2
fix sort_directives violations ( #80817 )
2021-04-21 13:49:03 -07:00
Casey Hillers
c571804913
Revert "Reland [devicelab] Migrate Gallery to BuildTestTask ( #78361 )" ( #79903 )
...
This reverts commit 0c9781e3dd
2021-04-06 16:28:54 -07:00
Casey Hillers
0c9781e3dd
Reland [devicelab] Migrate Gallery to BuildTestTask ( #78361 )
2021-04-06 16:04:03 -07:00
Jenn Magder
1f19fd7108
Take screenshot when startup perf test fails to run ( #79514 )
2021-03-31 21:32:49 -07:00
Jia Hao
8158b478d7
Add tests for integration tests to devicelab ( #79258 )
2021-03-30 22:29:03 -07:00
Jenn Magder
12880f7751
Point gallery test data to FLUTTER_TEST_OUTPUTS_DIR ( #79332 )
2021-03-29 21:39:03 -07:00
Kaushik Iska
e6920662ad
Add a test to exercise multiple async microtasks in frame workload ( #79163 )
2021-03-29 20:49:05 -07:00
Dan Field
374993ce88
fix tree ( #79329 )
2021-03-29 18:52:36 -07:00
Dan Field
750fd1d536
Avoid hard coding "build" for test output files ( #79322 )
2021-03-29 17:36:34 -07:00
Zachary Anderson
5efc7169eb
Reverts "Implement dartPluginClass support for plugins #74469 " ( #78623 )
...
* Revert "Enable dart_plugin_registry_test (#76645 )"
This reverts commit 109e0bb9f5https://github.com/flutter/flutter/pull/76662 (#77093 )"
This reverts commit cdca6485f0#76662 )"
This reverts commit dadbd47d09#76561 )"
This reverts commit 098ece522d#76838 )"
This reverts commit 1610a27476#74469 )"
This reverts commit b7d4806243
2021-03-23 14:28:11 -07:00
Jenn Magder
3463946448
Take screenshot when drive fails ( #78822 )
2021-03-22 19:06:28 -07:00
Casey Hillers
c30fdfbe82
Revert "[devicelab] Migrate Gallery to BuildTestTask ( #77956 )" ( #78355 )
...
This reverts commit 93fb258602
2021-03-16 12:20:36 -07:00
Casey Hillers
93fb258602
[devicelab] Migrate Gallery to BuildTestTask ( #77956 )
2021-03-16 11:58:03 -07:00
Zachary Anderson
9167083d09
Explain why devtools in pinned ( #77657 )
2021-03-09 08:34:03 -08:00
Jenn Magder
85e2c52b39
Increase activated devtools version to 2.0 ( #77637 )
2021-03-08 13:17:21 -08:00
Michael Goderbauer
cb867bbedc
Enable unnecessary_await_in_return lint ( #77434 )
2021-03-05 18:38:15 -08:00
Jenn Magder
e9e8ca7640
Add debug_second_compile_millis benchmark metric ( #77420 )
2021-03-05 15:33:28 -08:00
Casey Hillers
b0afe3464e
Create BuildTestTask ( #77307 )
2021-03-04 18:49:03 -08:00
Casey Hillers
7ed797b053
Revert "[devicelab] Separate build and test from Flutter gallery tests ( #76415 )" ( #77086 )
...
This reverts commit 297c7b5cf2
2021-03-02 12:17:18 -08:00
Casey Hillers
297c7b5cf2
[devicelab] Separate build and test from Flutter gallery tests ( #76415 )
2021-03-02 11:49:02 -08:00
Jenn Magder
1610a27476
Remove dart_plugin_registry_test timeouts ( #76838 )
2021-02-25 20:26:02 -08:00
Jenn Magder
d69e2f10d8
Remove unused android_splash_screens integration test ( #76429 )
2021-02-22 14:46:04 -08:00
Jenn Magder
7cd99db0e4
Remove unused image_loading integration test ( #76430 )
2021-02-22 10:51:53 -08:00
Emmanuel Garcia
b7d4806243
Implement dartPluginClass support for plugins ( #74469 )
2021-02-19 09:22:45 -08:00
chunhtai
815976a8e4
change stack size test to test arm device ( #75814 )
2021-02-17 12:46:03 -08:00
Jenn Magder
d35058f5b8
Do not fail if 9xth_percentile_memory_usage is not recorded ( #76153 )
2021-02-16 15:56:02 -08:00
godofredoc
a0e8681452
Add flutter update packages to some tests. ( #75530 )
...
* Add flutter update packages to some tests.
Analyzer_benchmark and flutter_test_performance require to pub get
multiple directories. Rather than delegating the recipes to run flutter
update-packages we explicitly running on tests that need it.
Bug: https://github.com/flutter/flutter/issues/75524
* Add pub get directly on the analyis classes.
* Run flutter get in dev/tools.
* Fix directory path.
* Add more dependency directories.
* Fix typo.
* Add more dependencies.
* Add stocks dependency.
* Fix paths to some apps.
* Add more dependencies.
* Complete dependencies definition.
* More analysis dependencies.
* Add examples dependencies.
* Dev tool dependencies.
* Use update-packages for analyzer benchmark.
2021-02-11 15:30:55 -08:00
chunhtai
713fa8e360
Reland "add a benchmark test for stack size ( #75039 )" ( #75434 )
...
* Reland "add a benchmark test for stack size (#75039 )"
This reverts commit de683de9d5
2021-02-04 12:16:31 -08:00
Shi-Hao Hong
de683de9d5
Revert "add a benchmark test for stack size ( #75039 )" ( #75383 )
...
This reverts commit 9d9109aa6f
2021-02-04 10:26:04 +08:00
chunhtai
9d9109aa6f
add a benchmark test for stack size ( #75039 )
2021-02-03 15:16:03 -08:00
Jenn Magder
91aad2bb06
Avoid iOS local networking dialog in integration tests ( #75163 )
2021-02-01 13:33:25 -08:00
Jonah Williams
7ee910b0a8
[flutter_tools] ensure --dart-define can parse args with commas ( #73798 )
2021-01-15 13:51:32 -08:00
Yuqian Li
c4114a7527
Remove more flaky non-e2e tests ( #74062 )
...
Fixes https://github.com/flutter/flutter/issues/73873
2021-01-15 13:22:26 -08:00
LongCatIsLooong
cbe72db135
macrobenchmark: TextField with complex paragraph ( #73374 )
2021-01-12 15:44:01 -08:00
Jenn Magder
66145fe652
Force plugins to inherit minimum macOS version from Flutter app ( #72764 )
2021-01-11 11:16:12 -08:00
Yegor
1f8501f0a4
web benchmark choose renderer explicitly ( #73582 )
2021-01-08 12:04:03 -08:00
nturgut
272b23cabd
[web] make sure tests and benchmarks use correct backend - add autodetect false ( #73047 )
...
* add autodetect false
* fix typo
2020-12-28 10:55:53 -08:00
nturgut
14206399c3
make sure tests and becnhmarks use correct backend ( #72628 )
2020-12-21 09:55:23 -08:00
xster
ca82c572b7
Revert "let NOTICES be double gzip wrapped to reduce on-disk installed space ( #71899 )" ( #72438 )
2020-12-16 10:58:19 -08:00
xster
4ed3432e8f
let NOTICES be double gzip wrapped to reduce on-disk installed space ( #71899 )
2020-12-15 13:29:14 -08:00
Kate Lovett
1c244da28d
Add verbose flag to hot mode tests ( #71610 )
2020-12-02 16:47:35 -06:00
Jonah Williams
1e0628001e
[devicelab] dont use set modified for hot reload bench ( #70965 )
2020-11-20 13:02:28 -08:00
Jonah Williams
9424474793
[devicelab] update hot reload benchmark to be more representative ( #70643 )
...
update hot reload benchmark to be more representative
2020-11-18 14:54:01 -08:00
Jim Graham
61460d255a
preserve detailFiles entry in TaskResult JSON ( #70668 )
...
* preserve detailFiles entry in TaskResult JSON
2020-11-17 16:05:54 -08:00
Yuqian Li
f7811ea541
e2e perf tests don't have CPU/GPU/memory metrics ( #70439 )
...
Address comment in https://github.com/flutter/flutter/pull/66386/files#r522671103
2020-11-13 11:16:50 -08:00
Yegor
9e5d22d101
Say [APP] instead of [Gallery] in web benchmarks ( #69624 )
2020-11-03 10:13:07 -08:00
Jenn Magder
bb495ba90c
Do not fail if average_memory_usage is not recorded ( #69339 )
2020-10-29 16:09:50 -07:00
Jonah Williams
31c96b5d83
[devicelab] do not fail test if CPU measurement is not recorded ( #69268 )
2020-10-29 09:32:34 -07:00
Jonah Williams
18341efa2f
[devicelab] retry startup of start up test ( #69272 )
2020-10-29 09:19:07 -07:00
Jonah Williams
83d4351e0c
[devicelab] work around occasional null values for devtools ( #69273 )
...
* [devicelab] work around occasional null values for devtools
* Update perf_tests.dart
2020-10-29 09:18:38 -07:00
Jenn Magder
13896b3bd1
Decrease device discovery timeout from 10 to 5 seconds ( #69266 )
2020-10-28 19:43:19 -07:00
Jenn Magder
135aab9cf5
Increase device run perf test timeout ( #69260 )
2020-10-28 18:29:04 -07:00
Jonah Williams
2c12a8d917
[devicelab] remove twc enabled test and uncaught image test ( #68518 )
2020-10-24 13:19:51 -07:00
Jonah Williams
ab20ae782a
[devicelab] uinstall during memory test ( #68548 )
2020-10-20 09:49:50 -07:00
Jonah Williams
938fae9c99
remove --machine flag ( #68538 )
2020-10-19 17:06:28 -07:00
Jonah Williams
a152c0f429
[devicelab] reland: reduce iterations of startup test, use application binary ( #68532 )
...
These devicelab tests are incredibly flaky. Currently they will build & install the same application 15 times. This causes the temp storage to fill up on android, and has a good chance of flaking on iOS due to install issues.
The change from 3 to 15 increased total test time for 2 -> 12 minutes on iOS, or roughly 5 more test equivalents for every single iOS test. Reduce the iteration count back to 5
Uninstall the app after each run so temp storage does not fill up.
2020-10-19 16:51:28 -07:00
Jonah Williams
4a3e2a1af5
Revert "[devicelab] reduce iterations, uninstall at end, and use --application-binary in all startup tests ( #68516 )" ( #68531 )
...
This reverts commit a4c2075a45
2020-10-19 15:05:46 -07:00
Jonah Williams
8262f808ba
Revert "[devicelab] fix flutter gallery app name ( #68528 )" ( #68530 )
...
This reverts commit 0f69f8e53b
2020-10-19 15:05:10 -07:00
Jonah Williams
0f69f8e53b
[devicelab] fix flutter gallery app name ( #68528 )
2020-10-19 14:48:05 -07:00
Jonah Williams
a4c2075a45
[devicelab] reduce iterations, uninstall at end, and use --application-binary in all startup tests ( #68516 )
...
These devicelab tests are incredibly flaky. Currently they will build & install the same application 15 times. This causes the temp storage to fill up on android, and has a good chance of flaking on iOS due to install issues.
The change from 3 to 15 increased total test time for 2 -> 12 minutes on iOS, or roughly 5 more test equivalents for every single iOS test. Reduce the iteration count back to 5
Uninstall the app after each run so temp storage does not fill up.
2020-10-19 14:16:04 -07:00
Jonah Williams
03db9bf918
[devicelab] migrate defines test to DriverTest ( #68407 )
...
Removes one-off handling for defines test and forces it to run through the DriverTest interface
2020-10-19 12:28:43 -07:00
Jonah Williams
223df0c351
[devicelab] split end to end tests into driver targets ( #68410 )
...
Split the integration_ui target into individual driver tests. Remove disabled screenshot tests
2020-10-19 12:28:13 -07:00
Jonah Williams
e422d5c724
[flutter_tools] reland: --no-android-gradle-daemon in devicelab ( #68491 )
...
Remove devicelab specific code for shutting down gradle daemon, add --android-gradle-daemon option to build/run/drive`. Avoids need for un-tested devicelab specific handler. There are also some feature requests for this, so 2 birds one stone.
Example:
flutter build apk --no-android-gradle-daemon will pass --no-daemon on to gradle
2020-10-19 10:27:58 -07:00
Jonah Williams
ed5482de19
Revert "[flutter_tools] add --android-gradle-daemon option, use in devicelab ( #68409 )" ( #68489 )
...
This reverts commit ddab72e79f
2020-10-19 09:33:52 -07:00
Jonah Williams
ddab72e79f
[flutter_tools] add --android-gradle-daemon option, use in devicelab ( #68409 )
...
Remove devicelab specific code for shutting down gradle daemon, add --android-gradle-daemon option to build/run/drive`. Avoids need for un-tested devicelab specific handler. There are also some feature requests for this, so 2 birds one stone.
Example:
flutter build apk --no-android-gradle-daemon will pass --no-daemon on to gradle
2020-10-19 09:12:21 -07:00
Alexandre Ardhuin
c0176c9ee5
use_is_even_rather_than_modulo ( #68301 )
2020-10-16 20:20:00 +02:00
Dan Field
12f54e17f4
reland List queue search optimization ( #68214 )
...
* Revert "Revert "Improve performance of collectAllElements (#68065 )" (#68207 )"
This reverts commit 46ff57d6f1
2020-10-15 13:46:50 -07:00
Jonah Williams
46ff57d6f1
Revert "Improve performance of collectAllElements ( #68065 )" ( #68207 )
...
This reverts commit 8ba5732c4c
2020-10-15 08:04:59 -07:00
Dan Field
8ba5732c4c
Improve performance of collectAllElements ( #68065 )
2020-10-14 21:32:04 -07:00
Jonah Williams
33903c17e1
[devicelab] delete disabled or not useful benchmarks ( #68107 )
...
- run_without_leak_tests: have been disabled for months
- build_benchmark: the tooling work here is mostly done and we're not tracking further improvements, free up more devicelab capacity
- system_debug_ios: does not work post iOS13
- mac_enable_twc: not adding more mac tests to devicelab
- hello_world_start_up: disabled
Any tests that we think will be valuable in the future can be resurrected from the git history.
2020-10-14 10:30:10 -07:00
Jonah Williams
751459df24
[flutter_tool] support --use-application-binary in flutter drive ( #68060 )
...
--use-application-binary allows running with an already built APK. This can be useful for speeding up CI test cases, or in our case eventually supporting some sort of build server. Demonstrate that this works by updating the old gallery test to use it. Fixes #56604
Co-authored-by: Jenn Magder <magder@google.com>
2020-10-13 19:27:30 -07:00
Jonah Williams
eb24393efe
remove missing argument ( #67974 )
2020-10-12 17:18:09 -07:00
Jonah Williams
5dfe7e6d51
[flutter_tools] attempt to stabilize hot restart benchmark the old fashioned way ( #67971 )
...
A change which sped up hot restart locally caused many of the devicelab measures to regress. I think this is because we do not measure when the isolate is actually "ready", so starting a reload or restart prematurely can cause time spent doing initialization to be registered as part of the reload operation.
A fix for this would be to have the framework include some sort of "initialization complete" event ... but it is not clear what the correct trigger would be. Perhaps after the first frame is successfully registered?
(9a3a0dc
2020-10-12 17:00:26 -07:00
Yuqian Li
98d1ad0195
Purge persistent cache for perf test runs ( #67697 )
2020-10-08 19:17:02 -07:00
Casey Hillers
9e206a0c93
Refactor devicelab logic to use TaskResult instead of JSON ( #67550 )
2020-10-07 16:37:09 -07:00
Ming Lyu (CareF)
76c0d69b14
migrate textfield_perf to e2e ( #64503 )
2020-10-02 14:47:03 -07:00
Yuqian Li
e45157fc08
5x startup test repitition to reduce noise ( #67147 )
2020-10-02 12:22:05 -07:00
Ming Lyu (CareF)
db2532a949
migrate color_filter_and_fade_perf ( #64484 )
2020-10-01 17:32:02 -07:00
Yuqian Li
b92d250116
Let perf tests measure memory by default ( #66570 )
...
Fixes https://github.com/flutter/flutter/issues/66569
2020-10-01 15:20:17 -07:00
Chris Yang
2d26bafec2
remove --trace-startup ( #66568 )
2020-09-29 17:22:04 -07:00
Yuqian Li
54ac7bc936
Reland "Default measureCpuGpu to true ( #66386 )" ( #66604 )
...
This reverts commit 2d9e500523
2020-09-28 10:26:35 -07:00
Jenn Magder
65159afb55
Force plugins to inherit minimum iOS version from Flutter app ( #66590 )
2020-09-28 10:14:47 -07:00
Yuqian Li
2d9e500523
Revert "Default measureCpuGpu to true ( #66386 )" ( #66594 )
...
This reverts commit 48ce83a833
2020-09-24 15:17:57 -07:00
Yuqian Li
48ce83a833
Default measureCpuGpu to true ( #66386 )
2020-09-24 13:42:03 -07:00
Ming Lyu (CareF)
f681fcf32b
migrate backdrop_filter_perf ( #64482 )
2020-09-22 19:52:02 -07:00
Michael R Fairhurst
7f3c9b6bda
Remove unused 'dart:async' imports. ( #65568 )
2020-09-16 14:14:06 -07:00
Ming Lyu (CareF)
b3f19a3e1a
migrate animated_placeholder_perf ( #64478 )
2020-09-16 07:47:03 -07:00
Yuqian Li
b8a39c15f8
Collect memory metrics ( #65798 )
2020-09-15 12:47:05 -07:00
Jonah Williams
4e20f00053
[ci] remove create offline tests ( #65791 )
...
Currently these tests are taking CI time without providing any value, because there is no verification that network connectivity is avoided. This is better covered by a unit test that verifies that --offline is passed to pub.
2020-09-14 17:54:59 -07:00
Ming Lyu (CareF)
51f1c98490
migrate cubic_bezier_perf to e2e ( #64487 )
2020-09-11 20:02:03 -07:00
Yuqian Li
e1eddb401d
Revert the revert ( #65602 )
2020-09-11 16:20:03 -07:00
xster
65ae30c8cc
Update create templates to 1.0.0 ( #65234 )
2020-09-10 12:57:56 -07:00
gaaclarke
37de94d7d2
devicelab: started averaging startup time for ios test ( #64978 )
2020-09-02 16:35:03 -07:00
Christopher Fujino
237c0ab424
Delete catalog generator android/ios tests ( #64977 )
2020-09-02 11:25:04 -07:00
Ming Lyu (CareF)
28de49e358
Revert "Reland #61998 and update complex_layout ios files ( #64885 )" ( #64990 )
...
This reverts commit df83398687
2020-08-31 18:47:08 -07:00
Ming Lyu (CareF)
df83398687
Reland #61998 and update complex_layout ios files ( #64885 )
2020-08-31 17:23:06 -07:00
Dan Field
b5ed913ecc
Memory/cpu/gpu benchmark for showing large images in succession ( #64762 )
2020-08-31 10:03:57 -07:00
Shi-Hao Hong
34541c3073
Revert "A benchmark test case for measuring scroll smoothness ( #61998 )" ( #64883 )
...
This reverts commit 12b7355da1
2020-08-30 18:42:10 +08:00
Ming Lyu (CareF)
12b7355da1
A benchmark test case for measuring scroll smoothness ( #61998 )
2020-08-29 04:28:03 -07:00
Ming Lyu (CareF)
d30e36ba8c
migrate flutter_gallery_sksl_warmup__transition_perf to e2e ( #64275 )
2020-08-21 19:36:03 -07:00
Jim Graham
9e86e9fb1e
report list of detail files so devicelab can save them ( #64009 )
2020-08-20 10:58:25 -07:00
Yuqian Li
6eb45d35da
Rename needsMeasureCpuGpu to measureCpuGpu ( #64000 )
2020-08-19 13:26:07 -07:00
Remi Rousselet
2b25e29192
add benchmark for ChangeNotifier.notifyListeners ( #62715 )
2020-08-14 17:06:03 -07:00
Ming Lyu (CareF)
6f26e806ab
bug fix for flutter_gallery__transition_perf(_with_semantics) ( #63799 )
...
* report failure for semantics test
* bug fix
2020-08-14 19:37:08 -04:00
Ming Lyu (CareF)
360023e2bc
Clean up flutter_gallery__transition_perf ( #63609 )
2020-08-13 14:41:04 -07:00
Ming Lyu (CareF)
0629030a05
WidgetTester.drag with time duration ( #63410 )
2020-08-12 21:01:03 -07:00
Ming Lyu (CareF)
2384376f64
Migrate gallery/transitions_perf test to e2e ( #62064 )
2020-08-12 13:36:07 -07:00
Yuqian Li
2296bb154b
Measure CPU/GPU with the simple animation test ( #63124 )
2020-08-07 20:41:07 -07:00
Yuqian Li
6d487355a3
Remove cubic_bezier_perf.dart ( #63028 )
2020-08-05 20:21:02 -07:00
Tianguang
504963b4d1
Pin gallery version ( #62986 )
2020-08-05 15:11:18 -07:00
Ming Lyu (CareF)
1d329d2cc9
migrate macrobenchmark/multi_widget_construction test to e2e ( #62539 )
2020-08-04 18:56:03 -07:00
Yuqian Li
e6bc56f25a
Reland "Add Crane test to the new Gallery app ( #62162 )" ( #62544 )
2020-07-31 09:56:04 -07:00
Michael Goderbauer
e4b6754155
Bump new gallery version ( #62439 )
2020-07-28 15:25:03 -07:00
Jonah Williams
27e13dd53e
Revert "Add Crane test to the new Gallery app ( #62162 )" ( #62430 )
...
This reverts commit 1ffdfa81d6
2020-07-28 11:32:34 -07:00
Yuqian Li
1ffdfa81d6
Add Crane test to the new Gallery app ( #62162 )
2020-07-28 10:56:05 -07:00
Ming Lyu (CareF)
056e455e94
Add a E2E based performance test case ( #61509 )
2020-07-23 08:31:04 -07:00
Chris Yang
c5a69b9b8a
Reland "Branch out android platform view perf testing #60238 " 2nd time ( #61748 )
2020-07-22 18:36:11 -07:00
Ming Lyu (CareF)
54c9441723
benchmarkLive: a new LiveTestWidgetsFlutterBindingFramePolicy for benchmark on device ( #61388 )
...
* add benchmarkLive flag and tests
* update handlePointerEventRecord doc
* using e2e 0.6.1
2020-07-17 18:56:12 -04:00
Ming Lyu (CareF)
7bef51acc9
cleanup macrobenchmark duplicate files ( #61621 )
...
* cleanup macrobenchmark duplicate files
2020-07-17 14:34:33 -04:00
Emmanuel Garcia
293a2bf8e8
Android views using hybrid composition e2e driver test ( #61507 )
2020-07-16 16:19:49 -07:00
Chris Yang
6a525b9aa5
Revert "Reland "Branch out android platform view perf testing ( #60238 )" ( #61554 )" ( #61642 )
2020-07-16 13:14:52 -07:00
Chris Yang
63ceeb8f15
Reland "Branch out android platform view perf testing ( #60238 )" ( #61554 )
2020-07-16 11:23:52 -07:00
Sam Rawlins
54f99d642d
Remove unused optional parameters of private functions. ( #60446 )
2020-07-15 09:41:02 -07:00
Chris Yang
77efc00af0
Revert "Branch out android platform view perf testing ( #60238 )" ( #61482 )
...
This reverts commit 9f4499f431
2020-07-14 15:10:21 -07:00
Chris Yang
9f4499f431
Branch out android platform view perf testing ( #60238 )
2020-07-14 13:07:41 -07:00
Pierre-Louis
49cf97c35b
Update new gallery HEAD commit ( #60504 )
...
The gallery repository history has been rewritten (see flutter/gallery#87 ), so updating to HEAD commit
2020-06-29 10:49:29 +02:00
Ming Lyu (CareF)
025463f463
Heavy Widget construction and destruction performance test ( #60336 )
...
* Add widget construction benchmark
* Add to device lab
2020-06-26 17:38:26 -04:00
Ming Lyu (CareF)
99f5eebc6b
Add --device-id option for devicelab/bin/run.dart ( #59276 )
...
* Implement device selection for devicelab/run.dart
* Add test to --device-id option for devicelab/run
* Update dev/devicelab/bin/run.dart by jonahwilliam
* Rename deviceOperatingSystem enum mock -> fake
Co-authored-by: Jonah Williams <jonahwilliams@google.com>
2020-06-26 09:29:46 -04:00
Tianguang
02f8e02880
Add Web Benchmarks for Flutter Gallery (Flutter Side) — 1/4 ( #57576 )
2020-06-24 10:28:03 -07:00
liyuqian
850ea6d29d
Add SkSL shader warm-up tests to Flutter gallery ( #59932 )
2020-06-23 17:48:02 -07:00
Chris Bracken
e0f60918d4
Roll the engine from 965fbbe to b5f5e63 ( #59804 )
...
This rolls the engine from:
965fbbed1776545ee681cb57f3fb1d0c2000bbcb to
b5f5e6332cb4987e9e38ffaa267733ec0a8705ba. A Dart SDK roll in this range
changed the format of the compileExpression RPC VMService endpoint,
necessitating a tool patch.
2020-06-18 16:12:54 -07:00
liyuqian
9dad2d98df
Perf test with SkSL warm-up ( #56638 )
2020-06-06 14:43:02 -07:00
liyuqian
08225fad28
Add iOS new gallery perf test ( #58648 )
2020-06-04 10:23:01 -07:00
Jim Graham
7261b98e81
Enabling the ImageFiltered(ImageFilter.matrix) page of macrobenchmark ( #58277 )
2020-05-30 18:53:01 -07:00
Jonah Williams
d9144bf8fc
[flutter_tools] rename output LICENSE file to NOTICES and support loading either ( #57871 )
...
Work towards #16723
This is only safe to land after #58131 lands in google3. Only build NOTICES in asset manfiest, and load either LICENSE or NOTICES from pubspec dependencies.
2020-05-29 11:55:02 -07:00
liyuqian
721927efd3
Use pub inside the Flutter directory ( #57704 )
2020-05-21 17:52:02 -07:00
liyuqian
a635765116
Reland "Add DevTools memory test ( #55486 )" ( #57340 )
2020-05-19 18:02:03 -07:00
Jonah Williams
231a055069
[devicelab] fix web twc task missing display ( #56623 )
2020-05-08 09:50:46 -07:00
liyuqian
a849daf283
Roll new gallery version in the perf test ( #56575 )
2020-05-07 18:59:02 -07:00
Zachary Anderson
19967e2463
Revert "Add DevTools memory test ( #55486 )" ( #56445 )
...
This reverts commit 9ee6763a66
2020-05-06 07:53:26 -07:00
liyuqian
9ee6763a66
Add DevTools memory test ( #55486 )
2020-05-05 15:12:01 -07:00
Jonah Williams
f04d61944a
[devicelab] enable macOS, windows, linux, and web on devicelab bots ( #56336 )
...
* enable macOS desktop
* enable all configs on CI
* Update track_widget_creation_enabled_task.dart
* Update framework.dart
* remove FLUTTER_WEB
* remove config environment variables
* configure in correct spot
2020-05-04 18:49:28 -07:00
Jenn Magder
c8c55b4098
Check Xcode build setting FULL_PRODUCT_NAME for bundle name ( #55799 )
2020-05-04 11:31:08 -07:00
Jonah Williams
6dc1e83f12
[flutter_tools] ensure track-widget-creation can be disabled on Android/macOS ( #56203 )
...
Ensure --no-track-widget-creation is piped through android/macOS. Adds integration testing for iOS/android/macOS
2020-05-04 11:22:15 -07:00
Emmanuel Garcia
9d106bdead
Read correct file for android view benchmark ( #55935 )
2020-04-28 23:09:50 -07:00
Emmanuel Garcia
b176042c1a
Add benchmark for hybrid composition on Android ( #55609 )
2020-04-28 19:24:15 -07:00
liyuqian
a091206ed1
Add performance tests for the new gallery ( #55181 )
2020-04-22 20:03:01 -07:00
Tianguang
fbf4fa0a05
Devicelab tests (Chrome run, Web compile) for New Flutter Gallery ( #53096 )
2020-04-21 11:48:03 -07:00
Jim Graham
77ea2da746
benchmark animation performance of Opacity widget ( #54903 )
2020-04-17 18:34:10 -07:00
Jonah Williams
e092dcfa22
[flutter_tools] Reland: fix multiple dart defines ( #54973 )
2020-04-16 10:56:49 -07:00
Jonah Williams
11ab2fa35c
Revert "[flutter_tools] fix multiple defines in flutter tooling, web ( #54909 )" ( #54967 )
...
This reverts commit b8bd09db21
2020-04-16 08:33:16 -07:00
Jonah Williams
b8bd09db21
[flutter_tools] fix multiple defines in flutter tooling, web ( #54909 )
2020-04-15 22:25:32 -07:00
Jonah Williams
6cb74eeac8
fix apk location for devicelab ( #54697 )
2020-04-13 16:56:27 -07:00
Kaushik Iska
7b9aeb2ff2
[flutter_driver] Reland add SceneDisplayLag stats to timeline summary ( #54490 )
2020-04-11 15:30:01 -07:00
Kaushik Iska
50b4c39c5d
Revert "[flutter_driver] Add SceneDisplayLag stats to timeline summary ( #54218 )" ( #54480 )
...
This reverts commit ce92333bf7
2020-04-10 12:48:48 -07:00
Kaushik Iska
ce92333bf7
[flutter_driver] Add SceneDisplayLag stats to timeline summary ( #54218 )
2020-04-10 12:20:01 -07:00
Yegor
4e3cf198e8
disable tracing for non-frame based benchmarks ( #54236 )
2020-04-08 09:17:03 -07:00
Yegor
29c88081b9
Collect chrome://tracing data in Web benchmarks ( #53879 )
...
Collect chrome://tracing data in Web benchmarks
2020-04-03 15:10:39 -07:00
Mouad Debbar
45a8b3db81
complete text layout benchmark ( #53295 )
2020-03-27 14:56:02 -07:00
Chris Yang
b05210c707
Move ios screenshot test to flutter gold. ( #52553 )
2020-03-19 16:27:41 -07:00
Emmanuel Garcia
a3c6e4a0b9
Reland: Add Platform View benchmark ( #52839 )
2020-03-18 13:24:52 -07:00
Emmanuel Garcia
dc8ffe0430
Revert "Add benchmark for platform views ( #52717 )" ( #52834 )
...
This reverts commit 1f1731842a
2020-03-18 11:16:38 -07:00
Emmanuel Garcia
1f1731842a
Add benchmark for platform views ( #52717 )
2020-03-18 10:55:50 -07:00
Michael Thomsen
e167181444
Move flutter_gallery to the testing folder ( #52532 )
...
Move Flutter Gallery to dev/integration_tests/ as it is an older copy used only for testing. The current version of the Flutter Gallery now lives in https://github.com/flutter/gallery .
2020-03-16 10:31:42 +01:00
liyuqian
8bff33e497
Remove missed frame budget count ( #52560 )
2020-03-13 17:26:02 -07:00
liyuqian
c80d1e8266
Perf test for color filter with saveLayer ( #52063 )
2020-03-13 10:31:02 -07:00
Chris Yang
7fb7ea63b3
Reland "Add ios platform view integration test ( #51882 )" ( #52440 )
2020-03-11 16:32:47 -07:00
Mouad Debbar
5bb552270d
[web] Add benchmarks for text layout ( #51663 )
2020-03-10 18:46:03 -07:00
Chris Yang
fc5350ed04
Revert "Add ios platform view integration test ( #51882 )" ( #52373 )
...
This reverts commit 357fd2db38
2020-03-10 18:42:15 -07:00
Chris Yang
357fd2db38
Add ios platform view integration test ( #51882 )
2020-03-10 17:33:01 -07:00
Jonah Williams
4ce34f2516
[benchmarks] remove archived build aot benchmarks ( #52283 )
2020-03-09 20:15:59 -07:00
Jonah Williams
c1112d3f7e
[flutter_tools] Reland: Allow providing dart-defines to Android, iOS, macOS builds ( #52044 )
2020-03-06 14:53:36 -08:00
Jonah Williams
ee476a7bd1
Revert "[flutter_tools] Allow providing dart-defines to Android, iOS, macOS builds ( #51714 )" ( #52041 )
...
This reverts commit ee60eeea3e
2020-03-05 12:51:42 -08:00
Jonah Williams
ee60eeea3e
[flutter_tools] Allow providing dart-defines to Android, iOS, macOS builds ( #51714 )
2020-03-05 12:38:40 -08:00
Mouad Debbar
03d6b58002
[web] Allow benchmarks to customize their score keys ( #51493 )
2020-02-28 13:54:45 -08:00
Yegor
cd0fbd3205
improve web benchmark error reporting ( #51490 )
2020-02-28 10:14:22 -08:00
Dan Field
d030296a97
Reland test ( #50987 )
2020-02-20 01:51:15 -08:00
Jonah Williams
d0b7f0cd4e
Revert "Animated placeholder perf ( #50851 )" ( #50984 )
...
This reverts commit e4fbb1aba6
2020-02-18 12:32:46 -08:00
Dan Field
e4fbb1aba6
Animated placeholder perf ( #50851 )
2020-02-18 11:29:22 -08:00
Alexandre Ardhuin
0bd45bc222
update lint list + enable unnecessary_string_interpolations ( #50593 )
2020-02-14 09:43:52 +01:00
Yegor
b34046903b
Fix stack trace parsing on non-debug builds; add e2e tests ( #50652 )
...
* Fix stack trace parsing on non-debug builds; add e2e tests
2020-02-13 18:34:08 -08:00
Alexandre Ardhuin
b953c3e5a8
use raw strings to avoid escaping ( #50322 )
2020-02-07 16:35:55 +01:00
Jonah Williams
7b074468a4
Update compile size benchmarks to include --split-debug-info and --tree-shake-icons ( #50313 )
2020-02-06 23:28:41 -08:00
Alexandre Ardhuin
5c28e3eeea
unnecessary escapes fixes ( #50178 )
...
* unnecessary escapes fixes
* replace some strings with raw strings
* update regexp
* address review comments
2020-02-07 06:35:50 +01:00
Emmanuel Garcia
8c398a8ddd
Reland: Skia gold driver test ( #50160 )
2020-02-06 17:14:50 -08:00
Yegor
e4014a55c8
Web benchmarks: make headless mode opt-out ( #50166 )
2020-02-05 13:21:33 -08:00
Dan Field
4b8efad99b
Font subset in the tool ( #49737 )
2020-02-04 20:34:24 -08:00
Emmanuel Garcia
9b3e1639db
Revert "Reland: Skia gold driver test ( #49905 )" ( #50127 )
...
This reverts commit e03f439145
2020-02-04 13:28:55 -08:00
Yegor
ff7eb778f6
Respect CHROME_EXECUTABLE in web benchmarks ( #49911 )
2020-01-31 18:31:08 -08:00
Emmanuel Garcia
e03f439145
Reland: Skia gold driver test ( #49905 )
2020-01-31 14:50:50 -08:00
Emmanuel Garcia
1eb5bb653c
Revert "Use skia golden files in driver test ( #49750 )" ( #49900 )
2020-01-31 12:14:08 -08:00
Emmanuel Garcia
a50743f658
Use skia golden files in driver test ( #49750 )
2020-01-31 11:05:29 -08:00
Yegor
423459da18
Initial web benchmark harness and 3 benchmarks ( #49460 )
...
Initial web benchmark harness and 3 benchmarks
2020-01-30 14:19:17 -08:00
Jonah Williams
2f59919496
[flutter_tools] Reland fast start by default for Android ( #49315 )
2020-01-24 19:18:01 -08:00
Jonah Williams
2ebe9da454
Revert "[flutter_tools] Reland enable fast-start by default for Android ( #48851 )" ( #49227 )
2020-01-21 09:51:08 -08:00
Jonah Williams
1ac01b30ca
[flutter_tools] Reland enable fast-start by default for Android ( #48851 )
2020-01-21 08:59:26 -08:00
Emmanuel Garcia
fca5917519
Test hot reload targeting a Fuchsia device ( #48472 )
2020-01-10 14:38:01 -08:00
Alexandre Ardhuin
4f9b6cf017
enable lint prefer_final_in_for_each ( #47724 )
2020-01-07 16:32:04 +01:00
Jenn Magder
85e9be36bf
Revert "Check Xcode build setting FULL_PRODUCT_NAME for the name of the built app during flutter run ( #47266 )" ( #47568 )
...
This reverts commit 648a5d8a1e
2019-12-20 17:45:16 -08:00
Jenn Magder
648a5d8a1e
Check Xcode build setting FULL_PRODUCT_NAME for the name of the built app during flutter run ( #47266 )
2019-12-19 14:18:10 -08:00
Gary Qian
b011ea5468
Pass _caretPrototype to prevent cache miss ( #46720 )
2019-12-20 06:46:49 +09:00
Jenn Magder
65ad8d805a
Revert "Check Xcode build setting FULL_PRODUCT_NAME for the name of the built app during flutter run ( #46928 )" ( #47264 )
...
This reverts commit e54e301d50
2019-12-17 17:20:57 -08:00
Jenn Magder
e54e301d50
Check Xcode build setting FULL_PRODUCT_NAME for the name of the built app during flutter run ( #46928 )
2019-12-17 16:13:01 -08:00
Jim Graham
fa190a8685
New benchmark to measure performance of animations after removing a BackdropFilter. ( #46924 )
2019-12-13 13:27:53 -08:00
Chris Yang
4a0049627f
Reland "Add a FlutterDriver screenshot test to device lab. #45411 " ( #46620 )
2019-12-10 12:43:36 -08:00
Jenn Magder
e58dc16d7b
Revert "Add a FlutterDriver screenshot test to device lab. ( #45411 )" ( #46281 )
...
This reverts commit adec6977be
2019-12-06 18:21:52 -08:00
Chris Yang
adec6977be
Add a FlutterDriver screenshot test to device lab. ( #45411 )
2019-12-06 14:17:02 -08:00
Alexandre Ardhuin
ec1a015045
implicit-casts:false in dev ( #45787 )
2019-12-05 22:34:06 +01:00
Jonah Williams
0b2bf99491
Reland: Update macOS configuration settings ( #45966 )
2019-12-03 08:13:08 -08:00
Ian Hickson
449f4a6673
License update ( #45373 )
...
* Update project.pbxproj files to say Flutter rather than Chromium
Also, the templates now have an empty organization so that we don't cause people to give their apps a Flutter copyright.
* Update the copyright notice checker to require a standard notice on all files
* Update copyrights on Dart files. (This was a mechanical commit.)
* Fix weird license headers on Dart files that deviate from our conventions; relicense Shrine.
Some were already marked "The Flutter Authors", not clear why. Their
dates have been normalized. Some were missing the blank line after the
license. Some were randomly different in trivial ways for no apparent
reason (e.g. missing the trailing period).
* Clean up the copyrights in non-Dart files. (Manual edits.)
Also, make sure templates don't have copyrights.
* Fix some more ORGANIZATIONNAMEs
2019-11-27 15:04:02 -08:00
sjindel-google
43a8a1902e
Fix erroneous comments referring to blobs snapshots. ( #41378 )
2019-11-21 12:09:43 +01:00
Jonah Williams
0e36a91d18
Add macOS hot reload test ( #45264 )
2019-11-20 12:35:53 -08:00
liyuqian
a32fc986f3
Add a perf test for picture raster cache ( #45050 )
...
This will catch issues like
https://github.com/flutter/flutter/issues/44252 , and this test is
inspired by the `list_demo` sample app in
https://github.com/flutter/flutter/issues/43083#issue-509586473
This is tested locally on a Moto G4 before and after the fix
https://github.com/flutter/engine/pull/13710
The `average_frame_rasterizer_time_millis` of this test drops from
~5.4ms to ~4.9ms after that fix.
2019-11-19 15:48:41 -08:00
Jenn Magder
6e5769d425
Remove FLUTTER_DEVICELAB_XCODE_PROVISIONING_CONFIG code paths ( #45136 )
2019-11-19 11:19:44 -08:00
Ian Hickson
1ce4a4f36f
Make sure all our .dart files have license headers ( #44467 )
2019-11-08 16:53:21 -08:00
Jonah Williams
cc51ad5d08
Reland: enable usage of experimental web compiler ( #44400 )
2019-11-07 20:13:02 -08:00
Jonah Williams
7535ef735f
Revert "Enable usage of experimental incremental compiler for web ( #43576 )" ( #44396 )
...
This reverts commit e5d6d92498
2019-11-07 16:32:20 -08:00
Jonah Williams
e5d6d92498
Enable usage of experimental incremental compiler for web ( #43576 )
2019-11-07 16:29:51 -08:00
xster
cf95cd4394
Add v1 plugin register function into v2 plugin template ( #44166 )
2019-11-05 20:03:50 -08:00
Jonah Williams
e778686e72
Re-enable chrome dev mode tests ( #43691 )
2019-10-29 13:23:27 -07:00
liyuqian
9cc29c61df
Reland "Measure iOS CPU/GPU percentage #41426 " ( #41578 )
...
This reverts commit baea9bf7cc
2019-09-29 11:33:43 -07:00
liyuqian
baea9bf7cc
Revert "Reland "Measure iOS CPU/GPU percentage ( #41234 )" ( #41426 )" ( #41575 )
...
This reverts commit 67b5bdf99b
2019-09-29 10:58:13 -07:00
liyuqian
67b5bdf99b
Reland "Measure iOS CPU/GPU percentage ( #41234 )" ( #41426 )
...
This reverts commit f1e7fe8142https://github.com/flutter/packages/pull/39
2019-09-28 14:24:46 -07:00
Jonah Williams
f1e7fe8142
Revert "Reland "Measure iOS CPU/GPU percentage ( #39439 )" ( #41234 )" ( #41400 )
2019-09-26 12:27:01 -07:00
liyuqian
406b44983a
Reland "Measure iOS CPU/GPU percentage ( #39439 )" ( #41234 )
...
This reverts commit 652be88ecdhttps://github.com/flutter/packages/pull/37
2019-09-26 10:39:24 -07:00
Jonah Williams
39eecd5226
give benchmark output dill path ( #40857 )
2019-09-24 19:10:34 -04:00
Alexandre Ardhuin
a36f809e27
add missing trailing commas (in dev/) ( #40704 )
2019-09-19 07:54:46 +02:00
Alexandre Ardhuin
df4bf453ab
more UI-as-code ( #35516 )
2019-09-17 16:23:44 +02:00
liyuqian
652be88ecd
Revert "Measure iOS CPU/GPU percentage ( #39439 )" ( #40624 )
...
This reverts commit af9f424d5dflutter/flutter#39439
Reason: this passed the local device lab test on my Macbook but it failed in the actual device lab. Will investigate, fix, and reland.
TBR: @dnfield @goderbauer @tvolkert @Hixie
2019-09-16 15:00:27 -07:00
liyuqian
af9f424d5d
Measure iOS CPU/GPU percentage ( #39439 )
...
For https://github.com/flutter/flutter/issues/33899
Test added:
- simple_animation_perf_ios
Test modified:
- backdrop_filter_perf_ios__timeline_summary
We'll add the CPU/GPU measurement to more iOS tests
once it's proven to be non-flaky.
2019-09-16 13:14:38 -07:00
Phil Quitslund
37846b032f
migrate from slow async io calls ( #39515 )
...
* migrate from slow async io calls
2019-08-29 16:47:10 -07:00
Jonah Williams
d2f70a6d20
kill leaked chrome processes ( #39514 )
2019-08-29 14:28:37 -07:00
Collin Jackson
a1c185f37a
Fix plugin template app's tests ( #39080 )
...
* Fix plugin template
* Add test of plugin template working
2019-08-26 14:57:16 -07:00
Christopher Fujino
65f8f9c0b8
add --exit and --match-host-platform defaults to devicelab runner ( #37832 )
2019-08-20 14:37:42 -07:00
liyuqian
e77237d6d3
Reland "Fix the first frame logic in tracing and driver ( #35297 )" ( #37192 )
...
This relands https://github.com/flutter/flutter/pull/35297
The followings have been done to fix the broken tests:
1. Add `didSendFirstFrameRasterizedEvent` extension and its tests
2. Wait for `didSendFirstFrameRasterizedEvent` instead of
`didSendFirstFrameEvent` during start up tests
3. Mark missed (probably newly added) start up tests as flaky
2019-07-31 11:01:52 -07:00
Jonah Williams
3068fc4f7c
Revert "Fix the first frame logic in tracing and driver ( #35297 )" ( #37027 )
...
This reverts commit 68fc7231b3
2019-07-26 13:08:36 -07:00
Jason Simmons
a3a350df1c
devicelab: replace the FLUTTER_ENGINE environment variable with the new local engine flags ( #36969 )
2019-07-26 10:06:56 -07:00
liyuqian
68fc7231b3
Fix the first frame logic in tracing and driver ( #35297 )
...
This should fix https://github.com/flutter/flutter/issues/31442 and https://github.com/flutter/flutter/issues/34867
2019-07-26 09:38:12 -07:00
Matt Carroll
a7387b127d
Added demo projects for splash screen support on Android. ( #35728 )
2019-07-24 13:44:13 -07:00
Jonah Williams
c4cab5dc92
add missing config to create ( #36727 )
2019-07-22 19:48:55 -07:00
Jonah Williams
819538704a
fix devicelab tests ( #36717 )
2019-07-22 17:08:42 -07:00
Todd Volkert
0f625196cc
Add plumbing for hello world startup test in devicelab ( #36410 )
...
This is the first step in getting esoteric devices wired
up to device lab to ensure that we can at least start Flutter
apps in profile mode on such devices.
https://github.com/flutter/flutter/issues/35838
2019-07-18 11:13:14 -07:00
Jonah Williams
f711308376
Add sync star benchmark cases ( #36303 )
2019-07-17 16:19:49 -07:00
Jim Graham
6372250995
add the transformPoint and transformRect benchmarks ( #36026 )
2019-07-17 13:39:13 -07:00
Jenn Magder
b5c1b61c73
Add platform_interaction_test_swift to devicelab ( #35775 )
2019-07-10 14:13:01 -07:00
Jonah Williams
91e3b2d671
add iOS build benchmarks ( #35749 )
2019-07-08 18:09:00 -07:00
Alexander Aprelev
9f285aa9d9
Introduce image_list performance benchmark that runs on jit(debug) build. ( #35424 )
...
* Introduce image_list performance benchmark that runs on jit(debug) build.
We want to track performance of debug build because ongoing work on reducing the cost of spanwing new isolate will impact jit(debug) more than it will aot(release) configurations.
* Newlines and spaces
2019-07-08 08:23:06 -07:00
Jonah Williams
05b4c67550
add APK build time benchmarks ( #35481 )
2019-07-03 10:54:04 -07:00
Alexandre Ardhuin
758009ba70
more ui-as-code ( #35393 )
...
* more ui-as-code
* address review comments
2019-07-02 21:11:56 +02:00
Alexander Aprelev
3badcf51a4
Introduce image loading performance test. ( #34823 )
...
* Introduce image loading performance test.
This example reports how long it takes to load images over the network(locally spawned server).
2019-06-28 15:14:03 -07:00
Tong Mu
03ed06f44d
New benchmark: Gesture semantics ( #35232 )
...
* Add semanticsEnabled to widgetBenchmark
* Add button_matrix_app and gesture benchmark
2019-06-28 00:37:01 -07:00
Alexandre Ardhuin
919dcf53f3
enable lints prefer_spread_collections and prefer_inlined_adds ( #35189 )
2019-06-27 21:23:16 +02:00
Jim Graham
f83fd9d467
Add test case for Flutter Issue #27677 as a benchmark. ( #34870 )
...
* Add test case for Flutter Issue #27677 as a benchmark.
See https://github.com/flutter/flutter/issues/27677
I got the following results running the test on a Moto E2 which
will help us determine how much we can gain by analyzing the
operations and eliminating unnecessary repaints based on
dirty rectangles/regions.
no blurs - avg 216.0 fps over 3 samples
blur the group - avg 22.9 fps over 3 samples
blur each txt - avg 3.4 fps over 3 samples
* Added the new benchmark to be tracked on the dashboard.
2019-06-24 20:53:22 -07:00
Jonah Williams
25b5656969
Reland: rename web device ( #34885 )
2019-06-24 11:09:07 -07:00
Todd Volkert
fb2f18e7e8
Prepare for Uint8List SDK breaking changes ( #34295 )
...
https://github.com/dart-lang/sdk/issues/36900
2019-06-12 10:22:50 -07:00
Emmanuel Garcia
8627ff433b
Allow multi-abi shared libraries in APKs and App bundles ( #34123 )
...
* Gradle generates ELF shared libraries instead of AOT snapshots.
* `flutter build apk/appbundle` supports multiple `--target-platform` and defaults to `android-arm` and `android-arm64`.
* `flutter build apk` now has a flag called `--split-per-abi`.
2019-06-10 13:16:09 -07:00
Jonah Williams
4c0145d97b
Fix web size test for new world ( #34063 )
2019-06-07 13:52:04 -07:00
Jonah Williams
227ffb58d7
fix devicelab test for chrome reload worklow ( #34056 )
2019-06-07 12:44:17 -07:00
Jonah Williams
50ea6f32d3
add benchmarks to track web size ( #33892 )
2019-06-05 12:40:21 -07:00
Jonah Williams
83986acbdb
Add a real-er web restart, doctor, workflow ( #33786 )
2019-06-03 23:19:42 -07:00
Chris Bracken
98ea501995
Revert "Add real-er restart for web using webkit inspection protocol ( #33629 )" ( #33703 )
...
Revert "fix devicelab manfiest (#33698 )"
This reverts commit 5a6a00dc540d79f0fc79
2019-05-31 21:53:30 -07:00
Jonah Williams
5a6a00dc54
Add real-er restart for web using webkit inspection protocol ( #33629 )
2019-05-31 17:37:01 -07:00
Jason Simmons
311cde98a6
Reland "Clean up some flutter_tools tests and roll dependencies" ( #33225 )
...
This relands flutter/flutter#33163 with a fix to the integration_ui test.
2019-05-29 19:04:35 -07:00
Jonah Williams
925f5f1c53
Revert "Wire up hot restart and incremental rebuilds for web ( #33197 )" ( #33529 )
...
This reverts commit 52ae99682e
2019-05-29 12:09:01 -07:00
Jonah Williams
52ae99682e
Wire up hot restart and incremental rebuilds for web ( #33197 )
2019-05-29 09:49:16 -07:00
Chris Bracken
156b4220b4
Americanise spellings ( #33323 )
...
Updates documentation and non-public API to use American spellings for
consistency with the rest of the codebase.
No changes to behaviour... other than how it's spelt.
2019-05-24 19:13:02 -07:00
Chris Bracken
4d9923201b
Correct typos ( #33322 )
...
Corects a bnuch of typeos throuhgout teh Fluter codebsae.
Made use of the `misspell` tool:
https://github.com/client9/misspell
2019-05-24 19:12:45 -07:00
Jonah Williams
a30ffb60ad
Revert "Clean up some flutter_tools tests and roll dependencies ( #33163 )" ( #33206 )
2019-05-22 12:20:02 -07:00
Ian Hickson
e5f81e1048
Clean up some flutter_tools tests and roll dependencies ( #33163 )
...
* Clean up some flutter_tools tests
* Remove arbitrary retry that happens even for fundamental errors, and generally clean up _DevFSHttpWriter.
* Update dependencies (requires fixes; see next commit)
* Fixes for new dependencies.
2019-05-22 09:31:37 -07:00
Dan Field
99bd2795b0
Add rrect contains microbenchmark ( #30985 )
2019-04-15 09:01:40 -07:00
Tim Sneath
529189791c
Replace flutter.io with flutter.dev ( #30562 )
2019-04-05 11:39:30 -07:00
Jonah Williams
1bfa2f2311
Intercept errors thrown by synchronous Completers in image resolution. ( #30139 )
2019-03-29 10:05:18 -07:00
Dan Field
ecfdd7e1ea
Detect and cleanup leaky processes ( #29196 )
...
* Detect and cleanup leaky processes
* Add flaky tests for detecting leaked processes
2019-03-22 14:32:36 -07:00
Alexandre Ardhuin
387f885481
Add missing trailing commas ( #28673 )
...
* add trailing commas on list/map/parameters
* add trailing commas on Invocation with nb of arg>1
* add commas for widget containing widgets
* add trailing commas if instantiation contains trailing comma
* revert bad change
2019-03-01 08:17:55 +01:00
liyuqian
19a6a6f431
Reland "Shader warm up ( #27660 )" ( #28537 )
...
This reverts commit adc8e159a5https://github.com/flutter/flutter/pull/28530 gets merged
Merge on yellow doc test because the doc test is actually green.
2019-02-27 09:33:08 -08:00
liyuqian
adc8e159a5
Revert "Shader warm up ( #27660 )" ( #28376 )
...
This reverts commit a44f174efchttps://github.com/flutter/flutter/issues/28374
TBR: xster
Merge on red to fix the tree
2019-02-22 17:32:37 -08:00
liyuqian
a44f174efc
Shader warm up ( #27660 )
...
This patch adds a default shader warm up process which moves shader compilation from the animation time to the startup time. This also provides an extension for `runApp` so developers can customize the warm up process.
This should reduce our worst_frame_rasterizer_time_millis from ~100ms to ~20-30ms for both flutter_gallery and complex_layout benchmarks. Besides, this should also have a significant improvement on 90th and 99th percentile time (50%-100% speedup in some cases, but I haven't tested them thoroughly; I'll let our device lab collect the data afterwards).
The tradeoff the is the startup time (time to first frame). Our `flutter run --profile --trace-startup` seems to be a little noisy and I see about 100ms-200ms increase in that measurement for complex_layout and flutter_gallery. Note that this only happens on the first run after install or data wipe. Later the Skia persistent cache will remove the overhead.
This also adds a cubic_bezier benchmark to test the custom shader warm up process.
This should fix https://github.com/flutter/flutter/issues/813 (either by `defaultShaderWarmUp`, or a `customShaderWarmUp`).
2019-02-22 15:37:02 -08:00
Dan Field
04b7a5b366
Reduce memory benchmark perf tests outer loop to 10. ( #28281 )
...
* reduce iterations to avoid test timing out
2019-02-21 14:46:24 -08:00
Jonah Williams
67cf21577f
Add basic codegen app to be used for integration testing and benchmarks ( #27257 )
2019-02-14 23:17:16 -08:00
liyuqian
de321b9cc1
Add scroll performance test for flutter_gallery ( #27513 )
...
Previously, we had a scroll_perf drive test but we were not exercising
it on our device lab. This helps us tracking issues like:
https://github.com/flutter/flutter/issues/24782
2019-02-04 22:54:11 -08:00
Jason Simmons
b5ca595d61
Remove icudtl.dat from APK asset size checks ( #27505 )
2019-02-04 12:40:43 -08:00
Michael Goderbauer
6d20ff2446
Remove all obsolete "// ignore:" ( #27271 )
2019-01-30 08:56:12 -08:00
liyuqian
8ad4cbe06e
Add cull opacity perf test to device lab ( #25381 )
...
For https://github.com/flutter/flutter/issues/24712
This test verifies that https://github.com/flutter/engine/pull/6923 will speedup the average rasterize time of this test from ~150ms to ~10ms
Please see non-auto-generated files in 37b21d9fb4
2018-12-17 22:01:07 -08:00
Jonah Williams
938dd5a4aa
Revert "Update driver script to execute test through test_core" ( #24401 )
...
* Revert "Add dashing config file for generating docset from flutter docs (#24374 )"
This reverts commit ec8ca8606c#24168 )"
This reverts commit 6c62cf337f
2018-11-15 11:17:00 -08:00
Jonah Williams
6c62cf337f
Update driver script to execute test through test_core ( #24168 )
2018-11-15 10:50:25 -08:00
Michael Goderbauer
b8c29a1490
Add benchmark for LICENSE file size ( #23948 )
2018-11-05 13:57:40 -08:00
Michael Klimushyn
43c99404c5
Test flutter create --offline ( #23278 )
...
Verifies that flutter tools isn't rebuilt. Doesn't truly check that the
created output is runnable.
2018-10-22 16:39:28 -07:00
Greg Spencer
abb1758edf
Fix places in devicelab tests where it expects the app template. ( #22696 )
...
I missed some create template conversions in the devicelab directory.
2018-10-04 15:30:08 -07:00
Greg Spencer
3246a66374
Make devicelab tests use 'app' template ( #22694 )
...
Fixes the build after my module rename broke the Windows tests.
2018-10-04 14:30:59 -07:00
