Abhishek Ghaskata
16c0a3d700
Migrate task_result to null safety ( #84939 )
2021-06-21 10:04:02 -07:00
Jenn Magder
1d2f6c5296
Revert "Set up iOS native integration_tests in ui example project ( #84890 )" ( #84892 )
...
This reverts commit 05d5515732
2021-06-18 18:05:00 -07:00
Jenn Magder
05d5515732
Set up iOS native integration_tests in ui example project ( #84890 )
2021-06-18 17:45:11 -07:00
Jenn Magder
03034e9e4a
Audit devicelab log streaming for nullability ( #84820 )
2021-06-18 00:14:03 -07:00
Jenn Magder
697928d21f
Revert "Set up iOS native integration_tests in ui example project ( #84596 )" ( #84641 )
...
This reverts commit ef2879a46f
2021-06-15 10:09:41 -07:00
Jenn Magder
ef2879a46f
Set up iOS native integration_tests in ui example project ( #84596 )
2021-06-14 18:04:02 -07:00
Greg Spencer
ec5cfc001d
Fix build failure ( #84597 )
...
Fixes an incorrect cast that caused a build failure.
Landing on red to fix the build.
2021-06-14 15:17:25 -07:00
Greg Spencer
88f3811055
Turn on avoid_dynamic_calls lint, except packages/flutter tests, make appropriate changes. ( #84476 )
...
This adds avoid_dynamic_calls to the list of lints, and fixes all instances where it was violated.
Importantly, this lint is NOT turned on for flutter/packages/test, because those changes are happening in another PR: #84478
2021-06-14 14:16:57 -07:00
Alexandre Ardhuin
2c998d8be7
fix indentation of class members ( #84293 )
2021-06-10 11:29:03 -07:00
Alexandre Ardhuin
e467018d06
alignment of doc comments and annotations ( #84256 )
2021-06-09 07:54:02 -07:00
Dan Field
5cc7b6c3ea
Add option to stream logs to file for flutter logs and way to use it in devicelab runs ( #84008 )
2021-06-07 10:33:00 -07:00
Jenn Magder
94a41cde83
Mixed null safety in dev/devicelab ( #84017 )
2021-06-05 02:29:03 -07:00
Dan Field
83d51ecd1a
Delete obsolete TODO ( #83966 )
2021-06-03 23:29:05 -07:00
Jonah Williams
85df73d0e3
[flutter] ensure vmservice binding is registered in profile mode ( #83913 )
2021-06-03 17:59:03 -07:00
Anis Alibegić
c99ed373b3
Fixed large amount of spelling errors ( #83744 )
2021-06-02 10:14:06 -07:00
Alexandre Ardhuin
34059eec2c
enable lint prefer_interpolation_to_compose_strings ( #83407 )
2021-06-01 11:14:06 -07:00
Emmanuel Garcia
10416b3054
Roll Flutter Gallery with Gradle pinned dependencies ( #83136 )
2021-05-21 18:34:08 -07:00
nt4f04uNd
80a2b6b015
Fix typos ( #82589 )
2021-05-20 17:19:09 -07:00
Hattomo (TomohiroHattori)
08a70e7ac8
Enable avoid_escaping_inner_quotes lint ( #81153 )
2021-05-19 09:54:02 -07:00
gaaclarke
7cdd33fe99
added unawaited function for devicelab and turned on unawaited_futures linter ( #82833 )
2021-05-18 14:19:03 -07:00
Jonah Williams
d6fa9bbf91
[devicelab] await flutter create call in platform channels benchmark ( #82762 )
2021-05-18 08:55:38 -07:00
Jonah Williams
a3863b6592
[flutter_tools] support memory profiles from flutter drive ( #82739 )
2021-05-17 17:39:03 -07:00
Christopher Fujino
d6d3f0e0a8
add --verbose flag to pub global activate ( #82719 )
2021-05-17 11:39:28 -07:00
Dan Field
304b9c668e
Reland GC tracking benchmarks ( #82069 )
2021-05-14 19:59:24 -07:00
Christopher Fujino
855ada1d95
pub global deactivate devtools before installing ( #82491 )
...
* pub global deactivate devtools before installing
* upgrade devtools to latest
2021-05-13 17:13:03 -07:00
Jenn Magder
1ff5665fdd
Force LANG=en_US.UTF-8 in test runner ( #82308 )
2021-05-12 10:49:02 -07:00
Alexandre Ardhuin
c03e7488b4
remove noop primitive operations ( #82297 )
2021-05-12 00:04:02 -07:00
Michael Goderbauer
b8a2456737
Enable library_private_types_in_public_api lint ( #81578 )
2021-05-10 16:26:16 -07:00
Jacob Richman
f82dedd5b9
Update perf_tests to use devtools 2.2.2 ( #81869 )
2021-05-10 15:22:50 -07:00
Dan Field
3101374f60
Revert "Reland GC benchmark changes again ( #82042 )" ( #82059 )
...
This reverts commit 99a947c3e5
2021-05-07 13:19:56 -07:00
Dan Field
99a947c3e5
Reland GC benchmark changes again ( #82042 )
2021-05-07 12:29:01 -07:00
gaaclarke
a5f57b9e64
Added performance benchmarks for platform channels ( #81414 )
2021-05-07 10:24:03 -07:00
Zachary Anderson
4056ac057d
Revert "Reland GC related bench update ( #81794 )" ( #82005 )
...
This reverts commit 714dea5e03
2021-05-06 19:03:59 -07:00
Dan Field
714dea5e03
Reland GC related bench update ( #81794 )
2021-05-06 16:49:04 -07:00
Kate Lovett
2d89ebb929
Revert "Fix benchmark ( #81449 )" ( #81696 )
...
This reverts commit a3893aea04
2021-05-03 12:22:46 -05:00
Dan Field
a3893aea04
Fix benchmark ( #81449 )
2021-05-03 10:02:09 -07:00
Michael Goderbauer
3cbfe82d9d
Rev DevTools to 2.1.1 for tests ( #81515 )
2021-04-29 16:47:42 -07:00
Ian Hickson
6beafa7b16
Apply style guide regarding createTempSync pattern ( #81090 )
2021-04-27 14:59:03 -07:00
Phil Quitslund
08d7811f7f
sort directives ( #81210 )
2021-04-27 10:09:02 -07:00
xster
ff2dde2c7f
Reland double gzip wrapping NOTICES to reduce on-disk installed space ( #80897 )
2021-04-26 22:35:45 -07:00
Emmanuel Garcia
b0a63c4ffe
Reland the Dart plugin registry ( #79669 )
2021-04-23 15:34:04 -07:00
Jonah Williams
63ba1b23ca
[flutter_tools] add support for --bundle-sksl-path to flutter run / flutter drive ( #80885 )
2021-04-21 13:59:02 -07:00
Phil Quitslund
61c30c41b2
fix sort_directives violations ( #80817 )
2021-04-21 13:49:03 -07:00
Greg Spencer
36daea2d54
Reland "Remove a dynamic that is no longer necessary (and the TODO for it) ( #80294 )" ( #80373 )
2021-04-13 18:29:21 -07:00
Jenn Magder
7d5f39281d
Cache location of Java binary in devicelab tests ( #80172 )
2021-04-12 16:50:03 -07:00
Casey Hillers
c571804913
Revert "Reland [devicelab] Migrate Gallery to BuildTestTask ( #78361 )" ( #79903 )
...
This reverts commit 0c9781e3dd
2021-04-06 16:28:54 -07:00
Casey Hillers
0c9781e3dd
Reland [devicelab] Migrate Gallery to BuildTestTask ( #78361 )
2021-04-06 16:04:03 -07:00
Jenn Magder
1f19fd7108
Take screenshot when startup perf test fails to run ( #79514 )
2021-03-31 21:32:49 -07:00
Jonah Williams
4d54b8966a
roll gallery version to fix build ( #79456 )
2021-03-31 08:14:38 -07:00
Jia Hao
8158b478d7
Add tests for integration tests to devicelab ( #79258 )
2021-03-30 22:29:03 -07:00
Jenn Magder
12880f7751
Point gallery test data to FLUTTER_TEST_OUTPUTS_DIR ( #79332 )
2021-03-29 21:39:03 -07:00
Kaushik Iska
e6920662ad
Add a test to exercise multiple async microtasks in frame workload ( #79163 )
2021-03-29 20:49:05 -07:00
Dan Field
374993ce88
fix tree ( #79329 )
2021-03-29 18:52:36 -07:00
Dan Field
750fd1d536
Avoid hard coding "build" for test output files ( #79322 )
2021-03-29 17:36:34 -07:00
Zachary Anderson
5efc7169eb
Reverts "Implement dartPluginClass support for plugins #74469 " ( #78623 )
...
* Revert "Enable dart_plugin_registry_test (#76645 )"
This reverts commit 109e0bb9f5https://github.com/flutter/flutter/pull/76662 (#77093 )"
This reverts commit cdca6485f0#76662 )"
This reverts commit dadbd47d09#76561 )"
This reverts commit 098ece522d#76838 )"
This reverts commit 1610a27476#74469 )"
This reverts commit b7d4806243
2021-03-23 14:28:11 -07:00
Jenn Magder
3463946448
Take screenshot when drive fails ( #78822 )
2021-03-22 19:06:28 -07:00
Jonah Williams
4851bd51f9
[devicelab] remove vm_service_client from devicelab ( #78559 )
2021-03-18 11:51:07 -07:00
Casey Hillers
c30fdfbe82
Revert "[devicelab] Migrate Gallery to BuildTestTask ( #77956 )" ( #78355 )
...
This reverts commit 93fb258602
2021-03-16 12:20:36 -07:00
Casey Hillers
93fb258602
[devicelab] Migrate Gallery to BuildTestTask ( #77956 )
2021-03-16 11:58:03 -07:00
omerlevran46
c94648f9cc
[fuchsia] remove no devices found from ffx parsing ( #77651 )
2021-03-15 10:58:05 -07:00
Zachary Anderson
9167083d09
Explain why devtools in pinned ( #77657 )
2021-03-09 08:34:03 -08:00
Jenn Magder
85e2c52b39
Increase activated devtools version to 2.0 ( #77637 )
2021-03-08 13:17:21 -08:00
Michael Goderbauer
cb867bbedc
Enable unnecessary_await_in_return lint ( #77434 )
2021-03-05 18:38:15 -08:00
Jenn Magder
e9e8ca7640
Add debug_second_compile_millis benchmark metric ( #77420 )
2021-03-05 15:33:28 -08:00
Jenn Magder
7e02cc34f9
Bitcode strip Flutter.framework in assemble build target ( #77329 )
2021-03-05 10:38:57 -08:00
Casey Hillers
b0afe3464e
Create BuildTestTask ( #77307 )
2021-03-04 18:49:03 -08:00
Casey Hillers
c8c681f68e
[devicelab] Create test command to pass task args ( #77110 )
2021-03-04 11:59:02 -08:00
Michael Goderbauer
7b251f5f37
Enable use_function_type_syntax_for_parameters lint ( #77163 )
2021-03-04 08:59:17 -08:00
Casey Hillers
7ed797b053
Revert "[devicelab] Separate build and test from Flutter gallery tests ( #76415 )" ( #77086 )
...
This reverts commit 297c7b5cf2
2021-03-02 12:17:18 -08:00
Casey Hillers
297c7b5cf2
[devicelab] Separate build and test from Flutter gallery tests ( #76415 )
2021-03-02 11:49:02 -08:00
Michael Goderbauer
fc99e7c0d7
Enable missing_whitespace_between_adjacent_strings ( #77027 )
2021-03-01 18:30:17 -08:00
omerlevran46
f996033fcc
[fuchsia] - migrate devicer discovery workflows to use ffx ( #76241 )
2021-03-01 13:16:13 -08:00
Jenn Magder
1610a27476
Remove dart_plugin_registry_test timeouts ( #76838 )
2021-02-25 20:26:02 -08:00
Casey Hillers
5cac7c3b15
Add expectation test for upload metrics ( #76642 )
2021-02-23 16:11:03 -08:00
Jason Simmons
de35aef679
Check for a closed output stream in the devicelab ADB log reader ( #76633 )
2021-02-23 16:01:04 -08:00
Jenn Magder
d69e2f10d8
Remove unused android_splash_screens integration test ( #76429 )
2021-02-22 14:46:04 -08:00
Jenn Magder
7cd99db0e4
Remove unused image_loading integration test ( #76430 )
2021-02-22 10:51:53 -08:00
Jason Simmons
5c004eaf65
Roll Gallery (required by the latest engine update and Dart SDK) ( #76409 )
2021-02-19 14:45:54 -08:00
George Wright
3f4544611c
Revert "Reland "Roll Engine from 6993cb229b99 to c217d9d06e4f (60 revisions) ( #76352 )" ( #76394 )" ( #76403 )
...
This reverts commit 562f53bf52
2021-02-19 12:39:59 -08:00
Jason Simmons
562f53bf52
Reland "Roll Engine from 6993cb229b99 to c217d9d06e4f (60 revisions) ( #76352 )" ( #76394 )
...
This reverts commit c310717af2
2021-02-19 11:32:59 -08:00
Emmanuel Garcia
b7d4806243
Implement dartPluginClass support for plugins ( #74469 )
2021-02-19 09:22:45 -08:00
chunhtai
815976a8e4
change stack size test to test arm device ( #75814 )
2021-02-17 12:46:03 -08:00
Jenn Magder
d35058f5b8
Do not fail if 9xth_percentile_memory_usage is not recorded ( #76153 )
2021-02-16 15:56:02 -08:00
godofredoc
4597b51cbc
Fix problem causing tasks to timeout. ( #76028 )
...
This is because the command was actually collecting logs continuously
from the device. Additionally idevicesyslog does not have a reboot
option.
Bug: https://github.com/flutter/flutter/issues/76027
2021-02-14 17:28:27 -08:00
godofredoc
a0e8681452
Add flutter update packages to some tests. ( #75530 )
...
* Add flutter update packages to some tests.
Analyzer_benchmark and flutter_test_performance require to pub get
multiple directories. Rather than delegating the recipes to run flutter
update-packages we explicitly running on tests that need it.
Bug: https://github.com/flutter/flutter/issues/75524
* Add pub get directly on the analyis classes.
* Run flutter get in dev/tools.
* Fix directory path.
* Add more dependency directories.
* Fix typo.
* Add more dependencies.
* Add stocks dependency.
* Fix paths to some apps.
* Add more dependencies.
* Complete dependencies definition.
* More analysis dependencies.
* Add examples dependencies.
* Dev tool dependencies.
* Use update-packages for analyzer benchmark.
2021-02-11 15:30:55 -08:00
Yegor
e7953b3be4
[web] new service worker loading mechanism ( #75535 )
2021-02-11 09:16:21 -08:00
chunhtai
713fa8e360
Reland "add a benchmark test for stack size ( #75039 )" ( #75434 )
...
* Reland "add a benchmark test for stack size (#75039 )"
This reverts commit de683de9d5
2021-02-04 12:16:31 -08:00
Shi-Hao Hong
de683de9d5
Revert "add a benchmark test for stack size ( #75039 )" ( #75383 )
...
This reverts commit 9d9109aa6f
2021-02-04 10:26:04 +08:00
chunhtai
9d9109aa6f
add a benchmark test for stack size ( #75039 )
2021-02-03 15:16:03 -08:00
Jenn Magder
f4f33fd108
Dump logs on failing devicelab test to recipe artifact location ( #74378 )
2021-02-01 15:00:38 -08:00
Jenn Magder
91aad2bb06
Avoid iOS local networking dialog in integration tests ( #75163 )
2021-02-01 13:33:25 -08:00
Nate Bosch
dcc4fdd558
Pass only Uri to package:http APIs ( #74285 )
2021-01-20 09:59:03 -08:00
Jonah Williams
7ee910b0a8
[flutter_tools] ensure --dart-define can parse args with commas ( #73798 )
2021-01-15 13:51:32 -08:00
Yuqian Li
c4114a7527
Remove more flaky non-e2e tests ( #74062 )
...
Fixes https://github.com/flutter/flutter/issues/73873
2021-01-15 13:22:26 -08:00
Emmanuel Garcia
da90156f8c
Fix plugin java class desugar ( #73758 )
2021-01-13 14:09:04 -08:00
LongCatIsLooong
cbe72db135
macrobenchmark: TextField with complex paragraph ( #73374 )
2021-01-12 15:44:01 -08:00
Jenn Magder
66145fe652
Force plugins to inherit minimum macOS version from Flutter app ( #72764 )
2021-01-11 11:16:12 -08:00
Jenn Magder
062022b950
Move ios_content_validation_test to pre-submit tools test ( #73577 )
2021-01-11 10:29:06 -08:00
Yegor
1f8501f0a4
web benchmark choose renderer explicitly ( #73582 )
2021-01-08 12:04:03 -08:00
jensjoha
5bc725bea8
[dev] Don't use await for on stdout and stdin; pass local engine argument ( #72136 )
...
* [dev] Don't use await for on stdout and stdin; pass local engine argument
1) Don't use await for on stdout followd by await for on stderr.
This can cause nothing to happen. E.g. if one didn't do something
like `flutter pub upgrade` dev/automated_tests and the version in the
old one was pre-nnbd (but flutter itself use lots of nnbd stuff) lots
of errors would be emitted, but because we basically only listen to
stdout nothing will happen (deadlock once stderr buffer runs out).
Note that it still awaits the exit-code below.
2) Pass --local-engine (if given) so there won't be any crashes because
of that.
2021-01-08 08:12:36 +01:00
Jenn Magder
3082a2806e
build ios-framework simulator slices for profile/release ( #73378 )
2021-01-06 12:12:23 -08:00
nturgut
272b23cabd
[web] make sure tests and benchmarks use correct backend - add autodetect false ( #73047 )
...
* add autodetect false
* fix typo
2020-12-28 10:55:53 -08:00
Casey Hillers
849784e262
[devicelab] Add results path flag to test runner ( #72765 )
2020-12-22 16:45:38 -08:00
nturgut
14206399c3
make sure tests and becnhmarks use correct backend ( #72628 )
2020-12-21 09:55:23 -08:00
xster
ca82c572b7
Revert "let NOTICES be double gzip wrapped to reduce on-disk installed space ( #71899 )" ( #72438 )
2020-12-16 10:58:19 -08:00
xster
4ed3432e8f
let NOTICES be double gzip wrapped to reduce on-disk installed space ( #71899 )
2020-12-15 13:29:14 -08:00
Michael Goderbauer
78cbfbff42
Revert "Migrate devicelab to package:vm_service ( #71882 )" ( #72092 )
...
This reverts commit 9d1d0cfeb5
2020-12-10 12:56:02 -08:00
Dan Field
9d1d0cfeb5
Migrate devicelab to package:vm_service ( #71882 )
2020-12-10 12:43:04 -08:00
Casey Hillers
2565062df3
git branch flag ( #71886 )
2020-12-08 15:53:05 -08:00
Emmanuel Garcia
d35dd9f8a6
Allow flavors and build types when using plugins ( #71738 )
2020-12-07 09:23:04 -08:00
Jenn Magder
d4150d3f6d
Adopt Flutter.xcframework in tool ( #71495 )
2020-12-04 13:57:11 -08:00
Yegor
7efd7afdf8
Handle the glibc bug that Chrome occasionally hits ( #71705 )
2020-12-04 12:21:37 -08:00
Kate Lovett
1c244da28d
Add verbose flag to hot mode tests ( #71610 )
2020-12-02 16:47:35 -06:00
Jonah Williams
1e0628001e
[devicelab] dont use set modified for hot reload bench ( #70965 )
2020-11-20 13:02:28 -08:00
Jonah Williams
9424474793
[devicelab] update hot reload benchmark to be more representative ( #70643 )
...
update hot reload benchmark to be more representative
2020-11-18 14:54:01 -08:00
Jim Graham
61460d255a
preserve detailFiles entry in TaskResult JSON ( #70668 )
...
* preserve detailFiles entry in TaskResult JSON
2020-11-17 16:05:54 -08:00
Casey Hillers
a228a17c57
[devicelab] LUCI builder flag ( #70702 )
2020-11-17 11:28:03 -08:00
Yuqian Li
f7811ea541
e2e perf tests don't have CPU/GPU/memory metrics ( #70439 )
...
Address comment in https://github.com/flutter/flutter/pull/66386/files#r522671103
2020-11-13 11:16:50 -08:00
Emmanuel Garcia
b18e2a1cc4
Bump Gallery version ( #70130 )
2020-11-09 13:05:56 -08:00
Jonah Williams
c985fd35cd
[devicelab] re-land cocoon auto-restart ( #69710 )
...
Due to #69707 the SkSL tests need the process killing logic still.
2020-11-03 13:20:40 -08:00
Jonah Williams
ea3551b058
Revert "[devicelab] reboot attached devices after 30 test runs ( #69447 )" ( #69703 )
...
This reverts commit 406ca0bc59
2020-11-03 11:13:19 -08:00
Yegor
9e5d22d101
Say [APP] instead of [Gallery] in web benchmarks ( #69624 )
2020-11-03 10:13:07 -08:00
Jonah Williams
406ca0bc59
[devicelab] reboot attached devices after 30 test runs ( #69447 )
2020-11-03 10:10:55 -08:00
Greg Spencer
c0ef94780c
Fix spelling errors ( #69451 )
...
My yearly pass to fix spelling errors in the API dartdocs.
2020-10-31 03:12:27 -07:00
Jenn Magder
bb495ba90c
Do not fail if average_memory_usage is not recorded ( #69339 )
2020-10-29 16:09:50 -07:00
Jonah Williams
31c96b5d83
[devicelab] do not fail test if CPU measurement is not recorded ( #69268 )
2020-10-29 09:32:34 -07:00
Jonah Williams
18341efa2f
[devicelab] retry startup of start up test ( #69272 )
2020-10-29 09:19:07 -07:00
Jonah Williams
83d4351e0c
[devicelab] work around occasional null values for devtools ( #69273 )
...
* [devicelab] work around occasional null values for devtools
* Update perf_tests.dart
2020-10-29 09:18:38 -07:00
Jenn Magder
13896b3bd1
Decrease device discovery timeout from 10 to 5 seconds ( #69266 )
2020-10-28 19:43:19 -07:00
Jenn Magder
135aab9cf5
Increase device run perf test timeout ( #69260 )
2020-10-28 18:29:04 -07:00
Jonah Williams
2c12a8d917
[devicelab] remove twc enabled test and uncaught image test ( #68518 )
2020-10-24 13:19:51 -07:00
Casey Hillers
ce3ce20b14
[devicelab] Upload git branch ( #68541 )
2020-10-23 08:02:02 -07:00
Jonah Williams
37042fdb08
[flutter_tools] remove iOS screenshot on failure functionality ( #68650 )
...
* [flutter_tools] remove iOS screenshot on failure functionality
* remove all screenshot code
2020-10-22 13:34:07 -07:00
Jonah Williams
ab20ae782a
[devicelab] uinstall during memory test ( #68548 )
2020-10-20 09:49:50 -07:00
Jonah Williams
938fae9c99
remove --machine flag ( #68538 )
2020-10-19 17:06:28 -07:00
Jonah Williams
a152c0f429
[devicelab] reland: reduce iterations of startup test, use application binary ( #68532 )
...
These devicelab tests are incredibly flaky. Currently they will build & install the same application 15 times. This causes the temp storage to fill up on android, and has a good chance of flaking on iOS due to install issues.
The change from 3 to 15 increased total test time for 2 -> 12 minutes on iOS, or roughly 5 more test equivalents for every single iOS test. Reduce the iteration count back to 5
Uninstall the app after each run so temp storage does not fill up.
2020-10-19 16:51:28 -07:00
Jonah Williams
4a3e2a1af5
Revert "[devicelab] reduce iterations, uninstall at end, and use --application-binary in all startup tests ( #68516 )" ( #68531 )
...
This reverts commit a4c2075a45
2020-10-19 15:05:46 -07:00
Jonah Williams
8262f808ba
Revert "[devicelab] fix flutter gallery app name ( #68528 )" ( #68530 )
...
This reverts commit 0f69f8e53b
2020-10-19 15:05:10 -07:00
Jonah Williams
0f69f8e53b
[devicelab] fix flutter gallery app name ( #68528 )
2020-10-19 14:48:05 -07:00
Jonah Williams
a4c2075a45
[devicelab] reduce iterations, uninstall at end, and use --application-binary in all startup tests ( #68516 )
...
These devicelab tests are incredibly flaky. Currently they will build & install the same application 15 times. This causes the temp storage to fill up on android, and has a good chance of flaking on iOS due to install issues.
The change from 3 to 15 increased total test time for 2 -> 12 minutes on iOS, or roughly 5 more test equivalents for every single iOS test. Reduce the iteration count back to 5
Uninstall the app after each run so temp storage does not fill up.
2020-10-19 14:16:04 -07:00
Casey Hillers
1c35091a13
[devicelab] Cocoon client ( #68333 )
2020-10-19 13:12:04 -07:00
Jonah Williams
e8dc7a2e17
[devicelab] update hostonly tests to use flutter directly or precache deps ( #68487 )
...
Fixes #67370
By running most of these executions through flutter, we get the benefit of the flutter error handling and precaching. IN the test where this is not feasible, call pre-cache directly.
2020-10-19 13:01:50 -07:00
Jonah Williams
03db9bf918
[devicelab] migrate defines test to DriverTest ( #68407 )
...
Removes one-off handling for defines test and forces it to run through the DriverTest interface
2020-10-19 12:28:43 -07:00
Jonah Williams
223df0c351
[devicelab] split end to end tests into driver targets ( #68410 )
...
Split the integration_ui target into individual driver tests. Remove disabled screenshot tests
2020-10-19 12:28:13 -07:00
Jonah Williams
e422d5c724
[flutter_tools] reland: --no-android-gradle-daemon in devicelab ( #68491 )
...
Remove devicelab specific code for shutting down gradle daemon, add --android-gradle-daemon option to build/run/drive`. Avoids need for un-tested devicelab specific handler. There are also some feature requests for this, so 2 birds one stone.
Example:
flutter build apk --no-android-gradle-daemon will pass --no-daemon on to gradle
2020-10-19 10:27:58 -07:00
Jonah Williams
ed5482de19
Revert "[flutter_tools] add --android-gradle-daemon option, use in devicelab ( #68409 )" ( #68489 )
...
This reverts commit ddab72e79f
2020-10-19 09:33:52 -07:00
Jonah Williams
ddab72e79f
[flutter_tools] add --android-gradle-daemon option, use in devicelab ( #68409 )
...
Remove devicelab specific code for shutting down gradle daemon, add --android-gradle-daemon option to build/run/drive`. Avoids need for un-tested devicelab specific handler. There are also some feature requests for this, so 2 birds one stone.
Example:
flutter build apk --no-android-gradle-daemon will pass --no-daemon on to gradle
2020-10-19 09:12:21 -07:00
Alexandre Ardhuin
c0176c9ee5
use_is_even_rather_than_modulo ( #68301 )
2020-10-16 20:20:00 +02:00
Jonah Williams
35c364053b
Fix screenshotting code ( #68261 )
2020-10-15 19:03:28 -07:00
Jonah Williams
d7f80fcdd3
[flutter_tools] configure screenshot on failure for all tasks ( #68260 )
2020-10-15 18:53:00 -07:00
Jonah Williams
ef205f7ebf
[devicelab] mark catalina not flaky and list iproxy processes before tet ( #68239 )
2020-10-15 14:21:40 -07:00
Dan Field
12f54e17f4
reland List queue search optimization ( #68214 )
...
* Revert "Revert "Improve performance of collectAllElements (#68065 )" (#68207 )"
This reverts commit 46ff57d6f1
2020-10-15 13:46:50 -07:00
Jonah Williams
0f88644883
[devicelab] allow the devicelab to take a screenshot if the iOS connection fails with FLUTTER_IOS_SCREENSHOT_ON_CONNECTION_FAILURE ( #68156 )
...
More attempts to remote diagnose the issues in the iOS devicelab
2020-10-15 13:13:28 -07:00
Jenn Magder
25857ce513
Use --device-timeout instead of deprecated --timeout in devicelab ( #68230 )
2020-10-15 12:45:59 -07:00
Jonah Williams
f5608f2b33
[devicelab] track any leaked processes ( #68218 )
2020-10-15 10:54:31 -07:00
Jonah Williams
2321b72dfb
[flutter_tools] move gradle download failure handling into tool ( #68140 )
...
This crash affects anyone using flutter, so move it into the tool where it can be tested and documented. Ensure it works on windows devicelab too.
2020-10-15 09:20:52 -07:00
Jonah Williams
46ff57d6f1
Revert "Improve performance of collectAllElements ( #68065 )" ( #68207 )
...
This reverts commit 8ba5732c4c
2020-10-15 08:04:59 -07:00
Dan Field
8ba5732c4c
Improve performance of collectAllElements ( #68065 )
2020-10-14 21:32:04 -07:00
Jonah Williams
33903c17e1
[devicelab] delete disabled or not useful benchmarks ( #68107 )
...
- run_without_leak_tests: have been disabled for months
- build_benchmark: the tooling work here is mostly done and we're not tracking further improvements, free up more devicelab capacity
- system_debug_ios: does not work post iOS13
- mac_enable_twc: not adding more mac tests to devicelab
- hello_world_start_up: disabled
Any tests that we think will be valuable in the future can be resurrected from the git history.
2020-10-14 10:30:10 -07:00
Jonah Williams
751459df24
[flutter_tool] support --use-application-binary in flutter drive ( #68060 )
...
--use-application-binary allows running with an already built APK. This can be useful for speeding up CI test cases, or in our case eventually supporting some sort of build server. Demonstrate that this works by updating the old gallery test to use it. Fixes #56604
Co-authored-by: Jenn Magder <magder@google.com>
2020-10-13 19:27:30 -07:00
Jonah Williams
eb24393efe
remove missing argument ( #67974 )
2020-10-12 17:18:09 -07:00
Jonah Williams
5dfe7e6d51
[flutter_tools] attempt to stabilize hot restart benchmark the old fashioned way ( #67971 )
...
A change which sped up hot restart locally caused many of the devicelab measures to regress. I think this is because we do not measure when the isolate is actually "ready", so starting a reload or restart prematurely can cause time spent doing initialization to be registered as part of the reload operation.
A fix for this would be to have the framework include some sort of "initialization complete" event ... but it is not clear what the correct trigger would be. Perhaps after the first frame is successfully registered?
(9a3a0dc
2020-10-12 17:00:26 -07:00
Yuqian Li
98d1ad0195
Purge persistent cache for perf test runs ( #67697 )
2020-10-08 19:17:02 -07:00
Yuqian Li
684449a841
Remove measureIosCpuGpu ( #67363 )
2020-10-08 12:02:03 -07:00
Casey Hillers
9e206a0c93
Refactor devicelab logic to use TaskResult instead of JSON ( #67550 )
2020-10-07 16:37:09 -07:00
Jenn Magder
e5131fa31b
Increase device discovery timeout in devicelab health check ( #67337 )
2020-10-06 12:23:02 -07:00
Ming Lyu (CareF)
76c0d69b14
migrate textfield_perf to e2e ( #64503 )
2020-10-02 14:47:03 -07:00
Yuqian Li
e45157fc08
5x startup test repitition to reduce noise ( #67147 )
2020-10-02 12:22:05 -07:00
Ming Lyu (CareF)
db2532a949
migrate color_filter_and_fade_perf ( #64484 )
2020-10-01 17:32:02 -07:00
Yuqian Li
b92d250116
Let perf tests measure memory by default ( #66570 )
...
Fixes https://github.com/flutter/flutter/issues/66569
2020-10-01 15:20:17 -07:00
Chris Yang
2d26bafec2
remove --trace-startup ( #66568 )
2020-09-29 17:22:04 -07:00
Yuqian Li
4728892753
Roll gallery to the newest version ( #66693 )
...
The previously broken test should be fixed by
https://github.com/flutter/gallery/pull/331
2020-09-28 22:45:54 -07:00
Yuqian Li
54ac7bc936
Reland "Default measureCpuGpu to true ( #66386 )" ( #66604 )
...
This reverts commit 2d9e500523
2020-09-28 10:26:35 -07:00
Jenn Magder
65159afb55
Force plugins to inherit minimum iOS version from Flutter app ( #66590 )
2020-09-28 10:14:47 -07:00
Yuqian Li
3e8fb33c08
Revert "Roll gallery to the newest version ( #66584 )" ( #66666 )
...
This reverts commit 2ae09caace
2020-09-25 12:18:28 -07:00
Yuqian Li
2ae09caace
Roll gallery to the newest version ( #66584 )
...
This shouldn't break our tests as
https://github.com/flutter/gallery/issues/275 is closed.
2020-09-25 11:05:33 -07:00
Jenn Magder
a6a8a14d02
Do not cleanup Gradle in non-Android integration tests ( #66487 )
2020-09-24 18:34:07 -07:00
Yuqian Li
2d9e500523
Revert "Default measureCpuGpu to true ( #66386 )" ( #66594 )
...
This reverts commit 48ce83a833
2020-09-24 15:17:57 -07:00
Yuqian Li
48ce83a833
Default measureCpuGpu to true ( #66386 )
2020-09-24 13:42:03 -07:00
godofredoc
57cda51f7e
Fix gradle_plugin_light_apk test. ( #66496 )
2020-09-23 16:52:02 -07:00
Ming Lyu (CareF)
f681fcf32b
migrate backdrop_filter_perf ( #64482 )
2020-09-22 19:52:02 -07:00
Michael R Fairhurst
7f3c9b6bda
Remove unused 'dart:async' imports. ( #65568 )
2020-09-16 14:14:06 -07:00
Ming Lyu (CareF)
b3f19a3e1a
migrate animated_placeholder_perf ( #64478 )
2020-09-16 07:47:03 -07:00
Yuqian Li
b8a39c15f8
Collect memory metrics ( #65798 )
2020-09-15 12:47:05 -07:00
Jonah Williams
4e20f00053
[ci] remove create offline tests ( #65791 )
...
Currently these tests are taking CI time without providing any value, because there is no verification that network connectivity is avoided. This is better covered by a unit test that verifies that --offline is passed to pub.
2020-09-14 17:54:59 -07:00
Ming Lyu (CareF)
51f1c98490
migrate cubic_bezier_perf to e2e ( #64487 )
2020-09-11 20:02:03 -07:00
Yuqian Li
e1eddb401d
Revert the revert ( #65602 )
2020-09-11 16:20:03 -07:00
xster
65ae30c8cc
Update create templates to 1.0.0 ( #65234 )
2020-09-10 12:57:56 -07:00
Tong Wu
abeaf11829
[devicelab] Remove ~/.gradle after each devicelab task run ( #65434 )
2020-09-09 01:50:03 -07:00
Jenn Magder
ace54425e0
Add observatory Bonjour service to built iOS Info.plist bundle ( #65138 )
2020-09-02 18:47:56 -07:00
Jenn Magder
259deec221
Revert "Add observatory Bonjour service to built iOS Info.plist bundle ( #65138 )" ( #65141 )
...
This reverts commit 5e0aa8b9fc
2020-09-02 18:31:45 -07:00
Jenn Magder
5e0aa8b9fc
Add observatory Bonjour service to built iOS Info.plist bundle ( #65138 )
2020-09-02 17:57:43 -07:00
gaaclarke
37de94d7d2
devicelab: started averaging startup time for ios test ( #64978 )
2020-09-02 16:35:03 -07:00
Jenn Magder
cb819504f3
Revert "Add observatory Bonjour service to built iOS Info.plist bundle ( #64988 )" ( #65109 )
...
This reverts commit 4fde217dea
2020-09-02 12:31:17 -07:00
Christopher Fujino
237c0ab424
Delete catalog generator android/ios tests ( #64977 )
2020-09-02 11:25:04 -07:00
Jenn Magder
4fde217dea
Add observatory Bonjour service to built iOS Info.plist bundle ( #64988 )
2020-09-02 11:11:07 -07:00
Ming Lyu (CareF)
28de49e358
Revert "Reland #61998 and update complex_layout ios files ( #64885 )" ( #64990 )
...
This reverts commit df83398687
2020-08-31 18:47:08 -07:00
Ming Lyu (CareF)
df83398687
Reland #61998 and update complex_layout ios files ( #64885 )
2020-08-31 17:23:06 -07:00
Dan Field
b5ed913ecc
Memory/cpu/gpu benchmark for showing large images in succession ( #64762 )
2020-08-31 10:03:57 -07:00
Shi-Hao Hong
34541c3073
Revert "A benchmark test case for measuring scroll smoothness ( #61998 )" ( #64883 )
...
This reverts commit 12b7355da1
2020-08-30 18:42:10 +08:00
