Commit Graph

908 Commits

Author SHA1 Message Date
Ian Hickson
57f097b532
Refactor devicelab bin/run.dart and other cleanup (#96320) 2022-01-10 13:40:17 -08:00
Zachary Anderson
764c3c18d4
Revert "Add total_ui_gc_time to benchmarks captured (#96125)" (#96137) 2022-01-04 12:14:36 -08:00
Kaushik Iska
da9e87021d
Add total_ui_gc_time to benchmarks captured (#96125) 2022-01-04 10:02:21 -08:00
Christopher Fujino
6054eda86b
fix lateinitialization error in devicelab-runner (#94957) 2021-12-28 18:19:16 -08:00
godofredoc
e6971136e4
Adds a home method to device classes. (#95103) 2021-12-13 17:09:09 -08:00
Jim Graham
ee204880a5
Opacity Peephole optimization benchmarks (#94447) 2021-12-01 01:39:02 -08:00
Jason Simmons
67a8200e24
Roll Gallery for compatibility with the latest Gradle dependencies (#93985)
See https://github.com/flutter/flutter/issues/93975
2021-11-20 17:42:56 -08:00
Core
d8034538bd
feat: enable flavor option on test command (#89045) 2021-11-11 09:23:02 -08:00
Greg Spencer
52ae102f18
Adds tool warning log level and command line options to fail on warning/error output (#92031) 2021-11-10 16:13:04 -08:00
Zachary Anderson
3fba55a18d
Revert "Bump Gallery version (#93173)" (#93207)
This reverts commit 36a0bc5b96.
2021-11-06 23:40:10 -07:00
Emmanuel Garcia
36a0bc5b96
Bump Gallery version (#93173) 2021-11-05 17:33:31 -07:00
keyonghan
33be68d9bf
Stop sending metrics to builder name (#92989) 2021-11-05 16:28:02 -07:00
Jenn Magder
dc20a6066f
Skip codesigning during native macOS integration tests (#92938) 2021-11-02 16:41:32 -07:00
Emmanuel Garcia
93b3810022
Roll Gallery with updated Gradle lockfiles (#92850) 2021-11-01 10:47:57 -07:00
Ian Hickson
7f7f487abc
Feature/cpu gpu memory gallery transition tests (#92626) 2021-10-28 16:03:03 -07:00
keyonghan
30d3866ab9
Add extra benchmark metrics to test name in addition to builder name (#92530) 2021-10-27 15:33:06 -07:00
keyonghan
7de92e2653
Add devicelab benchmark tags support (#92141) 2021-10-20 15:03:06 -07:00
Jason Simmons
0bf2c9b3b7
Add local engine flag support to the SkSL caching performance benchmark scripts (#91773) 2021-10-14 10:57:32 -07:00
Jia Hao
e32201235f
Indicate that only physical iOS devices are supported (#79350) 2021-10-13 10:43:05 -07:00
Ian Hickson
f90b019c68
Enable prefer_relative_imports and fix files. (#91573) 2021-10-11 10:28:07 -07:00
Ian Hickson
7b01346c5c
Enable no_default_cases lint (#91530) 2021-10-11 10:23:04 -07:00
Ian Hickson
b3f63d38ac
Document why some lints aren't enabled and fix some minor issues. (#91527) 2021-10-09 04:03:03 -07:00
Ian Hickson
61a0add286
Enable avoid_redundant_argument_values lint (#91409) (#91462) 2021-10-08 09:25:14 -07:00
Zachary Anderson
b9d2177da0
Revert "Enable avoid_redundant_argument_values lint (#91409)" (#91461)
This reverts commit 5fd259be24.
2021-10-07 21:11:07 -07:00
Ian Hickson
5fd259be24
Enable avoid_redundant_argument_values lint (#91409) 2021-10-07 20:13:02 -07:00
Jenn Magder
4ef6fc1833
Update number of IPHONEOS_DEPLOYMENT_TARGET in plugin_test_ios (#91324) 2021-10-07 10:13:04 -07:00
Dan Field
22c1ca769b
Add a startup test that delays runApp (#91346) 2021-10-06 09:43:02 -07:00
stuartmorgan
8231592d71
Update minimum iOS version in plugin_test (#91099) 2021-10-05 10:33:04 -07:00
Alexander Aprelev
98120d19d3
Add a microbenchmark that measures performance of flutter compute. (#91257)
* Add a microbenchmark that measures performance of flutter compute.

This benchmark should show performance improvements when compute is switched to Isolate.exit

* Fix analyzer warnings, increase warmup iterations

* Fix license header
2021-10-04 14:16:23 -07:00
Jenn Magder
be8d29ffc6
Run native_ui_tests_macos in correct directory (#90829) 2021-09-27 17:38:03 -07:00
Jenn Magder
5c79a0c2f4
Run flutter_gallery macOS native tests on presubmit (#89620) 2021-09-22 13:18:07 -07:00
Jim Graham
abfb889fff
Add raster cache metrics to timeline summaries (#89393) 2021-09-04 18:31:03 -07:00
Konstantin Scheglov
cfd0743d10
Fix UNNECESSARY_TYPE_CHECK_TRUE violations. (#89186) 2021-08-31 15:46:05 -07:00
keyonghan
e311e3b3ef
skip staging update (#89137) 2021-08-30 09:26:05 -07:00
keyonghan
db4c104c8e
Use task name when uploading metrics to skia perf (#89004) 2021-08-26 22:31:02 -07:00
keyonghan
b67e264203
Revert "Skip staging test update to cocoon in test runner (#88835)" (#88971)
This reverts commit 884dfc260d.
2021-08-26 09:41:22 -07:00
Casey Hillers
b0950fd567
Revert "Use bucket to check staging test instead of builder name (#88908)" (#88969)
This reverts commit d36f246dcc.
2021-08-26 09:19:50 -07:00
keyonghan
d36f246dcc
Use bucket to check staging test instead of builder name (#88908) 2021-08-25 20:36:02 -07:00
keyonghan
884dfc260d
Skip staging test update to cocoon in test runner (#88835) 2021-08-25 11:36:03 -07:00
Jenn Magder
413f88f209
Do not try to codesign during plugin_test_ios (#88834) 2021-08-24 21:36:36 -07:00
keyonghan
b468be3030
Use default value for ResultData when uploading metrics from test runner (#88749) 2021-08-24 12:04:03 -07:00
keyonghan
208d312ff0
Upload devicelab test metrics from test runner (#88447) 2021-08-20 12:57:03 -07:00
Jonah Williams
060e4608b1
clean up stale or unnecessary TODOS (#88308) 2021-08-16 21:37:03 -07:00
yusufm
fe52e56614
Adding a timeout and retry to upload results step. (#87306)
* Adding a timeout and retry to upload results step.

* Adding tests for retries and timeout.

* Adding async to call

* Fixing sleep to trigger the timeout, and adding addition timeout test.

* Fixing minor typo.

* Fixing some minor flutter style issues.

Co-authored-by: yusufm <mohsinally@google.com>
2021-08-03 13:40:28 -07:00
Casey Hillers
79f377dabe
[devicelab] Only upload results on master (#87125) 2021-07-27 12:49:05 -07:00
Jenn Magder
f673c5c58f
Remove obsolete codegen_integration tests (#86962) 2021-07-23 14:56:04 -07:00
Jenn Magder
6881fca7b7
Respect plugin excluded iOS architectures (#86905) 2021-07-23 13:56:03 -07:00
Jenn Magder
81aeb33ce3
Increase Flutter framework minimum iOS version to 9.0 (#86840) 2021-07-22 13:21:05 -07:00
keyonghan
a5b9b5774a
Fix the tree (#86691)
* fix type cast error

* update doc
2021-07-19 20:23:45 -07:00
keyonghan
3aeb794298
Extend test runner command to update test flaky status (#86513) 2021-07-19 09:46:03 -07:00
Kaushik Iska
df3fe587e8
Validate that min frame number is numeric (#86498) 2021-07-15 17:11:09 -07:00
keyonghan
4d96a3fd50
Rerun devicelab task from test runner (#86394) 2021-07-14 15:23:10 -07:00
William Hesse
e01d327239
Always write devicelab test results to a file if the resultsPath option is present (#86393)
Some runs of DeviceLab performance tests are run without a gitBranch option, but
still must save their results to a local file.
2021-07-13 22:00:26 -07:00
Darren Austin
4c96cb26d2
Fixed a cast issue with host_mode_tests.dart. (#86392) 2021-07-13 17:31:02 -07:00
Darren Austin
ef5ffd08f6
Migrate devicelab framework code to null safety. (#86325)
(Attempt to reland #85993)
2021-07-13 12:14:50 -07:00
Darren Austin
08ef7752d5
Revert "Migrate core devicelab framework to null safety. (#85993)" (#86269)
This reverts commit 2175e64e4f.
2021-07-11 23:25:25 -07:00
Darren Austin
2175e64e4f
Migrate core devicelab framework to null safety. (#85993)
Migrate core devicelab framework to null safety.
2021-07-11 18:36:30 -07:00
Ahmed Ashour
a666925a02
Add newline at end of file (#86008) 2021-07-08 15:01:10 -07:00
Dan Field
e36e62e9a6
Revert "Revert "Audit hashCode overrides outside of packages/flutter (#85370)" (#85451)" (#85567)
This reverts commit 2be0d57fa2.
2021-06-30 09:46:54 -07:00
Ren You
2be0d57fa2
Revert "Audit hashCode overrides outside of packages/flutter (#85370)" (#85451)
This reverts commit 9846fa5145.
2021-06-28 09:55:31 -07:00
Dan Field
9846fa5145
Audit hashCode overrides outside of packages/flutter (#85370) 2021-06-26 17:36:04 -07:00
gaaclarke
66fd0b28b0
replaced unawaited with synchronous / await calls where needed (#82839) 2021-06-24 16:22:43 -07:00
Abhishek Ghaskata
3d124d25e8
migrate host agent (#84755) 2021-06-22 12:21:03 -07:00
Abhishek Ghaskata
16c0a3d700
Migrate task_result to null safety (#84939) 2021-06-21 10:04:02 -07:00
Jenn Magder
1d2f6c5296
Revert "Set up iOS native integration_tests in ui example project (#84890)" (#84892)
This reverts commit 05d5515732.
2021-06-18 18:05:00 -07:00
Jenn Magder
05d5515732
Set up iOS native integration_tests in ui example project (#84890) 2021-06-18 17:45:11 -07:00
Jenn Magder
03034e9e4a
Audit devicelab log streaming for nullability (#84820) 2021-06-18 00:14:03 -07:00
Jenn Magder
697928d21f
Revert "Set up iOS native integration_tests in ui example project (#84596)" (#84641)
This reverts commit ef2879a46f.
2021-06-15 10:09:41 -07:00
Jenn Magder
ef2879a46f
Set up iOS native integration_tests in ui example project (#84596) 2021-06-14 18:04:02 -07:00
Greg Spencer
ec5cfc001d
Fix build failure (#84597)
Fixes an incorrect cast that caused a build failure.

Landing on red to fix the build.
2021-06-14 15:17:25 -07:00
Greg Spencer
88f3811055
Turn on avoid_dynamic_calls lint, except packages/flutter tests, make appropriate changes. (#84476)
This adds avoid_dynamic_calls to the list of lints, and fixes all instances where it was violated.

Importantly, this lint is NOT turned on for flutter/packages/test, because those changes are happening in another PR: #84478
2021-06-14 14:16:57 -07:00
Alexandre Ardhuin
2c998d8be7
fix indentation of class members (#84293) 2021-06-10 11:29:03 -07:00
Alexandre Ardhuin
e467018d06
alignment of doc comments and annotations (#84256) 2021-06-09 07:54:02 -07:00
Dan Field
5cc7b6c3ea
Add option to stream logs to file for flutter logs and way to use it in devicelab runs (#84008) 2021-06-07 10:33:00 -07:00
Jenn Magder
94a41cde83
Mixed null safety in dev/devicelab (#84017) 2021-06-05 02:29:03 -07:00
Dan Field
83d51ecd1a
Delete obsolete TODO (#83966) 2021-06-03 23:29:05 -07:00
Jonah Williams
85df73d0e3
[flutter] ensure vmservice binding is registered in profile mode (#83913) 2021-06-03 17:59:03 -07:00
Anis Alibegić
c99ed373b3
Fixed large amount of spelling errors (#83744) 2021-06-02 10:14:06 -07:00
Alexandre Ardhuin
34059eec2c
enable lint prefer_interpolation_to_compose_strings (#83407) 2021-06-01 11:14:06 -07:00
Emmanuel Garcia
10416b3054
Roll Flutter Gallery with Gradle pinned dependencies (#83136) 2021-05-21 18:34:08 -07:00
nt4f04uNd
80a2b6b015
Fix typos (#82589) 2021-05-20 17:19:09 -07:00
Hattomo (TomohiroHattori)
08a70e7ac8
Enable avoid_escaping_inner_quotes lint (#81153) 2021-05-19 09:54:02 -07:00
gaaclarke
7cdd33fe99
added unawaited function for devicelab and turned on unawaited_futures linter (#82833) 2021-05-18 14:19:03 -07:00
Jonah Williams
d6fa9bbf91
[devicelab] await flutter create call in platform channels benchmark (#82762) 2021-05-18 08:55:38 -07:00
Jonah Williams
a3863b6592
[flutter_tools] support memory profiles from flutter drive (#82739) 2021-05-17 17:39:03 -07:00
Christopher Fujino
d6d3f0e0a8
add --verbose flag to pub global activate (#82719) 2021-05-17 11:39:28 -07:00
Dan Field
304b9c668e
Reland GC tracking benchmarks (#82069) 2021-05-14 19:59:24 -07:00
Christopher Fujino
855ada1d95
pub global deactivate devtools before installing (#82491)
* pub global deactivate devtools before installing
* upgrade devtools to latest
2021-05-13 17:13:03 -07:00
Jenn Magder
1ff5665fdd
Force LANG=en_US.UTF-8 in test runner (#82308) 2021-05-12 10:49:02 -07:00
Alexandre Ardhuin
c03e7488b4
remove noop primitive operations (#82297) 2021-05-12 00:04:02 -07:00
Michael Goderbauer
b8a2456737
Enable library_private_types_in_public_api lint (#81578) 2021-05-10 16:26:16 -07:00
Jacob Richman
f82dedd5b9
Update perf_tests to use devtools 2.2.2 (#81869) 2021-05-10 15:22:50 -07:00
Dan Field
3101374f60
Revert "Reland GC benchmark changes again (#82042)" (#82059)
This reverts commit 99a947c3e5.
2021-05-07 13:19:56 -07:00
Dan Field
99a947c3e5
Reland GC benchmark changes again (#82042) 2021-05-07 12:29:01 -07:00
gaaclarke
a5f57b9e64
Added performance benchmarks for platform channels (#81414) 2021-05-07 10:24:03 -07:00
Zachary Anderson
4056ac057d
Revert "Reland GC related bench update (#81794)" (#82005)
This reverts commit 714dea5e03.
2021-05-06 19:03:59 -07:00
Dan Field
714dea5e03
Reland GC related bench update (#81794) 2021-05-06 16:49:04 -07:00
Kate Lovett
2d89ebb929
Revert "Fix benchmark (#81449)" (#81696)
This reverts commit a3893aea04.
2021-05-03 12:22:46 -05:00
Dan Field
a3893aea04
Fix benchmark (#81449) 2021-05-03 10:02:09 -07:00
Michael Goderbauer
3cbfe82d9d
Rev DevTools to 2.1.1 for tests (#81515) 2021-04-29 16:47:42 -07:00
Ian Hickson
6beafa7b16
Apply style guide regarding createTempSync pattern (#81090) 2021-04-27 14:59:03 -07:00
Phil Quitslund
08d7811f7f
sort directives (#81210) 2021-04-27 10:09:02 -07:00
xster
ff2dde2c7f
Reland double gzip wrapping NOTICES to reduce on-disk installed space (#80897) 2021-04-26 22:35:45 -07:00
Emmanuel Garcia
b0a63c4ffe
Reland the Dart plugin registry (#79669) 2021-04-23 15:34:04 -07:00
Jonah Williams
63ba1b23ca
[flutter_tools] add support for --bundle-sksl-path to flutter run / flutter drive (#80885) 2021-04-21 13:59:02 -07:00
Phil Quitslund
61c30c41b2
fix sort_directives violations (#80817) 2021-04-21 13:49:03 -07:00
Greg Spencer
36daea2d54
Reland "Remove a dynamic that is no longer necessary (and the TODO for it) (#80294)" (#80373) 2021-04-13 18:29:21 -07:00
Jenn Magder
7d5f39281d
Cache location of Java binary in devicelab tests (#80172) 2021-04-12 16:50:03 -07:00
Casey Hillers
c571804913
Revert "Reland [devicelab] Migrate Gallery to BuildTestTask (#78361)" (#79903)
This reverts commit 0c9781e3dd.
2021-04-06 16:28:54 -07:00
Casey Hillers
0c9781e3dd
Reland [devicelab] Migrate Gallery to BuildTestTask (#78361) 2021-04-06 16:04:03 -07:00
Jenn Magder
1f19fd7108
Take screenshot when startup perf test fails to run (#79514) 2021-03-31 21:32:49 -07:00
Jonah Williams
4d54b8966a
roll gallery version to fix build (#79456) 2021-03-31 08:14:38 -07:00
Jia Hao
8158b478d7
Add tests for integration tests to devicelab (#79258) 2021-03-30 22:29:03 -07:00
Jenn Magder
12880f7751
Point gallery test data to FLUTTER_TEST_OUTPUTS_DIR (#79332) 2021-03-29 21:39:03 -07:00
Kaushik Iska
e6920662ad
Add a test to exercise multiple async microtasks in frame workload (#79163) 2021-03-29 20:49:05 -07:00
Dan Field
374993ce88
fix tree (#79329) 2021-03-29 18:52:36 -07:00
Dan Field
750fd1d536
Avoid hard coding "build" for test output files (#79322) 2021-03-29 17:36:34 -07:00
Zachary Anderson
5efc7169eb
Reverts "Implement dartPluginClass support for plugins #74469" (#78623)
* Revert "Enable dart_plugin_registry_test (#76645)"

This reverts commit 109e0bb9f5.

* Revert "Apply changes caused by https://github.com/flutter/flutter/pull/76662 (#77093)"

This reverts commit cdca6485f0.

* Revert "Disable clang format in the plugin registrants (#76662)"

This reverts commit dadbd47d09.

* Revert "Disable warnings for the dart plugin registrant (#76561)"

This reverts commit 098ece522d.

* Revert "Remove dart_plugin_registry_test timeouts (#76838)"

This reverts commit 1610a27476.

* Revert "Implement dartPluginClass support for plugins (#74469)"

This reverts commit b7d4806243.

Kick.
2021-03-23 14:28:11 -07:00
Jenn Magder
3463946448
Take screenshot when drive fails (#78822) 2021-03-22 19:06:28 -07:00
Jonah Williams
4851bd51f9
[devicelab] remove vm_service_client from devicelab (#78559) 2021-03-18 11:51:07 -07:00
Casey Hillers
c30fdfbe82
Revert "[devicelab] Migrate Gallery to BuildTestTask (#77956)" (#78355)
This reverts commit 93fb258602.
2021-03-16 12:20:36 -07:00
Casey Hillers
93fb258602
[devicelab] Migrate Gallery to BuildTestTask (#77956) 2021-03-16 11:58:03 -07:00
omerlevran46
c94648f9cc
[fuchsia] remove no devices found from ffx parsing (#77651) 2021-03-15 10:58:05 -07:00
Zachary Anderson
9167083d09
Explain why devtools in pinned (#77657) 2021-03-09 08:34:03 -08:00
Jenn Magder
85e2c52b39
Increase activated devtools version to 2.0 (#77637) 2021-03-08 13:17:21 -08:00
Michael Goderbauer
cb867bbedc
Enable unnecessary_await_in_return lint (#77434) 2021-03-05 18:38:15 -08:00
Jenn Magder
e9e8ca7640
Add debug_second_compile_millis benchmark metric (#77420) 2021-03-05 15:33:28 -08:00
Jenn Magder
7e02cc34f9
Bitcode strip Flutter.framework in assemble build target (#77329) 2021-03-05 10:38:57 -08:00
Casey Hillers
b0afe3464e
Create BuildTestTask (#77307) 2021-03-04 18:49:03 -08:00
Casey Hillers
c8c681f68e
[devicelab] Create test command to pass task args (#77110) 2021-03-04 11:59:02 -08:00
Michael Goderbauer
7b251f5f37
Enable use_function_type_syntax_for_parameters lint (#77163) 2021-03-04 08:59:17 -08:00
Casey Hillers
7ed797b053
Revert "[devicelab] Separate build and test from Flutter gallery tests (#76415)" (#77086)
This reverts commit 297c7b5cf2.
2021-03-02 12:17:18 -08:00
Casey Hillers
297c7b5cf2
[devicelab] Separate build and test from Flutter gallery tests (#76415) 2021-03-02 11:49:02 -08:00
Michael Goderbauer
fc99e7c0d7
Enable missing_whitespace_between_adjacent_strings (#77027) 2021-03-01 18:30:17 -08:00
omerlevran46
f996033fcc
[fuchsia] - migrate devicer discovery workflows to use ffx (#76241) 2021-03-01 13:16:13 -08:00
Jenn Magder
1610a27476
Remove dart_plugin_registry_test timeouts (#76838) 2021-02-25 20:26:02 -08:00
Casey Hillers
5cac7c3b15
Add expectation test for upload metrics (#76642) 2021-02-23 16:11:03 -08:00
Jason Simmons
de35aef679
Check for a closed output stream in the devicelab ADB log reader (#76633) 2021-02-23 16:01:04 -08:00
Jenn Magder
d69e2f10d8
Remove unused android_splash_screens integration test (#76429) 2021-02-22 14:46:04 -08:00
Jenn Magder
7cd99db0e4
Remove unused image_loading integration test (#76430) 2021-02-22 10:51:53 -08:00
Jason Simmons
5c004eaf65
Roll Gallery (required by the latest engine update and Dart SDK) (#76409) 2021-02-19 14:45:54 -08:00
George Wright
3f4544611c
Revert "Reland "Roll Engine from 6993cb229b99 to c217d9d06e4f (60 revisions) (#76352)" (#76394)" (#76403)
This reverts commit 562f53bf52.
2021-02-19 12:39:59 -08:00
Jason Simmons
562f53bf52
Reland "Roll Engine from 6993cb229b99 to c217d9d06e4f (60 revisions) (#76352)" (#76394)
This reverts commit c310717af2.

Also update Gallery to a version that is compatible with this roll.
2021-02-19 11:32:59 -08:00
Emmanuel Garcia
b7d4806243
Implement dartPluginClass support for plugins (#74469) 2021-02-19 09:22:45 -08:00
chunhtai
815976a8e4
change stack size test to test arm device (#75814) 2021-02-17 12:46:03 -08:00
Jenn Magder
d35058f5b8
Do not fail if 9xth_percentile_memory_usage is not recorded (#76153) 2021-02-16 15:56:02 -08:00
godofredoc
4597b51cbc
Fix problem causing tasks to timeout. (#76028)
This is because the command was actually collecting logs continuously
from the device. Additionally idevicesyslog does not have a reboot
option.

Bug: https://github.com/flutter/flutter/issues/76027
2021-02-14 17:28:27 -08:00
godofredoc
a0e8681452
Add flutter update packages to some tests. (#75530)
* Add flutter update packages to some tests.

Analyzer_benchmark and flutter_test_performance require to pub get
multiple directories. Rather than delegating the recipes to run flutter
update-packages we explicitly running on tests that need it.

Bug: https://github.com/flutter/flutter/issues/75524

* Add pub get directly on the analyis classes.

* Run flutter get in dev/tools.

* Fix directory path.

* Add more dependency directories.

* Fix typo.

* Add more dependencies.

* Add stocks dependency.

* Fix paths to some apps.

* Add more dependencies.

* Complete dependencies definition.

* More analysis dependencies.

* Add examples dependencies.

* Dev tool dependencies.

* Use update-packages for analyzer benchmark.
2021-02-11 15:30:55 -08:00
Yegor
e7953b3be4
[web] new service worker loading mechanism (#75535) 2021-02-11 09:16:21 -08:00
chunhtai
713fa8e360
Reland "add a benchmark test for stack size (#75039)" (#75434)
* Reland "add a benchmark test for stack size (#75039)"

This reverts commit de683de9d5.

* fix typo
2021-02-04 12:16:31 -08:00
Shi-Hao Hong
de683de9d5
Revert "add a benchmark test for stack size (#75039)" (#75383)
This reverts commit 9d9109aa6f.
2021-02-04 10:26:04 +08:00
chunhtai
9d9109aa6f
add a benchmark test for stack size (#75039) 2021-02-03 15:16:03 -08:00
Jenn Magder
f4f33fd108
Dump logs on failing devicelab test to recipe artifact location (#74378) 2021-02-01 15:00:38 -08:00
Jenn Magder
91aad2bb06
Avoid iOS local networking dialog in integration tests (#75163) 2021-02-01 13:33:25 -08:00
Nate Bosch
dcc4fdd558
Pass only Uri to package:http APIs (#74285) 2021-01-20 09:59:03 -08:00
Jonah Williams
7ee910b0a8
[flutter_tools] ensure --dart-define can parse args with commas (#73798) 2021-01-15 13:51:32 -08:00
Yuqian Li
c4114a7527
Remove more flaky non-e2e tests (#74062)
Fixes https://github.com/flutter/flutter/issues/73873
2021-01-15 13:22:26 -08:00
Emmanuel Garcia
da90156f8c
Fix plugin java class desugar (#73758) 2021-01-13 14:09:04 -08:00
LongCatIsLooong
cbe72db135
macrobenchmark: TextField with complex paragraph (#73374) 2021-01-12 15:44:01 -08:00
Jenn Magder
66145fe652
Force plugins to inherit minimum macOS version from Flutter app (#72764) 2021-01-11 11:16:12 -08:00
Jenn Magder
062022b950
Move ios_content_validation_test to pre-submit tools test (#73577) 2021-01-11 10:29:06 -08:00
Yegor
1f8501f0a4
web benchmark choose renderer explicitly (#73582) 2021-01-08 12:04:03 -08:00
jensjoha
5bc725bea8
[dev] Don't use await for on stdout and stdin; pass local engine argument (#72136)
* [dev] Don't use await for on stdout and stdin; pass local engine argument

1) Don't use await for on stdout followd by await for on stderr.
   This can cause nothing to happen. E.g. if one didn't do something
   like `flutter pub upgrade` dev/automated_tests and the version in the
   old one was pre-nnbd (but flutter itself use lots of nnbd stuff) lots
   of errors would be emitted, but because we basically only listen to
   stdout nothing will happen (deadlock once stderr buffer runs out).
   Note that it still awaits the exit-code below.
2) Pass --local-engine (if given) so there won't be any crashes because
   of that.
2021-01-08 08:12:36 +01:00
Jenn Magder
3082a2806e
build ios-framework simulator slices for profile/release (#73378) 2021-01-06 12:12:23 -08:00
nturgut
272b23cabd
[web] make sure tests and benchmarks use correct backend - add autodetect false (#73047)
* add autodetect false

* fix typo
2020-12-28 10:55:53 -08:00
Casey Hillers
849784e262
[devicelab] Add results path flag to test runner (#72765) 2020-12-22 16:45:38 -08:00
nturgut
14206399c3
make sure tests and becnhmarks use correct backend (#72628) 2020-12-21 09:55:23 -08:00
xster
ca82c572b7
Revert "let NOTICES be double gzip wrapped to reduce on-disk installed space (#71899)" (#72438) 2020-12-16 10:58:19 -08:00
xster
4ed3432e8f
let NOTICES be double gzip wrapped to reduce on-disk installed space (#71899) 2020-12-15 13:29:14 -08:00
Michael Goderbauer
78cbfbff42
Revert "Migrate devicelab to package:vm_service (#71882)" (#72092)
This reverts commit 9d1d0cfeb5.
2020-12-10 12:56:02 -08:00
Dan Field
9d1d0cfeb5
Migrate devicelab to package:vm_service (#71882) 2020-12-10 12:43:04 -08:00
Casey Hillers
2565062df3
git branch flag (#71886) 2020-12-08 15:53:05 -08:00
Emmanuel Garcia
d35dd9f8a6
Allow flavors and build types when using plugins (#71738) 2020-12-07 09:23:04 -08:00
Jenn Magder
d4150d3f6d
Adopt Flutter.xcframework in tool (#71495) 2020-12-04 13:57:11 -08:00
Yegor
7efd7afdf8
Handle the glibc bug that Chrome occasionally hits (#71705) 2020-12-04 12:21:37 -08:00
Kate Lovett
1c244da28d
Add verbose flag to hot mode tests (#71610) 2020-12-02 16:47:35 -06:00
Jonah Williams
1e0628001e
[devicelab] dont use set modified for hot reload bench (#70965) 2020-11-20 13:02:28 -08:00
Jonah Williams
9424474793
[devicelab] update hot reload benchmark to be more representative (#70643)
update hot reload benchmark to be more representative
2020-11-18 14:54:01 -08:00
Jim Graham
61460d255a
preserve detailFiles entry in TaskResult JSON (#70668)
* preserve detailFiles entry in TaskResult JSON
2020-11-17 16:05:54 -08:00
Casey Hillers
a228a17c57
[devicelab] LUCI builder flag (#70702) 2020-11-17 11:28:03 -08:00
Yuqian Li
f7811ea541
e2e perf tests don't have CPU/GPU/memory metrics (#70439)
Address comment in https://github.com/flutter/flutter/pull/66386/files#r522671103
2020-11-13 11:16:50 -08:00
Emmanuel Garcia
b18e2a1cc4
Bump Gallery version (#70130) 2020-11-09 13:05:56 -08:00
Jonah Williams
c985fd35cd
[devicelab] re-land cocoon auto-restart (#69710)
Due to #69707 the SkSL tests need the process killing logic still.
2020-11-03 13:20:40 -08:00
Jonah Williams
ea3551b058
Revert "[devicelab] reboot attached devices after 30 test runs (#69447)" (#69703)
This reverts commit 406ca0bc59.
2020-11-03 11:13:19 -08:00
Yegor
9e5d22d101
Say [APP] instead of [Gallery] in web benchmarks (#69624) 2020-11-03 10:13:07 -08:00
Jonah Williams
406ca0bc59
[devicelab] reboot attached devices after 30 test runs (#69447) 2020-11-03 10:10:55 -08:00
Greg Spencer
c0ef94780c
Fix spelling errors (#69451)
My yearly pass to fix spelling errors in the API dartdocs.
2020-10-31 03:12:27 -07:00
Jenn Magder
bb495ba90c
Do not fail if average_memory_usage is not recorded (#69339) 2020-10-29 16:09:50 -07:00
Jonah Williams
31c96b5d83
[devicelab] do not fail test if CPU measurement is not recorded (#69268) 2020-10-29 09:32:34 -07:00
Jonah Williams
18341efa2f
[devicelab] retry startup of start up test (#69272) 2020-10-29 09:19:07 -07:00
Jonah Williams
83d4351e0c
[devicelab] work around occasional null values for devtools (#69273)
* [devicelab] work around occasional null values for devtools

* Update perf_tests.dart
2020-10-29 09:18:38 -07:00
Jenn Magder
13896b3bd1
Decrease device discovery timeout from 10 to 5 seconds (#69266) 2020-10-28 19:43:19 -07:00
Jenn Magder
135aab9cf5
Increase device run perf test timeout (#69260) 2020-10-28 18:29:04 -07:00
Jonah Williams
2c12a8d917
[devicelab] remove twc enabled test and uncaught image test (#68518) 2020-10-24 13:19:51 -07:00
Casey Hillers
ce3ce20b14
[devicelab] Upload git branch (#68541) 2020-10-23 08:02:02 -07:00
Jonah Williams
37042fdb08
[flutter_tools] remove iOS screenshot on failure functionality (#68650)
* [flutter_tools] remove iOS screenshot on failure functionality

* remove all screenshot code
2020-10-22 13:34:07 -07:00
Jonah Williams
ab20ae782a
[devicelab] uinstall during memory test (#68548) 2020-10-20 09:49:50 -07:00
Jonah Williams
938fae9c99
remove --machine flag (#68538) 2020-10-19 17:06:28 -07:00
Jonah Williams
a152c0f429
[devicelab] reland: reduce iterations of startup test, use application binary (#68532)
These devicelab tests are incredibly flaky. Currently they will build & install the same application 15 times. This causes the temp storage to fill up on android, and has a good chance of flaking on iOS due to install issues.

The change from 3 to 15 increased total test time for 2 -> 12 minutes on iOS, or roughly 5 more test equivalents for every single iOS test. Reduce the iteration count back to 5

Uninstall the app after each run so temp storage does not fill up.
2020-10-19 16:51:28 -07:00
Jonah Williams
4a3e2a1af5
Revert "[devicelab] reduce iterations, uninstall at end, and use --application-binary in all startup tests (#68516)" (#68531)
This reverts commit a4c2075a45.
2020-10-19 15:05:46 -07:00