Commit Graph

586 Commits

Author SHA1 Message Date
Jonah Williams
751459df24
[flutter_tool] support --use-application-binary in flutter drive (#68060)
--use-application-binary allows running with an already built APK. This can be useful for speeding up CI test cases, or in our case eventually supporting some sort of build server. Demonstrate that this works by updating the old gallery test to use it. Fixes #56604

Co-authored-by: Jenn Magder <magder@google.com>
2020-10-13 19:27:30 -07:00
Jonah Williams
eb24393efe
remove missing argument (#67974) 2020-10-12 17:18:09 -07:00
Jonah Williams
5dfe7e6d51
[flutter_tools] attempt to stabilize hot restart benchmark the old fashioned way (#67971)
A change which sped up hot restart locally caused many of the devicelab measures to regress. I think this is because we do not measure when the isolate is actually "ready", so starting a reload or restart prematurely can cause time spent doing initialization to be registered as part of the reload operation.

A fix for this would be to have the framework include some sort of "initialization complete" event ... but it is not clear what the correct trigger would be. Perhaps after the first frame is successfully registered?

(9a3a0dc caused the benchmark regression - possibly since we spend less time syncing files now so we start the restart earlier)
2020-10-12 17:00:26 -07:00
Yuqian Li
98d1ad0195
Purge persistent cache for perf test runs (#67697) 2020-10-08 19:17:02 -07:00
Yuqian Li
684449a841
Remove measureIosCpuGpu (#67363) 2020-10-08 12:02:03 -07:00
Casey Hillers
9e206a0c93
Refactor devicelab logic to use TaskResult instead of JSON (#67550) 2020-10-07 16:37:09 -07:00
Jenn Magder
e5131fa31b
Increase device discovery timeout in devicelab health check (#67337) 2020-10-06 12:23:02 -07:00
Ming Lyu (CareF)
76c0d69b14
migrate textfield_perf to e2e (#64503) 2020-10-02 14:47:03 -07:00
Yuqian Li
e45157fc08
5x startup test repitition to reduce noise (#67147) 2020-10-02 12:22:05 -07:00
Ming Lyu (CareF)
db2532a949
migrate color_filter_and_fade_perf (#64484) 2020-10-01 17:32:02 -07:00
Yuqian Li
b92d250116
Let perf tests measure memory by default (#66570)
Fixes https://github.com/flutter/flutter/issues/66569
2020-10-01 15:20:17 -07:00
Chris Yang
2d26bafec2
remove --trace-startup (#66568) 2020-09-29 17:22:04 -07:00
Yuqian Li
4728892753
Roll gallery to the newest version (#66693)
The previously broken test should be fixed by
https://github.com/flutter/gallery/pull/331
2020-09-28 22:45:54 -07:00
Yuqian Li
54ac7bc936
Reland "Default measureCpuGpu to true (#66386)" (#66604)
This reverts commit 2d9e500523.

In addition, this fixes broken Android tests of the original PR.
2020-09-28 10:26:35 -07:00
Jenn Magder
65159afb55
Force plugins to inherit minimum iOS version from Flutter app (#66590) 2020-09-28 10:14:47 -07:00
Yuqian Li
3e8fb33c08
Revert "Roll gallery to the newest version (#66584)" (#66666)
This reverts commit 2ae09caace.
2020-09-25 12:18:28 -07:00
Yuqian Li
2ae09caace
Roll gallery to the newest version (#66584)
This shouldn't break our tests as
https://github.com/flutter/gallery/issues/275 is closed.
2020-09-25 11:05:33 -07:00
Jenn Magder
a6a8a14d02
Do not cleanup Gradle in non-Android integration tests (#66487) 2020-09-24 18:34:07 -07:00
Yuqian Li
2d9e500523
Revert "Default measureCpuGpu to true (#66386)" (#66594)
This reverts commit 48ce83a833.
2020-09-24 15:17:57 -07:00
Yuqian Li
48ce83a833
Default measureCpuGpu to true (#66386) 2020-09-24 13:42:03 -07:00
godofredoc
57cda51f7e
Fix gradle_plugin_light_apk test. (#66496) 2020-09-23 16:52:02 -07:00
Ming Lyu (CareF)
f681fcf32b
migrate backdrop_filter_perf (#64482) 2020-09-22 19:52:02 -07:00
Michael R Fairhurst
7f3c9b6bda
Remove unused 'dart:async' imports. (#65568) 2020-09-16 14:14:06 -07:00
Ming Lyu (CareF)
b3f19a3e1a
migrate animated_placeholder_perf (#64478) 2020-09-16 07:47:03 -07:00
Yuqian Li
b8a39c15f8
Collect memory metrics (#65798) 2020-09-15 12:47:05 -07:00
Jonah Williams
4e20f00053
[ci] remove create offline tests (#65791)
Currently these tests are taking CI time without providing any value, because there is no verification that network connectivity is avoided. This is better covered by a unit test that verifies that --offline is passed to pub.
2020-09-14 17:54:59 -07:00
Ming Lyu (CareF)
51f1c98490
migrate cubic_bezier_perf to e2e (#64487) 2020-09-11 20:02:03 -07:00
Yuqian Li
e1eddb401d
Revert the revert (#65602) 2020-09-11 16:20:03 -07:00
xster
65ae30c8cc
Update create templates to 1.0.0 (#65234) 2020-09-10 12:57:56 -07:00
Tong Wu
abeaf11829
[devicelab] Remove ~/.gradle after each devicelab task run (#65434) 2020-09-09 01:50:03 -07:00
Jenn Magder
ace54425e0
Add observatory Bonjour service to built iOS Info.plist bundle (#65138) 2020-09-02 18:47:56 -07:00
Jenn Magder
259deec221
Revert "Add observatory Bonjour service to built iOS Info.plist bundle (#65138)" (#65141)
This reverts commit 5e0aa8b9fc.
2020-09-02 18:31:45 -07:00
Jenn Magder
5e0aa8b9fc
Add observatory Bonjour service to built iOS Info.plist bundle (#65138) 2020-09-02 17:57:43 -07:00
gaaclarke
37de94d7d2
devicelab: started averaging startup time for ios test (#64978) 2020-09-02 16:35:03 -07:00
Jenn Magder
cb819504f3
Revert "Add observatory Bonjour service to built iOS Info.plist bundle (#64988)" (#65109)
This reverts commit 4fde217dea.
2020-09-02 12:31:17 -07:00
Christopher Fujino
237c0ab424
Delete catalog generator android/ios tests (#64977) 2020-09-02 11:25:04 -07:00
Jenn Magder
4fde217dea
Add observatory Bonjour service to built iOS Info.plist bundle (#64988) 2020-09-02 11:11:07 -07:00
Ming Lyu (CareF)
28de49e358
Revert "Reland #61998 and update complex_layout ios files (#64885)" (#64990)
This reverts commit df83398687.
2020-08-31 18:47:08 -07:00
Ming Lyu (CareF)
df83398687
Reland #61998 and update complex_layout ios files (#64885) 2020-08-31 17:23:06 -07:00
Dan Field
b5ed913ecc
Memory/cpu/gpu benchmark for showing large images in succession (#64762) 2020-08-31 10:03:57 -07:00
Shi-Hao Hong
34541c3073
Revert "A benchmark test case for measuring scroll smoothness (#61998)" (#64883)
This reverts commit 12b7355da1.
2020-08-30 18:42:10 +08:00
Ming Lyu (CareF)
12b7355da1
A benchmark test case for measuring scroll smoothness (#61998) 2020-08-29 04:28:03 -07:00
Zachary Anderson
6f02c0b231
Revert "Roll new gallery to help flaky Crane test (#64676)" (#64824)
This reverts commit e825281745.
2020-08-28 13:54:51 -07:00
Yuqian Li
e825281745
Roll new gallery to help flaky Crane test (#64676) 2020-08-28 10:48:03 -07:00
Ming Lyu (CareF)
d30e36ba8c
migrate flutter_gallery_sksl_warmup__transition_perf to e2e (#64275) 2020-08-21 19:36:03 -07:00
Jim Graham
9e86e9fb1e
report list of detail files so devicelab can save them (#64009) 2020-08-20 10:58:25 -07:00
Yuqian Li
6eb45d35da
Rename needsMeasureCpuGpu to measureCpuGpu (#64000) 2020-08-19 13:26:07 -07:00
Remi Rousselet
2b25e29192
add benchmark for ChangeNotifier.notifyListeners (#62715) 2020-08-14 17:06:03 -07:00
Ming Lyu (CareF)
6f26e806ab
bug fix for flutter_gallery__transition_perf(_with_semantics) (#63799)
* report failure for semantics test

* bug fix
2020-08-14 19:37:08 -04:00
Ming Lyu (CareF)
360023e2bc
Clean up flutter_gallery__transition_perf (#63609) 2020-08-13 14:41:04 -07:00
Ming Lyu (CareF)
0629030a05
WidgetTester.drag with time duration (#63410) 2020-08-12 21:01:03 -07:00
Emmanuel Garcia
febcbcb885
Print dex when analyzing the APK (#63538) 2020-08-12 17:56:04 -07:00
Ming Lyu (CareF)
2384376f64
Migrate gallery/transitions_perf test to e2e (#62064) 2020-08-12 13:36:07 -07:00
Yuqian Li
2296bb154b
Measure CPU/GPU with the simple animation test (#63124) 2020-08-07 20:41:07 -07:00
Yuqian Li
6d487355a3
Remove cubic_bezier_perf.dart (#63028) 2020-08-05 20:21:02 -07:00
Tianguang
504963b4d1
Pin gallery version (#62986) 2020-08-05 15:11:18 -07:00
Ming Lyu (CareF)
1d329d2cc9
migrate macrobenchmark/multi_widget_construction test to e2e (#62539) 2020-08-04 18:56:03 -07:00
Yuqian Li
e6bc56f25a
Reland "Add Crane test to the new Gallery app (#62162)" (#62544) 2020-07-31 09:56:04 -07:00
Michael Goderbauer
e4b6754155
Bump new gallery version (#62439) 2020-07-28 15:25:03 -07:00
Jonah Williams
27e13dd53e
Revert "Add Crane test to the new Gallery app (#62162)" (#62430)
This reverts commit 1ffdfa81d6.
2020-07-28 11:32:34 -07:00
Yuqian Li
1ffdfa81d6
Add Crane test to the new Gallery app (#62162) 2020-07-28 10:56:05 -07:00
Jenn Magder
e8e5de44ec
Parse .flutter-plugins-dependencies for add-to-app iOS modules (#61269) 2020-07-28 10:16:09 -07:00
Todd Volkert
901ccbe65b
Add timeout to the devicelab runner logs (#62418) 2020-07-28 09:40:11 -07:00
Will Larche
7782845edd
[Material] Updated icons and fonts (#61778) 2020-07-24 15:41:13 -07:00
Zachary Anderson
5e0ba2290f
Pass --disable-dart-dev in more places (#62217) 2020-07-24 13:37:08 -07:00
Jason Simmons
fc72a5f105
Disable DartDev when running device lab tests (#62154)
This is a workaround for https://github.com/flutter/flutter/issues/62139
so that the engine roll pipeline can proceed.
2020-07-23 14:17:27 -07:00
Ming Lyu (CareF)
056e455e94
Add a E2E based performance test case (#61509) 2020-07-23 08:31:04 -07:00
Chris Yang
c5a69b9b8a
Reland "Branch out android platform view perf testing #60238" 2nd time (#61748) 2020-07-22 18:36:11 -07:00
Ming Lyu (CareF)
54c9441723
benchmarkLive: a new LiveTestWidgetsFlutterBindingFramePolicy for benchmark on device (#61388)
* add benchmarkLive flag and tests

* update handlePointerEventRecord doc

* using e2e 0.6.1
2020-07-17 18:56:12 -04:00
Ming Lyu (CareF)
7bef51acc9
cleanup macrobenchmark duplicate files (#61621)
* cleanup macrobenchmark duplicate files
2020-07-17 14:34:33 -04:00
Emmanuel Garcia
293a2bf8e8
Android views using hybrid composition e2e driver test (#61507) 2020-07-16 16:19:49 -07:00
Chris Yang
6a525b9aa5
Revert "Reland "Branch out android platform view perf testing (#60238)" (#61554)" (#61642) 2020-07-16 13:14:52 -07:00
Chris Yang
63ceeb8f15
Reland "Branch out android platform view perf testing (#60238)" (#61554) 2020-07-16 11:23:52 -07:00
Sam Rawlins
54f99d642d
Remove unused optional parameters of private functions. (#60446) 2020-07-15 09:41:02 -07:00
Chris Yang
77efc00af0
Revert "Branch out android platform view perf testing (#60238)" (#61482)
This reverts commit 9f4499f431.
2020-07-14 15:10:21 -07:00
Chris Yang
9f4499f431
Branch out android platform view perf testing (#60238) 2020-07-14 13:07:41 -07:00
Tong Wu
aa0125387c
[devicelab] This no-op change marks 3 tests to run on LUCI builders. (#61257) 2020-07-10 21:49:40 -07:00
Jenn Magder
1e510ff636
Turn on add-to-app iOS platform unit tests (#61007) 2020-07-09 15:52:49 -07:00
Pierre-Louis
49cf97c35b
Update new gallery HEAD commit (#60504)
The gallery repository history has been rewritten (see flutter/gallery#87), so updating to HEAD commit
2020-06-29 10:49:29 +02:00
Ming Lyu (CareF)
025463f463
Heavy Widget construction and destruction performance test (#60336)
* Add widget construction benchmark

* Add to device lab
2020-06-26 17:38:26 -04:00
Ming Lyu (CareF)
99f5eebc6b
Add --device-id option for devicelab/bin/run.dart (#59276)
* Implement device selection for devicelab/run.dart

* Add test to --device-id option for devicelab/run

* Update dev/devicelab/bin/run.dart by jonahwilliam

* Rename deviceOperatingSystem enum mock -> fake

Co-authored-by: Jonah Williams <jonahwilliams@google.com>
2020-06-26 09:29:46 -04:00
Tianguang
02f8e02880
Add Web Benchmarks for Flutter Gallery (Flutter Side) — 1/4 (#57576) 2020-06-24 10:28:03 -07:00
liyuqian
850ea6d29d
Add SkSL shader warm-up tests to Flutter gallery (#59932) 2020-06-23 17:48:02 -07:00
Chris Yang
2e63b7d4f8
Add --platforms to flutter create -t plugin command (#59507) 2020-06-23 17:38:03 -07:00
Christopher Fujino
ca32668b0b
port devicelab from idevice_id -> xcdevices (#59907) 2020-06-23 14:37:14 -07:00
Jenn Magder
6a2bc2617e
Replace ANDROID_HOME user messages with ANDROID_SDK_ROOT (#59867) 2020-06-22 18:43:04 -07:00
Chris Bracken
e0f60918d4
Roll the engine from 965fbbe to b5f5e63 (#59804)
This rolls the engine from:
965fbbed1776545ee681cb57f3fb1d0c2000bbcb to
b5f5e6332cb4987e9e38ffaa267733ec0a8705ba. A Dart SDK roll in this range
changed the format of the compileExpression RPC VMService endpoint,
necessitating a tool patch.
2020-06-18 16:12:54 -07:00
Jenn Magder
3744b82d8c
Support .flutter-plugins-dependencies (#59209) 2020-06-11 13:25:01 -07:00
Ming Lyu (CareF)
b5d0b9122f
Cleanup devicelab framework duplicate (#59046)
* combine forwardStandardStreams

* combine exec and eval
2020-06-10 19:30:12 -04:00
liyuqian
9dad2d98df
Perf test with SkSL warm-up (#56638) 2020-06-06 14:43:02 -07:00
Greg Spencer
ab68721a5d
Add Android device build/OS/API Level information to logs. (#58747)
This adds some information about the chosen device to the output log so that we can tell what type of device/OS Level/API Level the test is running on when doing a postmortem on a failed test.
2020-06-05 14:02:07 -07:00
liyuqian
08225fad28
Add iOS new gallery perf test (#58648) 2020-06-04 10:23:01 -07:00
Jim Graham
7261b98e81
Enabling the ImageFiltered(ImageFilter.matrix) page of macrobenchmark (#58277) 2020-05-30 18:53:01 -07:00
Jonah Williams
d9144bf8fc
[flutter_tools] rename output LICENSE file to NOTICES and support loading either (#57871)
Work towards #16723

This is only safe to land after #58131 lands in google3. Only build NOTICES in asset manfiest, and load either LICENSE or NOTICES from pubspec dependencies.
2020-05-29 11:55:02 -07:00
Jenn Magder
d9adfe3f7e
Allow FLUTTER_APPLICATION_PATH to be null for misconfigured Xcode projects (#57701) 2020-05-27 10:08:09 -07:00
liyuqian
721927efd3
Use pub inside the Flutter directory (#57704) 2020-05-21 17:52:02 -07:00
liyuqian
a635765116
Reland "Add DevTools memory test (#55486)" (#57340) 2020-05-19 18:02:03 -07:00
Jonah Williams
631087d83b
[flutter_tools] cache-bust in service worker (#56786) 2020-05-16 14:57:04 -07:00
Nate Bosch
59a8ef3a21
Remove direct uses of LocalPlatform (#56605)
When `const LocalPlatform` is used immediately and not passed as a
dependency it does not have utility over the static properties from
`dart:io`. Remove these uses to reduce the noise around how the
instantiable `Platform` class is used.
2020-05-11 12:59:29 -07:00
Jonah Williams
231a055069
[devicelab] fix web twc task missing display (#56623) 2020-05-08 09:50:46 -07:00