Commit Graph

506 Commits

Author SHA1 Message Date
Mikkel Nygaard Ravn
60bc1cfde7 Remove personal dev team from ios code sigining (#9631)
* Mark channels_integration_test_ios flaky

* Removed personal dev team from ios code siging

* Removed provisioning profile diffs against other samples
2017-04-27 11:07:52 +02:00
Mikkel Nygaard Ravn
70ff50f929 Integration test for channel communication (#9621) 2017-04-27 08:44:28 +02:00
Alexandre Ardhuin
35803c2297 comprehensive list of lints (#9330)
* comprehensive list of lints
* add comments to commented out lint
* fix unnecessary_this lints
* exclude prefer_final_fields
2017-04-20 09:38:57 +02:00
Ian Hickson
96d8a2a3ad Mark some tests as flaky (#9489)
These tests have recently been turning the build red incorrectly. Until they are reliable, let's mark them flaky.
2017-04-20 00:11:31 -07:00
Phil Quitslund
fc58bd7679 IntelliJ metadata cleanup (flutter-intellij#914). (#9427)
Follow-up from #9422
2017-04-17 13:42:31 -07:00
Yegor
7e3bb94d5f Mark complex_layout_scroll_perf__timeline_summary as flaky (#9405) 2017-04-14 17:15:34 -07:00
Adam Barth
ea71bdca20 Start using @immutable annotations (#9152)
There are more places we can use this annotation, but this patch just gets us
started.
2017-04-14 10:38:58 -07:00
Devon Carew
9493df2da8 update the IntelliJ metadata files (#9388) 2017-04-14 08:55:26 -07:00
Yegor
9dfcc6ec79 Revert "temporarily mark iOS tests as flaky (#9314)" (#9333)
This reverts commit ff23a1ebfe.

Our iOS lab hardware is back to normal.
2017-04-11 12:26:15 -07:00
Yegor
ff23a1ebfe temporarily mark iOS tests as flaky (#9314) 2017-04-10 10:51:31 -07:00
Ian Hickson
3eb87830e9 Constants! Constants everywhere! (#9286)
Aggressively apply the const lint.
2017-04-07 12:24:32 -07:00
Yegor
d538c11486 update devicelab docs (#9274) 2017-04-06 16:27:29 -07:00
Yegor
57ca2b5ce8 obey custom timeout supplied by cocoon (#9260) 2017-04-06 10:48:45 -07:00
Michael Goderbauer
a559b8df5c [Regression] Re-enable ANSI color support on Windows (#9232)
Also adds a test to make sure we don't break it again.
2017-04-05 15:44:22 -07:00
Ian Hickson
86a490ffe8 Tracked skipped tests in technical debt benchmark (#9206) 2017-04-05 12:23:21 -07:00
Alexandre Ardhuin
189028a958 Separate the 'if' expression from its statement (#9177) 2017-04-04 21:45:50 +02:00
Yegor
1182eb18c5 add "flaky" and "timeout_in_minutes" devicelab task options (#9168) 2017-04-04 10:46:07 -07:00
xster
4245bce545 Add full platform build speed instrumentations (#9162)
* Add new metric to size_tests instead

* Small lints
2017-04-04 01:05:53 -07:00
Chris Bracken
abfee824cd Re-enable iOS transitions test in devicelab (#9097)
This reverts commit 326355f0f9.
2017-03-29 19:19:57 -07:00
Yegor
e067041279 increase vmservice timeout; log stderr in microbenchmarks (#9088) 2017-03-29 15:40:17 -07:00
Ian Hickson
326355f0f9 Turn off this flaky test for now. (#9065)
cc @cbracken
2017-03-28 16:40:13 -07:00
Jason Simmons
f7d0aa03f8 Throw an exception if flutter run fails during a microbenchmark (#9061) 2017-03-28 15:46:53 -07:00
Yegor
0ec3ffb4bc increase total task timeout; decrease individual benchmark timeout (#9063) 2017-03-28 15:42:06 -07:00
Michael Goderbauer
506aea0316 enable windows tests with workaround (#9058) 2017-03-28 14:22:03 -07:00
Collin Jackson
e2b49d64d6 Revert "Revert "Revert "Include fragment support in Android build to allow use of FragmentActivity in FlutterActivity (#9036)"" (#9046)" (#9047)
Test is still failing with increased timeout.

This reverts commit 864b3c37c6.
2017-03-27 19:16:58 -07:00
Collin Jackson
864b3c37c6 Revert "Revert "Include fragment support in Android build to allow use of FragmentActivity in FlutterActivity (#9036)"" (#9046)
Increased the time limit slightly to allow the microbenchmark test time to finish.
2017-03-27 18:12:14 -07:00
Michael Goderbauer
cea7c66dfd Disable flaky WIndows test :( (#9029) 2017-03-27 14:04:50 -07:00
Sarah Zakarias
d274888be6 Rename platform_services to platform_channel (#9018)
* Rename platform_services to platform_channel

* rename in README

* renamed tests

* update modules.xml
2017-03-27 11:17:31 +02:00
Yegor
71690343fb detailed error message re missing xcconfigs (#9001) 2017-03-24 10:35:21 -07:00
Sarah Zakarias
912279bf6f Patch Debug/Release.xcconfig files in devicelab tests (#9000) 2017-03-24 15:57:06 +01:00
Sarah Zakarias
47fc81f14d Revert "Remove flutter_view_ios__start_up.dart (#8978)" (#8996)
This reverts commit 38e4e48d06.
2017-03-24 11:45:57 +01:00
Yegor
bc8cc80b9f Xcode 8-compatible provisioning profiles in devicelab tests (#8987) 2017-03-23 17:35:04 -07:00
Sarah Zakarias
38e4e48d06 Remove flutter_view_ios__start_up.dart (#8978) 2017-03-23 16:06:09 +01:00
Sarah Zakarias
18db5a2e68 Add start-up test for flutter_view sample (#8892)
* Add start-up test for flutter_view sample

* add reportMetrics flag to startup test

* rewording in manifest.yaml
2017-03-23 13:20:00 +01:00
Sarah Zakarias
d1f73fd0ad Add integration test for the Platform Services app (#8826) 2017-03-20 22:19:03 +01:00
Michael Goderbauer
9781f1aff0 make hot_mode_dev_cycle benchmark run in verbose mode (#8862) 2017-03-17 12:16:19 -07:00
Alexandre Ardhuin
a0769f2488 apply the upcoming rule unnecessary_this (#8838) 2017-03-17 08:05:42 +01:00
Ian Hickson
2bbe82ef30 Increase timeout and verbosity to diagnose devicelab failure (#8832) 2017-03-16 15:02:43 -07:00
Michael Goderbauer
79002c7453 add tasks for Windows bots in device lab (#8827) 2017-03-16 13:47:14 -07:00
Michael Goderbauer
d87f19817f devicelab benchmarks run on Windows (#8814)
* devicelab benchmarks run on Windows

* fix analyzer issue

* fix test

* fix pubspec
2017-03-15 16:33:10 -07:00
Alexandre Ardhuin
2166ea5b7f apply partially the upcoming unnecessary_lambdas (#8810) 2017-03-15 23:09:58 +01:00
Yegor
f8238185cc fix size Android tests broken by #8759 (#8796) 2017-03-15 10:08:22 -07:00
Chris Bracken
6c97dd2c6c Declare locals as final where not reassigned (dev) (#8574) 2017-03-03 18:06:08 -08:00
Alexandre Ardhuin
69b6bb87d1 prefer_is_empty and prefer_is_not_empty (#8474) 2017-03-01 22:17:30 -08:00
Phil Quitslund
a002e72022 Bump to test 0.12.20. (#8349)
* Bump to test `0.12.20`.

Some test `0.12.20` highlights:
  * introduces `expectLater()`  that returns a `Future` that completes when the matcher has finished running
  * deprecates the `verbose` parameter to `expect()` and the `formatFailure()` (to be removed in `0.13.0`)

Otherwise:
  * to keep up w/ the deprecation of `verbose`, removes `widget_tester` API to pass `verbose` flag (alternatively we could suppress the warning for now)

* Update stack manipulation.

* Fix framecount.
2017-02-23 15:08:25 -08:00
Alexandre Ardhuin
8c043d06de fix lints for directives_ordering rule (#8382) 2017-02-23 13:37:26 -08:00
Alexandre Ardhuin
e9a775bf38 prefer const constructors (#8316) 2017-02-21 14:54:29 -08:00
Todd Volkert
c233f38291 Update package:test dependencies to 0.12.18+2 (#8247) 2017-02-17 17:35:11 -08:00
Phil Quitslund
c458fb9d2c Bump Dart SDK to 1.23.0-dev.0.0 (#8222)
* ups pinned `test` to `0.12.15+9` (to play nice w/ the latest analyzer)
* integrates `analyzer` with analysis driver defaulting to ON
2017-02-16 16:50:35 -08:00
Michael Goderbauer
7231fd3ed6 Enable flutter drive on Windows (#8146)
... and run some more tests on Windows.
2017-02-14 13:14:52 -08:00
Jakob Andersen
eebc72a343 Update path to built .apk. (#8137) 2017-02-14 13:46:45 +00:00
Alexandre Ardhuin
e151a1a438 prefer_contains (#8040) 2017-02-09 15:17:55 -08:00
Michael Goderbauer
723489de02 Make dev/bots/test.dart pass on Windows (#7998)
* disables all `flutter test` and `flutter drive` tests on Windows as those two commands are not fully implemented on Windows yet
* fixes other failures on Windows
2017-02-08 15:57:31 -08:00
Ian Hickson
21434fcf1a Refactor 'flutter drive' to get the observatory port from the logs (#7695)
This remove a very brittle aspect of flutter drive, whereby it would
assume a known port instead of explicitly finding out what it was.

Fixes #7692 and hopefully fixes the devicelab tests.
2017-01-27 01:37:28 -08:00
Ian Hickson
19d22c9726 Make devicelab count as a bot so we can see crash logs (#7687) 2017-01-26 20:17:40 -08:00
Ian Hickson
f1cdf57053 Be gentler, for MacOS (#7684)
Turns out MacOS has a really low open files limit and so if you try to
open EVERY FILE AT THE SAME TIME it falls over.

This just opens the files one at a time, the way we used to back in
the old days.
2017-01-26 18:48:01 -08:00
Ian Hickson
a4a1392c44 --debug-port is now --observatory-port (#7680) 2017-01-26 18:01:34 -08:00
Ian Hickson
aff4e82891 Technical Debt tracker (#7667) 2017-01-26 17:04:37 -08:00
Jason Simmons
bc04c53231 Fix VMIsolateRef type declaration (#7666)
Fixes https://github.com/flutter/flutter/issues/7661
2017-01-26 14:24:04 -08:00
Yegor
862657e4e4 devicelab: add more hot-reload metrics (#7602) 2017-01-24 09:04:48 -08:00
Yegor
4bec9cd940 update build benchmark to match #7589 (#7600) 2017-01-23 17:49:01 -08:00
Ian Hickson
63aa1397a3 Increase the strictness of our requiring explicit types (#7585)
...now that we have generic methods, their types need to be specified too.
2017-01-23 01:04:31 -08:00
Ian Hickson
15a7eb3b6c Move to real generic method syntax (#7235) 2017-01-21 20:58:44 -08:00
Jason Simmons
584dbe3d32 Fix the activity name in the Gallery back button memory metric (#7527) 2017-01-18 14:14:40 -08:00
Yegor
0c7a9da98f microbenchmarks: single-line JSON; consolidate #7433 workaround (#7450)
- output single-line JSON because iOS 9.x cannot output more than one line
- move the workaround for #7433 into LiveTestWidgetsFlutterBinding so that it works in all cases (e.g. animation_bench.dart on iOS)
2017-01-11 14:29:21 -08:00
Yegor
42ccffca36 fix microbenchmarks on iOS (#7429) 2017-01-10 18:16:00 -08:00
Yegor
b6ac86435a export missed transition count to the dashboard (#7426) 2017-01-10 13:09:43 -08:00
Yegor
3c7122a797 devicelab: fix basic_material_app_ios__size; add microbenchmarks (#7408) 2017-01-10 09:30:00 -08:00
Yegor
1df639b432 add microbenchmarks to devicelab (fixes #7081) (#7396) 2017-01-09 14:57:14 -08:00
Todd Volkert
29a88cf817 Bump path to 1.4.0 and meta to 1.0.4 (#7369) 2017-01-05 16:44:27 -08:00
Yegor
cf61905c04 publish GPU metrics to dashboard; compact transition event printout (#7254) 2016-12-13 15:22:23 -08:00
Yegor
adf998cb2a remove mega_gallery__refresh_time superseded by hot_mode_dev_cycle__benchmark (#7171) 2016-12-06 12:20:54 -08:00
Jason Simmons
2fd786b567 A devicelab memory test for Android app suspend and resume (#7164) 2016-12-06 10:13:21 -08:00
Yegor
568a6e1e65 measure IPA size (#7158) 2016-12-05 12:46:59 -08:00
Jason Simmons
7da3ab634a Devicelab memory usage test that navigates repeatedly to a screen within Gallery (#7137) 2016-12-05 11:08:25 -08:00
Yegor
d7c215199d add hello_world__memory test to devicelab (#7143) 2016-12-02 16:50:27 -08:00
Jason Simmons
2563636d90 A devicelab test of memory usage for a minimal app (#7126) 2016-12-02 10:27:43 -08:00
Yegor
45a4f639c9 devicelab: make specifying device OS less confusing (#7132) 2016-12-01 18:35:40 -08:00
Jason Simmons
4da4ca89aa Add a devicelab test that captures memory usage metrics on Android (#7120) 2016-12-01 11:37:16 -08:00
Adam Barth
7c795d5fdd Update iml files (#7025)
These now match what 2016.3 expects.
2016-11-27 07:46:54 -08:00
Ian Hickson
06ca1b3326 Revert "Revert "update vm_service_client to 0.2.2+4"" (#6919) 2016-11-23 08:50:55 -08:00
Adam Barth
49fa3f4933 Revert "update vm_service_client to 0.2.2+4" (#6918) 2016-11-17 19:54:53 -08:00
Yegor
05fdc2910b update vm_service_client to 0.2.2+4 (#6917) 2016-11-17 17:50:47 -08:00
Hans Muller
861492d6f4 Changed vm_service_client version back to 0.2.2+2 (#6909) 2016-11-17 15:33:45 -08:00
Yegor
4145f5fcfd allow passing file path as reference to devicelab task (#6877) 2016-11-16 13:54:06 -08:00
Ian Hickson
9f1c91f934 Update README.md (#6867)
Some minor tweaks to answer questions I had when looking at this.
2016-11-15 12:35:18 -08:00
Dan Rubel
34e466f1fd Refactor flutter command exit code - part 3 of 3 (#6838)
* Remove the workaround that pinned args to v0.13.6
This reverts most of the changes in commit 6331b6c8b5
* throw exception if exit code is not an integer
* rework command infrastructure to throw ToolExit when non-zero exitCode
* convert commands to return Future<Null>
* cleanup remaining commands to use throwToolExit for non-zero exit code
* remove isUnusual exception message
* add type annotations for updated args package
2016-11-14 14:21:30 -05:00
Yegor
cffd551793 log full timeline when transition test fails; print stack chain in task errors (#6772) 2016-11-09 15:32:22 -08:00
Dan Rubel
6331b6c8b5 revert args to 0.13.6 (#6765) 2016-11-08 17:15:11 -05:00
Devon Carew
4d68eebce9 add an intellij module for the dev/devicelab package (#6550) 2016-10-28 17:28:58 +02:00
Yegor
80627a5ccd unlock device before running perf test (#6540) 2016-10-25 18:05:53 -07:00
Yegor
33c6526462 fix frame info extraction logic; track frames in gallery test (#6505) 2016-10-25 11:02:18 -07:00
Yegor
4f8da89dc4 Revert "reenable dev/devicelab/test/run_test.dart (#6364)" (#6378)
This reverts commit 8f273e49de.
2016-10-19 18:43:19 -04:00
Yegor
1eda886e7e unlock device before running transition test (#6371) 2016-10-18 10:20:05 -07:00
Yegor
8f273e49de reenable dev/devicelab/test/run_test.dart (#6364)
I ran the test 10 times on Linux and Mac and it succeeded
consistently. Let's reenable until there are new reports that it's
flaky.

Fixes #5901
2016-10-17 19:31:58 -07:00
Yegor
8c8be6b5df remove engineEnterTimestampMicros from benchmark list; not useful (#6242) 2016-10-06 22:31:32 -07:00
Yegor
6081476458 improve devicelab docs (#6206) 2016-10-06 10:20:58 -07:00
Yegor
74804e6f1d fix analyzer_server__analysis_time benchmark broken in #6093 (#6205) 2016-10-04 13:27:41 -07:00
Yegor
6cdab85d28 Sync test code with Cocoon (#6129)
* fix flutter watch benchmark

Syncs d2d7950ecd

* Split Android/iOS impl behind a unified interface

Syncs db87e10fa5

* Switch from pub get to flutter packages get

Syncs b378005cbb

* "silent" option in test runner; fix analysis errors;
2016-09-29 10:19:15 -07:00
Devon Carew
8755e569ca suppress pub override warning; decouple the analyzer versions (#5991)
* suppress warning; decouple the analyzer versions

* also pass in --no-packages-dir
2016-09-22 07:40:38 -07:00
Dan Rubel
3f025e0ddf remove ignore unawaited_future comments (#5959) 2016-09-21 08:35:04 -04:00
Ian Hickson
4f0eff31bc Fix crash when a RenderObject tree is rooted in a non-RenderObject environment (#5933) 2016-09-20 14:14:05 -07:00
Dan Rubel
d65460e7a5 cleanup unawaited futures lints (#5945) 2016-09-20 07:32:09 -04:00
Yegor
921287b412 migrate hot reload benchmark to the new devicelab framework (#5878) 2016-09-19 10:03:26 -07:00
Phil Quitslund
fffde14f64 Update tools to use analyzer from vended Dart SDK. (#5900)
* Update tools to use `analyzer` from vended Dart SDK.

* updates `flutter_tools` and `flutter_test` to use the SDK-vended `analyzer` package
* tweaks dependency tracking logic to only record the SDK-vended `analyzer` so as not to crash on spurious conflicts (due to transitive dependencies)

* Review fixes.
2016-09-16 11:06:17 -07:00
Yegor
1ba1562293 move CI tests into the main repo (#5758) 2016-09-14 13:22:53 -07:00