Commit Graph

341 Commits

Author SHA1 Message Date
Jonah Williams
6e3ebc9350
[flutter_tools] only run web shard if requested (#69932) 2020-11-05 23:58:40 -08:00
Jonah Williams
6fe800abd5
[null-safety] remove enable experiment flags (#69930) 2020-11-05 23:58:11 -08:00
Dan Field
76784651d4
Move package:integration_test to flutter/flutter (#69622) 2020-11-05 17:28:47 -08:00
Jonah Williams
a3f6ea6f38
[flutter_tools] split web integration tests into new shard (#69914) 2020-11-05 17:21:44 -08:00
Jenn Magder
ae0a9cb560
Revert "Initial migration of metrics_center (#69629)" (#69848)
This reverts commit ada6b7e57e.
2020-11-04 19:18:38 -08:00
Yuqian Li
ada6b7e57e
Initial migration of metrics_center (#69629)
For the ease of code reviews, this only includes minimal code from
MetricPoint, GoogleBenchmarksParser, and their unit tests.

See go/flutter-metrics-center-migration for the overall plan.
2020-11-04 17:13:41 -08:00
Yegor
f03ac0be81
start and stop chromedriver once per sub-shard; do not wait for it to quit (#69443)
* start and stop chromedriver once per sub-shard; do not wait for it to quit

* enable web_long_running_tests but keep them as flaky
2020-10-30 17:27:55 -07:00
Jonah Williams
3e41962dff
[null-safety] update tests and tool auto-detection for null safe dart (#69405)
Disable null safety auto-detection for the web
2020-10-30 13:42:54 -07:00
Zachary Anderson
2562224665
Disable tests that time-out on CI (#69432) 2020-10-30 12:46:44 -07:00
Yegor
2fa03438de
add web_long_running_tests shard containing long-running web tests (#67324) 2020-10-29 14:23:02 -07:00
stuartmorgan
c23319ee9f
Enable dev/bots/ build_tests for Linux (#68658)
Enables build_test for Linux. Currently only flutter_gallery has platform directories for the desktop platforms, so this will run only that build, but this will provide an end-to-end build test for Linux.

Other example/test projects can be brought online for Linux in the future just by adding the linux/ directory to the project.
2020-10-29 09:27:59 -07:00
Jonah Williams
7629758ed7
[flutter_tools] measure driver success and failure (#69226)
Currently we only have a test that measures if flutter drive can fail. Unfortunately it has been failing for multiple years based on the fact that the error is due to a missing Gradle config.

Add a smoke success test case, and update both tests to use the test API and the tester-device.
2020-10-28 18:15:23 -07:00
Yegor
7a10b46ee0
Print errors in all build modes (#69046) 2020-10-26 15:57:02 -07:00
stuartmorgan
22c502e315
Add Windows build test (#68657)
Enables build_test for Windows. Currently only flutter_gallery has platform directories for the desktop platforms, so this will run only that build, but this will provide an end-to-end build test for Windows.

Other example/test projects can be brought online for Windows in the future just by adding the windows/ directory to the project.
2020-10-22 15:14:30 -07:00
stuartmorgan
4ea6d3de93
Enable dev/bots/ build_tests for macOS (#68656)
Enables build_test for Windows, macOS, and Linux. Currently only
flutter_gallery has platform directories for the desktop platforms, so
this will run only that build, but this will provide an end-to-end build
test for all three desktop platforms.

Once this lands, other example/test projects can be brought online for
desktop platforms in the future just by adding the relevant platform
directories to the project.
2020-10-22 13:52:19 -07:00
Michael Goderbauer
dd2ea7c503
Migrate all of examples/layers to sound null safety (#68744) 2020-10-22 13:33:07 -07:00
Jonah Williams
a655a1778d
[null-safety] swap tool unit tests to tester (#68733) 2020-10-22 13:17:31 -07:00
Michael Goderbauer
42f3709a5a
Sound null safety for framework and flutter_test (#68642) 2020-10-21 10:09:11 -07:00
Yegor
ff9082cf6d
Refactor command utilities for tests (#68324)
* refactor command running utilities for tests

Co-authored-by: Jonah Williams <jonahwilliams@google.com>
2020-10-19 20:56:25 -07:00
Michael Goderbauer
52d3bef017
Reland removal of examples/catalog (#67545) 2020-10-07 13:17:08 -07:00
Jonah Williams
ddb01a0c81
[null-safety] add integration tests for sound null safety modes, add support for sound null safety in dart2js (#67171)
Add integration tests to verify that ddc and dart2js can be built and run in sound mode. Updates dart2js compilation to insert a language version comment into the generated entrypoint if necessary.

dart-lang/sdk#42253
2020-10-02 21:52:38 -07:00
Michael Goderbauer
19e07d2beb
Migrate flutter_test (#66663) 2020-09-30 17:03:40 -07:00
godofredoc
fd0e223b74
Add Firebase tests to flutter dashboard. (#66677)
This PR also enables firebase tests on presubmit and removes code that
won't be used anymore from test runner.

Bug:
  https://github.com/flutter/infra/pull/225
2020-09-25 14:26:39 -07:00
godofredoc
cfe53fd3c5
Enable linux and win hostonly devicelab tests. (#66085) 2020-09-21 11:27:06 -07:00
Jonah Williams
b88f308af7
[flutter_tools] port deprecated settings test to flutter integration shard (#65806)
Port the deprecated settings devicelab test to tool integration shard. Tests that apps can be built using the deprecated android/settings.gradle file.

Part of #65790
2020-09-15 10:55:07 -07:00
Jonah Williams
4e20f00053
[ci] remove create offline tests (#65791)
Currently these tests are taking CI time without providing any value, because there is no verification that network connectivity is avoided. This is better covered by a unit test that verifies that --offline is passed to pub.
2020-09-14 17:54:59 -07:00
Greg Spencer
94592acb71
Creates a way to test private APIs in the Flutter package. (#65505) 2020-09-13 15:52:03 -07:00
Jonah Williams
3f6c862177
[null-safety] remove sound-null-safety by default, remove experiment flag (#64594)
To allow tests to begin migrating to null safety, sound null safety needs to be disabled. Also removes the experiment flag that is unnecessary since the framework is on the SDK allowlist.
2020-08-25 15:57:54 -07:00
Mouad Debbar
707f995de3
[web] Fix and enable editable_text_test.dart (#64516) 2020-08-25 04:51:03 -07:00
Jonah Williams
69fd5c50a2
[flutter_tools] null assertions off by default for web (#64186)
Like Android/iOS, only enable --null-assertions if asked. Previously this was enabled by default for web, but in general this has proved to be too breaking to enable by default.

#61042
2020-08-19 14:52:47 -07:00
Jonah Williams
38e0c25823
[flutter_tools] reland: enable --null-assertions for flutter framework tests (#64120)
Reland of acdb909 with fixes to semantics.dart

#61042
2020-08-19 13:25:42 -07:00
Jenn Magder
1b47759528
Revert "[null-safety] enable null assertions for framework tests (#64071)" (#64118)
This reverts commit acdb909fcb.
2020-08-18 18:08:51 -07:00
Jonah Williams
acdb909fcb
[null-safety] enable null assertions for framework tests (#64071) 2020-08-18 17:21:04 -07:00
Jenn Magder
0fe1adadd2
Pin iOS module test plugin versions (#63445) 2020-08-11 06:26:05 -07:00
Jenn Magder
31dfaa0c7e
Temporarily turn off module_test_ios during investigation (#63448) 2020-08-10 19:08:35 -07:00
Jonah Williams
e762e7e05f
[flutter_tools] deflake integration tests by running single isolate (#62534)
There are some occasional difficult to repro flakes on the tool integration tests. Try running only a single isolate to simplify the environment a bit.
2020-07-30 11:06:34 -07:00
Jason Simmons
e64fe11542
Manual engine roll to 626244a72c5d53cc6d00c840987f9059faed511a (#62163)
Disabled web_benchmarks_canvaskit in the bot scripts because it was
failing in the Cirrus environment.
2020-07-23 18:11:17 -07:00
Jonah Williams
cb7770b3a5
[flutter_tools] add support for enable null safety asserts (#61114)
Enable null safety asserts for web debug mode. This induces runtime asserts at the boundaries between null safe and non-null safe libraries. Adds integration test that validates assertion error is thrown.

#61042
2020-07-15 09:54:39 -07:00
Jenn Magder
1e510ff636
Turn on add-to-app iOS platform unit tests (#61007) 2020-07-09 15:52:49 -07:00
Jonah Williams
80b5ee4e7c
Roll tester (#61128)
landing to unblock meta rollback
2020-07-08 14:39:55 -07:00
Jonah Williams
de205ec13c
Roll tester version (#60668)
Includes a fix to a startup race condition and log truncation that should make sure strings aren't cut off
2020-07-06 10:36:05 -07:00
Jonah Williams
f2f48df3af
Experiment with tester on the flutter_tools general shard (#60490)
Use tester (disclaimer, written by me) to unit test the flutter tools general shard. Since these tests are designed to be hermetic, the single compilation/single isolate model offers a tremendous speedup over the default pub run test workflow. On previous linux shard, test execution alone took 10:30, while now it takes only 1:30.
2020-06-29 22:19:55 -07:00
Jenn Magder
6a2bc2617e
Replace ANDROID_HOME user messages with ANDROID_SDK_ROOT (#59867) 2020-06-22 18:43:04 -07:00
Jonah Williams
958f7c5b55
[flutter_tools] ensure generated entrypoint matches test and web entrypoint language version (#59291)
Ensure that the language version of the test/web generated entrypoint matches the language version of the test file to run, or the overall package language version if no annotation is provided.
2020-06-16 09:17:12 -07:00
Michael Goderbauer
584fd5f913
Word substitutions (#59484)
* Word substitutions

* ++
2020-06-16 09:15:43 -07:00
Alexandre Ardhuin
65ef1f94bb
test flutter framework with null-safety (#59280) 2020-06-11 16:40:02 -07:00
Jenn Magder
9037ccd355
Add per-test timeout to Cirrus tool general tests (#58649) 2020-06-09 12:38:01 -07:00
Jonah Williams
b1d75fc99d
[flutter_tools] add flag for sound-null-safety, unify with experiments (#58533)
Also combines experiments into extraGenSnapshot/ExtraFrontEndOptions. Allows providing --no-sound-null-safety to allow out of order migration and running.
2020-06-03 21:02:07 -07:00
Jonah Williams
01b9bf8ea6
[flutter_tools] deprecate flutter generate and codegen (#58328) 2020-06-03 09:28:02 -07:00
Jonah Williams
6bd156b8ed
[null-safety] disable tests until framework has migrated (#57235) 2020-05-14 12:34:53 -07:00