flutter/dev/integration_tests
Loïc Sharma 4b1d2644cb
Fix keyboard_hot_restart_ios flakes (#168518)
The keyboard hot restart test does these steps:

1. It launches an app that forces the keyboard to be visible
2. It checks that the keyboard is visible by examining the app's logs
3. It updates the app to no longer force the keyboard to be visible and
hot restarts the app
4. It checks that the keyboard is no longer visible by examining the
app's logs

Previously, the test app printed the keyboard status whenever the app
rebuilt. The test would move on as soon as it saw a log that indicates
the keyboard was in the expected state. However, since the app could log
the keyboard's visibility _before_ the Dart VM was available, hot
restart commands could be ignored (or at least, that's my theory from
the DeviceLab logs).

Now, the test app prints the keyboard status non-stop. The test now
waits until the Dart VM is available before checking if the logs
indicate the keyboard is open. Also, the test now waits until the hot
restart has completed before checking if the keyboard is closed. In
theory, this should ensure that hot restart does not happen until after
the Dart VM is available.

Follow-up to: https://github.com/flutter/flutter/pull/167013
Part of: https://github.com/flutter/flutter/issues/10713

## Pre-launch Checklist

- [x] I read the [Contributor Guide] and followed the process outlined
there for submitting PRs.
- [x] I read the [Tree Hygiene] wiki page, which explains my
responsibilities.
- [x] I read and followed the [Flutter Style Guide], including [Features
we expect every widget to implement].
- [x] I signed the [CLA].
- [x] I listed at least one issue that this PR fixes in the description
above.
- [x] I updated/added relevant documentation (doc comments with `///`).
- [x] I added new tests to check the change I am making, or this PR is
[test-exempt].
- [x] I followed the [breaking change policy] and added [Data Driven
Fixes] where supported.
- [x] All existing and new tests are passing.

If you need help, consider asking for advice on the #hackers-new channel
on [Discord].

<!-- Links -->
[Contributor Guide]:
https://github.com/flutter/flutter/blob/main/docs/contributing/Tree-hygiene.md#overview
[Tree Hygiene]:
https://github.com/flutter/flutter/blob/main/docs/contributing/Tree-hygiene.md
[test-exempt]:
https://github.com/flutter/flutter/blob/main/docs/contributing/Tree-hygiene.md#tests
[Flutter Style Guide]:
https://github.com/flutter/flutter/blob/main/docs/contributing/Style-guide-for-Flutter-repo.md
[Features we expect every widget to implement]:
https://github.com/flutter/flutter/blob/main/docs/contributing/Style-guide-for-Flutter-repo.md#features-we-expect-every-widget-to-implement
[CLA]: https://cla.developers.google.com/
[flutter/tests]: https://github.com/flutter/tests
[breaking change policy]:
https://github.com/flutter/flutter/blob/main/docs/contributing/Tree-hygiene.md#handling-breaking-changes
[Discord]:
https://github.com/flutter/flutter/blob/main/docs/contributing/Chat.md
[Data Driven Fixes]:
https://github.com/flutter/flutter/blob/main/docs/contributing/Data-driven-Fixes.md
2025-05-19 19:05:09 +00:00
..
android_engine_test Error when trying to use old HC mode when HCPP is enabled (#168027) 2025-05-12 18:53:16 +00:00
android_module_host_with_custom_build_v2_embedding/app/src/main/java/io/flutter/addtoapp Fix package declarations for add-to-app integration tests (#77648) 2021-03-30 14:19:02 -07:00
android_semantics_testing add missing lockfiles not checked in from running generate_gradle_lockfiles.dart (#168600) 2025-05-09 19:46:52 +00:00
android_views Roll pub packages (#168509) 2025-05-08 00:50:25 +00:00
channels add missing lockfiles not checked in from running generate_gradle_lockfiles.dart (#168600) 2025-05-09 19:46:52 +00:00
deferred_components_test Roll pub packages (#168509) 2025-05-08 00:50:25 +00:00
display_cutout_rotation Increase pinned version of leak tracker to enable access to experimental tracking on web. (#167502) 2025-04-21 23:48:15 +00:00
external_textures Roll pub packages (#168509) 2025-05-08 00:50:25 +00:00
flavors add missing lockfiles not checked in from running generate_gradle_lockfiles.dart (#168600) 2025-05-09 19:46:52 +00:00
flutter_gallery add missing lockfiles not checked in from running generate_gradle_lockfiles.dart (#168600) 2025-05-09 19:46:52 +00:00
hook_user_defines Roll pub packages (#168509) 2025-05-08 00:50:25 +00:00
ios_add2app_life_cycle iOS: Update minimum iOS version to 13.0 (#167737) 2025-04-24 20:15:13 +00:00
ios_app_with_extensions iOS: Update minimum iOS version to 13.0 (#167737) 2025-04-24 20:15:13 +00:00
ios_host_app iOS: Update minimum iOS version to 13.0 (#167737) 2025-04-24 20:15:13 +00:00
ios_host_app_swift iOS: Update minimum iOS version to 13.0 (#167737) 2025-04-24 20:15:13 +00:00
ios_platform_view_tests Roll pub packages (#168509) 2025-05-08 00:50:25 +00:00
keyboard_hot_restart Fix keyboard_hot_restart_ios flakes (#168518) 2025-05-19 19:05:09 +00:00
link_hook Roll pub packages (#168509) 2025-05-08 00:50:25 +00:00
module_host_with_custom_build/.gradle Reland "Branch out android platform view perf testing #60238" 2nd time (#61748) 2020-07-22 18:36:11 -07:00
module_host_with_custom_build_v2_embedding Reapply "[ Device Lab ] Upgrade Device Lab projects to Java 18" (#166016) (#166059) 2025-03-27 15:07:22 +00:00
new_gallery Normalize BottomAppBarTheme (#168586) 2025-05-14 17:38:18 +00:00
platform_interaction Roll pub packages (#168509) 2025-05-08 00:50:25 +00:00
pure_android_host_apps Fix build_android_host_app_with_module_source device lab tests (#166077) 2025-03-27 17:42:48 +00:00
release_smoke_test add missing lockfiles not checked in from running generate_gradle_lockfiles.dart (#168600) 2025-05-09 19:46:52 +00:00
spell_check add missing lockfiles not checked in from running generate_gradle_lockfiles.dart (#168600) 2025-05-09 19:46:52 +00:00
ui add missing lockfiles not checked in from running generate_gradle_lockfiles.dart (#168600) 2025-05-09 19:46:52 +00:00
web Remove <meta content="IE=Edge" http-equiv="X-UA-Compatible"> (#166252) 2025-03-31 16:03:56 +00:00
web_compile_tests Bump characters, collection, meta (#161066) 2025-01-03 02:23:10 +00:00
web_e2e_tests Roll pub packages (#168509) 2025-05-08 00:50:25 +00:00
wide_gamut_test Increase pinned version of leak tracker to enable access to experimental tracking on web. (#167502) 2025-04-21 23:48:15 +00:00
windows_startup_test Roll pub packages (#168509) 2025-05-08 00:50:25 +00:00
README.md Warn that integration tests are not run automatically (#162626) 2025-02-03 22:36:41 +00:00

Automated Flutter integration test suites

Each suite consists of either a complete Flutter app and a flutter_driver specification that drives tests from the UI, or a native app that is meant to integrate with Flutter for testing.

Intended for use with devicelab tests.

If you want to run a driver test locally, to debug a problem with a test, you can use this command from the appropriate subdirectory:

flutter drive -t <test> --driver <driver>

For example:

flutter drive -t lib/keyboard_resize.dart --driver test_driver/keyboard_resize_test.dart

New tests require new CI runner

Adding code to this directory will not automatically cause it to be run by any already existing ci tooling. This directory is intentinally a "choose your own adventure" piece of tooling.