flutter/dev/integration_tests
Andrew Kolos 016eb85177
Support conditional bundling of assets based on --flavor (#132985)
Provides support for conditional bundling of assets through the existing `--flavor` option for `flutter build` and `flutter run`. Closes https://github.com/flutter/flutter/issues/21682. Resolves https://github.com/flutter/flutter/issues/136092

## Change
Within the `assets` section pubspec.yaml, the user can now specify one or more `flavors` that an asset belongs to. Consider this example:

```yaml
# pubspec.yaml
flutter:
  assets:
    - assets/normal-asset.png
    - path: assets/vanilla/ice-cream.png
      flavors: 
        - vanilla
    - path: assets/strawberry/ice-cream.png
      flavors:
        - strawberry
```

With this pubspec,
* `flutter run --flavor vanilla` will not include `assets/strawberry/ice-cream.png` in the build output.
* `flutter run --flavor strawberry` will not include `assets/vanilla/ice-cream.png`.
* `flutter run` will only include `assets/normal-asset.png`.

## Open questions

* Should this be supported for all platforms, or should this change be limited to ones with documented `--flavor` support (Android, iOS, and (implicitly) MacOS)? This PR currently only enables this feature for officially supported platforms.

## Design thoughts, what this PR does not do, etc.

### This does not provide an automatic mapping/resolution of asset keys/paths to others based on flavor at runtime.

The implementation in this PR represents a simplest approach. Notably, it does not give Flutter the ability to dynamically choose an asset based on flavor using a single asset key. For example, one can't use `Image.asset('config.json')` to dynamically choose between different "flavors" of `config.json` (such as `dev-flavor/config.json` or `prod-flavor/config.json`). However, a user could always implement such a mechanism in their project or in a library by examining the flavor at runtime.

### When multiple entries affect the same file and 1) at least one of these entries have a `flavors` list provided and 2) these lists are not equivalent, we always consider the manifest to be ambiguous and will throw a `ToolExit`. 

<details>
For example, these manifests would all be considered ambiguous:

```yaml
assets:
  - assets/
  - path: assets/vanilla.png
    flavors: 
      - vanilla

assets:
  - path: assets/vanilla/
    flavors: 
      - vanilla
  - path: assets/vanilla/cherry.png
     flavor:
      - cherry

# Thinking towards the future where we might add glob/regex support and more conditions other than flavor:
assets:
  - path: assets/vanilla/**
    flavors:
      - vanilla
  - path: assets/**/ios/**
    platforms: 
       - ios

# Ambiguous in the case of assets like "assets/vanilla/ios/icon.svg" since we 
# don't know if flavor `vanilla` and platform `ios` should be combined using or-logic or and-logic.
```

See [this review comment thread](https://github.com/flutter/flutter/pull/132985#discussion_r1381909942) for the full story on how I arrived at this decision.
</details>

### This does not support Android's multidimensional flavors feature (in an intuitive way)

<details>

Conder this excerpt from a Flutter project's android/app/build.gradle file:

```groovy
android {
    // ...

    flavorDimensions "mode", "api"

    productFlavors {
        free {
            dimension "mode"
            applicationIdSuffix ".free"
        }

        premium {
            dimension "mode"
            applicationIdSuffix ".premium"
        }

        minApi23 {
            dimension "api"
            versionNameSuffix "-minApi23"
        }

        minApi21 {
            dimension "api"
            versionNameSuffix "-minApi21"
        }
    }
}
```

In this setup, the following values are valid `--flavor` are valid `freeMinApi21`, `freeMinApi23`, `premiumMinApi21`, and `premiumMinApi23`. We call these values "flavor combinations". Consider the following from the Android documentation[^1]:

> In addition to the source set directories you can create for each individual product flavor and build variant, you can also create source set directories for each combination of product flavors. For example, you can create and add Java sources to the src/demoMinApi24/java/ directory, and Gradle uses those sources only when building a variant that combines those two product flavors.
> 
> Source sets you create for product flavor combinations have a higher priority than source sets that belong to each individual product flavor. To learn more about source sets and how Gradle merges resources, read the section about how to [create source sets](https://developer.android.com/build/build-variants#sourcesets).

This feature will not behave in this way. If a user utilizes this feature and also Android's multidimensional flavors feature, they will have to list out all flavor combinations that contain the flavor they want to limit an asset to:

```yaml
assets:
  - assets/free/
    flavors:
      - freeMinApi21
      - freeMinApi23
```

This is mostly due to a technical limitation in the hot-reload feature of `flutter run`. During a hot reload, the tool will try to update the asset bundle on the device, but the tool does not know the flavors contained within the flavor combination (that the user passes to `--flavor`). Gradle is the source of truth of what flavors were involved in the build, and `flutter run` currently does not access to that information since it's an implementation detail of the build process. We could bubble up this information, but it would require a nontrivial amount of engineering work, and it's unclear how desired this functionality is. It might not be worth implementing.

</details>

See https://flutter.dev/go/flavor-specific-assets for the (outdated) design document. 

<summary>Pre-launch Checklist</summary>

</details>

[^1]: https://developer.android.com/build/build-variants#flavor-dimensions
2023-12-07 23:50:00 +00:00
..
abstract_method_smoke_test [Android] Bump template & integration test Gradle version to 7.6.4 (#139276) 2023-12-07 18:31:20 +00:00
android_custom_host_app [Android] Bump template & integration test Gradle version to 7.6.4 (#139276) 2023-12-07 18:31:20 +00:00
android_embedding_v2_smoke_test [Android] Bump template & integration test Gradle version to 7.6.4 (#139276) 2023-12-07 18:31:20 +00:00
android_host_app/.gradle Reland "Branch out android platform view perf testing #60238" 2nd time (#61748) 2020-07-22 18:36:11 -07:00
android_host_app_v2_embedding [Android] Bump template & integration test Gradle version to 7.6.4 (#139276) 2023-12-07 18:31:20 +00:00
android_module_host_with_custom_build_v2_embedding/app/src/main/java/io/flutter/addtoapp Fix package declarations for add-to-app integration tests (#77648) 2021-03-30 14:19:02 -07:00
android_semantics_testing [Android] Bump template & integration test Gradle version to 7.6.4 (#139276) 2023-12-07 18:31:20 +00:00
android_views [Android] Bump template & integration test Gradle version to 7.6.4 (#139276) 2023-12-07 18:31:20 +00:00
channels [Android] Bump template & integration test Gradle version to 7.6.4 (#139276) 2023-12-07 18:31:20 +00:00
deferred_components_test [Android] Bump template & integration test Gradle version to 7.6.4 (#139276) 2023-12-07 18:31:20 +00:00
external_ui [Android] Bump template & integration test Gradle version to 7.6.4 (#139276) 2023-12-07 18:31:20 +00:00
flavors Support conditional bundling of assets based on --flavor (#132985) 2023-12-07 23:50:00 +00:00
flutter_gallery [Android] Bump template & integration test Gradle version to 7.6.4 (#139276) 2023-12-07 18:31:20 +00:00
gradle_deprecated_settings [Android] Bump template & integration test Gradle version to 7.6.4 (#139276) 2023-12-07 18:31:20 +00:00
hybrid_android_views [Android] Bump template & integration test Gradle version to 7.6.4 (#139276) 2023-12-07 18:31:20 +00:00
ios_add2app_life_cycle Roll dependencies (#139606) 2023-12-06 19:22:06 +00:00
ios_app_with_extensions Roll dependencies (#139606) 2023-12-06 19:22:06 +00:00
ios_host_app Native assets support for MacOS and iOS (#130494) 2023-09-10 08:07:13 +00:00
ios_host_app_swift Set template and migrate apps to iOS 11 minimum (#101963) 2022-04-15 11:34:08 -07:00
ios_platform_view_tests Roll dependencies (#139606) 2023-12-06 19:22:06 +00:00
module_host_with_custom_build/.gradle Reland "Branch out android platform view perf testing #60238" 2nd time (#61748) 2020-07-22 18:36:11 -07:00
module_host_with_custom_build_v2_embedding [Android] Bump template & integration test Gradle version to 7.6.4 (#139276) 2023-12-07 18:31:20 +00:00
non_nullable [Android] Bump template & integration test Gradle version to 7.6.4 (#139276) 2023-12-07 18:31:20 +00:00
platform_interaction [Android] Bump template & integration test Gradle version to 7.6.4 (#139276) 2023-12-07 18:31:20 +00:00
release_smoke_test [Android] Bump template & integration test Gradle version to 7.6.4 (#139276) 2023-12-07 18:31:20 +00:00
spell_check Roll dependencies (#139606) 2023-12-06 19:22:06 +00:00
ui Roll dependencies (#139606) 2023-12-06 19:22:06 +00:00
web Pin package:web 0.4.0 (#138428) 2023-11-15 15:03:21 -08:00
web_compile_tests Pin package:web 0.4.0 (#138428) 2023-11-15 15:03:21 -08:00
web_e2e_tests Roll dependencies (#139606) 2023-12-06 19:22:06 +00:00
wide_gamut_test Roll dependencies (#139606) 2023-12-06 19:22:06 +00:00
windows_startup_test Roll dependencies (#139606) 2023-12-06 19:22:06 +00:00
README.md Added a more generous timeout period for the keyboard animation. (#62628) 2020-08-04 08:14:17 -07:00

Automated Flutter integration test suites

Each suite consists of either a complete Flutter app and a flutter_driver specification that drives tests from the UI, or a native app that is meant to integrate with Flutter for testing.

Intended for use with devicelab tests.

If you want to run a driver test locally, to debug a problem with a test, you can use this command from the appropriate subdirectory:

flutter drive -t <test> --driver <driver>

For example:

flutter drive -t lib/keyboard_resize.dart --driver test_driver/keyboard_resize_test.dart