# Test Expectations File. # # Format: # crbug.com/<###> [ [Tags] ] TestName [Expectations] # # Tag Matching Semantics: # - OS and Device tags use ANY (OR) matching semantics: If an expectation # specifies multiple OS tags (e.g., [ iOS17 iOS18 ]) or multiple device tags # (e.g., [ iPhone iPad ]), matching ANY tag within that category satisfies the # category requirement. # - Other tags use ALL (AND) matching semantics: EVERY tag belonging to the # "Other" category (e.g., [ Simulator Debug ASan ]) present in the expectation # must be active for the expectation to apply. # # Supported Tags (case-insensitive): # - OS Version (supports hierarchical and partial version strings): # - Major version: e.g., iOS18, iOS26 # - Major.Minor version: e.g., iOS18.1 # - Full version: e.g., iOS18.1.2 # - Build number: e.g., build-24A5355p (prefixed with 'build-') # # - Device Family and Model (supports hierarchical and partial model strings): # - Family: iPhone, iPad # - Model prefix (without revision suffix): e.g., iPhone16, iPad14 # - Exact hardware model: e.g., iPhone16,1, iPad14,3 # # - Other Supported Tags: # - Environment: Simulator, Device # - Build configuration: Debug, Release # - Sanitizer: ASan # - Platform: Catalyst # # Expectations: Failure, Pass, Skip, Crash # (Multiple expectations can be combined, e.g., [ Pass Failure ] denotes a flaky # test that sometimes passes and sometimes fails.) # # Examples: # crbug.com/123456 [ iOS26 Simulator Debug ] MyTestCase/testAppStoreSearch [ Failure ] # -> Expects MyTestCase/testAppStoreSearch to fail every time on debug builds on an iOS26 # Simulator. # crbug.com/789101 [ iOS17 iOS18 iPhone ] FlakyTestCase [ Pass Failure ] # -> Expects FlakyTestCase to pass or fail (but never crash) on iPhone devices and # simulators running iOS versions 17 or 18. # crbug.com/234567 [ iPhone16,1 ASan ] CrashingTestCase/testMethod [ Crash ] # -> Expects CrashingTestCase/testMethod to crash every time on ASAN builds running on # iPhone16,1 (iPhone 15 Pro) devices and simulators. # # Smoke test to verify expectations functionality. Do not remove. crbug.com/523267238 SmokeTestCase/testFailingMethod [ Failure ] crbug.com/523267238 SmokeTestCase/testCrashingMethod [ Crash ] crbug.com/523267238 SmokeTestCase/testFlakyFailureMethod [ Pass Failure ] crbug.com/523267238 SmokeTestCase/testFlakyCrashMethod [ Pass Crash ] crbug.com/523267238 SmokeTestCase/testFlakyPassingMethod [ Pass Failure ] crbug.com/523267238 SmokeTestCase/testFlakyCrashPassingMethod [ Pass Crash ] # Gardening surpression 2026-07-09 crbug.com/533057223 [ iPad Simulator ] SigninCoordinatorTestCase/testSyncOnWhenPassphraseIntroducedAfterSignIn [ Pass Failure ] crbug.com/533075931 [ iPad Simulator ] GeminiCopresenceTestCase/testConversationPersistenceOnSignOut [ Pass Failure ] # Gardening suppression 2026-07-24 crbug.com/536840723 [ iPad Simulator ] TabGridTestCase/testEmptyStateAfterNoResultsSearchForIncognitoTabGrid [ Pass Failure ] # Gardening suppression 2026-07-30 crbug.com/540811503 DeeplinkSigninTestCase/testCrossDeviceSigninSignedInTargetAccountNotOnDevice [Pass Failure] crbug.com/540829196 DeeplinkSigninTestCase/testCrossDeviceSigninSignedInTargetAccountOnDevice [Failure] crbug.com/540481922 [iOS18 iPhone] SnapshotTestCase/testSnapshotWithScrollDown [Pass Failure] # Multi-window iPad iOS 27 issues crbug.com/508127830 [ iOS27 Device ] MultitaskingWindowTestCase/testResizeToCompactAndReturnToFullscreen [ Pass Failure ] crbug.com/508127830 [ iOS27 Device ] MultitaskingWindowTestCase/testStatusBarTapToWindowedModeAndMultipleResizes [ Pass Failure ] crbug.com/508127830 [ iOS27 Device ] MultitaskingWindowTestCase/testStatusBarTapToWindowedModeAndResize [ Pass Failure ] crbug.com/508127830 [ iOS27 Device ] MultitaskingWindowTestCase/testStatusBarTapToWindowedModeAndReturnToFullscreen [ Pass Failure ] crbug.com/508127830 [ iOS27 Device ] SearchEngineTestCase/testOpenSecondWindow [ Pass Failure ] crbug.com/508127830 [ iOS27 Device ] AssistantSidePanelTestCase/testMultitaskingTransitionBetweenSheetAndSidePanel [ Pass Failure ] # Gardening suppression 2026-07-31 crbug.com/541234788 [ iPhone Simulator ] SaveToDriveTestCase/testDownloadToDriveAppUninstalledUpdatesButton [ Pass Failure ] crbug.com/541234336 CardUnmaskAuthenticationSelectionEgtest/testDismissInputViaSwipe [ Pass Failure ] crbug.com/541236854 ComposeboxTestCase/testAttachUnrealizedTab [ Pass Failure ] crbug.com/541236775 OmniboxHardwareKeyboardInteractionTestCase/testHardwareLeftRightArrowKey [ Pass Failure ] crbug.com/541290681 SafariDataImportTestCase/testPasswordConflictResolution [ Pass Failure ] # Gardening suppression 2026-08-06 crbug.com/543490495 GeminiCopresenceTestCase/testFloatyHiddenOnNTPAndTabGrid [ Failure ] # Gardening suppression 2026-08-11 crbug.com/545123760 [ iPad Simulator ] TabGroupsTestCase/testReopenGroupFromAnotherWindow [ Pass Failure ] crbug.com/545122908 [ iPad Simulator ] MailtoHandlerTestCase/testDefaultAppsInMultiWindow [ Pass Failure ] # Gardening suppression 2026-08-12 crbug.com/437843552 [ Simulator ] HistorySystemEGTest/testSearchSyncedHistory [ Pass Failure ] crbug.com/545634498 [ iPad Device ] HistorySystemEGTest/testSearchSyncedHistory [ Pass Failure ] crbug.com/545633687 [ Simulator ] TabGroupsEGTest/testReopenGroupFromAnotherWindow [ Pass Failure ] crbug.com/545633687 [ iPad Device ] TabGroupsEGTest/testReopenGroupFromAnotherWindow [ Pass Failure ] # Gardening suppression 2026-08-20 crbug.com/549761710 InternalDiscoverFeedTestCase/testFeedAblationHidesFeed [ Pass Failure ] # Gardening suppression 2026-08-21 crbug.com/550305483 [ iPad Device ] TabStripSharedGroupTestCase/testTabStripSharedGroupDeleteSharedGroup [ Pass Failure ] crbug.com/550305489 [ iPad Device ] TabStripSharedGroupTestCase/testTabStripSharedGroupLeaveSharedGroup [ Pass Failure ] # Gardening suppression 2026-08-24 crbug.com/552121965 [ iOS26.5 iPad ] ChildWindowOpenByDOMTestCase/testWindowClosedWithoutName [ Failure ] # Gardening suppression 2026-08-26 crbug.com/552774721 GeminiEGTest/testAcceptPromoAndConsent [ Pass Failure ] crbug.com/552774721 GeminiEGTest/testAcceptPromoDeclineConsent [ Pass Failure ] crbug.com/552978116 GeminiPageContextWithMigrationTestCase/testPageSharingDisabledThenEnabledInFloaty [ Pass Failure ] crbug.com/552978116 GeminiPageContextWithoutMigrationTestCase/testPageSharingDisabledThenEnabledInFloaty [ Pass Failure ]