Skip to content

[Known Build Error] iOS UITest screenshot baseline mismatches after ACES pool migration #33879

@PureWeen

Description

@PureWeen

Build Information

Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=1276073
Leg Name: iOS UITests Mono (v18.4)

Description

iOS screenshot-based UITests are failing after the migration to ACES agent pools (PR #33790). The new macOS 26 (Tahoe) environment renders slightly differently than the previous macOS 15 (Sequoia), causing screenshot comparison failures.

Root Cause: PR #33790 switched CI from MAUI pool to AcesShared pool with different macOS version.

Partially Fixed: PR #33910 updated baselines and added cropBottom/Assert.Ignore for the original 14 tests. The 4 tests below were not covered by that PR and are still failing.

Affected Tests

  • ContentPage_Title_WithBackgroundColor
  • VerifyClearButtonVisiblityWhenTextAlignedVertically
  • VerifyClearButtonVisiblityWhenTextPresentOrEmpty
  • VerifyClearVisiblityButtonWhenTextColorChanged

Error Message

{
  "ErrorPattern": "Snapshot different than baseline: (ContentPage_Title_WithBackgroundColor|VerifyClearButtonVisiblityWhenTextAlignedVertically|VerifyClearButtonVisiblityWhenTextPresentOrEmpty|VerifyClearVisiblityButtonWhenTextColorChanged)\\.png",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=1276073
Error message validated: [Snapshot different than baseline: (ContentPage_Title_WithBackgroundColor|VerifyClearButtonVisiblityWhenTextAlignedVertically|VerifyClearButtonVisiblityWhenTextPresentOrEmpty|VerifyClearVisiblityButtonWhenTextColorChanged)\.png]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 2/9/2026 9:25:22 PM UTC

Report

Build Definition Step Name Console log Pull Request
2930647 dotnet-maui Controls (API 30) Entry Log
Build Definition Test Pull Request
1354762 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
1339869 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor #34455
1333377 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(Windows).VerifyClearVisiblityButtonWhenTextColorChanged #34455
1332507 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(Windows).ContentPage_Title_WithBackgroundColor #34455

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 1 5

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions