When you submit an App Center Test with Xamarin.UITest you can include an Android or an iOS application but not both. Sometimes the App Center Test report will show results for both platforms even though only one could possibly actually execute.

When Xamarin.UITests are run in the App Center the framework may execute for both platforms. But, it short-circuits in a known way (by throwing a special exception) when trying to run on the "wrong" platform. This "short-circuit" is very fast and happens without invoking any device interaction. We intercept that short-circuit and exclude those test results from the test report.

This all happens when you invoke the ConfigureApp statement which is typically in your NUnit [Setup] or AppInitializer code. If you prevent that ConfigureApp statement from being executed (maybe by skipping the statement for the "wrong" platform) or surround it with a try-catch block we will not see the special exception and will continue running the test which will probably fail very fast and include the results in the test report.

If you are having this issue, take a look at your ConfigureApp statements and make sure one is executed for each platform and that you are not hiding exceptions with a try-catch around it.