I'm using a 12-core AMD. I am guessing/hoping that it's just that something pathological is going on with partitioning of the EditorFeatures and Semantic tests.
Microsoft.CommonLanguageServerProtocol.Framework.UnitTests_45 PASSED 00:00:11.2565931
Microsoft.CodeAnalysis.VisualBasic.Scripting.Desktop.UnitTests_37 PASSED 00:00:18.6123253
Microsoft.CodeAnalysis.VisualBasic.Workspaces.UnitTests_42 PASSED 00:00:20.8450232
Microsoft.VisualStudio.LanguageServices.LiveShare.UnitTests_47 PASSED 00:00:21.2936126
Microsoft.CodeAnalysis.VisualBasic.Scripting.UnitTests_38 PASSED 00:00:27.2351635
Microsoft.CodeAnalysis.CSharp.EndToEnd.UnitTests_7 PASSED 00:00:50.3013618
Microsoft.Build.Tasks.CodeAnalysis.UnitTests_0 PASSED 00:00:52.5660889
Microsoft.CodeAnalysis.VisualBasic.ExpressionEvaluator.ResultProvider.UnitTests_36 PASSED 00:01:08.3307018
Roslyn.VisualStudio.Next.UnitTests_50 PASSED 00:01:44.7481710
Microsoft.CodeAnalysis.CSharp.ExpressionEvaluator.ResultProvider.UnitTests_10 PASSED 00:01:48.4419319
Microsoft.CodeAnalysis.CSharp.IOperation.UnitTests_9 PASSED 00:01:52.6506406
VBCSCompiler.UnitTests_51 PASSED 00:02:04.1634139
Microsoft.CodeAnalysis.VisualBasic.Syntax.UnitTests_41 PASSED 00:02:16.3590613
Microsoft.CodeAnalysis.CSharp.ExpressionEvaluator.ExpressionCompiler.UnitTests_8 PASSED 00:02:17.4384099
Microsoft.CodeAnalysis.CSharp.CommandLine.UnitTests_2 PASSED 00:02:20.2933692
Roslyn.Compilers.VisualBasic.IOperation.UnitTests_49 PASSED 00:02:31.8388570
Microsoft.CodeAnalysis.Workspaces.UnitTests_44 PASSED 00:03:08.3557131
Microsoft.CodeAnalysis.Workspaces.MSBuild.UnitTests_43 FAILED 00:03:12.1567084
Microsoft.CodeAnalysis.CSharp.Scripting.Desktop.UnitTests_11 FAILED 00:03:56.8431415
Microsoft.CodeAnalysis.VisualBasic.ExpressionEvaluator.ExpressionCompiler.UnitTests_35 PASSED 00:04:23.2476633
Microsoft.CodeAnalysis.CSharp.Scripting.UnitTests_12 PASSED 00:05:06.7500866
Microsoft.CodeAnalysis.CSharp.Syntax.UnitTests_15 PASSED 00:05:11.8625854
Microsoft.CodeAnalysis.CSharp.WinRT.UnitTests_16 PASSED 00:05:12.8594736
Microsoft.CodeAnalysis.CSharp.Workspaces.UnitTests_17 PASSED 00:05:14.5190731
Microsoft.CodeAnalysis.EditorFeatures.UnitTests_18 PASSED 00:05:16.6034913
Microsoft.CodeAnalysis.ExternalAccess.FSharp.UnitTests_20 PASSED 00:05:16.8722090
Microsoft.CodeAnalysis.ExternalAccess.OmniSharp.UnitTests_21 PASSED 00:05:17.6866693
Microsoft.CodeAnalysis.ExternalAccess.Razor.UnitTests_22 PASSED 00:05:18.5347725
Microsoft.CodeAnalysis.ExternalAccess.RazorCompiler.UnitTests_23 PASSED 00:05:19.1747348
Microsoft.CodeAnalysis.ExpressionEvaluator.FunctionResolver.UnitTests_24 PASSED 00:05:20.4666350
Microsoft.CodeAnalysis.LanguageServer.Protocol.UnitTests_25 PASSED 00:05:21.5724389
Microsoft.CodeAnalysis.LanguageServerIndexFormat.Generator.UnitTests_26 PASSED 00:05:22.5717388
Microsoft.CodeAnalysis.Rebuild.UnitTests_27 PASSED 00:05:23.9947018
Microsoft.CodeAnalysis.Scripting.Desktop.UnitTests_28 PASSED 00:05:25.0290426
Microsoft.CodeAnalysis.Scripting.UnitTests_29 PASSED 00:05:25.7525933
Microsoft.CodeAnalysis.VisualBasic.CodeStyle.UnitTests_31 PASSED 00:05:27.2810698
Microsoft.CodeAnalysis.VisualBasic.CommandLine.UnitTests_32 PASSED 00:05:27.7149825
Microsoft.VisualStudio.LanguageServices.UnitTests_48 PASSED 00:05:44.3086586
Microsoft.CodeAnalysis.CSharp.EditorFeatures2.UnitTests_4 PASSED 00:07:42.2951576
Microsoft.CodeAnalysis.UnitTests_30 PASSED 00:07:57.2283684
Microsoft.CodeAnalysis.VisualBasic.Semantic.UnitTests_39 FAILED 00:08:00.4458204
Microsoft.VisualStudio.LanguageServices.CSharp.UnitTests_46 PASSED 00:08:31.6574814
Microsoft.CodeAnalysis.VisualBasic.Symbol.UnitTests_40 PASSED 00:09:43.8752524
Microsoft.CodeAnalysis.VisualBasic.Emit.UnitTests_34 PASSED 00:10:20.8347463
Microsoft.CodeAnalysis.VisualBasic.EditorFeatures.UnitTests_33 PASSED 00:12:49.0165478
Microsoft.CodeAnalysis.CSharp.Emit2.UnitTests_6 PASSED 00:12:56.6826522
Microsoft.CodeAnalysis.CSharp.CodeStyle.UnitTests_1 PASSED 00:14:15.8714810
Microsoft.CodeAnalysis.CSharp.Emit.UnitTests_5 PASSED 00:14:24.8575071
Microsoft.CodeAnalysis.EditorFeatures2.UnitTests_19 PASSED 00:15:51.2910029
Microsoft.CodeAnalysis.CSharp.Symbol.UnitTests_14 PASSED 00:19:15.7618353
Microsoft.CodeAnalysis.CSharp.Semantic.UnitTests_13 PASSED 00:25:17.1770459
Microsoft.CodeAnalysis.CSharp.EditorFeatures.UnitTests_3 PASSED 00:35:32.7607774
I've also been getting a number of local failures that I've been treating as "meaningless", probably because the runtime in use in local runs is different than the one in CI.
Errors Microsoft.CodeAnalysis.Workspaces.MSBuild.UnitTests_43
[xUnit.net 00:00:20.98] Microsoft.CodeAnalysis.MSBuild.UnitTests.VisualStudioMSBuildWorkspaceTests.TestOpenProject_UpdateExistingReferences [FAIL]
[xUnit.net 00:00:24.58] Microsoft.CodeAnalysis.MSBuild.UnitTests.VisualStudioMSBuildWorkspaceTests.TestOpenProject_WithUnrecognizedProjectReferenceFileExtension_WithMetadata_SkipFalse_SucceedsByLoadingMetadata [FAIL]
[xUnit.net 00:02:09.28] Microsoft.CodeAnalysis.MSBuild.UnitTests.VisualStudioMSBuildWorkspaceTests.TestOpenProject_WithUnrecognizedProjectReferenceFileExtension_WithMetadata_SkipTrue_SucceedsByLoadingMetadata [FAIL]
[xUnit.net 00:02:32.06] Microsoft.CodeAnalysis.MSBuild.UnitTests.VisualStudioMSBuildWorkspaceTests.TestOpenProject_WithReferencedProject_LoadMetadata_ExistingMetadata_Succeeds [FAIL]
Command: exec "C:\Program Files\dotnet\sdk\8.0.100-preview.1.23115.2\vstest.console.dll" @"C:\Users\rikki\src\roslyn\artifacts\tmp\Debug\vstest-rsp\vstest_43.rsp"
xUnit output log: C:\Users\rikki\src\roslyn\artifacts\log\Debug\xUnitFailure-Microsoft.CodeAnalysis.Workspaces.MSBuild.UnitTests_43.log
[xUnit.net 00:00:20.98] Microsoft.CodeAnalysis.MSBuild.UnitTests.VisualStudioMSBuildWorkspaceTests.TestOpenProject_UpdateExistingReferences [FAIL]
[xUnit.net 00:00:24.58] Microsoft.CodeAnalysis.MSBuild.UnitTests.VisualStudioMSBuildWorkspaceTests.TestOpenProject_WithUnrecognizedProjectReferenceFileExtension_WithMetadata_SkipFalse_SucceedsByLoadingMetadata [FAIL]
[xUnit.net 00:02:09.28] Microsoft.CodeAnalysis.MSBuild.UnitTests.VisualStudioMSBuildWorkspaceTests.TestOpenProject_WithUnrecognizedProjectReferenceFileExtension_WithMetadata_SkipTrue_SucceedsByLoadingMetadata [FAIL]
[xUnit.net 00:02:32.06] Microsoft.CodeAnalysis.MSBuild.UnitTests.VisualStudioMSBuildWorkspaceTests.TestOpenProject_WithReferencedProject_LoadMetadata_ExistingMetadata_Succeeds [FAIL]
Errors Microsoft.CodeAnalysis.CSharp.Scripting.Desktop.UnitTests_11
[xUnit.net 00:00:45.61] Microsoft.CodeAnalysis.CSharp.Scripting.Test.InteractiveSessionReferencesTests.References_Versioning_FxUnification2 [FAIL]
[xUnit.net 00:00:51.91] Microsoft.CodeAnalysis.CSharp.Scripting.Test.InteractiveSessionReferencesTests.References_Versioning_FxUnification1 [FAIL]
Command: exec "C:\Program Files\dotnet\sdk\8.0.100-preview.1.23115.2\vstest.console.dll" @"C:\Users\rikki\src\roslyn\artifacts\tmp\Debug\vstest-rsp\vstest_11.rsp"
xUnit output log: C:\Users\rikki\src\roslyn\artifacts\log\Debug\xUnitFailure-Microsoft.CodeAnalysis.CSharp.Scripting.Desktop.UnitTests_11.log
[xUnit.net 00:00:45.61] Microsoft.CodeAnalysis.CSharp.Scripting.Test.InteractiveSessionReferencesTests.References_Versioning_FxUnification2 [FAIL]
[xUnit.net 00:00:51.91] Microsoft.CodeAnalysis.CSharp.Scripting.Test.InteractiveSessionReferencesTests.References_Versioning_FxUnification1 [FAIL]
Errors Microsoft.CodeAnalysis.VisualBasic.Semantic.UnitTests_39
[xUnit.net 00:07:48.11] Microsoft.CodeAnalysis.VisualBasic.UnitTests.Semantics.BinaryOperators.Test5 [FAIL]
[xUnit.net 00:07:52.10] Microsoft.CodeAnalysis.VisualBasic.UnitTests.Semantics.BinaryOperators.Test1 [FAIL]
Command: exec "C:\Program Files\dotnet\sdk\8.0.100-preview.1.23115.2\vstest.console.dll" @"C:\Users\rikki\src\roslyn\artifacts\tmp\Debug\vstest-rsp\vstest_39.rsp"
xUnit output log: C:\Users\rikki\src\roslyn\artifacts\log\Debug\xUnitFailure-Microsoft.CodeAnalysis.VisualBasic.Semantic.UnitTests_39.log
[xUnit.net 00:07:48.11] Microsoft.CodeAnalysis.VisualBasic.UnitTests.Semantics.BinaryOperators.Test5 [FAIL]
[xUnit.net 00:07:52.10] Microsoft.CodeAnalysis.VisualBasic.UnitTests.Semantics.BinaryOperators.Test1 [FAIL]
Also, it's somewhat difficult to understand the meaning of failed work items as the parallel test run is going, because of the opaque names of the results files. It seems like the "friendly name" of these work items still exists elsewhere, e.g. when the times are written out.
36 running, 3 queued, 13 completed
C:\Users\rikki\src\roslyn\artifacts\TestResults\Debug\WorkItem_43_x64_test_results.html
36 running, 2 queued, 14 completed, 1 failures
36 running, 1 queued, 15 completed, 1 failures
36 running, 0 queued, 16 completed, 1 failures
C:\Users\rikki\src\roslyn\artifacts\TestResults\Debug\WorkItem_11_x64_test_results.html
35 running, 0 queued, 17 completed, 2 failures
I'm using a 12-core AMD. I am guessing/hoping that it's just that something pathological is going on with partitioning of the EditorFeatures and Semantic tests.
I've also been getting a number of local failures that I've been treating as "meaningless", probably because the runtime in use in local runs is different than the one in CI.
Also, it's somewhat difficult to understand the meaning of failed work items as the parallel test run is going, because of the opaque names of the results files. It seems like the "friendly name" of these work items still exists elsewhere, e.g. when the times are written out.