Skip to content

Suppress flaky tests errors in AzDO UI #3930

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
paulmedynski wants to merge 5 commits into from
Closed

Suppress flaky tests errors in AzDO UI #3930

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
a900926
Task 42088: Suppress flaky tests errors in AzDO UI
paulmedynski Feb 3, 2026
47862b1
Task 42088: Suppress flaky tests errors in AzDO UI
paulmedynski Feb 3, 2026
aa2308b
Task 42088: Suppress flaky tests errors in AzDO UI
paulmedynski Feb 3, 2026
a7d0160
Addressed Copilot review comments.
paulmedynski Feb 3, 2026
92e0cc5
Missed Unix functional and manual flaky updates.
paulmedynski Feb 4, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
192 changes: 183 additions & 9 deletions build.proj
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -279,10 +279,10 @@
<!-- Run all tests applicable to the host OS. -->
<Target Name="RunTests" DependsOnTargets="RunUnitTests;RunFunctionalTests;RunManualTests"/>

<!-- Run all unit tests applicable to the host OS. -->
<!-- Run all (non-flaky) unit tests applicable to the host OS. -->
<Target Name="RunUnitTests" DependsOnTargets="RunUnitTestsWindows;RunUnitTestsUnix" Condition="$(ReferenceType.Contains('Project'))"/>

<!-- Run all unit tests applicable to Windows. -->
<!-- Run all (non-flaky) unit tests applicable to Windows. -->
<Target Name="RunUnitTestsWindows" Condition="'$(IsEnabledWindows)' == 'true' AND $(ReferenceType.Contains('Project'))">
<PropertyGroup>
<TestCommand>
Expand All @@ -304,7 +304,7 @@
<Exec ConsoleToMsBuild="true" Command="$(TestCommand)"/>
</Target>

<!-- Run all unit tests applicable to Unix. -->
<!-- Run all (non-flaky) unit tests applicable to Unix. -->
<Target Name="RunUnitTestsUnix" Condition="'$(IsEnabledWindows)' != 'true' AND $(ReferenceType.Contains('Project'))">
<PropertyGroup>
<TestCommand>
Expand All @@ -326,10 +326,68 @@
<Exec ConsoleToMsBuild="true" Command="$(TestCommand)"/>
</Target>

<!-- Run all Functional tests applicable to the host OS. -->
<!-- Run all flaky unit tests applicable to the host OS. -->
<Target Name="RunFlakyUnitTests" DependsOnTargets="RunFlakyUnitTestsWindows;RunFlakyUnitTestsUnix" Condition="$(ReferenceType.Contains('Project'))"/>

<!-- Run all flaky unit tests applicable to Windows. -->
<Target Name="RunFlakyUnitTestsWindows" Condition="'$(IsEnabledWindows)' == 'true' AND $(ReferenceType.Contains('Project'))">
<PropertyGroup>
<TestCommand>
$(DotnetPath)dotnet test "@(UnitTestsProj)"
-f $(TF)
-p:Configuration=$(Configuration)
$(CollectStatement)
--results-directory $(ResultsDirectory)
--filter "category = flaky"
--logger:"trx;LogFilePrefix=Unit-Windows$(TargetGroup)-$(TestSet)"
--blame-hang
--blame-hang-dump-type full
--blame-hang-timeout 10m
</TestCommand>
<!-- Convert more than one whitespace character into one space -->
<TestCommand>$([System.Text.RegularExpressions.Regex]::Replace($(TestCommand), "\s+", " "))</TestCommand>
</PropertyGroup>
<Message Text=">>> Running unit tests for Windows via command: $(TestCommand)"/>
<!--
We instruct MSBuild to ignore the exit code and output from the tests that matches
error/warning expressions. This avoids cluttering the Azure DevOps pipeline runs UI with
spurious errors.
-->
<Exec ConsoleToMsBuild="true"
IgnoreExitCode="true"
IgnoreStandardErrorWarningFormat="true"
Command="$(TestCommand)"/>
</Target>

<!-- Run all flaky unit tests applicable to Unix. -->
<Target Name="RunFlakyUnitTestsUnix" Condition="'$(IsEnabledWindows)' != 'true' AND $(ReferenceType.Contains('Project'))">
<PropertyGroup>
<TestCommand>
$(DotnetPath)dotnet test "@(UnitTestsProj)"
-f $(TF)
-p:Configuration=$(Configuration)
$(CollectStatement)
--results-directory $(ResultsDirectory)
--filter "category = flaky"
--logger:"trx;LogFilePrefix=Unit-Unixnetcoreapp-$(TestSet)"
--blame-hang
--blame-hang-dump-type full
--blame-hang-timeout 10m
</TestCommand>
<!-- Convert more than one whitespace character into one space -->
<TestCommand>$([System.Text.RegularExpressions.Regex]::Replace($(TestCommand), "\s+", " "))</TestCommand>
</PropertyGroup>
<Message Text=">>> Running unit tests for Unix via command: $(TestCommand)"/>
<Exec ConsoleToMsBuild="true"
IgnoreExitCode="true"
IgnoreStandardErrorWarningFormat="true"
Command="$(TestCommand)"/>
</Target>

<!-- Run all (non-flaky) Functional tests applicable to the host OS. -->
<Target Name="RunFunctionalTests" DependsOnTargets="RunFunctionalTestsWindows;RunFunctionalTestsUnix" />

<!-- Run all Functional tests applicable to Windows. -->
<!-- Run all (non-flaky) Functional tests applicable to Windows. -->
<Target Name="RunFunctionalTestsWindows" Condition="'$(IsEnabledWindows)' == 'true'">
<PropertyGroup>
<TestCommand>
Expand All @@ -352,7 +410,7 @@
<Exec ConsoleToMsBuild="true" Command="$(TestCommand)" />
</Target>

<!-- Run all Functional tests applicable to Unix. -->
<!-- Run all (non-flaky) Functional tests applicable to Unix. -->
<Target Name="RunFunctionalTestsUnix" Condition="'$(IsEnabledWindows)' != 'true'">
<PropertyGroup>
<TestCommand>
Expand All @@ -375,10 +433,65 @@
<Exec ConsoleToMsBuild="true" Command="$(TestCommand)" />
</Target>

<!-- Run all Manual tests applicable to the host OS. -->
<!-- Run all flaky Functional tests applicable to the host OS. -->
<Target Name="RunFlakyFunctionalTests" DependsOnTargets="RunFlakyFunctionalTestsWindows;RunFlakyFunctionalTestsUnix" />

<!-- Run all flaky Functional tests applicable to Windows. -->
<Target Name="RunFlakyFunctionalTestsWindows" Condition="'$(IsEnabledWindows)' == 'true'">
<PropertyGroup>
<TestCommand>
$(DotnetPath)dotnet test "@(FunctionalTestsProj)"
-f $(TF)
-p:Configuration=$(Configuration)
-p:ReferenceType=$(ReferenceType)
$(CollectStatement)
--results-directory $(ResultsDirectory)
--filter "category = flaky"
--logger:"trx;LogFilePrefix=Functional-Windows$(TargetGroup)-$(TestSet)"
--blame-hang
--blame-hang-dump-type full
--blame-hang-timeout 10m
</TestCommand>
<!-- Convert more than one whitespace character into one space -->
<TestCommand>$([System.Text.RegularExpressions.Regex]::Replace($(TestCommand), "\s+", " "))</TestCommand>
</PropertyGroup>
<Message Text=">>> Running Functional test for Windows via command: $(TestCommand)" />
<Exec ConsoleToMsBuild="true"
IgnoreExitCode="true"
IgnoreStandardErrorWarningFormat="true"
Command="$(TestCommand)"/>
</Target>

<!-- Run all flaky Functional tests applicable to Unix. -->
<Target Name="RunFlakyFunctionalTestsUnix" Condition="'$(IsEnabledWindows)' != 'true'">
<PropertyGroup>
<TestCommand>
$(DotnetPath)dotnet test "@(FunctionalTestsProj)"
-f $(TF)
-p:Configuration=$(Configuration)
-p:ReferenceType=$(ReferenceType)
$(CollectStatement)
--results-directory $(ResultsDirectory)
--filter "category = flaky"
--logger:"trx;LogFilePrefix=Functional-Unixnetcoreapp-$(TestSet)"
--blame-hang
--blame-hang-dump-type full
--blame-hang-timeout 10m
</TestCommand>
<!-- Convert more than one whitespace character into one space -->
<TestCommand>$([System.Text.RegularExpressions.Regex]::Replace($(TestCommand), "\s+", " "))</TestCommand>
</PropertyGroup>
<Message Text=">>> Running Functional test for Unix via command: $(TestCommand)" />
<Exec ConsoleToMsBuild="true"
IgnoreExitCode="true"
IgnoreStandardErrorWarningFormat="true"
Command="$(TestCommand)"/>
</Target>

<!-- Run all (non-flaky) Manual tests applicable to the host OS. -->
<Target Name="RunManualTests" DependsOnTargets="RunManualTestsWindows;RunManualTestsUnix" />

<!-- Run all Manual tests applicable to Windows. -->
<!-- Run all (non-flaky) Manual tests applicable to Windows. -->
<Target Name="RunManualTestsWindows" Condition="'$(IsEnabledWindows)' == 'true'">
<PropertyGroup>
<TestCommand>
Expand All @@ -401,10 +514,10 @@
<TestCommand>$(TestCommand.Replace($([System.Environment]::NewLine), " "))</TestCommand>
</PropertyGroup>
<Message Text=">>> Running Manual test for Windows via command: $(TestCommand)" />
<Exec ConsoleToMsBuild="true" Command="$(TestCommand)" />

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win22_Sql22_Named_Instance net8_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win22_Sql22 net8_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win22_Sql22 net8_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win22_Sql22 net8_0_AnyCPU_ManagedSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win22_Sql22 net8_0_AnyCPU_ManagedSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win11_ARM64_Azure_Sql net9_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net9.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp         --collect "Code coverage"         --results-directory TestResults         --filter "category!=failing&category!=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win22_Sql19 net8_0_AnyCPU_ManagedSNI_2)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Project         -p:TestSet=2         -p:TestTargetOS=Windowsnetcoreapp         --collect "Code coverage"         --results-directory TestResults         --filter "category!=failing&category!=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-2"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win22_Azure_Sql net8_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win22_Azure_Sql net8_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win22_Azure_Sql net8_0_AnyCPU_ManagedSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win22_Sql22 net8_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win22_Azure_Sql net462_AnyCPU_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetfxVersion=net462         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetfx                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetfx-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win22_Azure_Sql net462_AnyCPU_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetfxVersion=net462         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetfx                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetfx-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win22_Azure_Sql net9_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net9.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win22_Azure_Sql net9_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net9.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win22_Azure_Sql net9_0_AnyCPU_ManagedSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net9.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win22_Azure_Sql net9_0_AnyCPU_ManagedSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net9.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win22_Sql22_x86 net8_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         C:\x86\dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win22_Sql19 net8_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win22_Sql22_Named_Instance net9_0_AnyCPU_ManagedSNI_2)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net9.0         -p:ReferenceType=Package         -p:TestSet=2         -p:TestTargetOS=Windowsnetcoreapp         --collect "Code coverage"         --results-directory TestResults         --filter "category!=failing&category!=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-2"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win11_ARM64_Azure_Sql net8_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win11_ARM64_Azure_Sql net8_0_AnyCPU_ManagedSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp         --collect "Code coverage"         --results-directory TestResults         --filter "category!=failing&category!=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win22_Sql19 net9_0_AnyCPU_NativeSNI_2)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net9.0         -p:ReferenceType=Package         -p:TestSet=2         -p:TestTargetOS=Windowsnetcoreapp         --collect "Code coverage"         --results-directory TestResults         --filter "category!=failing&category!=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-2"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win22_Azure_Sql net462_AnyCPU_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetfxVersion=net462         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetfx                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetfx-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win22_Azure_Sql net462_AnyCPU_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetfxVersion=net462         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetfx                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetfx-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win22_Azure_Sql net9_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net9.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win22_Azure_Sql net9_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net9.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win22_Azure_Sql net8_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win22_Azure_Sql net8_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win22_Azure_Sql net9_0_AnyCPU_ManagedSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net9.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win22_Azure_Sql net8_0_AnyCPU_ManagedSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win11_Azure_Sql net9_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net9.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win11_Azure_Sql net9_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net9.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win11_Azure_Sql net462_AnyCPU_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetfxVersion=net462         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetfx                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetfx-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win11_Azure_Sql net8_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win11_Azure_Sql net9_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net9.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp         --collect "Code coverage"         --results-directory TestResults         --filter "category!=failing&category!=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win11_Azure_Sql net9_0_AnyCPU_ManagedSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net9.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project (Win11_Azure_Sql net8_0_AnyCPU_ManagedSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Project

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Project         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win11_Azure_Sql net8_0_AnyCPU_ManagedSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win11_Azure_Sql net8_0_AnyCPU_ManagedSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win11_Azure_Sql net8_0_AnyCPU_NativeSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win11_Azure_Sql net9_0_AnyCPU_ManagedSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net9.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win11_Azure_Sql net9_0_AnyCPU_ManagedSNI_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net9.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win11_Azure_Sql net462_AnyCPU_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetfxVersion=net462         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetfx                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetfx-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package (Win11_Azure_Sql net462_AnyCPU_3)

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetfxVersion=net462         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetfx                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetfx-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.

Check failure on line 517 in build.proj

View check run for this annotation

Azure Pipelines / PR-SqlClient-Package

build.proj#L517 

build.proj(517,5): Error MSB3073: The command "         dotnet test "src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj"         --no-build         -v n         -p:Configuration=Debug         -p:TargetnetcoreVersion=net8.0         -p:ReferenceType=Package         -p:TestSet=3         -p:TestTargetOS=Windowsnetcoreapp                  --results-directory TestResults         --filter "category=flaky"         --logger:"trx;LogFilePrefix=Manual-Windowsnetcoreapp-3"         --blame-hang         --blame-hang-dump-type full         --blame-hang-timeout 10m       " exited with code 1.
</Target>

<!-- Run all Manual tests applicable to Unix. -->
<!-- Run all (non-flaky) Manual tests applicable to Unix. -->
<Target Name="RunManualTestsUnix" Condition="'$(IsEnabledWindows)' != 'true'">
<PropertyGroup>
<TestCommand>
Expand All @@ -430,6 +543,67 @@
<Exec ConsoleToMsBuild="true" Command="$(TestCommand)" />
</Target>

<!-- Run all flaky Manual tests applicable to the host OS. -->
<Target Name="RunFlakyManualTests" DependsOnTargets="RunFlakyManualTestsWindows;RunFlakyManualTestsUnix" />

<!-- Run all flaky Manual tests applicable to Windows. -->
<Target Name="RunFlakyManualTestsWindows" Condition="'$(IsEnabledWindows)' == 'true'">
<PropertyGroup>
<TestCommand>
$(DotnetPath)dotnet test "@(ManualTestsProj)"
--no-build
-v n
-p:Configuration=$(Configuration)
-p:Target$(TFGroup)Version=$(TF)
-p:ReferenceType=$(ReferenceType)
-p:TestSet=$(TestSet)
-p:TestTargetOS=Windows$(TargetGroup)
$(CollectStatement)
--results-directory $(ResultsDirectory)
--filter "category = flaky"
--logger:"trx;LogFilePrefix=Manual-Windows$(TargetGroup)-$(TestSet)"
--blame-hang
--blame-hang-dump-type full
--blame-hang-timeout 10m
</TestCommand>
<TestCommand>$(TestCommand.Replace($([System.Environment]::NewLine), " "))</TestCommand>
</PropertyGroup>
<Message Text=">>> Running Manual test for Windows via command: $(TestCommand)" />
<Exec ConsoleToMsBuild="true"
IgnoreExitCode="true"
IgnoreStandardErrorWarningFormat="true"
Command="$(TestCommand)"/>
</Target>

<!-- Run all flaky Manual tests applicable to Unix. -->
<Target Name="RunFlakyManualTestsUnix" Condition="'$(IsEnabledWindows)' != 'true'">
<PropertyGroup>
<TestCommand>
$(DotnetPath)dotnet test "@(ManualTestsProj)"
--no-build
-v n
-p:Configuration=$(Configuration)
-p:TargetNetCoreVersion=$(TF)
-p:ReferenceType=$(ReferenceType)
-p:TestSet=$(TestSet)
-p:TestTargetOS=Unixnetcoreapp
$(CollectStatement)
--results-directory $(ResultsDirectory)
--filter "category = flaky"
--logger:"trx;LogFilePrefix=Manual-Unixnetcoreapp-$(TestSet)"
--blame-hang
--blame-hang-dump-type full
--blame-hang-timeout 10m
</TestCommand>
<TestCommand>$(TestCommand.Replace($([System.Environment]::NewLine), " "))</TestCommand>
</PropertyGroup>
<Message Text=">>> Running Manual test for Unix via command: $(TestCommand)" />
<Exec ConsoleToMsBuild="true"
IgnoreExitCode="true"
IgnoreStandardErrorWarningFormat="true"
Command="$(TestCommand)"/>
</Target>

<!-- Clean all build outputs. -->
<Target Name="Clean">
<RemoveDir Directories='$([System.IO.Directory]::GetDirectories(".", "artifacts", SearchOption.AllDirectories))' />
Expand Down
9 changes: 6 additions & 3 deletions eng/pipelines/common/templates/jobs/run-tests-package-reference-job.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,9 @@
# The .NET Foundation licenses this file to you under the MIT license. #
# See the LICENSE file in the project root for more information. #
#################################################################################

# This template is part of the MDS Official pipeline.

parameters:
- name: downloadPackageStep
type: step
Expand Down Expand Up @@ -35,20 +38,20 @@ jobs:
isCustom: true
name: ADO-1ES-Pool
vmImage: 'ADO-MMS22-SQL19'

variables: # More settings at https://aka.ms/obpipelines/yaml/jobs
- template: /eng/pipelines/libraries/mds-validation-variables.yml@self

steps:
- template: /eng/pipelines/common/templates/steps/pre-build-step.yml

- ${{parameters.downloadPackageStep }}

- pwsh: Copy-Item -Path "$(Build.SourcesDirectory)/NuGet.config.local" -Destination "$(Build.SourcesDirectory)/NuGet.config" -Force
displayName: Use local NuGet packages

- template: /eng/pipelines/common/templates/steps/update-config-file-step.yml
parameters:
parameters:
TCPConnectionString: $(SQL_TCP_CONN_STRING)
NPConnectionString: $(SQL_NP_CONN_STRING)
SupportsIntegratedSecurity: false
Expand Down
47 changes: 3 additions & 44 deletions eng/pipelines/common/templates/steps/build-and-run-tests-netcore-step.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,9 @@
# The .NET Foundation licenses this file to you under the MIT license. #
# See the LICENSE file in the project root for more information. #
#################################################################################

# This template is part of the MDS Official pipeline.

parameters:
- name: TargetNetCoreVersion
type: string
Expand Down Expand Up @@ -86,27 +89,6 @@ steps:
--blame-hang-dump-type full
--blame-hang-timeout 10m

- task: DotNetCoreCLI@2
Copy link
Contributor Author

@paulmedynski paulmedynski Feb 3, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Official builds don't need to be running flaky tests. We currently don't run any tests in the official MDS builds anyway (an issue we should probably fix).

displayName: 'Run Flaky Functional Tests for ${{parameters.TargetNetCoreVersion }}'
condition: succeededOrFailed()
inputs:
command: test
projects: 'src\Microsoft.Data.SqlClient\tests\FunctionalTests\Microsoft.Data.SqlClient.FunctionalTests.csproj'
arguments: >-
-p:Platform=${{ parameters.platform }}
-p:TestTargetOS=${{ parameters.TestTargetOS }}
-p:TargetNetCoreVersion=${{ parameters.TargetNetCoreVersion }}
-p:ReferenceType=${{ parameters.referenceType }}
-p:Configuration=${{ parameters.buildConfiguration }}
-p:MdsPackageVersion=${{ parameters.mdsPackageVersion }}
--no-build
-v n
--filter "category=flaky"
--blame-hang
--blame-hang-dump-type full
--blame-hang-timeout 10m
continueOnError: true

- task: DotNetCoreCLI@2
displayName: 'Run Manual Tests for ${{parameters.TargetNetCoreVersion }}'
condition: succeededOrFailed()
Expand All @@ -128,26 +110,3 @@ steps:
--blame-hang-dump-type full
--blame-hang-timeout 10m
retryCountOnTaskFailure: ${{parameters.retryCountOnManualTests }}

- task: DotNetCoreCLI@2
displayName: 'Run Flaky Manual Tests for ${{parameters.TargetNetCoreVersion }}'
condition: succeededOrFailed()
inputs:
command: test
projects: 'src\Microsoft.Data.SqlClient\tests\ManualTests\Microsoft.Data.SqlClient.ManualTesting.Tests.csproj'
arguments: >-
-p:Platform=${{ parameters.platform }}
-p:TestTargetOS=${{ parameters.TestTargetOS }}
-p:TargetNetCoreVersion=${{ parameters.TargetNetCoreVersion }}
-p:ReferenceType=${{ parameters.referenceType }}
-p:Configuration=${{ parameters.buildConfiguration }}
-p:MdsPackageVersion=${{ parameters.mdsPackageVersion }}
--no-build
-v n
--filter "category=flaky"
--collect "Code Coverage"
--blame-hang
--blame-hang-dump-type full
--blame-hang-timeout 10m
retryCountOnTaskFailure: ${{parameters.retryCountOnManualTests }}
continueOnError: true
Loading
Loading