Enhance unit tests with timeout handling and stability improvements

[XuehaoSun]

Description

This pull request updates the test infrastructure across all pipeline scripts to improve reliability, consistency, and test diagnostics. The main changes include adding the pytest-timeout package, enforcing test timeouts and session limits, collecting test duration statistics, and standardizing the use of the COVERAGE_CORE=sysmon environment variable for all test runs.

Test Infrastructure Improvements

• Added pytest-timeout to all environments to enforce per-test and session timeouts, reducing the risk of hanging tests. [1] [2] [3] [4] [5]
• Updated all test commands to use COVERAGE_CORE=sysmon for consistent coverage collection and environment reporting. [1] [2] [3] [4]

Test Execution Enhancements

• Added --timeout, --session-timeout, --durations=0, and --durations-min=1 options to pytest calls to enforce time limits and collect test duration data, aiding in identifying slow tests. [1] [2] [3] [4]
• Applied these options consistently across CPU, CUDA, HPU, and XPU test scripts, including for integration and special test suites. [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11]

Test Coverage and Logging

• Ensured all test runs append coverage data and output logs in a consistent format, improving reporting and debugging. [1] [2] [3]
• Extended test orchestration to include integration and LLMC tests during nightly runs.

Directory and Path Corrections

• Fixed test discovery paths for incremental and LLMC unit tests to ensure correct test files are executed. [1] [2]

These updates make the test pipeline more robust, prevent hanging jobs, and provide better diagnostics for slow or problematic tests.

[AutoRoundBot]

/azp run Unit-Test-CUDA-AutoRound

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).