Skip to content

Fix test case skip reasoning#4361

Draft
kanchansenlaskar wants to merge 1 commit intomainfrom
kasenlaskar/fix_testskip_reasoning
Draft

Fix test case skip reasoning#4361
kanchansenlaskar wants to merge 1 commit intomainfrom
kasenlaskar/fix_testskip_reasoning

Conversation

@kanchansenlaskar
Copy link
Copy Markdown
Collaborator

Description

Related Issue

Type of Change

  • Bug fix
  • New feature
  • Breaking change
  • Refactoring
  • Documentation update

Checklist

  • Description is filled in above
  • No credentials, secrets, or internal details are included
  • Peer review requested (if not, add required peer reviewers after raising PR)
  • Tests executed and results posted below

Test Validation

Key Test Cases:

Impacted LISA Features:

Tested Azure Marketplace Images:

Test Results

Image VM Size Result
PASSED / FAILED / SKIPPED

Copilot AI review requested due to automatic review settings March 19, 2026 09:45
Copy link
Copy Markdown
Collaborator Author

@kanchansenlaskar kanchansenlaskar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@copilot list out all the test cases which are getting impacted and are worth testing for this change

Copy link
Copy Markdown
Contributor

Copilot AI commented Mar 19, 2026

@kanchansenlaskar I've opened a new pull request, #4362, to work on those changes. Once the pull request is ready, I'll request review from you.

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates Azure platform capability-selection error reporting so skipped tests can surface requirement-mismatch reasons (instead of a generic skip/quota message) when no candidate VM sizes satisfy the test requirements.

Changes:

  • Persist unmet requirement reasons during _get_meet_capabilities evaluation so they can be reused later for skip messaging.
  • Build a de-duplicated “Requirement mismatch” error string from collected reasons when VM selection fails.
  • Replace the prior generic “no available quota found” message with a more detailed (or fallback) skip reason.

You can also share your feedback on Copilot code review. Take the survey.

Comment on lines +2732 to +2736
else:
# Collect unique reasons from the first failing candidate to
# surface a meaningful skip message instead of a generic one.
if not unmet_reasons:
unmet_reasons.extend(check_result.reasons)
Comment on lines +2847 to +2851
error = (
f"Test skipped on '{location}' for an unknown reason. "
"This could be due to insufficient quota, unmet hardware "
"requirements, or other undiagnosed causes. "
"Manual investigation may be required."
Copy link
Copy Markdown
Collaborator Author

@kanchansenlaskar kanchansenlaskar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@copilot list out all the test cases which are getting impacted and are worth testing for this change

Copy link
Copy Markdown
Contributor

Copilot AI commented Mar 19, 2026

@kanchansenlaskar I've opened a new pull request, #4363, to work on those changes. Once the pull request is ready, I'll request review from you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants