Skip to content

JENKINS-72538 - SKIP status configurable when calculating all tests#77

Merged
asimell merged 16 commits intomasterfrom
include-skip
Nov 13, 2024
Merged

JENKINS-72538 - SKIP status configurable when calculating all tests#77
asimell merged 16 commits intomasterfrom
include-skip

Conversation

@asimell
Copy link
Copy Markdown
Contributor

@asimell asimell commented Nov 13, 2024

  • Further deprecate the use of onlyCritical flag. It no longer does anything, but is still kept to keep existing pipelines alive.
  • Deprecate getCriticalPassed and getCriticalFailed functions. They will now just return overall passed/failed test cases.
  • Introduce a new flag countSkippedTests that either ignores skipped tests when calculating pass percentage (current behaviour) or takes them into account (new behaviour)
  • Deprecate several unit tests as they are testing test criticality parsing, which is no longer done.

* @throws IOException thrown exception
* @throws ServletException thrown exception
*/
public FormValidation doCheckUnstableThreshold(

Check warning

Code scanning / Jenkins Security Scan

Stapler: Missing POST/RequirePOST annotation

Potential CSRF vulnerability: If DescriptorImpl#doCheckUnstableThreshold connects to user-specified URLs, modifies state, or is expensive to run, it should be annotated with @POST or @RequirePOST
* @throws IOException thrown exception
* @throws ServletException thrown exception
*/
public FormValidation doCheckUnstableThreshold(

Check warning

Code scanning / Jenkins Security Scan

Stapler: Missing permission check

Potential missing permission check in DescriptorImpl#doCheckUnstableThreshold
* @throws IOException thrown exception
* @throws ServletException thrown exception
*/
public FormValidation doCheckPassThreshold(@QueryParameter String value)

Check warning

Code scanning / Jenkins Security Scan

Stapler: Missing POST/RequirePOST annotation

Potential CSRF vulnerability: If DescriptorImpl#doCheckPassThreshold connects to user-specified URLs, modifies state, or is expensive to run, it should be annotated with @POST or @RequirePOST
* @throws IOException thrown exception
* @throws ServletException thrown exception
*/
public FormValidation doCheckPassThreshold(@QueryParameter String value)

Check warning

Code scanning / Jenkins Security Scan

Stapler: Missing permission check

Potential missing permission check in DescriptorImpl#doCheckPassThreshold
Copy link
Copy Markdown
Member

@Tattoo Tattoo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add // TODO: remove test when criticality is removed to line 61

#robot-summary-table .fail {
color: #f00;
}
#robot-summary-table .pass {
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should we have yellow color here as well?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This class is only used for the font colour in the summary table. Of course we could add a yellow colour in the skipped column if any tests were skipped, but then again we could also take colouring off the table altogether?

asimell and others added 10 commits November 13, 2024 13:07
…properties

Co-authored-by: Tatu Kairi <280218+Tattoo@users.noreply.github.com>
Co-authored-by: Tatu Kairi <280218+Tattoo@users.noreply.github.com>
Co-authored-by: Tatu Kairi <280218+Tattoo@users.noreply.github.com>
…est.java

Co-authored-by: Tatu Kairi <280218+Tattoo@users.noreply.github.com>
…acroTest.java

Co-authored-by: Tatu Kairi <280218+Tattoo@users.noreply.github.com>
…okenMacroTest.java

Co-authored-by: Tatu Kairi <280218+Tattoo@users.noreply.github.com>
Co-authored-by: Tatu Kairi <280218+Tattoo@users.noreply.github.com>
…rties

Co-authored-by: Tatu Kairi <280218+Tattoo@users.noreply.github.com>
Copy link
Copy Markdown
Member

@Tattoo Tattoo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

one more addition to documentation

Co-authored-by: Tatu Kairi <280218+Tattoo@users.noreply.github.com>
@asimell asimell merged commit 0996b03 into master Nov 13, 2024
@asimell asimell deleted the include-skip branch November 13, 2024 13:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants