Skip to content

Bootstrap job for zapper-enabled test plan (New)#1352

Merged
p-gentili merged 3 commits into
mainfrom
reset-zap-env
Jul 25, 2024
Merged

Bootstrap job for zapper-enabled test plan (New)#1352
p-gentili merged 3 commits into
mainfrom
reset-zap-env

Conversation

@p-gentili
Copy link
Copy Markdown
Collaborator

@p-gentili p-gentili commented Jul 22, 2024

Description

When a device is hooked up with a Zapper, depending on the previous conditions of the setup, its presence might affect the other test cases, like seen in https://github.com/canonical/checkbox/issues/1326.

This PR introduces a new bootstrap job, to clear Zapper-related environment before running the actual test plan.

It assumes that the Zapper setup is correctly configured, via zapper setup, since it will unplug USB sticks if not configured for provisioning.

Resolved issues

Resolves CHECKBOX-1481 and https://github.com/canonical/checkbox/issues/1326.

Documentation

N/A

Tests

See #1352 (comment).

@p-gentili p-gentili changed the title New: bootstrap job for zapper-enabled test plan Bootstrap job for zapper-enabled test plan (New) Jul 22, 2024
@codecov
Copy link
Copy Markdown

codecov Bot commented Jul 22, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 44.20%. Comparing base (9409c50) to head (4641c72).
Report is 146 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1352      +/-   ##
==========================================
+ Coverage   44.18%   44.20%   +0.02%     
==========================================
  Files         359      359              
  Lines       38813    38827      +14     
  Branches     6581     6585       +4     
==========================================
+ Hits        17148    17162      +14     
+ Misses      21003    21002       -1     
- Partials      662      663       +1     
Flag Coverage Δ
checkbox-support 52.70% <100.00%> (+0.13%) ⬆️
provider-base 18.57% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@p-gentili p-gentili marked this pull request as ready for review July 23, 2024 07:40
@p-gentili
Copy link
Copy Markdown
Collaborator Author

@rmartin013, we'll need to properly configure your setups with zapper setup start or manually editing the Zapper configuration file. I can do it for you remotely.

Copy link
Copy Markdown
Collaborator

@Hook25 Hook25 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This LGTM, if the api PR is approved, please do (re-)test this and merge it

If not feel free to link it

@p-gentili
Copy link
Copy Markdown
Collaborator Author

Tested on the same environment as the linked issue.

Test case:
1. start zapper streaming (it will "connect" a second monitor)
2. start provided launcher (SRU test-plan)

Expected: `resolution_after_suspend` passes

Running latest beta: FAILED, see https://certification.canonical.com/hardware/202210-30711/submission/382542/test-results/?term=resolution_before_suspend

Running this branch:

[...]
=====[ Bootstrap com.canonical.certification::zapper_capabilities (9/11) ]======
=====[ Bootstrap com.canonical.certification::zapper_reset_setup (10/11) ]======
[...]

PASS, see https://certification.canonical.com/hardware/202210-30711/submission/382558/test-results/?term=resolution_before_suspend

@p-gentili p-gentili merged commit 9a1afd7 into main Jul 25, 2024
@p-gentili p-gentili deleted the reset-zap-env branch July 25, 2024 15:03
pedro-avalos pushed a commit that referenced this pull request Jul 29, 2024
* Add: zapper reset bootstrap job

* Fix: removed deprecated zapper-enabled job
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants