Checkbox snap cannot resume from poweroff and reboot tests

[clairlin53]

Bug Description

The DUT always restart the test plan and will not finish the test while running the reboot/poweroff.
The session will keep increasing.

1. The job power-management/poweroff and power-management/reboot from the client-cert-desktop-22-04-automated test plan use pm_test.py to go with poweroff/reboot will cause the test plan restart.

2. The job power-management/suspend_30_cycles_with_reboots from the client-cert-desktop-22-04-stress test plan use pm_test.py to reboot the DUT will cause the test case restart.

Note:
Run checkbox remote with debian version, the client-cert-desktop-22-04-automated test passed, the session can be finished.
CID:202302-31214
Checkbox version:2.9.1

To Reproduce

1. $snap install checkbox22 --beta
2. $snap install checkbox --beta --classic
3. Run Checkbox Remote via command on host $checkbox.checkbox-cli remote <IP address>
4. Select client-cert-desktop-22-04-automated or client-cert-desktop-22-04-stress test plan

Environment

1. CID: 202302-31262
2. OS: Jammy Desktop
3. Checkbox Type: Snap
4. Snap list info

bare                       1.0               5      latest/stable    canonical✓           base
bugit                      1.2               25     latest/edge      pieq                 devmode
checkbox                   2.9.1             2779   latest/beta      ce-certification-qa  classic
checkbox22                 2.9.1             478    latest/beta      ce-certification-qa  -
core20                     20230801          2015   latest/stable    canonical✓           base
core22                     20230801          864    latest/stable    canonical✓           base
firefox                    117.0.1-2         3131   latest/stable/…  mozilla✓             -
gnome-3-38-2004            0+git.efb213a     143    latest/stable/…  canonical✓           -
gnome-42-2204              0+git.ff35a85     126    latest/stable/…  canonical✓           -
gtk-common-themes          0.1-81-g442e511   1535   latest/stable/…  canonical✓           -
snap-store                 41.3-71-g709398e  959    latest/stable/…  canonical✓           -
snapd                      2.60.3            20092  latest/stable    canonical✓           snapd
snapd-desktop-integration  0.9               83     latest/stable/…  canonical✓           -
sosreport                  4.6.0             225    latest/stable    arif-ali             classic

Relevant log output

No response

Additional context

No response

[LiaoU3]

I suggest that we could change the title to Checkbox snap cannot resume from poweroff and reboot tests. And I also observed that this issue also happened on non-remote cases which is local run. After the system poweroff or reboot, checkbox will not resume from the previous session automatically which makes me have to run checkbox.checkbox-cli to manually resume the session.

[pieqq]

• power-management/poweroff uses the flag noreturn
• power-management/reboot uses the flag noreturn
• power-management/suspend_30_cycles_with_reboots uses the flag noreturn

This means Checkbox will save the session before the commands from these jobs are executed... but it won't do anything else to help resuming the session.

A workaround is to add the autorestart flag. It will let Checkbox configure the device to automatically resume the session once the device is restarted. The problem with this flag is that we lose the output from the job, and the only result we can see is something like Automatically marked as passed after resuming.

I need to check with @kissiel if this is the best solution or if we have to implement something better for Checkbox.