Auto resume is not working in `edge` channel

[LiaoU3]

Bug Description

In stable and beta, checkbox could automatically resume back after a reboot.
But in edge, checkbox could not automatcally resume back.

Comparison if could auto resume

channel	remote	local
stable (3.0.0)	O	O
beta (3.3.0-dev19)	O	O
edge (3.3.0-dev93)	X	X

Note: The test cases using pm_test like power-management/poweroff or power-management/reboot can not resume back in all channels. This is a know issue, so we are not talking about those cases with pm_test (By the way the test cases with pm_test is removed from testplans in PR #904). In here we only talk about other regular test cases using reboot, dbus etc.

snap list

We installed checkbox and checkbox22 with edge channel.

u@u-UPN-EHL01:~$ snap list 
Name                       Version           Rev    Tracking         Publisher            Notes
bare                       1.0               5      latest/stable    canonical✓           base
checkbox                   3.3.0-dev46       5398   latest/edge      ce-certification-qa  classic
checkbox22                 3.3.0-dev87       764    latest/edge      ce-certification-qa  -
core20                     20231123          2105   latest/stable    canonical✓           base
core22                     20231123          1033   latest/stable    canonical✓           base
firefox                    121.0.1-1         3626   latest/stable/…  mozilla✓             -
gnome-3-38-2004            0+git.efb213a     143    latest/stable/…  canonical✓           -
gnome-42-2204              0+git.ff35a85     141    latest/stable    canonical✓           -
gtk-common-themes          0.1-81-g442e511   1535   latest/stable/…  canonical✓           -
snap-store                 41.3-71-g709398e  959    latest/stable/…  canonical✓           -
snapd                      2.61.1            20671  latest/stable    canonical✓           snapd
snapd-desktop-integration  0.9               83     latest/stable/…  canonical✓           -

checkbox remote

We run checkbox.checkbox-cli remote and select testplan manually then run it. After the DUT reboot, tt reconnects, but it shows me the list of available test plans instead of actually resuming the session.

(base) vincent@vincent-XPS-9320:~$ checkbox.checkbox-cli remote 10.102.88.57
WARNING:root:remote is deprecated and will be removed in the next major release of Checkbox. Please use control instead
WARNING:plainbox.providers.v1:$PROVIDERPATH is defined, so following provider sources are ignored ['/home/vincent/.local/share/plainbox-providers-1', '/var/tmp/checkbox-providers-develop'] 
Connecting to 10.102.88.57:18871. Timeout: 600s
-----------------------------[ Running job 1 / 5 ]------------------------------
--------------------------------[ Warm reboot ]---------------------------------
ID: com.canonical.certification::power-management/warm-reboot
Category: Power Management tests
--------------------------------------------------------------------------------
Connection lost!
connection closed by peer
Reconnecting ...
Reconnected (took: 55s) # Checkbox shows "Select Test Plan" screen instead of resuming the session
(base) vincent@vincent-XPS-9320:~$ 

To Reproduce

1. Install Stock Ubuntu on the DUT and your computer
2. Install checkbox on the DUT and your computer
   1. sudo snap install checkbox --edge --classic
   2. sudo nap install checkbox22 --edge
3. Run checkbox remote on your computer
   1. checkbox.checkbox-cli remote {DUT IP}
   2. Select Automated power tests

or

3. Local run checkbox on DUT
   1. checkbox.checkbox-cli
   2. Select Automated power tests

Environment

• OS: Ubuntu 22.04 Desktop
• Kernel: 5.15.0-1046-intel-iotg
• Checkbox Type: Snap
• Checkbox version:
  • checkbox: 3.3.0-dev46
  • checkbox22: 3.3.0-dev87

Relevant log output

No response

Additional context

No response

[syncronize-issues-to-jira]

Thank you for reporting us your feedback!

The internal ticket has been created: https://warthogs.atlassian.net/browse/CHECKBOX-1168.

This message was autogenerated

[pieqq]

What happens if you use a launcher to run this test plan completely automatically?

[launcher]
launcher_version = 1
stock_reports = text
[test plan]
unit = com.canonical.certification::power-automated
forced = yes
[test selection]
forced = yes
[ui]
type = silent

[LiaoU3]

@pieqq If I run with the launcher you provided, it could resume back automatically.

[LiaoU3]

By the way, I also try with stable and beta version of checkbox and checkbox22, I didn't observe this issue on them. They could resume back automatically.

[zongminl]

This is going to be a blocker for ODM program customer, so the next release of checkbox to stable channel needs to be blocked with it

[pieqq]

The problem here is that although using a launcher is a good workaround, the customer still needs access to the Manifest Entry UI when running Checkbox for the first time in order to setup the DUT. (different DUTs would have different Manifest entries, so we cannot provide a generic launcher)

[Hook25]

@LiaoU3 can you check if the new resume menu solves the issue? You should now be able (in edge) to resume any session via the menu