Extend the wwan connection tests to support multiple cycle connection tests (New)

[stanley31huang]

Description

Extend the wwan connection tests to support multiple cycle connection tests, we found an issue that the LTE connection could not be established at second round.

As discussed internally with the QA team, we have all agreed that the default number of test runs for WWAN connections tests is 2.

WARNING: This modifies com.canonical.certification::sru-server

Resolved issues

Here is the support ticket: 00379830.

Our SWE has identified this issue is related to the modem firmware and modem-manager snap, and they are trying to add a patch to modem-manager snap as a workaround.

Documentation

N/A

Tests

sideload test results:
https://certification.canonical.com/hardware/202501-36167/submission/435331/

list bootstrapped results:

ubuntu@ubuntu:/var/tmp/checkbox-providers$ sudo checkbox-ce-oem.checkbox-cli list-bootstrapped com.canonical.certification::wwan-automated
$PROVIDERPATH is defined, so following provider sources are ignored ['/snap/checkbox-ce-oem/844/providers/checkbox-provider-ce-oem', '/root/.local/share/plainbox-providers-1', '/var/tmp/checkbox-providers-develop'] 
Using sideloaded provider: checkbox-provider-base, version 4.3.0.dev71 from /var/tmp/checkbox-providers/base
com.canonical.certification::snap
com.canonical.certification::package
com.canonical.plainbox::manifest
com.canonical.certification::wwan/detect
com.canonical.certification::wwan/check-sim-present-Quectel-RM520N-GL-868371053819781-auto
com.canonical.certification::wwan/3gpp-scan-Quectel-RM520N-GL-868371053819781-auto
com.canonical.certification::rtc
com.canonical.certification::sleep
com.canonical.certification::wwan/gsm-connection-Quectel-RM520N-GL-868371053819781-auto
com.canonical.certification::wwan/gsm-reconnection-Quectel-RM520N-GL-868371053819781-auto
com.canonical.certification::suspend/suspend_advanced_auto
com.canonical.certification::after-suspend-wwan/3gpp-scan-Quectel-RM520N-GL-868371053819781-auto

test submission: https://certification.canonical.com/hardware/202502-36310/submission/413123/

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 50.04%. Comparing base (47b58dd) to head (d37a72f).
⚠️ Report is 241 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1534      +/-   ##
==========================================
+ Coverage   50.00%   50.04%   +0.04%     
==========================================
  Files         378      378              
  Lines       40772    40771       -1     
  Branches     6846     6847       +1     
==========================================
+ Hits        20387    20404      +17     
+ Misses      19658    19640      -18     
  Partials      727      727              

Flag	Coverage Δ
provider-base	26.45% <100.00%> (+0.10%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[stanley31huang]

The PR is ready, but I did not test it on real machine.

[rickwu666666]

LGTM

[rickwu666666]

I've also tried with one of my machine which is x86 and uc24. And everything works expected.
https://certification.canonical.com/hardware/202502-36310/submission/438456/test-results/

[fernando79513]

Is this one ready to be merged?
@pieqq, do you want to give it a second review or is the approval from rick enough?

[pieqq]

I'm sorry it took so long to review. It looks OK, and thanks @rickwu666666 for testing this on real hardware with a SIM card.