Skip to content

Update client-cert-iot-desktop-24-04 to nest audio-cert test plan (New)#1953

Merged
Hook25 merged 2 commits intomainfrom
update-iot-desktop-test-plan
Jun 16, 2025
Merged

Update client-cert-iot-desktop-24-04 to nest audio-cert test plan (New)#1953
Hook25 merged 2 commits intomainfrom
update-iot-desktop-test-plan

Conversation

@weizhenwu
Copy link
Copy Markdown
Contributor

Description

Currently, the client-cert-iot-desktop-24-04 test plan nests audio-manual and audio-automated test plans.
It only contains a few alsa tests, and it's not enough to validate the audio on the desktop image with pipewire.
This PR changes the nested plans to audio-cert-manual and audio-cert-automated so it can have a better coverage.

Resolved issues

N/A

Documentation

N/A

Tests

Before applying the change:

$checkbox-cli list-bootstrapped com.canonical.certification::client-cert-iot-desktop-24-04-manual
com.canonical.certification::audio/detect-playback-devices
com.canonical.certification::audio/alsa-playback
com.canonical.certification::audio/1_playback_displayport_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::audio/1_playback_type-c_displayport_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::audio/1_playback_hdmi_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::audio/1_playback_type-c_hdmi_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::audio/1_playback_thunderbolt3_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::after-suspend-audio/alsa-playback
com.canonical.certification::after-suspend-audio/1_playback_displayport_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::after-suspend-audio/1_playback_type-c_displayport_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::after-suspend-audio/1_playback_hdmi_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::after-suspend-audio/1_playback_type-c_hdmi_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::after-suspend-audio/1_playback_thunderbolt3_TigerLake_LP_GT2__Iris_Xe_Graphics_

$ checkbox-cli list-bootstrapped com.canonical.certification::client-cert-iot-desktop-24-04-automated
com.canonical.certification::audio/detect-playback-devices
com.canonical.certification::audio/detect-capture-devices
com.canonical.certification::audio/alsa-loopback-automated
com.canonical.certification::after-suspend-audio/detect-playback-devices
com.canonical.certification::after-suspend-audio/detect-capture-devices
com.canonical.certification::after-suspend-audio/alsa-loopback-automated

After applying the changes:

$ checkbox-cli list-bootstrapped com.canonical.certification::client-cert-iot-desktop-24-04-manual
com.canonical.certification::audio/speaker-headphone-plug-detection
com.canonical.certification::audio/microphone-plug-detection
com.canonical.certification::audio/list_devices
com.canonical.certification::audio/playback_headphones
com.canonical.certification::audio/alsa_record_playback_external
com.canonical.certification::audio/playback_auto
com.canonical.certification::audio/alsa_record_playback_internal
com.canonical.certification::audio/channels
com.canonical.certification::audio/external-linein
com.canonical.certification::audio/external-lineout
com.canonical.certification::audio/1_playback_displayport_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::audio/1_playback_type-c_displayport_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::audio/1_playback_hdmi_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::audio/1_playback_type-c_hdmi_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::audio/1_playback_thunderbolt3_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::after-suspend-audio/speaker-headphone-plug-detection
com.canonical.certification::after-suspend-audio/microphone-plug-detection
com.canonical.certification::after-suspend-audio/playback_headphones
com.canonical.certification::after-suspend-audio/alsa_record_playback_external
com.canonical.certification::after-suspend-audio/playback_auto
com.canonical.certification::after-suspend-audio/alsa_record_playback_internal
com.canonical.certification::after-suspend-audio/channels
com.canonical.certification::after-suspend-audio/external-linein
com.canonical.certification::after-suspend-audio/external-lineout
com.canonical.certification::after-suspend-audio/1_playback_displayport_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::after-suspend-audio/1_playback_type-c_displayport_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::after-suspend-audio/1_playback_hdmi_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::after-suspend-audio/1_playback_type-c_hdmi_TigerLake_LP_GT2__Iris_Xe_Graphics_
com.canonical.certification::after-suspend-audio/1_playback_thunderbolt3_TigerLake_LP_GT2__Iris_Xe_Graphics_

$ checkbox-cli list-bootstrapped com.canonical.certification::client-cert-iot-desktop-24-04-automated
com.canonical.certification::audio/detect_sinks
com.canonical.certification::audio/detect_sources
com.canonical.certification::audio/alsa_record_playback_automated
com.canonical.certification::audio/alsa_info_collect
com.canonical.certification::audio/alsa_info_attachment
com.canonical.certification::audio/list_devices
com.canonical.certification::audio/valid-sof-firmware-sig
com.canonical.certification::after-suspend-audio/detect_sinks
com.canonical.certification::after-suspend-audio/detect_sources
com.canonical.certification::after-suspend-audio/alsa_record_playback_automated

@codecov
Copy link
Copy Markdown

codecov bot commented Jun 12, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 50.52%. Comparing base (d1b0f88) to head (83ed101).
⚠️ Report is 109 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #1953   +/-   ##
=======================================
  Coverage   50.52%   50.52%           
=======================================
  Files         384      384           
  Lines       41111    41111           
  Branches     7531     7531           
=======================================
  Hits        20770    20770           
  Misses      19599    19599           
  Partials      742      742           
Flag Coverage Δ
provider-certification-client 57.14% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@weizhenwu weizhenwu changed the title Update client-cert-iot-desktop-24-04 to nest audio-cert test plan Update client-cert-iot-desktop-24-04 to nest audio-cert test plan (New) Jun 12, 2025
@weizhenwu weizhenwu marked this pull request as ready for review June 12, 2025 06:07
Copy link
Copy Markdown
Collaborator

@Hook25 Hook25 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@Hook25 Hook25 merged commit a8e5a64 into main Jun 16, 2025
25 of 26 checks passed
@Hook25 Hook25 deleted the update-iot-desktop-test-plan branch June 16, 2025 09:09
mreed8855 pushed a commit that referenced this pull request Jul 30, 2025
…w) (#1953)

* update iot desktop 24.04 test plan

* update after-suspend test plan
mreed8855 pushed a commit that referenced this pull request Jul 31, 2025
…w) (#1953)

* update iot desktop 24.04 test plan

* update after-suspend test plan
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants