Skip to content

DPDK: Timeout related bugfixes#4602

Open
mcgov wants to merge 9 commits into
mainfrom
mcgov/dpdk-reboot
Open

DPDK: Timeout related bugfixes#4602
mcgov wants to merge 9 commits into
mainfrom
mcgov/dpdk-reboot

Conversation

@mcgov

@mcgov mcgov commented Jul 16, 2026

Copy link
Copy Markdown
Collaborator

Description

This PR contains commits for fixing several reliablity issues related to the DPDK tests and timeouts.

  • Environments are frequently marked dirty when they should not be due to a short timeout during cleanup.
  • Reboots take much longer once rdma-core is installed, causing test timeouts.
  • Kill function did not attempt SIGINT first, resulting in erroneous test failures unless the test timed out for one of the above reasons.

Related Issue

Type of Change

  • Bug fix
  • New feature
  • Breaking change
  • Refactoring
  • Documentation update

Checklist

  • Description is filled in above
  • No credentials, secrets, or internal details are included
  • Peer review requested (if not, add required peer reviewers after raising PR)
  • Tests executed and results posted below

Test Validation

Key Test Cases:

verify_dpdk_build_failsafe|verify_dpdk_build_netvsc|verify_dpdk_send_receive_failsafe|verify_dpdk_send_receive_netvsc|verify_dpdk_send_receive_multi_txrx_queue_failsafe|verify_dpdk_send_receive_multi_txrx_queue_netvsc

Impacted LISA Features:
Dpdk, RdmaCoreInstaller

Tested Azure Marketplace Images:

Canonical:ubuntu-24_04-lts:server:latest

Test Results

2026-07-16 17:15:03.643[8180][INFO] lisa.RootRunner ________________________________________
2026-07-16 17:15:03.643[8180][INFO] lisa.RootRunner Dpdk.verify_dpdk_build_netvsc: PASSED
2026-07-16 17:15:03.643[8180][INFO] lisa.RootRunner Dpdk.verify_dpdk_build_failsafe: SKIPPED skipped: Failsafe PMD test on MANA is not supported.
2026-07-16 17:15:03.643[8180][INFO] lisa.RootRunner Dpdk.verify_dpdk_send_receive_multi_txrx_queue_failsafe: PASSED
2026-07-16 17:15:03.644[8180][INFO] lisa.RootRunner Dpdk.verify_dpdk_send_receive_multi_txrx_queue_netvsc: PASSED
2026-07-16 17:15:03.644[8180][INFO] lisa.RootRunner Dpdk.verify_dpdk_send_receive_failsafe: PASSED
2026-07-16 17:15:03.644[8180][INFO] lisa.RootRunner Dpdk.verify_dpdk_send_receive_netvsc: PASSED
2026-07-16 17:15:03.644[8180][INFO] lisa.RootRunner test result summary
2026-07-16 17:15:03.644[8180][INFO] lisa.RootRunner TOTAL : 6
2026-07-16 17:15:03.644[8180][INFO] lisa.RootRunner QUEUED : 0
2026-07-16 17:15:03.644[8180][INFO] lisa.RootRunner ASSIGNED : 0
2026-07-16 17:15:03.644[8180][INFO] lisa.RootRunner RUNNING : 0
2026-07-16 17:15:03.644[8180][INFO] lisa.RootRunner FAILED : 0
2026-07-16 17:15:03.644[8180][INFO] lisa.RootRunner PASSED : 5
2026-07-16 17:15:03.644[8180][INFO] lisa.RootRunner SKIPPED : 1

Image VM Size Result
Canonical:ubuntu-24_04-lts:server:latest Standard_F72s_v2 5 / 0 / 1
Copilot AI review requested due to automatic review settings July 16, 2026 17:18

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR targets reliability issues in the DPDK test suite by reducing spurious timeout failures during cleanup/reboot flows, improving rdma-core source-install behavior, and making testpmd termination more graceful (SIGINT before SIGKILL) to preserve runtime stats.

Changes:

  • Adjust DPDK cleanup reboot behavior to avoid overly short reboot timeouts that can incorrectly mark environments dirty.
  • Refine rdma-core source-install detection and add systemd unit masking to prevent rdma-ndd from delaying SSH after installation.
  • Update testpmd termination logic to attempt SIGINT first, falling back to SIGKILL only if needed.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.

File Description
lisa/microsoft/testsuites/dpdk/rdmacore.py Tweaks rdma-core source installer detection/cleanup and masks rdma-ndd service after install.
lisa/microsoft/testsuites/dpdk/dpdkutil.py Removes a too-short reboot timeout during parallel cleanup.
lisa/microsoft/testsuites/dpdk/dpdktestpmd.py Tries SIGINT before SIGKILL when terminating an existing testpmd process.
Comment thread lisa/microsoft/testsuites/dpdk/rdmacore.py
Comment thread lisa/microsoft/testsuites/dpdk/rdmacore.py Outdated
Comment thread lisa/microsoft/testsuites/dpdk/rdmacore.py Outdated
Copilot AI review requested due to automatic review settings July 16, 2026 17:34
@github-actions

Copy link
Copy Markdown

⚠️ AI Test Selection — cancelled

36 test case(s) selected (view run)

Marketplace image: suse sles-15-sp6 gen2 latest

Count
✅ Passed 2
❌ Failed 2
⏭️ Skipped 4
Total 8
Test case details
Test Case Status Time (s) Message
verify_dpdk_symmetric_mp (lisa_0_1) ❌ FAILED 11.288 failed. UnsupportedDistroException: Unsupported system: 'SUSE Linux Enterprise Server 15 SP6'
verify_dpdk_build_gb_hugepages_netvsc (lisa_0_2) ❌ FAILED 127.248 failed. AssertionError: [any([0, 0]) resolved to false. Test data was empty or all zeroes for dpdktestpmd.tx_pps_data.]
verify_dpdk_build_failsafe (lisa_0_3) ✅ PASSED 131.397
verify_dpdk_build_gb_hugepages_failsafe (lisa_0_4) ✅ PASSED 124.531
verify_dpdk_vpp (lisa_0_12) ⏭️ SKIPPED 121.710 skipped: Unsupported system: 'SUSE Linux Enterprise Server 15 SP6'. VPP package was not available in repository after ad
verify_dpdk_send_receive_multi_txrx_queue_max_mtu_netvsc (lisa_0_15) ⏭️ SKIPPED 10.906 skipped: set mtu test is intended for MANA VMs only.
verify_dpdk_send_receive_multi_txrx_queue_4k_mtu_netvsc (lisa_0_17) ⏭️ SKIPPED 6.744 skipped: set mtu test is intended for MANA VMs only.
verify_dpdk_send_receive_multi_txrx_queue_8k_mtu_netvsc (lisa_0_18) ⏭️ SKIPPED 5.412 skipped: set mtu test is intended for MANA VMs only.
@github-actions

Copy link
Copy Markdown

🤖 AI Test Selection

No test cases were selected for this PR.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 4 comments.

Comment thread lisa/microsoft/testsuites/dpdk/rdmacore.py Outdated
Comment thread lisa/microsoft/testsuites/dpdk/dpdktestpmd.py
Comment thread lisa/microsoft/testsuites/dpdk/dpdktestpmd.py Outdated
Comment thread lisa/microsoft/testsuites/dpdk/dpdktestpmd.py Outdated
Copilot AI review requested due to automatic review settings July 16, 2026 17:46
@mcgov
mcgov force-pushed the mcgov/dpdk-reboot branch from a8d5faa to 10ed0b3 Compare July 16, 2026 17:46
@github-actions

Copy link
Copy Markdown

❌ AI Test Selection — FAILED

36 test case(s) selected (view run)

Marketplace image: suse sles-15-sp6 gen2 latest

Selected test cases
perf_dpdk_send_only_failsafe_pmd
perf_dpdk_send_only_netvsc_pmd
perf_dpdk_minimal_failsafe_pmd
perf_dpdk_minimal_netvsc_pmd
perf_dpdk_multi_queue_failsafe_pmd
perf_dpdk_multi_queue_netvsc_pmd
perf_dpdk_l3fwd_ntttcp_tcp
verify_dpdk_build_netvsc
verify_dpdk_symmetric_mp
verify_dpdk_build_gb_hugepages_netvsc
verify_dpdk_build_failsafe
verify_dpdk_build_gb_hugepages_failsafe
verify_dpdk_ovs
verify_dpdk_nff_go
verify_dpdk_multiprocess
verify_dpdk_testpmd_hotplug_receiver_failsafe_pmd
verify_dpdk_testpmd_hotplug_receiver_netvsc_pmd
verify_dpdk_testpmd_hotplug_sender_failsafe_pmd
verify_dpdk_testpmd_hotplug_sender_netvsc_pmd
verify_dpdk_vpp
verify_dpdk_ring_ping
verify_dpdk_send_receive_multi_txrx_queue_failsafe
verify_dpdk_send_receive_multi_txrx_queue_max_mtu_netvsc
verify_dpdk_send_receive_multi_txrx_queue_1500_mtu_netvsc
verify_dpdk_send_receive_multi_txrx_queue_4k_mtu_netvsc
verify_dpdk_send_receive_multi_txrx_queue_8k_mtu_netvsc
verify_dpdk_send_receive_multi_txrx_queue_netvsc
verify_dpdk_send_receive_failsafe
verify_dpdk_send_receive_gb_hugepages_failsafe
verify_dpdk_send_receive_netvsc
verify_dpdk_send_receive_gb_hugepages_netvsc
verify_dpdk_testpmd_multiple_port_receive_netvsc_pmd
verify_dpdk_l3fwd_ntttcp_tcp
verify_dpdk_l3fwd_ntttcp_tcp_hotplug
verify_dpdk_l3fwd_ntttcp_tcp_gb_hugepages
verify_uio_binding
Try to stop testpmd with SIGINT first so it can exit cleanly and
preserve send/recv/drop statistics.

If the process is still running, fall back to SIGKILL before using the
existing connection reset and hv_netvsc reload recovery path. This
improves hotplug test reliability without giving up clean shutdown data
when testpmd responds normally.
@mcgov
mcgov force-pushed the mcgov/dpdk-reboot branch from 10ed0b3 to 932c9b2 Compare July 16, 2026 17:51

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.

Comment thread lisa/microsoft/testsuites/dpdk/rdmacore.py
Comment thread lisa/microsoft/testsuites/dpdk/dpdktestpmd.py Outdated
Comment thread lisa/microsoft/testsuites/dpdk/dpdktestpmd.py
Copilot AI review requested due to automatic review settings July 16, 2026 17:51
@mcgov
mcgov force-pushed the mcgov/dpdk-reboot branch from 932c9b2 to 235a9fd Compare July 16, 2026 17:54

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 4 comments.

Comment thread lisa/microsoft/testsuites/dpdk/rdmacore.py Outdated
Comment thread lisa/microsoft/testsuites/dpdk/rdmacore.py Outdated
Comment thread lisa/microsoft/testsuites/dpdk/dpdktestpmd.py Outdated
Comment thread lisa/microsoft/testsuites/dpdk/dpdktestpmd.py
Copilot AI review requested due to automatic review settings July 16, 2026 17:57
@mcgov
mcgov force-pushed the mcgov/dpdk-reboot branch from f61ab84 to 1e5f444 Compare July 16, 2026 18:02

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.

Comments suppressed due to low confidence (1)

lisa/microsoft/testsuites/dpdk/dpdktestpmd.py:51

  • sleep is imported from lisa.util (which re-exports time.sleep) and is used for retry waiting below. Per LISA test guidelines, prefer bounded wait helpers like check_till_timeout() and import the needed symbols instead of sleep.
    parse_version,
)
from lisa.util.constants import DEVICE_TYPE_SRIOV, SIGINT
Comment thread lisa/microsoft/testsuites/dpdk/dpdktestpmd.py
Copilot AI review requested due to automatic review settings July 16, 2026 18:03
@github-actions

Copy link
Copy Markdown

⏭️ AI Test Selection — SKIPPED

36 test case(s) selected (view run)

Marketplace image: suse sles-15-sp6 gen2 latest

Selected test cases
perf_dpdk_send_only_failsafe_pmd
perf_dpdk_send_only_netvsc_pmd
perf_dpdk_minimal_failsafe_pmd
perf_dpdk_minimal_netvsc_pmd
perf_dpdk_multi_queue_failsafe_pmd
perf_dpdk_multi_queue_netvsc_pmd
perf_dpdk_l3fwd_ntttcp_tcp
verify_dpdk_build_netvsc
verify_dpdk_symmetric_mp
verify_dpdk_build_gb_hugepages_netvsc
verify_dpdk_build_failsafe
verify_dpdk_build_gb_hugepages_failsafe
verify_dpdk_ovs
verify_dpdk_nff_go
verify_dpdk_multiprocess
verify_dpdk_testpmd_hotplug_receiver_failsafe_pmd
verify_dpdk_testpmd_hotplug_receiver_netvsc_pmd
verify_dpdk_testpmd_hotplug_sender_failsafe_pmd
verify_dpdk_testpmd_hotplug_sender_netvsc_pmd
verify_dpdk_vpp
verify_dpdk_ring_ping
verify_dpdk_send_receive_multi_txrx_queue_failsafe
verify_dpdk_send_receive_multi_txrx_queue_max_mtu_netvsc
verify_dpdk_send_receive_multi_txrx_queue_1500_mtu_netvsc
verify_dpdk_send_receive_multi_txrx_queue_4k_mtu_netvsc
verify_dpdk_send_receive_multi_txrx_queue_8k_mtu_netvsc
verify_dpdk_send_receive_multi_txrx_queue_netvsc
verify_dpdk_send_receive_failsafe
verify_dpdk_send_receive_gb_hugepages_failsafe
verify_dpdk_send_receive_netvsc
verify_dpdk_send_receive_gb_hugepages_netvsc
verify_dpdk_testpmd_multiple_port_receive_netvsc_pmd
verify_dpdk_l3fwd_ntttcp_tcp
verify_dpdk_l3fwd_ntttcp_tcp_hotplug
verify_dpdk_l3fwd_ntttcp_tcp_gb_hugepages
verify_uio_binding
@github-actions

Copy link
Copy Markdown

🤖 AI Test Selection

No test cases were selected for this PR.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.

Comment thread lisa/microsoft/testsuites/dpdk/dpdktestpmd.py
Comment thread lisa/microsoft/testsuites/dpdk/dpdkutil.py Outdated
Copilot AI review requested due to automatic review settings July 16, 2026 18:16

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.

Comment thread lisa/microsoft/testsuites/dpdk/dpdktestpmd.py
Comment thread lisa/microsoft/testsuites/dpdk/dpdkutil.py
Copilot AI review requested due to automatic review settings July 16, 2026 19:29
@github-actions

Copy link
Copy Markdown

⚠️ AI Test Selection — cancelled

36 test case(s) selected (view run)

Marketplace image: suse sles-15-sp6 gen2 latest

Count
✅ Passed 7
❌ Failed 13
⏭️ Skipped 12
Total 32
Test case details
Test Case Status Time (s) Message
verify_dpdk_symmetric_mp (lisa_0_1) ❌ FAILED 18.152 failed. UnsupportedDistroException: Unsupported system: 'SUSE Linux Enterprise Server 15 SP6'
verify_dpdk_build_failsafe (lisa_0_3) ✅ PASSED 133.169
verify_dpdk_vpp (lisa_0_12) ⏭️ SKIPPED 126.071 skipped: Unsupported system: 'SUSE Linux Enterprise Server 15 SP6'. VPP package was not available in repository after ad
verify_dpdk_build_netvsc (lisa_0_0) ❌ FAILED 133.174 failed. AssertionError: [any([0]) resolved to false. Test data was empty or all zeroes for dpdktestpmd.tx_pps_data.] Exp
verify_dpdk_build_gb_hugepages_netvsc (lisa_0_2) ❌ FAILED 132.737 failed. AssertionError: [any([0, 0]) resolved to false. Test data was empty or all zeroes for dpdktestpmd.tx_pps_data.]
verify_dpdk_build_gb_hugepages_failsafe (lisa_0_4) ✅ PASSED 113.913
verify_dpdk_ovs (lisa_0_5) ❌ FAILED 144.422 failed. MissingPackagesException: Package manager could not install packages: ninja-build
verify_dpdk_send_receive_multi_txrx_queue_max_mtu_netvsc (lisa_0_15) ⏭️ SKIPPED 17.626 skipped: set mtu test is intended for MANA VMs only.
verify_dpdk_send_receive_multi_txrx_queue_1500_mtu_netvsc (lisa_0_16) ⏭️ SKIPPED 17.765 skipped: set mtu test is intended for MANA VMs only.
verify_dpdk_send_receive_multi_txrx_queue_netvsc (lisa_0_19) ❌ FAILED 146.634 failed. AssertionError: [any([0, 0, 0, 0, 0, 0, 0, 0]) resolved to false. Test data was empty or all zeroes for dpdktest
verify_dpdk_send_receive_multi_txrx_queue_4k_mtu_netvsc (lisa_0_17) ⏭️ SKIPPED 17.107 skipped: set mtu test is intended for MANA VMs only.
verify_dpdk_send_receive_gb_hugepages_failsafe (lisa_0_21) ✅ PASSED 68.978
verify_dpdk_send_receive_failsafe (lisa_0_20) ✅ PASSED 149.254
verify_dpdk_send_receive_multi_txrx_queue_8k_mtu_netvsc (lisa_0_18) ⏭️ SKIPPED 17.495 skipped: set mtu test is intended for MANA VMs only.
verify_dpdk_send_receive_netvsc (lisa_0_22) ❌ FAILED 152.197 failed. AssertionError: [any([0, 0, 0, 0, 0, 0, 0, 0]) resolved to false. Test data was empty or all zeroes for dpdktest
verify_dpdk_send_receive_gb_hugepages_netvsc (lisa_0_23) ❌ FAILED 68.772 failed. AssertionError: [any([0, 0, 0, 0, 0, 0, 0, 0]) resolved to false. Test data was empty or all zeroes for dpdktest
verify_dpdk_testpmd_multiple_port_receive_netvsc_pmd (lisa_0_24) ⏭️ SKIPPED 0.000 check skipped: OS type mismatch: ["requires [<class 'lisa.operating_system.Ubuntu'>] but VM supports [<class 'lisa.opera
verify_dpdk_l3fwd_ntttcp_tcp_hotplug (lisa_0_26) ⏭️ SKIPPED 0.000 check skipped: OS type mismatch: ["requires [<class 'lisa.operating_system.Ubuntu'>] but VM supports [<class 'lisa.opera
verify_dpdk_l3fwd_ntttcp_tcp_gb_hugepages (lisa_0_27) ⏭️ SKIPPED 0.000 check skipped: OS type mismatch: ["requires [<class 'lisa.operating_system.Ubuntu'>] but VM supports [<class 'lisa.opera
verify_dpdk_send_receive_multi_txrx_queue_failsafe (lisa_0_14) ❌ FAILED 143.392 failed. ValueError: too many values to unpack (expected 2)
verify_dpdk_l3fwd_ntttcp_tcp (lisa_0_25) ⏭️ SKIPPED 0.000 check skipped: OS type mismatch: ["requires [<class 'lisa.operating_system.Ubuntu'>] but VM supports [<class 'lisa.opera
verify_dpdk_nff_go (lisa_0_6) ⏭️ SKIPPED 100.342 skipped: Unsupported system: 'SUSE Linux Enterprise Server 15 SP6'. NFF-GO test not implemented on this OS
verify_uio_binding (lisa_0_28) ✅ PASSED 15.388
verify_dpdk_ring_ping (lisa_0_13) ❌ FAILED 58.465 failed. MissingPackagesException: Package manager could not install packages: ninja-build
verify_dpdk_testpmd_hotplug_sender_netvsc_pmd (lisa_0_11) ❌ FAILED 281.791 failed. LisaException: Found no vf hotplug events in testpmd output. Check output to verify if PPS drop occurred and por
verify_dpdk_testpmd_hotplug_sender_failsafe_pmd (lisa_0_10) ⏭️ SKIPPED 18.948 skipped: Failsafe PMD test on MANA is not supported.
perf_dpdk_minimal_failsafe_pmd (lisa_0_31) ✅ PASSED 67.595
perf_dpdk_minimal_netvsc_pmd (lisa_0_32) ❌ FAILED 66.100 failed. MissingPackagesException: Package manager could not install packages: git
perf_dpdk_send_only_failsafe_pmd (lisa_0_29) ✅ PASSED 134.735
perf_dpdk_send_only_netvsc_pmd (lisa_0_30) ❌ FAILED 143.694 failed. AssertionError: [any([0, 0, 0]) resolved to false. Test data was empty or all zeroes for dpdktestpmd.tx_pps_data
perf_dpdk_l3fwd_ntttcp_tcp (lisa_0_35) ⏭️ SKIPPED 44.094 skipped: l3fwd test not compatible, use X64 Ubuntu >= 22.04
perf_dpdk_multi_queue_netvsc_pmd (lisa_0_34) ❌ FAILED 180.270 failed. AssertionError: [any([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]) resolved to false. Test data was empty or all zero

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.

Comment thread lisa/microsoft/testsuites/dpdk/rdmacore.py Outdated
Comment thread lisa/microsoft/testsuites/dpdk/dpdktestpmd.py
mcgov and others added 5 commits July 16, 2026 12:40
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Remove shell=true

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Copilot AI review requested due to automatic review settings July 16, 2026 19:44
@mcgov
mcgov force-pushed the mcgov/dpdk-reboot branch from 7e53646 to fc476b4 Compare July 16, 2026 19:44
@github-actions

Copy link
Copy Markdown

⚠️ AI Test Selection — cancelled

36 test case(s) selected (view run)

Marketplace image: suse sles-15-sp6 gen2 latest

Count
✅ Passed 0
❌ Failed 34
⏭️ Skipped 0
Total 34
Test case details
Test Case Status Time (s) Message
verify_dpdk_build_netvsc (lisa_0_0) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_build_failsafe (lisa_0_3) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_build_gb_hugepages_failsafe (lisa_0_4) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_symmetric_mp (lisa_0_1) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_build_gb_hugepages_netvsc (lisa_0_2) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_ovs (lisa_0_5) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_vpp (lisa_0_12) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_multi_txrx_queue_failsafe (lisa_0_14) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_multi_txrx_queue_max_mtu_netvsc (lisa_0_15) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_multi_txrx_queue_1500_mtu_netvsc (lisa_0_16) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_multi_txrx_queue_4k_mtu_netvsc (lisa_0_17) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_multi_txrx_queue_8k_mtu_netvsc (lisa_0_18) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_multi_txrx_queue_netvsc (lisa_0_19) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_failsafe (lisa_0_20) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_netvsc (lisa_0_22) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_testpmd_multiple_port_receive_netvsc_pmd (lisa_0_24) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_l3fwd_ntttcp_tcp (lisa_0_25) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_l3fwd_ntttcp_tcp_hotplug (lisa_0_26) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_nff_go (lisa_0_6) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_multiprocess (lisa_0_7) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_testpmd_hotplug_sender_failsafe_pmd (lisa_0_10) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_testpmd_hotplug_sender_netvsc_pmd (lisa_0_11) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_ring_ping (lisa_0_13) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_uio_binding (lisa_0_28) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_testpmd_hotplug_receiver_failsafe_pmd (lisa_0_8) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_testpmd_hotplug_receiver_netvsc_pmd (lisa_0_9) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_gb_hugepages_netvsc (lisa_0_23) ❌ FAILED 171.511 failed. AssertionError: [any([0, 0, 0, 0, 0, 0, 0, 0]) resolved to false. Test data was empty or all zeroes for dpdktest
perf_dpdk_send_only_failsafe_pmd (lisa_0_29) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
perf_dpdk_minimal_failsafe_pmd (lisa_0_31) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
perf_dpdk_minimal_netvsc_pmd (lisa_0_32) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
perf_dpdk_l3fwd_ntttcp_tcp (lisa_0_35) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
perf_dpdk_multi_queue_failsafe_pmd (lisa_0_33) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
perf_dpdk_multi_queue_netvsc_pmd (lisa_0_34) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
perf_dpdk_send_only_netvsc_pmd (lisa_0_30) ❌ FAILED 138.214 failed. AssertionError: [any([0, 0, 0]) resolved to false. Test data was empty or all zeroes for dpdktestpmd.tx_pps_data

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.

Comment thread lisa/microsoft/testsuites/dpdk/rdmacore.py
Copilot AI review requested due to automatic review settings July 16, 2026 19:53

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.

Comment thread lisa/microsoft/testsuites/dpdk/dpdktestpmd.py
Comment thread lisa/microsoft/testsuites/dpdk/dpdktestpmd.py
Comment thread lisa/microsoft/testsuites/dpdk/rdmacore.py
Copilot AI review requested due to automatic review settings July 16, 2026 20:09
@mcgov
mcgov force-pushed the mcgov/dpdk-reboot branch from 0b737db to ca52a2b Compare July 16, 2026 20:09
@github-actions

Copy link
Copy Markdown

⚠️ AI Test Selection — cancelled

36 test case(s) selected (view run)

Marketplace image: suse sles-15-sp6 gen2 latest

Count
✅ Passed 2
❌ Failed 28
⏭️ Skipped 2
Total 32
Test case details
Test Case Status Time (s) Message
verify_dpdk_build_gb_hugepages_failsafe (lisa_0_4) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_build_gb_hugepages_netvsc (lisa_0_2) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_symmetric_mp (lisa_0_1) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_ovs (lisa_0_5) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_multi_txrx_queue_failsafe (lisa_0_14) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_multi_txrx_queue_max_mtu_netvsc (lisa_0_15) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_multi_txrx_queue_1500_mtu_netvsc (lisa_0_16) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_multi_txrx_queue_4k_mtu_netvsc (lisa_0_17) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_multi_txrx_queue_8k_mtu_netvsc (lisa_0_18) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_multi_txrx_queue_netvsc (lisa_0_19) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_failsafe (lisa_0_20) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_gb_hugepages_failsafe (lisa_0_21) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_netvsc (lisa_0_22) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_gb_hugepages_netvsc (lisa_0_23) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_l3fwd_ntttcp_tcp (lisa_0_25) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_l3fwd_ntttcp_tcp_hotplug (lisa_0_26) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_l3fwd_ntttcp_tcp_gb_hugepages (lisa_0_27) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_nff_go (lisa_0_6) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_testpmd_multiple_port_receive_netvsc_pmd (lisa_0_24) ⏭️ SKIPPED 0.000 check skipped: OS type mismatch: ["requires [<class 'lisa.operating_system.Ubuntu'>] but VM supports [<class 'lisa.opera
verify_dpdk_build_failsafe (lisa_0_3) ✅ PASSED 136.336
verify_dpdk_build_netvsc (lisa_0_0) ❌ FAILED 137.891 failed. AssertionError: [any([0, 0]) resolved to false. Test data was empty or all zeroes for dpdktestpmd.tx_pps_data.]
verify_dpdk_multiprocess (lisa_0_7) ❌ FAILED 150.652 failed. MissingPackagesException: Package manager could not install packages: ninja-build
verify_dpdk_vpp (lisa_0_12) ⏭️ SKIPPED 167.458 skipped: Unsupported system: 'SUSE Linux Enterprise Server 15 SP6'. VPP package was not available in repository after ad
verify_uio_binding (lisa_0_28) ✅ PASSED 15.490
verify_dpdk_testpmd_hotplug_sender_failsafe_pmd (lisa_0_10) ❌ FAILED 272.884 failed. LisaException: Found no vf hotplug events in testpmd output. Check output to verify if PPS drop occurred and por
perf_dpdk_send_only_failsafe_pmd (lisa_0_29) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
perf_dpdk_send_only_netvsc_pmd (lisa_0_30) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
perf_dpdk_minimal_failsafe_pmd (lisa_0_31) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
perf_dpdk_minimal_netvsc_pmd (lisa_0_32) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
perf_dpdk_l3fwd_ntttcp_tcp (lisa_0_35) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
perf_dpdk_multi_queue_failsafe_pmd (lisa_0_33) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
perf_dpdk_multi_queue_netvsc_pmd (lisa_0_34) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated no new comments.

@github-actions

Copy link
Copy Markdown

❌ AI Test Selection — FAILED

36 test case(s) selected (view run)

Marketplace image: suse sles-15-sp6 gen2 latest

Count
✅ Passed 6
❌ Failed 19
⏭️ Skipped 11
Total 36
Test case details
Test Case Status Time (s) Message
verify_dpdk_build_netvsc (lisa_0_0) ❌ FAILED 129.957 failed. AssertionError: [any([0, 0]) resolved to false. Test data was empty or all zeroes for dpdktestpmd.tx_pps_data.]
verify_dpdk_build_gb_hugepages_netvsc (lisa_0_2) ❌ FAILED 242.174 failed. AssertionError: [any([0, 0]) resolved to false. Test data was empty or all zeroes for dpdktestpmd.tx_pps_data.]
verify_dpdk_build_failsafe (lisa_0_3) ✅ PASSED 129.073
verify_dpdk_build_gb_hugepages_failsafe (lisa_0_4) ✅ PASSED 242.021
verify_dpdk_ovs (lisa_0_5) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_multi_txrx_queue_failsafe (lisa_0_14) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_multi_txrx_queue_max_mtu_netvsc (lisa_0_15) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_vpp (lisa_0_12) ⏭️ SKIPPED 54.680 skipped: Unsupported system: 'SUSE Linux Enterprise Server 15 SP6'. VPP package was not available in repository after ad
verify_dpdk_send_receive_multi_txrx_queue_8k_mtu_netvsc (lisa_0_18) ❌ FAILED 0.000 deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-ai-pr-4602-202607
verify_dpdk_send_receive_multi_txrx_queue_1500_mtu_netvsc (lisa_0_16) ⏭️ SKIPPED 15.700 skipped: set mtu test is intended for MANA VMs only.
verify_dpdk_send_receive_gb_hugepages_failsafe (lisa_0_21) ❌ FAILED 60.527 failed. MissingPackagesException: Package manager could not install packages: git
verify_dpdk_send_receive_netvsc (lisa_0_22) ❌ FAILED 26.442 failed. MissingPackagesException: Package manager could not install packages: git
verify_dpdk_send_receive_failsafe (lisa_0_20) ✅ PASSED 165.121
verify_dpdk_send_receive_gb_hugepages_netvsc (lisa_0_23) ❌ FAILED 26.436 failed. MissingPackagesException: Package manager could not install packages: git
verify_dpdk_send_receive_multi_txrx_queue_netvsc (lisa_0_19) ❌ FAILED 170.746 failed. AssertionError: [any([0, 0, 0, 0, 0, 0, 0, 0]) resolved to false. Test data was empty or all zeroes for dpdktest
verify_dpdk_send_receive_multi_txrx_queue_4k_mtu_netvsc (lisa_0_17) ⏭️ SKIPPED 15.270 skipped: set mtu test is intended for MANA VMs only.
verify_dpdk_symmetric_mp (lisa_0_1) ❌ FAILED 16.188 failed. UnsupportedDistroException: Unsupported system: 'SUSE Linux Enterprise Server 15 SP6'
verify_dpdk_l3fwd_ntttcp_tcp (lisa_0_25) ⏭️ SKIPPED 0.000 check skipped: OS type mismatch: ["requires [<class 'lisa.operating_system.Ubuntu'>] but VM supports [<class 'lisa.opera
verify_dpdk_l3fwd_ntttcp_tcp_gb_hugepages (lisa_0_27) ⏭️ SKIPPED 0.000 check skipped: OS type mismatch: ["requires [<class 'lisa.operating_system.Ubuntu'>] but VM supports [<class 'lisa.opera
verify_dpdk_testpmd_multiple_port_receive_netvsc_pmd (lisa_0_24) ⏭️ SKIPPED 0.000 check skipped: OS type mismatch: ["requires [<class 'lisa.operating_system.Ubuntu'>] but VM supports [<class 'lisa.opera
verify_dpdk_l3fwd_ntttcp_tcp_hotplug (lisa_0_26) ⏭️ SKIPPED 0.000 check skipped: OS type mismatch: ["requires [<class 'lisa.operating_system.Ubuntu'>] but VM supports [<class 'lisa.opera
verify_dpdk_nff_go (lisa_0_6) ⏭️ SKIPPED 111.069 skipped: Unsupported system: 'SUSE Linux Enterprise Server 15 SP6'. NFF-GO test not implemented on this OS
verify_uio_binding (lisa_0_28) ✅ PASSED 13.466
verify_dpdk_ring_ping (lisa_0_13) ❌ FAILED 56.459 failed. MissingPackagesException: Package manager could not install packages: ninja-build
verify_dpdk_testpmd_hotplug_sender_failsafe_pmd (lisa_0_10) ⏭️ SKIPPED 16.811 skipped: Failsafe PMD test on MANA is not supported.
verify_dpdk_multiprocess (lisa_0_7) ❌ FAILED 143.635 failed. MissingPackagesException: Package manager could not install packages: ninja-build
verify_dpdk_testpmd_hotplug_sender_netvsc_pmd (lisa_0_11) ❌ FAILED 185.981 failed. LisaException: Found no vf hotplug events in testpmd output. Check output to verify if PPS drop occurred and por
verify_dpdk_testpmd_hotplug_receiver_failsafe_pmd (lisa_0_8) ❌ FAILED 314.103 failed. HttpResponseError: Operation returned an invalid status '' Content: {"Error":{"Details":[{"Code":"RetryableError
verify_dpdk_testpmd_hotplug_receiver_netvsc_pmd (lisa_0_9) ❌ FAILED 226.818 failed. HttpResponseError: (RetryableError) A retryable error occurred. Code: RetryableError Message: A retryable error
perf_dpdk_minimal_netvsc_pmd (lisa_0_32) ❌ FAILED 26.108 failed. MissingPackagesException: Package manager could not install packages: git
perf_dpdk_minimal_failsafe_pmd (lisa_0_31) ✅ PASSED 63.518
perf_dpdk_send_only_netvsc_pmd (lisa_0_30) ❌ FAILED 130.085 failed. AssertionError: [any([0, 0, 0]) resolved to false. Test data was empty or all zeroes for dpdktestpmd.tx_pps_data
perf_dpdk_l3fwd_ntttcp_tcp (lisa_0_35) ⏭️ SKIPPED 29.659 skipped: l3fwd test not compatible, use X64 Ubuntu >= 22.04
perf_dpdk_send_only_failsafe_pmd (lisa_0_29) ⏭️ SKIPPED 17.819 skipped: Failsafe PMD test on MANA is not supported.
perf_dpdk_multi_queue_failsafe_pmd (lisa_0_33) ✅ PASSED 173.737
perf_dpdk_multi_queue_netvsc_pmd (lisa_0_34) ❌ FAILED 285.365 failed. AssertionError: [any([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]) resolved to false. Test data was empty or all zero
@mcgov
mcgov marked this pull request as ready for review July 16, 2026 22:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

2 participants