[HEALTH] 4.20 Health Check, please don't merge this! by DaanHoogland · Pull Request #10006 · apache/cloudstack

DaanHoogland · 2024-11-28T16:39:13Z

Description

This PR...

Types of changes

Breaking change (fix or feature that would cause existing functionality to change)
New feature (non-breaking change which adds functionality)
Bug fix (non-breaking change which fixes an issue)
Enhancement (improves an existing feature and functionality)
Cleanup (Code refactoring and cleanup, that may add test cases)
build/CI
test (unit or integration test code)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

Major
Minor

Bug Severity

Screenshots (if appropriate):

How Has This Been Tested?

How did you try to break this feature and the system with this change?

DaanHoogland · 2024-11-28T16:39:51Z

@blueorangutan package

blueorangutan · 2024-11-28T16:42:04Z

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

codecov · 2024-11-28T16:45:15Z

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 16.02%. Comparing base (f8adedc) to head (5a768b2).
Report is 33 commits behind head on 4.20.

Additional details and impacted files

@@             Coverage Diff              @@
##               4.20   #10006      +/-   ##
============================================
+ Coverage     16.00%   16.02%   +0.01%     
- Complexity    13104    13230     +126     
============================================
  Files          5651     5652       +1     
  Lines        495843   501186    +5343     
  Branches      60045    62221    +2176     
============================================
+ Hits          79363    80302     +939     
- Misses       407624   411977    +4353     
- Partials       8856     8907      +51

Flag	Coverage Δ
uitests	`3.95% <ø> (-0.06%)`	⬇️
unittests	`16.86% <ø> (+0.02%)`	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

blueorangutan · 2024-11-28T17:48:37Z

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 11641

DaanHoogland · 2024-11-29T08:19:06Z

zero day test
@blueorangutan test matrix

blueorangutan · 2024-11-29T08:20:03Z

@DaanHoogland a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

blueorangutan · 2024-11-29T09:09:33Z

[SF] Trillian Build Failed (tid-11818)

blueorangutan · 2024-11-29T09:17:51Z

[SF] Trillian Build Failed (tid-11817)

DaanHoogland · 2024-12-12T10:23:25Z

@blueorangutan package

blueorangutan · 2024-12-12T10:24:04Z

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

blueorangutan · 2024-12-12T10:26:12Z

Packaging result [SF]: ✖️ el8 ✖️ el9 ✖️ debian ✖️ suse15. SL-JID 11785

DaanHoogland · 2024-12-12T10:46:02Z

@blueorangutan package

blueorangutan · 2024-12-12T10:48:07Z

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

blueorangutan · 2024-12-12T11:54:50Z

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 11789

DaanHoogland · 2024-12-12T11:56:59Z

@blueorangutan test matrix

blueorangutan · 2024-12-12T11:58:03Z

@DaanHoogland a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

blueorangutan · 2024-12-13T03:45:58Z

[SF] Trillian test result (tid-11888)
Environment: kvm-ol8 (x2), Advanced Networking with Mgmt server ol8
Total time taken: 54177 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t11888-kvm-ol8.zip
Smoke tests completed. 141 look OK, 0 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File

blueorangutan · 2024-12-13T05:25:57Z

[SF] Trillian test result (tid-11889)
Environment: kvm-ubuntu22 (x2), Advanced Networking with Mgmt server u22
Total time taken: 60776 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t11889-kvm-ubuntu22.zip
Smoke tests completed. 140 look OK, 1 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_oobm_multiple_mgmt_server_ownership	`Failure`	31.79	test_outofbandmanagement.py

blueorangutan · 2024-12-14T01:50:57Z

[SF] Trillian test result (tid-11895)
Environment: vmware-70u3 (x2), Advanced Networking with Mgmt server ol8
Total time taken: 70916 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t11895-vmware-70u3.zip
Smoke tests completed. 138 look OK, 3 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_deploy_more_vms_than_limit_allows	`Error`	138.47	test_deploy_vms_in_parallel.py
test_01_deployVMInSharedNetwork	`Failure`	3603.40	test_network.py
ContextSuite context=TestSharedNetworkWithConfigDrive>:teardown	`Error`	3604.62	test_network.py
test_02_restore_vm_with_disk_offering	`Error`	53.00	test_restore_vm.py
test_03_restore_vm_with_disk_offering_custom_size	`Error`	51.91	test_restore_vm.py

DaanHoogland · 2024-12-14T16:53:53Z

@blueorangutan package

blueorangutan · 2024-12-14T16:56:03Z

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

blueorangutan · 2024-12-14T18:20:19Z

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 11810

DaanHoogland · 2024-12-14T18:43:01Z

@blueorangutan test matrix

blueorangutan · 2024-12-14T18:44:05Z

@DaanHoogland a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

blueorangutan · 2024-12-15T11:28:41Z

[SF] Trillian test result (tid-11904)
Environment: kvm-ubuntu22 (x2), Advanced Networking with Mgmt server u22
Total time taken: 58240 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t11904-kvm-ubuntu22.zip
Smoke tests completed. 140 look OK, 1 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_oobm_multiple_mgmt_server_ownership	`Failure`	30.75	test_outofbandmanagement.py

blueorangutan · 2024-12-15T12:06:58Z

[SF] Trillian test result (tid-11903)
Environment: kvm-ol8 (x2), Advanced Networking with Mgmt server ol8
Total time taken: 59937 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t11903-kvm-ol8.zip
Smoke tests completed. 141 look OK, 0 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File

DaanHoogland · 2024-12-16T09:37:48Z

@blueorangutan test matrix

DaanHoogland · 2025-03-24T10:55:45Z

@blueorangutan package

blueorangutan · 2025-03-24T10:58:04Z

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

blueorangutan · 2025-03-24T12:02:59Z

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 12872

DaanHoogland · 2025-03-24T12:11:39Z

@blueorangutan test matrix

blueorangutan · 2025-03-24T12:12:04Z

@DaanHoogland a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

blueorangutan · 2025-03-24T13:04:57Z

[SF] Trillian Build Failed (tid-12813)

blueorangutan · 2025-03-25T11:45:21Z

[SF] Trillian test result (tid-12810)
Environment: kvm-ol8 (x2), Advanced Networking with Mgmt server ol8
Total time taken: 81800 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t12810-kvm-ol8.zip
Smoke tests completed. 135 look OK, 6 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Test File
ContextSuite context=TestIsolatedNetworksPasswdServer>:setup	`Error`	test_password_server.py
ContextSuite context=TestPortForwardingRules>:setup	`Error`	test_portforwardingrules.py
ContextSuite context=TestRouterDHCPHosts>:setup	`Error`	test_router_dhcphosts.py
ContextSuite context=TestRouterDHCPOpts>:setup	`Error`	test_router_dhcphosts.py
ContextSuite context=TestRouterDns>:setup	`Error`	test_router_dns.py
ContextSuite context=TestRouterIpTablesPolicies>:setup	`Error`	test_routers_iptables_default_policy.py
ContextSuite context=TestVPCIpTablesPolicies>:setup	`Error`	test_routers_iptables_default_policy.py
ContextSuite context=TestIsolatedNetworks>:setup	`Error`	test_routers_network_ops.py
ContextSuite context=TestRedundantIsolateNetworks>:setup	`Error`	test_routers_network_ops.py

blueorangutan · 2025-03-25T12:01:18Z

[SF] Trillian test result (tid-12811)
Environment: kvm-ubuntu22 (x2), Advanced Networking with Mgmt server u22
Total time taken: 83538 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t12811-kvm-ubuntu22.zip
Smoke tests completed. 134 look OK, 7 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_delete_account	`Error`	1517.39	test_network.py
test_delete_network_while_vm_on_it	`Error`	1.22	test_network.py
test_deploy_vm_l2network	`Error`	1.22	test_network.py
test_l2network_restart	`Error`	2.36	test_network.py
ContextSuite context=TestPortForwarding>:setup	`Error`	3.63	test_network.py
ContextSuite context=TestPublicIP>:setup	`Error`	11.28	test_network.py
test_reboot_router	`Failure`	0.09	test_network.py
test_releaseIP	`Error`	5.69	test_network.py
test_releaseIP_using_IP	`Error`	5.95	test_network.py
ContextSuite context=TestRouterRules>:setup	`Error`	6.04	test_network.py
ContextSuite context=TestSharedNetworkWithConfigDrive>:setup	`Error`	1521.94	test_network.py
ContextSuite context=TestAdapterTypeForNic>:setup	`Error`	0.00	test_nic_adapter_type.py
test_oobm_multiple_mgmt_server_ownership	`Failure`	31.81	test_outofbandmanagement.py
ContextSuite context=TestRestoreVM>:setup	`Error`	0.00	test_restore_vm.py
ContextSuite context=TestRouterDHCPHosts>:setup	`Error`	0.00	test_router_dhcphosts.py
ContextSuite context=TestRouterDHCPOpts>:setup	`Error`	0.00	test_router_dhcphosts.py
ContextSuite context=TestRouterDns>:setup	`Error`	0.00	test_router_dns.py
ContextSuite context=TestRouterIpTablesPolicies>:setup	`Error`	0.00	test_routers_iptables_default_policy.py
ContextSuite context=TestVPCIpTablesPolicies>:setup	`Error`	0.00	test_routers_iptables_default_policy.py

Pearl1594 · 2025-03-28T15:36:05Z

@blueorangutan package

blueorangutan · 2025-03-28T15:38:04Z

@Pearl1594 a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

blueorangutan · 2025-03-28T16:57:26Z

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 12919

DaanHoogland · 2025-03-28T18:32:13Z

@blueorangutan test matrix

blueorangutan · 2025-03-28T18:34:03Z

@DaanHoogland a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

blueorangutan · 2025-03-28T18:37:25Z

[SF] Trillian Build Failed (tid-12849)

blueorangutan · 2025-03-28T18:37:36Z

[SF] Trillian Build Failed (tid-12851)

blueorangutan · 2025-03-28T18:37:55Z

[SF] Trillian Build Failed (tid-12850)

blueorangutan · 2025-03-29T16:47:04Z

[SF] Trillian test result (tid-12852)
Environment: xcpng82 (x2), Advanced Networking with Mgmt server ol9
Total time taken: 78004 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t12852-xcpng82.zip
Smoke tests completed. 136 look OK, 5 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
ContextSuite context=TestClusterDRS>:setup	`Error`	0.00	test_cluster_drs.py
ContextSuite context=TestSharedNetworkWithConfigDrive>:setup	`Error`	11.64	test_network.py
test_01_non_strict_host_anti_affinity	`Error`	238.22	test_nonstrict_affinity_group.py
test_02_non_strict_host_affinity	`Error`	120.41	test_nonstrict_affinity_group.py
test_02_create_volume	`Error`	5.26	test_resource_names.py
test_05_scale_vm_dont_allow_disk_offering_change	`Failure`	67.61	test_scale_vm.py

DaanHoogland · 2025-03-29T18:43:14Z

@blueorangutan package

blueorangutan · 2025-03-29T18:44:03Z

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

blueorangutan · 2025-03-29T19:51:21Z

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 12926

DaanHoogland · 2025-04-01T06:55:03Z

@blueorangutan test matrix

blueorangutan · 2025-04-01T06:56:04Z

@DaanHoogland a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

blueorangutan · 2025-04-01T09:09:43Z

[SF] Trillian Build Failed (tid-12871)

blueorangutan · 2025-04-01T22:08:16Z

[SF] Trillian test result (tid-12869)
Environment: kvm-ol8 (x2), Advanced Networking with Mgmt server ol8
Total time taken: 51856 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t12869-kvm-ol8.zip
Smoke tests completed. 141 look OK, 0 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File

blueorangutan · 2025-04-02T00:43:19Z

[SF] Trillian test result (tid-12870)
Environment: kvm-ubuntu22 (x2), Advanced Networking with Mgmt server u22
Total time taken: 61818 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t12870-kvm-ubuntu22.zip
Smoke tests completed. 140 look OK, 1 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_oobm_multiple_mgmt_server_ownership	`Failure`	31.90	test_outofbandmanagement.py
test_oobm_zchange_password	`Error`	6.50	test_outofbandmanagement.py

blueorangutan · 2025-04-02T04:54:14Z

[SF] Trillian test result (tid-12872)
Environment: xcpng82 (x2), Advanced Networking with Mgmt server ol9
Total time taken: 76994 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t12872-xcpng82.zip
Smoke tests completed. 136 look OK, 5 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
ContextSuite context=TestClusterDRS>:setup	`Error`	0.00	test_cluster_drs.py
ContextSuite context=TestSharedNetworkWithConfigDrive>:setup	`Error`	8.51	test_network.py
test_01_non_strict_host_anti_affinity	`Error`	232.44	test_nonstrict_affinity_group.py
test_02_non_strict_host_affinity	`Error`	117.47	test_nonstrict_affinity_group.py
test_02_create_volume	`Error`	3.24	test_resource_names.py
test_05_scale_vm_dont_allow_disk_offering_change	`Failure`	70.59	test_scale_vm.py

yadvr · 2025-04-08T10:59:03Z

#10668

…e#10501) Failures seen in apache#10006 (comment) and others. With apache#9773, the response of listManagementServers API has been changed. serviceip has been renamed to ipaddress. This was causing not all MS getting restarted and purge b/g task not being able to run. The code handling API response in the test has been updated. Signed-off-by: Abhishek Kumar <[email protected]>

DaanHoogland added the type:healthcheckrun label Dec 12, 2024

DaanHoogland force-pushed the healthcheck-4.20 branch from 7da03d1 to 992bb03 Compare December 12, 2024 10:45

DaanHoogland force-pushed the healthcheck-4.20 branch from 992bb03 to 4ca4f34 Compare December 14, 2024 16:53

yadvr closed this Apr 8, 2025

yadvr removed the type:healthcheckrun label Apr 8, 2025

Conversation

DaanHoogland commented Nov 28, 2024

Description

Types of changes

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

Bug Severity

Screenshots (if appropriate):

How Has This Been Tested?

How did you try to break this feature and the system with this change?

Uh oh!

DaanHoogland commented Nov 28, 2024

Uh oh!

blueorangutan commented Nov 28, 2024

Uh oh!

codecov bot commented Nov 28, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

blueorangutan commented Nov 28, 2024

Uh oh!

DaanHoogland commented Nov 29, 2024

Uh oh!

blueorangutan commented Nov 29, 2024

Uh oh!

blueorangutan commented Nov 29, 2024

Uh oh!

blueorangutan commented Nov 29, 2024

Uh oh!

DaanHoogland commented Dec 12, 2024

Uh oh!

blueorangutan commented Dec 12, 2024

Uh oh!

blueorangutan commented Dec 12, 2024

Uh oh!

DaanHoogland commented Dec 12, 2024

Uh oh!

blueorangutan commented Dec 12, 2024

Uh oh!

blueorangutan commented Dec 12, 2024

Uh oh!

DaanHoogland commented Dec 12, 2024

Uh oh!

blueorangutan commented Dec 12, 2024

Uh oh!

blueorangutan commented Dec 13, 2024

Uh oh!

blueorangutan commented Dec 13, 2024

Uh oh!

blueorangutan commented Dec 14, 2024

Uh oh!

DaanHoogland commented Dec 14, 2024

Uh oh!

blueorangutan commented Dec 14, 2024

Uh oh!

blueorangutan commented Dec 14, 2024

Uh oh!

DaanHoogland commented Dec 14, 2024

Uh oh!

blueorangutan commented Dec 14, 2024

Uh oh!

blueorangutan commented Dec 15, 2024

Uh oh!

blueorangutan commented Dec 15, 2024

Uh oh!

DaanHoogland commented Dec 16, 2024

Uh oh!

DaanHoogland commented Mar 24, 2025

Uh oh!

blueorangutan commented Mar 24, 2025

Uh oh!

blueorangutan commented Mar 24, 2025

Uh oh!

DaanHoogland commented Mar 24, 2025

Uh oh!

blueorangutan commented Mar 24, 2025

Uh oh!

blueorangutan commented Mar 24, 2025

Uh oh!

blueorangutan commented Mar 25, 2025

codecov bot commented Nov 28, 2024 •

edited

Loading