Back to Meshery

Test Report

docs/layouts/shortcodes/test-report.md

1.0.1918.2 KB
Original Source

END-TO-END TESTS

  • Testing started at: May 6th 2026, 11:51:50 pm

šŸ“¦ Test Result Summary

  • āœ… 134 passed
  • āŒ 3 failed
  • āš ļø 0 flaked
  • ā© 7 skipped

āŒ› Duration: 6 minutes and 59 seconds

Overall Result: šŸ‘Ž Some tests failed.

<details> <summary>[Show/Hide] Test Result Details</summary> <div markdown="1">
TestProviderBrowserTest CaseTagsResult
1Mesherychromium-meshery-providerAction buttons on adapters tabāœ…
2Mesherychromium-meshery-providerAggregation Charts are displayedāœ…
3Mesherychromium-meshery-provideralias resolutionrelationshipāœ…
4Mesherychromium-meshery-provideralias resolutionrelationshipāœ…
5Mesherychromium-meshery-provideralias resolutionrelationshipāœ…
6Mesherychromium-meshery-provideralias resolutionrelationshipāœ…
7Mesherychromium-meshery-provideralias resolutionrelationshipāœ…
8Mesherychromium-meshery-provideralias resolutionrelationshipāœ…
9Mesherychromium-meshery-provideralias resolutionrelationshipāœ…
10Mesherychromium-meshery-provideralias resolutionrelationshipāœ…
11Mesherychromium-meshery-provideralias resolutionrelationshipāœ…
12Mesherychromium-meshery-providerAll settings tabsāœ…
13Mesherychromium-meshery-providerCommon UI elementsāœ…
14Mesherychromium-meshery-providerconfig patching correctnessrelationshipāœ…
15Mesherychromium-meshery-providerconfig patching correctnessrelationshipāœ…
16Mesherychromium-meshery-providerconfig patching correctnessrelationshipāœ…
17Mesherychromium-meshery-providerconfig patching correctnessrelationshipāœ…
18Mesherychromium-meshery-providerconfig patching correctnessrelationshipāœ…
19Mesherychromium-meshery-providerconfig patching correctnessrelationshipāœ…
20Mesherychromium-meshery-providerconfig patching correctnessrelationshipāœ…
21Mesherychromium-meshery-providerconfig patching correctnessrelationshipāœ…
22Mesherychromium-meshery-providerconfig patching correctnessrelationshipāœ…
23Mesherychromium-meshery-providerConfigure Existing Istio adapter through Mesh Adapter URL from Management pageunstableāš ļø
24Mesherychromium-meshery-providerConnect to Meshery Istio Adapter and configure itāž–
25Mesherychromium-meshery-providerCreate a Modelāœ…
26Mesherychromium-meshery-providerDelete Kubernetes cluster connectionsāŒ
27Mesherychromium-meshery-providerevaluation idempotencyrelationshipāœ…
28Mesherychromium-meshery-providerevaluation idempotencyrelationshipāœ…
29Mesherychromium-meshery-providerevaluation idempotencyrelationshipāœ…
30Mesherychromium-meshery-providerevaluation idempotencyrelationshipāœ…
31Mesherychromium-meshery-providerevaluation idempotencyrelationshipāœ…
32Mesherychromium-meshery-providerevaluation idempotencyrelationshipāœ…
33Mesherychromium-meshery-providerevaluation idempotencyrelationshipāœ…
34Mesherychromium-meshery-providerevaluation idempotencyrelationshipāœ…
35Mesherychromium-meshery-providerevaluation idempotencyrelationshipāœ…
36Mesherychromium-meshery-providerGrafana elements on metrics tabāœ…
37Mesherychromium-meshery-providerImport a Model via CSV Importāž–
38Mesherychromium-meshery-providerImport a Model via File ImportāŒ
39Mesherychromium-meshery-providerImport a Model via Url Importāž–
40Mesherychromium-meshery-providerLogout from current user sessionāœ…
41Mesherychromium-meshery-providerPing Istio Adapterunstableāš ļø
42Mesherychromium-meshery-providerSearch a Model and Export itāœ…
43Mesherychromium-meshery-providershould edit design in Design Configuratorāœ…
44Mesherychromium-meshery-providershould identify relationships for All Relationshipsrelationshipāœ…
45Mesherychromium-meshery-providershould identify relationships for Container-Hierarchical-Parent-Alias-Relationshiprelationshipāœ…
46Mesherychromium-meshery-providershould identify relationships for deployment-configmap-reference-relationshiprelationshipāœ…
47Mesherychromium-meshery-providershould identify relationships for Hierarchical-Parent-Namespace-Relationshiprelationshipāœ…
48Mesherychromium-meshery-providershould identify relationships for meshery-designrelationshipāœ…
49Mesherychromium-meshery-providershould identify relationships for pv-pvc-edge-non-binding-reference-relationshiprelationshipāœ…
50Mesherychromium-meshery-providershould identify relationships for Service-To-Deployment-Networkrelationshipāœ…
51Mesherychromium-meshery-providershould verify Design Configurator page elementsāœ…
52Mesherychromium-meshery-providerstructural integrityrelationshipāœ…
53Mesherychromium-meshery-providerstructural integrityrelationshipāœ…
54Mesherychromium-meshery-providerstructural integrityrelationshipāœ…
55Mesherychromium-meshery-providerstructural integrityrelationshipāœ…
56Mesherychromium-meshery-providerstructural integrityrelationshipāœ…
57Mesherychromium-meshery-providerstructural integrityrelationshipāœ…
58Mesherychromium-meshery-providerstructural integrityrelationshipāœ…
59Mesherychromium-meshery-providerstructural integrityrelationshipāœ…
60Mesherychromium-meshery-providerstructural integrityrelationshipāœ…
61Mesherychromium-meshery-providerTest if Left Navigation Panel is displayedāœ…
62Mesherychromium-meshery-providerTest if Notification button is displayedāœ…
63Mesherychromium-meshery-providerTest if Profile button is displayedāœ…
64Mesherychromium-meshery-providerToggle "Send Anonymous Performance Results"āœ…
65Mesherychromium-meshery-providerToggle "Send Anonymous Usage Statistics"āœ…
66Mesherychromium-meshery-providerVerify Kanvas Detailsāœ…
67Mesherychromium-meshery-providerVerify Kanvas Snapshot UI elementsāœ…
68Mesherychromium-meshery-providerVerify Meshery Adapter for Istio Sectionāœ…
69Mesherychromium-meshery-providerVerify Meshery Catalog Section Detailsāœ…
70Mesherychromium-meshery-providerVerify Meshery Design Embed Detailsāœ…
71Mesherychromium-meshery-providerVerify Meshery Docker Extension Detailsāœ…
72Mesherychromium-meshery-providerVerify Performance Analysis Detailsāœ…
73Mesherychromium-meshery-providerVerify that UI components are displayedāœ…
74Nonechromium-local-providerAction buttons on adapters tabāœ…
75Nonechromium-local-providerAggregation Charts are displayedāœ…
76Nonechromium-local-provideralias resolutionrelationshipāœ…
77Nonechromium-local-provideralias resolutionrelationshipāœ…
78Nonechromium-local-provideralias resolutionrelationshipāœ…
79Nonechromium-local-provideralias resolutionrelationshipāœ…
80Nonechromium-local-provideralias resolutionrelationshipāœ…
81Nonechromium-local-provideralias resolutionrelationshipāœ…
82Nonechromium-local-provideralias resolutionrelationshipāœ…
83Nonechromium-local-provideralias resolutionrelationshipāœ…
84Nonechromium-local-provideralias resolutionrelationshipāœ…
85Nonechromium-local-providerAll settings tabsāœ…
86Nonechromium-local-providerCommon UI elementsāœ…
87Nonechromium-local-providerconfig patching correctnessrelationshipāœ…
88Nonechromium-local-providerconfig patching correctnessrelationshipāœ…
89Nonechromium-local-providerconfig patching correctnessrelationshipāœ…
90Nonechromium-local-providerconfig patching correctnessrelationshipāœ…
91Nonechromium-local-providerconfig patching correctnessrelationshipāœ…
92Nonechromium-local-providerconfig patching correctnessrelationshipāœ…
93Nonechromium-local-providerconfig patching correctnessrelationshipāœ…
94Nonechromium-local-providerconfig patching correctnessrelationshipāœ…
95Nonechromium-local-providerconfig patching correctnessrelationshipāœ…
96Nonechromium-local-providerConfigure Existing Istio adapter through Mesh Adapter URL from Management pageunstableāš ļø
97Nonechromium-local-providerConnect to Meshery Istio Adapter and configure itāž–
98Nonechromium-local-providerCreate a Modelāœ…
99Nonechromium-local-providerDelete Kubernetes cluster connectionsāž–
100Nonechromium-local-providerevaluation idempotencyrelationshipāœ…
101Nonechromium-local-providerevaluation idempotencyrelationshipāœ…
102Nonechromium-local-providerevaluation idempotencyrelationshipāœ…
103Nonechromium-local-providerevaluation idempotencyrelationshipāœ…
104Nonechromium-local-providerevaluation idempotencyrelationshipāœ…
105Nonechromium-local-providerevaluation idempotencyrelationshipāœ…
106Nonechromium-local-providerevaluation idempotencyrelationshipāœ…
107Nonechromium-local-providerevaluation idempotencyrelationshipāœ…
108Nonechromium-local-providerevaluation idempotencyrelationshipāœ…
109Nonechromium-local-providerGrafana elements on metrics tabāœ…
110Nonechromium-local-providerImport a Model via CSV Importāž–
111Nonechromium-local-providerImport a Model via File ImportāŒ
112Nonechromium-local-providerImport a Model via Url Importāž–
113Nonechromium-local-providerLogout from current user sessionāœ…
114Nonechromium-local-providerPing Istio Adapterunstableāš ļø
115Nonechromium-local-providerSearch a Model and Export itāœ…
116Nonechromium-local-providershould edit design in Design Configuratorāœ…
117Nonechromium-local-providershould identify relationships for All Relationshipsrelationshipāœ…
118Nonechromium-local-providershould identify relationships for Container-Hierarchical-Parent-Alias-Relationshiprelationshipāœ…
119Nonechromium-local-providershould identify relationships for deployment-configmap-reference-relationshiprelationshipāœ…
120Nonechromium-local-providershould identify relationships for Hierarchical-Parent-Namespace-Relationshiprelationshipāœ…
121Nonechromium-local-providershould identify relationships for meshery-designrelationshipāœ…
122Nonechromium-local-providershould identify relationships for pv-pvc-edge-non-binding-reference-relationshiprelationshipāœ…
123Nonechromium-local-providershould identify relationships for Service-To-Deployment-Networkrelationshipāœ…
124Nonechromium-local-providershould verify Design Configurator page elementsāœ…
125Nonechromium-local-providerstructural integrityrelationshipāœ…
126Nonechromium-local-providerstructural integrityrelationshipāœ…
127Nonechromium-local-providerstructural integrityrelationshipāœ…
128Nonechromium-local-providerstructural integrityrelationshipāœ…
129Nonechromium-local-providerstructural integrityrelationshipāœ…
130Nonechromium-local-providerstructural integrityrelationshipāœ…
131Nonechromium-local-providerstructural integrityrelationshipāœ…
132Nonechromium-local-providerstructural integrityrelationshipāœ…
133Nonechromium-local-providerstructural integrityrelationshipāœ…
134Nonechromium-local-providerTest if Left Navigation Panel is displayedāœ…
135Nonechromium-local-providerTest if Notification button is displayedāœ…
136Nonechromium-local-providerTest if Profile button is displayedāœ…
137Nonechromium-local-providerToggle "Send Anonymous Performance Results"āœ…
138Nonechromium-local-providerToggle "Send Anonymous Usage Statistics"āœ…
139Nonechromium-local-providerVerify Kanvas Detailsāœ…
140Nonechromium-local-providerVerify Kanvas Snapshot UI elementsāœ…
141Nonechromium-local-providerVerify Meshery Adapter for Istio Sectionāœ…
142Nonechromium-local-providerVerify Meshery Catalog Section Detailsāœ…
143Nonechromium-local-providerVerify Meshery Design Embed Detailsāœ…
144Nonechromium-local-providerVerify Meshery Docker Extension Detailsāœ…
145Nonechromium-local-providerVerify Performance Analysis Detailsāœ…
146Nonechromium-local-providerVerify that UI components are displayedāœ…
147Nonelocal-setupauthenticate as None providerāœ…
148Noneremote-setupauthenticate with Remote Providerāœ…
</div> </details>

āŒ Failed Test Details

The following tests failed. Click on each to see the failure reason:

<details> <summary>āŒ Delete Kubernetes cluster connections (Meshery - chromium-meshery-provider)</summary>

File Location: /home/runner/work/meshery/meshery/ui/tests/e2e/utils/waitForSnackBar.ts

Error Message:

Error: expect(locator).toBeVisible() failed

Locator: locator('text=Connection status updated').first()
Expected: visible
Timeout: 60000ms
Error: element(s) not found

Call log:
  - Expect "toBeVisible" with timeout 60000ms
  - waiting for locator('text=Connection status updated').first()

Code Snippet:

   at utils/waitForSnackBar.ts:5

  3 | export const waitForSnackBar = async (page: Page, message: string): Promise<void> => {
  4 |   const snackbar = page.locator(`text=${message}`).first();
> 5 |   await expect(snackbar).toBeVisible();
    |                          ^
  6 |   await snackbar.waitFor({ state: 'detached', timeout: 10000 });
  7 | };
  8 |
</details> <details> <summary>āŒ Import a Model via File Import (Meshery - chromium-meshery-provider)</summary>

File Location: Not Found

Error Message:

Test timeout of 60000ms exceeded.
</details> <details> <summary>āŒ Import a Model via File Import (None - chromium-local-provider)</summary>

File Location: Not Found

Error Message:

Test timeout of 60000ms exceeded.
</details>

šŸ”— Relationship Tests

<details> <summary>[Show/Hide] Relationship Test Details (18 tests)</summary> <div markdown="1">
KindTypeSubTypeFromToModelDesign NameStatus
edgebindingpermissionClusterRoleServiceAccountkubernetesUnderstanding Relationshipsāœ…
edgebindingpermissionRoleServiceAccountkubernetesUnderstanding Relationshipsāœ…
edgenon-bindingnetworkServiceDeploymentkubernetesservice-to-deployment-networkāœ…
edgenon-bindingnetworkServiceDeploymentkubernetesmeshery-design-fixture.jsonāœ…
edgenon-bindingreferenceClusterRoleBindingClusterRolekubernetesmeshery-design-fixture.jsonāŒ
hierarchicalparentaliasContainerDeploymentkubernetescontainer-hierarchical-parent-alias-relationshipāœ…
hierarchicalparentaliasContainerDeploymentkubernetesdeployment-configmap-reference-relationshipāœ…
hierarchicalparentaliasContainerDeploymentkubernetesservice-to-deployment-networkāœ…
hierarchicalparentaliasContainerDeploymentkubernetesmeshery-design-fixture.jsonāœ…
hierarchicalparentaliasContainerDeploymentkubernetesUnderstanding Relationshipsāœ…
hierarchicalparentaliasContainerPodkubernetescontainer-hierarchical-parent-alias-relationshipāœ…
hierarchicalparentinventory*Namespacekuberneteshierarchical-parent-namespace-relationshipāœ…
hierarchicalparentinventory*Namespacekubernetesservice-to-deployment-networkāœ…
hierarchicalparentinventory*Namespacekubernetespv-pvc-edge-non-binding-reference-relationshipāœ…
hierarchicalparentinventory*NamespacekubernetesUnderstanding Relationshipsāœ…
hierarchicalsiblingmatchlabelsClusterRoleClusterRolekubernetesmeshery-design-fixture.jsonāœ…
hierarchicalsiblingmatchlabelsDeploymentDeploymentkubernetesmeshery-design-fixture.jsonāœ…
hierarchicalsiblingmatchlabelsServiceServicekubernetesmeshery-design-fixture.jsonāœ…
</div> </details> <!-- To see the full report, please visit our CI/CD pipeline with reporter. -->