go.ligato.io/vpp-agent/v3@v3.5.0/tests/robot/suites/integration/restarts/scale_restarts.robot (about) 1 *** Settings *** 2 Resource ../../../libraries/kubernetes/Restarts_Setup.robot 3 Resource ../../../libraries/kubernetes/KubeTestOperations.robot 4 5 Resource ../../../variables/${VARIABLES}_variables.robot 6 7 Library SSHLibrary 8 9 Force Tags integration ExpectedFailure 10 Suite Setup Run Keywords 11 ... KubeSetup.Kubernetes Suite Setup ${CLUSTER_ID} 12 ... AND Restarts Suite Setup with ${16} VNFs at ${6} memifs each and ${48} non-VPP containers 13 Suite Teardown Restarts Suite Teardown 14 Test Teardown Recreate Topology If Test Failed 15 16 Documentation Test suite for Kubernetes pod restarts using a large number 17 ... of VNF and non-VPP pods. 18 ... 19 ... Restart performed through kubernetes pod deletion and through 20 ... segmentation fault signal sent to VPP. 21 ... 22 ... Connectivity verified using "ping" command from every non-VPP pod to each 23 ... visible VNF pod. 24 25 *** Variables *** 26 ${VARIABLES}= common 27 ${ENV}= common 28 ${CLUSTER_ID}= INTEGRATION1 29 ${vnf0_ip}= 192.168.1.1 30 ${novpp0_ip}= 192.168.1.2 31 32 ${repeats}= 1 33 34 *** Test Cases *** 35 Scale restart scenario - VNF 36 Repeat Keyword ${repeats} Scale restart scenario - VNF 37 38 Scale restart scenario - noVPP 39 Repeat Keyword ${repeats} Scale restart scenario - noVPP 40 41 Scale restart scenario - VSwitch 42 Repeat Keyword ${repeats} Scale restart scenario - VSwitch 43 44 Scale Restart Scenario - VSwitch and VNF 45 Repeat Keyword ${repeats} Scale Restart Scenario - VSwitch and VNF 46 47 Scale Restart Scenario - VSwitch and noVPP 48 Repeat Keyword ${repeats} Scale Restart Scenario - VSwitch and noVPP 49 50 Scale Restart Scenario - VSwitch, noVPP and VNF 51 Repeat Keyword ${repeats} Scale Restart Scenario - VSwitch, noVPP and VNF 52 53 Scale Restart Scenario - full topology in sequence etcd-vswitch-pods-sfc 54 Repeat Keyword ${repeats} Scale Restart Scenario - full topology in sequence etcd-vswitch-pods-sfc 55 56 Scale Restart Scenario - full topology in sequence etcd-vswitch-sfc-pods 57 Repeat Keyword ${repeats} Scale Restart Scenario - full topology in sequence etcd-vswitch-sfc-pods 58 59 Scale Restart Scenario - full topology in sequence etcd-sfc-vswitch-pods 60 Repeat Keyword ${repeats} Scale Restart Scenario - full topology in sequence etcd-sfc-vswitch-pods 61 62 Scale Restart Scenario - full topology in sequence etcd-sfc-pods-vswitch 63 Repeat Keyword ${repeats} Scale Restart Scenario - full topology in sequence etcd-sfc-pods-vswitch 64 65 66 *** Keywords *** 67 Recreate Topology If Test Failed 68 [Documentation] After a failed test, delete the kubernetes topology 69 ... and create it again. 70 BuiltIn.Run Keyword If Test Failed Run Keywords 71 ... Log Pods For Debug ${testbed_connection} 72 ... AND Cleanup_Restarts_Deployment_On_Cluster ${testbed_connection} 73 ... AND Restarts Suite Setup with ${16} VNFs at ${6} memifs each and ${48} non-VPP containers 74 75 Scale restart scenario - VNF 76 [Documentation] Restart all VNF nodes, ping their IP addresses from the non-VPP 77 ... nodes until each receives a reply, then verify connectivity both ways. 78 79 Ping Until Success - Unix Ping novpp-0 ${vnf0_ip} timeout=120s 80 Scale Verify Connectivity - Unix Ping 81 Scale Pod Restart - Pod Deletion vnf 82 Scale Wait For Reconnect - Unix Ping 83 Scale Verify Connectivity - Unix Ping 84 85 Scale Pod Restart - VPP SIGSEGV vnf 86 Scale Wait For Reconnect - Unix Ping 87 Scale Verify Connectivity - Unix Ping 88 89 Scale restart scenario - noVPP 90 [Documentation] Restart non-VPP node, ping it's IP address from the VNF 91 ... node until a reply is received, then verify connectivity both ways. 92 93 Ping Until Success - Unix Ping novpp-0 ${vnf0_ip} timeout=120s 94 Scale Verify Connectivity - Unix Ping 95 Scale Pod Restart - Pod Deletion novpp 96 Scale Wait For Reconnect - VPP Ping 97 Scale Verify Connectivity - Unix Ping 98 99 Scale restart scenario - VSwitch 100 [Documentation] Restart the vswitch, ping the VNF's IP address from 101 ... the non-VPP node until a reply is received, then verify connectivity 102 ... both ways. 103 104 Ping Until Success - Unix Ping novpp-0 ${vnf0_ip} timeout=120s 105 Scale Verify Connectivity - Unix Ping 106 Trigger Pod Restart - Pod Deletion ${testbed_connection} ${vswitch_pod_name} vswitch=${TRUE} 107 Scale Wait For Reconnect - Unix Ping 108 Scale Verify Connectivity - Unix Ping 109 110 Trigger Pod Restart - VPP SIGSEGV ${vswitch_pod_name} 111 Scale Wait For Reconnect - Unix Ping 112 Scale Verify Connectivity - Unix Ping 113 114 Scale Restart Scenario - VSwitch and VNF 115 [Documentation] Restart vswitch and VNF, ping the VNF's IP address from 116 ... the non-VPP node until a reply is received, then verify connectivity 117 ... both ways. 118 119 Ping Until Success - Unix Ping novpp-0 ${vnf0_ip} timeout=120s 120 Scale Verify Connectivity - Unix Ping 121 Scale Pod Restart - Pod Deletion vnf 122 Trigger Pod Restart - Pod Deletion ${testbed_connection} ${vswitch_pod_name} vswitch=${TRUE} 123 Scale Wait For Reconnect - Unix Ping 124 Scale Verify Connectivity - Unix Ping 125 126 Scale Pod Restart - VPP SIGSEGV vnf 127 Trigger Pod Restart - VPP SIGSEGV ${vswitch_pod_name} 128 Scale Wait For Reconnect - Unix Ping 129 Scale Verify Connectivity - Unix Ping 130 131 Scale Restart Scenario - VSwitch and noVPP 132 [Documentation] Restart vswitch and non-VPP pod, ping the non-VPP 133 ... pod's IP address from the VNF node until a reply is received, then 134 ... verify connectivity both ways. 135 136 Ping Until Success - Unix Ping novpp-0 ${vnf0_ip} timeout=120s 137 Scale Verify Connectivity - Unix Ping 138 Scale Pod Restart - Pod Deletion novpp 139 Trigger Pod Restart - Pod Deletion ${testbed_connection} ${vswitch_pod_name} vswitch=${TRUE} 140 Scale Wait For Reconnect - VPP Ping 141 Scale Verify Connectivity - Unix Ping 142 143 Scale Pod Restart - Pod Deletion novpp 144 Trigger Pod Restart - VPP SIGSEGV ${vswitch_pod_name} 145 Scale Wait For Reconnect - VPP Ping 146 Scale Verify Connectivity - Unix Ping 147 148 Scale Restart Scenario - VSwitch, noVPP and VNF 149 [Documentation] Restart vswitch, VNF and non-VPP pod, ping the non-VPP 150 ... pod's IP address from the VNF node until a reply is received, then 151 ... verify connectivity both ways. 152 153 Ping Until Success - Unix Ping novpp-0 ${vnf0_ip} timeout=120s 154 Scale Verify Connectivity - Unix Ping 155 Scale Pod Restart - Pod Deletion vnf 156 Scale Pod Restart - Pod Deletion novpp 157 Trigger Pod Restart - Pod Deletion ${testbed_connection} ${vswitch_pod_name} vswitch=${TRUE} 158 Scale Wait For Reconnect - VPP Ping 159 Scale Verify Connectivity - Unix Ping 160 161 Scale Pod Restart - VPP SIGSEGV vnf 162 Scale Pod Restart - Pod Deletion novpp 163 Trigger Pod Restart - VPP SIGSEGV ${vswitch_pod_name} 164 Scale Wait For Reconnect - VPP Ping 165 Scale Verify Connectivity - Unix Ping 166 167 Scale Restart Scenario - full topology in sequence etcd-vswitch-pods-sfc 168 [Documentation] Restart the full topology, then bring it back up in the 169 ... specified sequence and verify connectivity between VNF and non-VPP 170 ... pods. 171 172 Scale Wait For Reconnect - Unix Ping 173 Scale Verify Connectivity - Unix Ping 174 Restart Topology With Startup Sequence etcd vswitch vnf novpp sfc 175 Scale Wait For Reconnect - Unix Ping 176 Scale Verify Connectivity - Unix Ping 177 178 Scale Restart Scenario - full topology in sequence etcd-vswitch-sfc-pods 179 [Documentation] Restart the full topology, then bring it back up in the 180 ... specified sequence and verify connectivity between VNF and non-VPP 181 ... pods. 182 183 Scale Wait For Reconnect - Unix Ping 184 Scale Verify Connectivity - Unix Ping 185 Restart Topology With Startup Sequence etcd vswitch sfc vnf novpp 186 Scale Wait For Reconnect - Unix Ping 187 Scale Verify Connectivity - Unix Ping 188 189 Scale Restart Scenario - full topology in sequence etcd-sfc-vswitch-pods 190 [Documentation] Restart the full topology, then bring it back up in the 191 ... specified sequence and verify connectivity between VNF and non-VPP 192 ... pods. 193 194 Scale Wait For Reconnect - Unix Ping 195 Scale Verify Connectivity - Unix Ping 196 Restart Topology With Startup Sequence etcd sfc vswitch vnf novpp 197 Scale Wait For Reconnect - Unix Ping 198 Scale Verify Connectivity - Unix Ping 199 200 Scale Restart Scenario - full topology in sequence etcd-sfc-pods-vswitch 201 [Documentation] Restart the full topology, then bring it back up in the 202 ... specified sequence and verify connectivity between VNF and non-VPP 203 ... pods. 204 205 Scale Wait For Reconnect - Unix Ping 206 Scale Verify Connectivity - Unix Ping 207 Restart Topology With Startup Sequence etcd sfc vnf novpp vswitch 208 Scale Wait For Reconnect - Unix Ping 209 Scale Verify Connectivity - Unix Ping