This job view page is being replaced by Spyglass soon. Check out the new job view.
PRCecileRobertMichon: Fix e2e tests to work with CAPZ
ResultABORTED
Tests 0 failed / 38 succeeded
Started2021-04-30 23:10
Elapsed1h3m
Revision6153d29ba69dc3cb8116241c4ba7506bc56316e8
Refs 607
job-versionv1.21.1-rc.0.39+40d83ef170a4c6
kubetest-version
revisionv1.21.1-rc.0.39+40d83ef170a4c6

No Test Failures!


Show 38 Passed Tests

Show 10 Skipped Tests

Error lines from build-log.txt

... skipping 271 lines ...
Apr 30 23:21:27.806: INFO: Creating a kubernetes client
Apr 30 23:21:27.806: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
Apr 30 23:21:27.976: INFO: Creating deployment servicelb-test
Apr 30 23:21:28.034: INFO: Creating service servicelb-test in namespace e2e-tests-service-lb-zt25g
Apr 30 23:21:28.136: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-zt25g
Apr 30 23:21:28.136: INFO: Waiting service to expose...
Apr 30 23:21:28.191: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:21:38.249: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:21:48.248: INFO: Exposure successfully, get external ip: 20.190.6.102
Apr 30 23:21:48.248: INFO: Getting public IPs in the resourceGroup kubetest-kstdvhui
Apr 30 23:21:48.730: INFO: Getting public IP frontend configuration ID
Apr 30 23:21:48.730: INFO: Successfully obtained PIP front config id: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/a72a7d91d61a746fcaf2254b997d7a7d
Apr 30 23:21:48.730: INFO: Getting loadBalancer name from pipFrontendConfigurationID
Apr 30 23:21:48.730: INFO: Got loadBalancerName "kubetest-kstdvhui"
... skipping 18 lines ...
Apr 30 23:22:31.418: INFO: Creating a kubernetes client
Apr 30 23:22:31.418: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
Apr 30 23:22:31.588: INFO: Creating deployment servicelb-test
Apr 30 23:22:31.644: INFO: Creating service servicelb-test in namespace e2e-tests-service-lb-9zllf
Apr 30 23:22:31.739: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-9zllf
Apr 30 23:22:31.739: INFO: Waiting service to expose...
Apr 30 23:22:31.794: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:22:41.852: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:22:51.852: INFO: Exposure successfully, get external ip: 20.190.5.228
Apr 30 23:22:51.852: INFO: Getting public IPs in the resourceGroup kubetest-kstdvhui
Apr 30 23:22:52.033: INFO: Getting public IP frontend configuration ID
Apr 30 23:22:52.033: INFO: Successfully obtained PIP front config id: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/a8bd8ee6166994dc583af5ac8fdfc53f
Apr 30 23:22:52.033: INFO: Getting loadBalancer name from pipFrontendConfigurationID
Apr 30 23:22:52.033: INFO: Got loadBalancerName "kubetest-kstdvhui"
... skipping 111 lines ...
Apr 30 23:24:44.809: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
Apr 30 23:24:44.964: INFO: Creating deployment servicelb-test
Apr 30 23:24:45.103: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-kxr99
Apr 30 23:24:45.103: INFO: Creating public IP resource named service-lb-public-none-IP86df
Apr 30 23:24:48.478: INFO: PIP to 52.183.69.147
STEP: Waiting for exposure of the original service without assigned lb IP
Apr 30 23:24:48.530: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:24:58.590: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:25:08.584: INFO: Exposure successfully, get external ip: 20.190.6.207
STEP: Updating service to bound to specific public IP
Apr 30 23:25:08.584: INFO: will update IP to 52.183.69.147
Apr 30 23:25:08.747: INFO: still unmatched external IP, retry it in 10s seconds
Apr 30 23:25:18.800: INFO: still unmatched external IP, retry it in 10s seconds
Apr 30 23:25:28.801: INFO: still unmatched external IP, retry it in 10s seconds
Apr 30 23:25:38.802: INFO: Exposure successfully
STEP: Cleaning up
Apr 30 23:25:38.874: INFO: Deleting public IP resource named service-lb-public-none-IP86df in resource group kubetest-kstdvhui
Apr 30 23:25:39.168: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/publicIPAddresses/service-lb-public-none-IP86df can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/a4406ad44effc4c7d968c7a626e22c54. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Apr 30 23:25:41.495: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/publicIPAddresses/service-lb-public-none-IP86df can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/a4406ad44effc4c7d968c7a626e22c54. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Apr 30 23:25:43.565: INFO: Deleting namespace e2e-tests-service-lb-kxr99

• [SLOW TEST:71.007 seconds]
Ensure LoadBalancer
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:46
  should support assigning to specific IP when updating public service
... skipping 8 lines ...
Apr 30 23:25:55.815: INFO: Creating a kubernetes client
Apr 30 23:25:55.815: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
Apr 30 23:25:55.979: INFO: Creating deployment servicelb-test
Apr 30 23:25:56.032: INFO: Getting virtual network list
Apr 30 23:25:56.884: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-gxl77
STEP: Waiting for exposure of internal service with specific IP
Apr 30 23:25:56.936: INFO: Fail to get ingress, retry it in 10s seconds
Apr 30 23:26:06.991: INFO: Fail to get ingress, retry it in 10s seconds
Apr 30 23:26:16.995: INFO: Fail to get ingress, retry it in 10s seconds
Apr 30 23:26:26.990: INFO: Fail to get ingress, retry it in 10s seconds
Apr 30 23:26:36.990: INFO: Exposure successfully
Apr 30 23:26:37.138: INFO: Events list:
Apr 30 23:26:37.139: INFO: 0. {{ } {servicelb-test-76bf687774-9rn9x.167ac665b0ae08c5  e2e-tests-service-lb-gxl77  b19bb82f-7f4b-4bd4-aca6-1f2365be812e 3487 0 2021-04-30 23:25:56 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-scheduler Update v1 2021-04-30 23:25:56 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-gxl77 servicelb-test-76bf687774-9rn9x 0ee9fa38-c77d-4885-b778-e59dcbb18a72 v1 3482 } Scheduled Successfully assigned e2e-tests-service-lb-gxl77/servicelb-test-76bf687774-9rn9x to k8s-agentpool1-21738539-vmss000001 {default-scheduler } 2021-04-30 23:25:56 +0000 UTC 2021-04-30 23:25:56 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }
Apr 30 23:26:37.139: INFO: 1. {{ } {servicelb-test-76bf687774-9rn9x.167ac665f6108476  e2e-tests-service-lb-gxl77  78970c9c-b82c-4386-8069-af0fd4021aa2 3520 0 2021-04-30 23:25:57 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2021-04-30 23:25:57 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-gxl77 servicelb-test-76bf687774-9rn9x 0ee9fa38-c77d-4885-b778-e59dcbb18a72 v1 3483 spec.containers{test-app}} Pulling Pulling image "nginx:1.15" {kubelet k8s-agentpool1-21738539-vmss000001} 2021-04-30 23:25:57 +0000 UTC 2021-04-30 23:25:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }
Apr 30 23:26:37.139: INFO: 2. {{ } {servicelb-test-76bf687774-9rn9x.167ac666437e8443  e2e-tests-service-lb-gxl77  e01e2177-57d5-4d76-af5e-35bd1f081c07 3525 0 2021-04-30 23:25:58 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2021-04-30 23:25:58 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-gxl77 servicelb-test-76bf687774-9rn9x 0ee9fa38-c77d-4885-b778-e59dcbb18a72 v1 3483 spec.containers{test-app}} Pulled Successfully pulled image "nginx:1.15" in 1.299041041s {kubelet k8s-agentpool1-21738539-vmss000001} 2021-04-30 23:25:58 +0000 UTC 2021-04-30 23:25:58 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }
Apr 30 23:26:37.139: INFO: 3. {{ } {servicelb-test-76bf687774-9rn9x.167ac6664d4fc925  e2e-tests-service-lb-gxl77  9e6ad6a9-1c46-49d7-bdf2-da298c92e1bb 3527 0 2021-04-30 23:25:58 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2021-04-30 23:25:58 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-gxl77 servicelb-test-76bf687774-9rn9x 0ee9fa38-c77d-4885-b778-e59dcbb18a72 v1 3483 spec.containers{test-app}} Created Created container test-app {kubelet k8s-agentpool1-21738539-vmss000001} 2021-04-30 23:25:58 +0000 UTC 2021-04-30 23:25:58 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }
... skipping 50 lines ...
Apr 30 23:27:44.351: INFO: Creating a kubernetes client
Apr 30 23:27:44.352: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
Apr 30 23:27:44.505: INFO: Creating deployment servicelb-test
Apr 30 23:27:44.645: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-ccq7g
Apr 30 23:27:44.645: INFO: Creating public IP resource named service-lb-internal-none-public-IP0e60
STEP: Waiting for exposure of the original service without assigned lb private IP
Apr 30 23:27:48.723: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:27:58.779: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:28:08.777: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:28:18.776: INFO: Exposure successfully, get external ip: 10.240.0.6
Apr 30 23:28:18.879: INFO: Events list:
Apr 30 23:28:18.879: INFO: 0. {{ } {servicelb-test-76bf687774-5qznl.167ac67ef6f3652c  e2e-tests-service-lb-ccq7g  eccd8983-edc7-4997-9648-0f4931811bb1 4066 0 2021-04-30 23:27:44 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-scheduler Update v1 2021-04-30 23:27:44 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-ccq7g servicelb-test-76bf687774-5qznl f153d2c3-e372-4a06-a583-efe6ade78eed v1 4049 } Scheduled Successfully assigned e2e-tests-service-lb-ccq7g/servicelb-test-76bf687774-5qznl to k8s-agentpool1-21738539-vmss000001 {default-scheduler } 2021-04-30 23:27:44 +0000 UTC 2021-04-30 23:27:44 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }
Apr 30 23:28:18.880: INFO: 1. {{ } {servicelb-test-76bf687774-5qznl.167ac67f7315b3ec  e2e-tests-service-lb-ccq7g  d11d4d1e-abf9-4bc8-9774-5010cb6f5eac 4091 0 2021-04-30 23:27:46 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2021-04-30 23:27:46 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-ccq7g servicelb-test-76bf687774-5qznl f153d2c3-e372-4a06-a583-efe6ade78eed v1 4056 spec.containers{test-app}} Pulling Pulling image "nginx:1.15" {kubelet k8s-agentpool1-21738539-vmss000001} 2021-04-30 23:27:46 +0000 UTC 2021-04-30 23:27:46 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }
Apr 30 23:28:18.880: INFO: 2. {{ } {servicelb-test-76bf687774-5qznl.167ac6805a287c40  e2e-tests-service-lb-ccq7g  7235838b-cd8c-4d5a-b17d-ba345cfa53ac 4139 0 2021-04-30 23:27:50 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2021-04-30 23:27:50 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-ccq7g servicelb-test-76bf687774-5qznl f153d2c3-e372-4a06-a583-efe6ade78eed v1 4056 spec.containers{test-app}} Pulled Successfully pulled image "nginx:1.15" in 3.876755928s {kubelet k8s-agentpool1-21738539-vmss000001} 2021-04-30 23:27:50 +0000 UTC 2021-04-30 23:27:50 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }
Apr 30 23:28:18.880: INFO: 3. {{ } {servicelb-test-76bf687774-5qznl.167ac6805e8ce48e  e2e-tests-service-lb-ccq7g  a0a32cac-a98c-4f16-81aa-ccca25442471 4140 0 2021-04-30 23:27:50 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2021-04-30 23:27:50 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-ccq7g servicelb-test-76bf687774-5qznl f153d2c3-e372-4a06-a583-efe6ade78eed v1 4056 spec.containers{test-app}} Created Created container test-app {kubelet k8s-agentpool1-21738539-vmss000001} 2021-04-30 23:27:50 +0000 UTC 2021-04-30 23:27:50 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }
... skipping 34 lines ...
Apr 30 23:28:49.102: INFO: still unmatched external IP, retry it in 10s seconds
Apr 30 23:28:59.103: INFO: still unmatched external IP, retry it in 10s seconds
Apr 30 23:29:09.102: INFO: still unmatched external IP, retry it in 10s seconds
Apr 30 23:29:19.102: INFO: Exposure successfully
STEP: Cleaning up
Apr 30 23:29:19.165: INFO: Deleting public IP resource named service-lb-internal-none-public-IP0e60 in resource group kubetest-kstdvhui
Apr 30 23:29:19.566: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/publicIPAddresses/service-lb-internal-none-public-IP0e60 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/a39929eeb6f4b4258a6f2711628ec9df. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Apr 30 23:29:21.778: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/publicIPAddresses/service-lb-internal-none-public-IP0e60 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/a39929eeb6f4b4258a6f2711628ec9df. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Apr 30 23:29:23.881: INFO: Deleting namespace e2e-tests-service-lb-ccq7g

• [SLOW TEST:111.748 seconds]
Ensure LoadBalancer
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:46
  should support updating an internal service to a public service with assigned IP
... skipping 8 lines ...
Apr 30 23:29:36.106: INFO: Creating a kubernetes client
Apr 30 23:29:36.106: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
Apr 30 23:29:36.261: INFO: Creating deployment servicelb-test
Apr 30 23:29:36.315: INFO: Creating public IP resource named service-lb-public-remain6e1d
Apr 30 23:29:40.398: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-pt6mw
STEP: Waiting for exposure of the original service with assigned lb private IP
Apr 30 23:29:40.452: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:29:50.506: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:30:00.507: INFO: Exposure successfully, get external ip: 20.94.201.46
STEP: Update without changing the service and wait for a while
Apr 30 23:30:00.507: INFO: External IP is now 20.94.201.46
Apr 30 23:30:00.560: INFO: testlabel6e1d
Apr 30 23:30:00.669: INFO: External IP is still 20.94.201.46
Apr 30 23:30:10.724: INFO: External IP is still 20.94.201.46
... skipping 56 lines ...
Apr 30 23:39:40.726: INFO: External IP is still 20.94.201.46
Apr 30 23:39:50.728: INFO: External IP is still 20.94.201.46
Apr 30 23:40:00.728: INFO: External IP is still 20.94.201.46
Apr 30 23:40:00.784: INFO: External IP is still 20.94.201.46
STEP: Cleaning up
Apr 30 23:40:00.850: INFO: Deleting public IP resource named service-lb-public-remain6e1d in resource group kubetest-kstdvhui
Apr 30 23:40:01.429: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain6e1d can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/aff03920e9cd542fb9203b53eeefc43f. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Apr 30 23:40:03.711: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain6e1d can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/aff03920e9cd542fb9203b53eeefc43f. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Apr 30 23:40:05.706: INFO: Deleting namespace e2e-tests-service-lb-pt6mw

• [SLOW TEST:645.840 seconds]
Ensure LoadBalancer
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:46
  should have no operation since no change in service when update [Slow]
... skipping 6 lines ...
Apr 30 23:40:21.885: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
Apr 30 23:40:21.886: INFO: Creating a test namespace
Apr 30 23:40:21.942: INFO: Creating a kubernetes client
Apr 30 23:40:21.942: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
Apr 30 23:40:22.106: INFO: Creating deployment servicelb-test
Apr 30 23:40:22.163: INFO: Creating public IP resource named service-lb-public-remain1ced
Apr 30 23:40:26.218: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:40:36.275: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:40:46.277: INFO: Exposure successfully, get external ip: 20.94.215.123
Apr 30 23:40:46.277: INFO: Successfully created LoadBalancer service1 in namespace e2e-tests-service-lb-9l9gt with IP 20.94.215.123
Apr 30 23:40:46.397: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:40:56.456: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:41:06.457: INFO: Exposure successfully, get external ip: 20.94.215.123
Apr 30 23:41:06.457: INFO: Successfully created LoadBalancer service2 in namespace e2e-tests-service-lb-9l9gt with IP 20.94.215.123
STEP: Cleaning up
Apr 30 23:41:06.592: INFO: Deleting public IP resource named service-lb-public-remain1ced in resource group kubetest-kstdvhui
Apr 30 23:41:06.895: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain1ced can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/ae48a369c357a43b69c5a0249cabbafb. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Apr 30 23:41:09.102: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain1ced can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/ae48a369c357a43b69c5a0249cabbafb. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Apr 30 23:41:11.094: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain1ced can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/ae48a369c357a43b69c5a0249cabbafb. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Apr 30 23:41:13.085: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain1ced can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/ae48a369c357a43b69c5a0249cabbafb. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Apr 30 23:41:15.083: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain1ced can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/ae48a369c357a43b69c5a0249cabbafb. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Apr 30 23:41:17.087: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain1ced can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/ae48a369c357a43b69c5a0249cabbafb. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Apr 30 23:41:19.087: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain1ced can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/ae48a369c357a43b69c5a0249cabbafb. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Apr 30 23:41:21.084: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain1ced can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/ae48a369c357a43b69c5a0249cabbafb. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Apr 30 23:41:23.099: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain1ced can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/ae48a369c357a43b69c5a0249cabbafb. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Apr 30 23:41:25.257: INFO: Deleting namespace e2e-tests-service-lb-9l9gt

• [SLOW TEST:79.570 seconds]
Ensure LoadBalancer
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:46
  should support multiple external services sharing one preset public IP address
... skipping 5 lines ...
Apr 30 23:41:41.455: INFO: Creating a kubernetes client
Apr 30 23:41:41.455: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
Apr 30 23:41:41.459: INFO: Creating a test namespace
Apr 30 23:41:41.520: INFO: Creating a kubernetes client
Apr 30 23:41:41.520: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
Apr 30 23:41:41.682: INFO: Creating deployment servicelb-test
Apr 30 23:41:41.880: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:41:51.937: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:42:01.937: INFO: Exposure successfully, get external ip: 40.64.94.63
Apr 30 23:42:01.937: INFO: Successfully created LoadBalancer service1 in namespace e2e-tests-service-lb-vrpnl with IP 40.64.94.63
Apr 30 23:42:02.057: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:42:12.114: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:42:22.114: INFO: Exposure successfully, get external ip: 40.64.94.63
Apr 30 23:42:22.114: INFO: Successfully created LoadBalancer service2 in namespace e2e-tests-service-lb-vrpnl with IP 40.64.94.63
STEP: Deleting one service and check if the other service works well
Apr 30 23:42:22.240: INFO: Exposure successfully, get external ip: 40.64.94.63
STEP: Deleting all services
STEP: Checking if the public IP has been deleted
... skipping 19 lines ...
Apr 30 23:43:14.929: INFO: Creating a kubernetes client
Apr 30 23:43:14.929: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
Apr 30 23:43:14.933: INFO: Creating a test namespace
Apr 30 23:43:14.990: INFO: Creating a kubernetes client
Apr 30 23:43:14.990: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
Apr 30 23:43:15.154: INFO: Creating deployment servicelb-test
Apr 30 23:43:15.362: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:43:25.423: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:43:35.419: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:43:45.420: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:43:55.418: INFO: Exposure successfully, get external ip: 10.240.0.6
Apr 30 23:43:55.418: INFO: Successfully created LoadBalancer service1 in namespace e2e-tests-service-lb-jqj6r with IP 10.240.0.6
Apr 30 23:43:55.546: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:44:05.604: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:44:15.605: INFO: Exposure successfully, get external ip: 10.240.0.6
Apr 30 23:44:15.605: INFO: Successfully created LoadBalancer service2 in namespace e2e-tests-service-lb-jqj6r with IP 10.240.0.6
STEP: Cleaning up
Apr 30 23:44:15.799: INFO: Deleting namespace e2e-tests-service-lb-jqj6r

• [SLOW TEST:107.061 seconds]
... skipping 10 lines ...
Apr 30 23:45:01.992: INFO: Creating a test namespace
Apr 30 23:45:02.048: INFO: Creating a kubernetes client
Apr 30 23:45:02.048: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
Apr 30 23:45:02.213: INFO: Creating deployment servicelb-test
STEP: Checking the number of the node pools
STEP: Creating a service to trigger the LB reconcile
Apr 30 23:45:02.530: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:45:12.587: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:45:22.586: INFO: Exposure successfully, get external ip: 40.64.94.63
STEP: Checking the initial node number in the LB backend pool
Apr 30 23:45:22.586: INFO: Getting public IPs in the resourceGroup kubetest-kstdvhui
Apr 30 23:45:23.015: INFO: Getting public IP frontend configuration ID
Apr 30 23:45:23.016: INFO: Successfully obtained PIP front config id: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/aa6c8a89dce91454089d1217f6f27e89
Apr 30 23:45:23.016: INFO: Getting loadBalancer name from pipFrontendConfigurationID
... skipping 60 lines ...
Apr 30 23:46:40.680: INFO: Creating a kubernetes client
Apr 30 23:46:40.680: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
STEP: Create service
Apr 30 23:46:40.856: INFO: Creating service annotation-test in namespace e2e-tests-service-jnndr
Apr 30 23:46:40.941: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-jnndr
Apr 30 23:46:40.941: INFO: Waiting service to expose...
Apr 30 23:46:40.996: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:46:51.055: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:47:01.053: INFO: Exposure successfully, get external ip: 40.64.95.185
STEP: Validating External domain name
Apr 30 23:47:01.054: INFO: prefix is
%!(EXTRA string=kubetest-kstdvhui)Apr 30 23:47:01.054: INFO: Get domain name: annotation-testc132cb97-4275-4dca-bbdd-c9fcf465b6a9.westus2.cloudapp.azure.com
Apr 30 23:47:08.534: INFO: cleaning up test service annotation-test
Apr 30 23:47:08.608: INFO: Deleting service annotation-test in namespace e2e-tests-service-jnndr
... skipping 15 lines ...
Apr 30 23:47:55.066: INFO: Creating Azure clients
Apr 30 23:47:55.066: INFO: Creating a kubernetes client
Apr 30 23:47:55.066: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
Apr 30 23:47:55.237: INFO: Creating service annotation-test in namespace e2e-tests-service-jtj9f
Apr 30 23:47:55.303: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-jtj9f
Apr 30 23:47:55.303: INFO: Waiting service to expose...
Apr 30 23:47:55.359: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:48:05.417: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:48:15.416: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:48:25.417: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:48:35.418: INFO: Exposure successfully, get external ip: 10.240.0.6
STEP: Validating whether the load balancer is internal
Apr 30 23:48:35.418: INFO: Validating external IP not be public and internal accessible
Apr 30 23:48:35.419: INFO: Create a front pod to connect to service
Apr 30 23:48:35.486: INFO: Call from the created pod
Apr 30 23:48:35.541: INFO: waiting for the pod succeeded
... skipping 25 lines ...
Apr 30 23:49:56.511: INFO: Getting virtual network list
STEP: Test subnet doesn't exist. Creating a new one...
Apr 30 23:49:59.058: INFO: creating a new subnet lb-subnet, 10.0.0.0/24
Apr 30 23:49:59.272: INFO: Creating service annotation-test in namespace e2e-tests-service-47dpg
Apr 30 23:49:59.350: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-47dpg
Apr 30 23:49:59.350: INFO: Waiting service to expose...
Apr 30 23:49:59.406: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:50:09.463: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:50:19.462: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:50:29.463: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:50:39.464: INFO: Exposure successfully, get external ip: 10.0.0.4
Apr 30 23:50:39.464: INFO: Get External IP: 10.0.0.4
STEP: Validating external ip in target subnet
Apr 30 23:50:39.464: INFO: cleaning up test service annotation-test
Apr 30 23:50:39.538: INFO: Deleting service annotation-test in namespace e2e-tests-service-47dpg
Apr 30 23:51:17.649: INFO: cleaning up test subnet lb-subnet
... skipping 16 lines ...
Apr 30 23:51:34.204: INFO: Creating Azure clients
Apr 30 23:51:34.204: INFO: Creating a kubernetes client
Apr 30 23:51:34.205: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
Apr 30 23:51:34.372: INFO: Creating service annotation-test in namespace e2e-tests-service-jkt9h
Apr 30 23:51:34.436: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-jkt9h
Apr 30 23:51:34.436: INFO: Waiting service to expose...
Apr 30 23:51:34.494: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:51:44.553: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:51:54.552: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:52:04.553: INFO: Exposure successfully, get external ip: 20.190.9.1
Apr 30 23:52:04.553: INFO: Getting public IPs in the resourceGroup kubetest-kstdvhui
Apr 30 23:52:04.910: INFO: Getting public IP frontend configuration ID
Apr 30 23:52:04.910: INFO: Successfully obtained PIP front config id: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/a29090bc2a0104e37b5c85116aa1325c
Apr 30 23:52:04.910: INFO: Getting loadBalancer name from pipFrontendConfigurationID
Apr 30 23:52:04.910: INFO: Got loadBalancerName "kubetest-kstdvhui"
... skipping 20 lines ...
STEP: resource group e2e-b015 created
STEP: creating test PIP in the test resource group
Apr 30 23:52:46.658: INFO: Creating public IP resource named testPIP-bacd
STEP: Creating service annotation-test in namespace e2e-tests-service-vbrjl
Apr 30 23:52:50.528: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-vbrjl
STEP: Waiting service to expose...
Apr 30 23:52:50.584: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:53:00.640: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:53:10.643: INFO: Exposure successfully, get external ip: 52.175.217.252
Apr 30 23:53:10.643: INFO: Getting public IPs in the resourceGroup e2e-b015
Apr 30 23:53:10.747: INFO: Getting public IP frontend configuration ID
Apr 30 23:53:10.747: INFO: Successfully obtained PIP front config id: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-kstdvhui/providers/Microsoft.Network/loadBalancers/kubetest-kstdvhui/frontendIPConfigurations/a7fb133c5c1014c32abd138c4a7c040a
Apr 30 23:53:10.747: INFO: Getting loadBalancer name from pipFrontendConfigurationID
Apr 30 23:53:10.747: INFO: Got loadBalancerName "kubetest-kstdvhui"
... skipping 22 lines ...
Apr 30 23:54:23.623: INFO: Creating a kubernetes client
Apr 30 23:54:23.623: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
STEP: Exposing two services with shared security rule
Apr 30 23:54:23.798: INFO: Creating service annotation-test in namespace e2e-tests-service-nm9s7
Apr 30 23:54:23.865: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-nm9s7
Apr 30 23:54:23.865: INFO: Waiting service to expose...
Apr 30 23:54:23.936: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:54:33.993: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:54:43.995: INFO: Exposure successfully, get external ip: 20.190.10.124
Apr 30 23:54:43.995: INFO: Creating service annotation-test-share in namespace e2e-tests-service-nm9s7
Apr 30 23:54:44.065: INFO: Successfully created LoadBalancer service annotation-test-share in namespace e2e-tests-service-nm9s7
Apr 30 23:54:44.065: INFO: Waiting service to expose...
Apr 30 23:54:44.120: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:54:54.178: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:55:04.178: INFO: Exposure successfully, get external ip: 20.190.10.146
STEP: Validate shared security rule exists
Apr 30 23:55:04.179: INFO: Getting virtual network list
Apr 30 23:55:04.569: INFO: got sg list, length = 1
Apr 30 23:55:04.569: INFO: Found target security rule
STEP: Cleaning up
... skipping 16 lines ...
Apr 30 23:56:25.239: INFO: Creating deployment annotation-test
Apr 30 23:56:25.295: INFO: Creating Azure clients
Apr 30 23:56:25.295: INFO: Creating a kubernetes client
Apr 30 23:56:25.295: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
STEP: Creating a service with custom tags
STEP: Waiting service to expose...
Apr 30 23:56:25.606: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:56:35.663: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:56:45.663: INFO: Exposure successfully, get external ip: 20.190.10.124
STEP: Checking tags on the corresponding public IP
Apr 30 23:56:46.394: INFO: 
tags: map[a:0xc000786430 c:0xc0007864b0]
expectedTags: map[a:0xc000786de0 c:0xc000786df0]
STEP: Updating annotation and check tags again
... skipping 25 lines ...
Apr 30 23:57:49.384: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
STEP: Creating two test pips
Apr 30 23:57:49.547: INFO: Creating public IP resource named pip1
Apr 30 23:57:53.439: INFO: Creating public IP resource named pip2
STEP: Creating a service referring to the first pip
STEP: Waiting for the service to expose
Apr 30 23:57:56.632: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:58:06.685: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:58:16.684: INFO: Exposure successfully, get external ip: 52.183.84.60
STEP: Updating the service to refer to the second service
STEP: Waiting for service IP to be updated
Apr 30 23:58:16.844: INFO: Exposure successfully, get external ip: 52.183.84.60
Apr 30 23:58:26.897: INFO: Exposure successfully, get external ip: 52.183.84.60
Apr 30 23:58:36.898: INFO: Exposure successfully, get external ip: 52.191.140.124
... skipping 18 lines ...
Apr 30 23:59:03.335: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
Apr 30 23:59:03.490: INFO: Creating deployment nsg-test
STEP: Creating a service and expose it
Apr 30 23:59:03.544: INFO: Creating service nsg-test in namespace e2e-tests-nsg-4cgml
Apr 30 23:59:03.623: INFO: Successfully created LoadBalancer service nsg-test in namespace e2e-tests-nsg-4cgml
Apr 30 23:59:03.623: INFO: Waiting service to expose...
Apr 30 23:59:03.682: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:59:13.735: INFO: Fail to find ingress, retry it in 10 seconds
Apr 30 23:59:23.735: INFO: Exposure successfully, get external ip: 20.190.10.224
STEP: Validating ip exists in Security Group
Apr 30 23:59:23.735: INFO: Getting virtual network list
Apr 30 23:59:24.283: INFO: got sg list, length = 1
Apr 30 23:59:24.283: INFO: Found target security rule
STEP: Validating network security group working
... skipping 25 lines ...
May  1 00:01:00.973: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
May  1 00:01:01.131: INFO: Creating deployment nsg-test
STEP: Creating service and wait it to expose
May  1 00:01:01.185: INFO: Creating service nsg-test in namespace e2e-tests-nsg-bzcbd
May  1 00:01:01.274: INFO: Successfully created LoadBalancer service nsg-test in namespace e2e-tests-nsg-bzcbd
May  1 00:01:01.275: INFO: Waiting service to expose...
May  1 00:01:01.329: INFO: Fail to find ingress, retry it in 10 seconds
May  1 00:01:11.382: INFO: Fail to find ingress, retry it in 10 seconds
May  1 00:01:21.383: INFO: Exposure successfully, get external ip: 20.190.10.224
STEP: Validating if the corresponding IP prefix existing in nsg
May  1 00:01:21.383: INFO: Getting virtual network list
May  1 00:01:21.687: INFO: got sg list, length = 1
May  1 00:01:21.741: INFO: Deleting namespace e2e-tests-nsg-bzcbd

... skipping 11 lines ...
May  1 00:01:53.901: INFO: Creating a test namespace
May  1 00:01:53.958: INFO: Creating a kubernetes client
May  1 00:01:53.958: INFO: Kubernetes configuration file name: /root/tmp893692469/kubeconfig/kubeconfig.westus2.json
May  1 00:01:54.113: INFO: Creating deployment nsg-test
STEP: Creating a test service with the deny rule annotation but without `service.Spec.LoadBalancerSourceRanges`
STEP: Waiting for the service to expose
May  1 00:01:54.319: INFO: Fail to find ingress, retry it in 10 seconds
May  1 00:02:04.373: INFO: Fail to find ingress, retry it in 10 seconds
May  1 00:02:14.373: INFO: Fail to find ingress, retry it in 10 seconds
May  1 00:02:24.373: INFO: Fail to find ingress, retry it in 10 seconds
May  1 00:02:34.373: INFO: Exposure successfully, get external ip: 10.240.0.6
STEP: Checking if there is a deny_all rule
May  1 00:02:34.373: INFO: Getting virtual network list
May  1 00:02:34.553: INFO: got sg list, length = 1
STEP: Deleting the service
May  1 00:02:34.625: INFO: Deleting service nsg-test in namespace e2e-tests-nsg-kcqk2
STEP: Creating a test service with the deny rule annotation and `service.Spec.LoadBalancerSourceRanges`
STEP: Waiting for the service to expose
May  1 00:03:16.858: INFO: Fail to find ingress, retry it in 10 seconds
May  1 00:03:26.912: INFO: Fail to find ingress, retry it in 10 seconds
May  1 00:03:36.918: INFO: Fail to find ingress, retry it in 10 seconds
May  1 00:03:46.915: INFO: Fail to find ingress, retry it in 10 seconds
May  1 00:03:56.912: INFO: Exposure successfully, get external ip: 10.240.0.6
STEP: Checking if there is a LoadBalancerSourceRanges rule
May  1 00:03:56.912: INFO: Getting virtual network list
May  1 00:03:57.003: INFO: got sg list, length = 1
STEP: Checking if there is a deny_all rule
May  1 00:03:57.058: INFO: Deleting namespace e2e-tests-nsg-kcqk2
... skipping 5 lines ...
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:169
------------------------------

JUnit report was created: /logs/artifacts/junit_01.xml

Ran 25 of 35 Specs in 2648.933 seconds
SUCCESS! -- 25 Passed | 0 Failed | 0 Pending | 10 Skipped
--- PASS: TestAzureTest (2648.93s)
PASS
ok  	sigs.k8s.io/cloud-provider-azure/tests/e2e	2648.966s
2021/05/01 00:04:47 process.go:155: Step 'make test-ccm-e2e' finished in 45m11.628360117s
2021/05/01 00:04:47 aksengine_helpers.go:424: downloading /root/tmp893692469/log-dump.sh from https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump.sh
2021/05/01 00:04:47 util.go:68: curl https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump.sh
... skipping 67 lines ...
Dumping csi-azuredisk-node-nmjls_kube-system_liveness-probe-e6d6dbcba22d4f622a996f96bb9beb10f3989930f21dd413d6c44636d2a502e1.log
Dumping csi-azuredisk-node-nmjls_kube-system_node-driver-registrar-61dc77be7d5197171ffd06b5b9268b4d965753ae8602d867ff8ae396fd83f35c.log
Dumping csi-azurefile-controller-6bb468f459-ln48x_kube-system_azurefile-9b43acb26728060529b7976f672972578ee94a8a148b21fc1c84bd9b1f13114d.log
Dumping csi-azurefile-controller-6bb468f459-ln48x_kube-system_csi-attacher-7dc18842f5ab5898cf2987ea1d19f546eb2b0be759d8ac234420168bd20de94f.log
Dumping csi-azurefile-controller-6bb468f459-ln48x_kube-system_csi-provisioner-974c5f20aa13dc1fd61122802738fb405d90cb22de5e22f20ed9c935361ce0b8.log
Dumping csi-azurefile-controller-6bb468f459-ln48x_kube-system_csi-resizer-24860372f673a7945255c703169c66fcb22cc38cd6542de39a6d7aae433f399d.log
{"component":"entrypoint","file":"prow/entrypoint/run.go:169","func":"k8s.io/test-infra/prow/entrypoint.Options.ExecuteProcess","level":"error","msg":"Entrypoint received interrupt: terminated","severity":"error","time":"2021-05-01T00:05:52Z"}