kubernetes-sigs/cloud-provider-azure PR #1622 pull-cloud-provider-azure-e2e-ccm-vmss-basic-lb-1-21 #1520268577028968448
Recent runs || View in Spyglass
Recent runs || View in Spyglass
| PR | MartinForReal: [Release-1.0]backport #1567 #826 #1587 #1607 |
| Result | ABORTED |
| Tests | 0 failed / 0 succeeded |
| Started | |
| Elapsed | 2h13m |
| Revision | 84222a6a2aea66917255a70ee8841cf3100f0d2d |
| Refs |
1622 |
... skipping 17 lines ... 2022/04/30 05:09:46 aksengine.go:843: Reusing k8sprow.azurecr.io/kube-proxy-amd64:v1.21.13-rc.0-14-ge74362de849 2022/04/30 05:09:49 aksengine.go:843: Reusing k8sprow.azurecr.io/kube-scheduler-amd64:v1.21.13-rc.0-14-ge74362de849 2022/04/30 05:09:52 aksengine.go:854: Reusing https://k8sprowstorage.blob.core.windows.net/mystoragecontainer/kubernetes-node-linux-amd64-v1.21.13-rc.0-14-ge74362de849.tar.gz 2022/04/30 05:09:53 aksengine.go:840: k8sprow.azurecr.io/azure-cloud-controller-manager:v1.0.17-33-g0bc1582f does not exist 2022/04/30 05:09:53 aksengine.go:870: Building cloud controller manager and cloud node manager. 2022/04/30 05:09:53 process.go:153: Running: make -C /home/prow/go/src/sigs.k8s.io/cloud-provider-azure image push error: no builder "img-builder" found Unable to find image 'tonistiigi/binfmt:latest' locally latest: Pulling from tonistiigi/binfmt 2b4d0e08bd75: Pulling fs layer c331be51c382: Pulling fs layer c331be51c382: Verifying Checksum c331be51c382: Download complete ... skipping 1368 lines ... Apr 30 05:41:25.807: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 05:41:25.816: INFO: Creating a test namespace [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:89] Apr 30 05:41:26.015: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57] Apr 30 05:41:26.015: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 05:41:26.147: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] [1mSTEP[0m: creating a mixed protocol service Apr 30 05:41:26.404: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:41:36.438: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:41:46.437: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:41:56.437: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:42:06.441: INFO: Exposure successfully, get external ip: 20.127.31.195 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 05:42:06.441: INFO: checking the connectivity of the public IP 20.127.31.195 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 05:42:06.511: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Apr 30 05:42:06.511: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: checking load balancing rules Apr 30 05:42:06.511: INFO: Getting public IPs in the resourceGroup kubetest-wecn1lqd [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:734] ... skipping 20 lines ... Apr 30 05:43:39.538: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 05:43:39.653: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] [1mSTEP[0m: creating a public IP with tags Apr 30 05:43:39.695: INFO: Creating public IP resource named service-lb-public-IP2b75 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:175] Apr 30 05:43:43.511: INFO: created pip with address 20.25.9.143 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:153] [1mSTEP[0m: creating a service referencing the public IP Apr 30 05:43:43.606: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:43:53.642: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:44:03.640: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:44:13.639: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:44:23.639: INFO: Exposure successfully, get external ip: 20.25.9.143 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 05:44:23.639: INFO: checking the connectivity of the public IP 20.25.9.143 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 05:44:23.700: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Apr 30 05:44:23.700: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: deleting the service [1mSTEP[0m: test if the pip still exists [1mSTEP[0m: test if the tags are changed [1mSTEP[0m: cleaning up Apr 30 05:44:23.873: INFO: Deleting public IP resource named service-lb-public-IP2b75 in resource group kubetest-wecn1lqd [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:200] Apr 30 05:44:24.071: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:44:26.290: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:44:28.356: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:44:30.272: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:44:32.340: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:44:34.328: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:44:36.330: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:44:38.318: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:44:40.276: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:44:42.275: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:44:44.352: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:44:46.288: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:44:48.264: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:44:50.307: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:44:52.342: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:44:54.398: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:44:56.404: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:44:58.349: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:45:00.344: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:45:02.406: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:45:04.350: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:45:06.331: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:45:08.331: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:45:10.251: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:45:12.350: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:45:14.252: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:45:16.361: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:45:18.335: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:45:20.251: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:45:22.343: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:45:24.342: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource. To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205] Apr 30 05:45:26.336: INFO: Deleting namespace e2e-tests-service-lb-lhctg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:137] [32m• [SLOW TEST:124.944 seconds][0m Ensure LoadBalancer [90m/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:56[0m should support BYO public IP ... skipping 9 lines ... Apr 30 05:45:44.479: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 05:45:44.596: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] Apr 30 05:45:44.705: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-tz2mj [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:187] Apr 30 05:45:44.705: INFO: Creating public IP resource named service-lb-public-none-IPb5d0 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:175] Apr 30 05:45:48.262: INFO: PIP to 20.25.9.109 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:192] [1mSTEP[0m: Waiting for exposure of the original service without assigned lb IP Apr 30 05:45:48.299: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:45:58.334: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:46:08.333: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:46:18.334: INFO: Exposure successfully, get external ip: 20.228.128.151 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 05:46:18.334: INFO: checking the connectivity of the public IP 20.228.128.151 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 05:46:33.887: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Apr 30 05:46:33.888: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Updating service to bound to specific public IP Apr 30 05:46:33.888: INFO: will update IP to 20.25.9.109 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:209] ... skipping 20 lines ... Apr 30 05:49:54.035: INFO: expected IP is 20.25.9.109, current IP is 20.228.128.151, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:138] Apr 30 05:50:04.034: INFO: expected IP is 20.25.9.109, current IP is 20.228.128.151, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:138] Apr 30 05:50:14.035: INFO: expected IP is 20.25.9.109, current IP is 20.228.128.151, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:138] Apr 30 05:50:24.037: INFO: expected IP is 20.25.9.109, current IP is 20.228.128.151, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:138] Apr 30 05:50:34.035: INFO: Exposure successfully, get external ip: 20.25.9.109 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 05:50:34.035: INFO: checking the connectivity of the public IP 20.25.9.109 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 05:51:04.036: INFO: got error Get "http://20.25.9.109:80": dial tcp 20.25.9.109:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Apr 30 05:51:24.094: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Apr 30 05:51:24.094: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Cleaning up Apr 30 05:51:24.094: INFO: Deleting service servicelb-test in namespace e2e-tests-service-lb-tz2mj [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] Apr 30 05:52:52.222: INFO: Deleting public IP resource named service-lb-public-none-IPb5d0 in resource group kubetest-wecn1lqd [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:200] Apr 30 05:52:52.744: INFO: Deleting namespace e2e-tests-service-lb-tz2mj [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:137] ... skipping 13 lines ... Apr 30 05:53:04.891: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57] Apr 30 05:53:04.891: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 05:53:05.004: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] Apr 30 05:53:05.044: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:35] Apr 30 05:53:06.679: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-qm4pj [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:230] [1mSTEP[0m: Waiting for exposure of internal service with specific IP Apr 30 05:53:06.720: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:53:16.752: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:53:26.754: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:53:36.753: INFO: Exposure successfully, get external ip: 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 05:53:36.813: INFO: Events list: [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:243] Apr 30 05:53:36.813: INFO: 0. {{ } {servicelb-test-76bf687774-4f2pq.16ea96c4bebd4953 e2e-tests-service-lb-qm4pj 6cd7f4b7-3011-4876-8d85-5c4541e3e34b 5510 0 2022-04-30 05:53:05 +0000 UTC <nil> <nil> map[] map[] [] [] [{kube-scheduler Update events.k8s.io/v1 2022-04-30 05:53:05 +0000 UTC FieldsV1 {"f:action":{},"f:eventTime":{},"f:note":{},"f:reason":{},"f:regarding":{"f:apiVersion":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:reportingController":{},"f:reportingInstance":{},"f:type":{}}}]} {Pod e2e-tests-service-lb-qm4pj servicelb-test-76bf687774-4f2pq 4ead1a7a-0fd6-4e7c-b923-4bc0cecd8361 v1 5497 } Scheduled Successfully assigned e2e-tests-service-lb-qm4pj/servicelb-test-76bf687774-4f2pq to k8s-agentpool1-18522079-vmss000000 { } 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC 0 Normal 2022-04-30 05:53:05.142536 +0000 UTC nil Binding nil default-scheduler default-scheduler-k8s-master-18522079-2} [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245] Apr 30 05:53:36.814: INFO: 1. {{ } {servicelb-test-76bf687774-4f2pq.16ea96c4f04f9e1a e2e-tests-service-lb-qm4pj 80951ea9-8888-4bbb-8929-1d81a3f50ed5 5523 0 2022-04-30 05:53:05 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-04-30 05:53:05 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-qm4pj servicelb-test-76bf687774-4f2pq 4ead1a7a-0fd6-4e7c-b923-4bc0cecd8361 v1 5505 spec.containers{test-app}} Pulling Pulling image "nginx:1.15" {kubelet k8s-agentpool1-18522079-vmss000000} 2022-04-30 05:53:05 +0000 UTC 2022-04-30 05:53:05 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245] Apr 30 05:53:36.814: INFO: 2. {{ } {servicelb-test-76bf687774-4f2pq.16ea96c4f878ad97 e2e-tests-service-lb-qm4pj 70abb050-8f70-4a4d-8a55-a44bbd66f353 5531 0 2022-04-30 05:53:06 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-04-30 05:53:06 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-qm4pj servicelb-test-76bf687774-4f2pq 4ead1a7a-0fd6-4e7c-b923-4bc0cecd8361 v1 5505 spec.containers{test-app}} Pulled Successfully pulled image "nginx:1.15" in 136.895369ms {kubelet k8s-agentpool1-18522079-vmss000000} 2022-04-30 05:53:06 +0000 UTC 2022-04-30 05:53:06 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245] Apr 30 05:53:36.814: INFO: 3. {{ } {servicelb-test-76bf687774-4f2pq.16ea96c4fd9ac14b e2e-tests-service-lb-qm4pj 9778cc58-aed4-4639-ad82-f5c30af8bd7e 5535 0 2022-04-30 05:53:06 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-04-30 05:53:06 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-qm4pj servicelb-test-76bf687774-4f2pq 4ead1a7a-0fd6-4e7c-b923-4bc0cecd8361 v1 5505 spec.containers{test-app}} Created Created container test-app {kubelet k8s-agentpool1-18522079-vmss000000} 2022-04-30 05:53:06 +0000 UTC 2022-04-30 05:53:06 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245] ... skipping 55 lines ... Apr 30 05:55:52.733: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57] Apr 30 05:55:52.733: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 05:55:52.849: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] Apr 30 05:55:52.964: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-zl626 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:270] Apr 30 05:55:52.964: INFO: Creating public IP resource named service-lb-internal-none-public-IP0e3c [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:175] [1mSTEP[0m: Waiting for exposure of the original service without assigned lb private IP Apr 30 05:55:56.991: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:56:07.028: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:56:17.025: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:56:27.023: INFO: Exposure successfully, get external ip: 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 05:56:27.083: INFO: Events list: [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:290] Apr 30 05:56:27.084: INFO: 0. {{ } {servicelb-test-76bf687774-8qkfs.16ea96ebd11fd457 e2e-tests-service-lb-zl626 64f988e4-5da7-4979-8ed5-4c6e6075e2c4 6333 0 2022-04-30 05:55:52 +0000 UTC <nil> <nil> map[] map[] [] [] [{kube-scheduler Update events.k8s.io/v1 2022-04-30 05:55:52 +0000 UTC FieldsV1 {"f:action":{},"f:eventTime":{},"f:note":{},"f:reason":{},"f:regarding":{"f:apiVersion":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:reportingController":{},"f:reportingInstance":{},"f:type":{}}}]} {Pod e2e-tests-service-lb-zl626 servicelb-test-76bf687774-8qkfs 84d24054-3fe6-4136-a275-45b651869142 v1 6316 } Scheduled Successfully assigned e2e-tests-service-lb-zl626/servicelb-test-76bf687774-8qkfs to k8s-agentpool1-18522079-vmss000001 { } 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC 0 Normal 2022-04-30 05:55:52.954707 +0000 UTC nil Binding nil default-scheduler default-scheduler-k8s-master-18522079-2} [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:292] Apr 30 05:56:27.084: INFO: 1. {{ } {servicelb-test-76bf687774-8qkfs.16ea96ebffcd3962 e2e-tests-service-lb-zl626 d2ba3da4-3a06-4cb4-b81e-61a444435995 6351 0 2022-04-30 05:55:53 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-04-30 05:55:53 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-zl626 servicelb-test-76bf687774-8qkfs 84d24054-3fe6-4136-a275-45b651869142 v1 6322 spec.containers{test-app}} Pulling Pulling image "nginx:1.15" {kubelet k8s-agentpool1-18522079-vmss000001} 2022-04-30 05:55:53 +0000 UTC 2022-04-30 05:55:53 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:292] Apr 30 05:56:27.084: INFO: 2. {{ } {servicelb-test-76bf687774-8qkfs.16ea96ec09948ca2 e2e-tests-service-lb-zl626 090671fe-912d-4314-9561-4687643a2db6 6357 0 2022-04-30 05:55:53 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-04-30 05:55:53 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-zl626 servicelb-test-76bf687774-8qkfs 84d24054-3fe6-4136-a275-45b651869142 v1 6322 spec.containers{test-app}} Pulled Successfully pulled image "nginx:1.15" in 164.046119ms {kubelet k8s-agentpool1-18522079-vmss000001} 2022-04-30 05:55:53 +0000 UTC 2022-04-30 05:55:53 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:292] Apr 30 05:56:27.084: INFO: 3. {{ } {servicelb-test-76bf687774-8qkfs.16ea96ec0e4a9c97 e2e-tests-service-lb-zl626 c72f96d2-63c0-44e2-9990-69dc870bb79a 6360 0 2022-04-30 05:55:53 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-04-30 05:55:53 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-zl626 servicelb-test-76bf687774-8qkfs 84d24054-3fe6-4136-a275-45b651869142 v1 6322 spec.containers{test-app}} Created Created container test-app {kubelet k8s-agentpool1-18522079-vmss000001} 2022-04-30 05:55:53 +0000 UTC 2022-04-30 05:55:53 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:292] ... skipping 62 lines ... Apr 30 05:59:42.058: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57] Apr 30 05:59:42.058: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 05:59:42.173: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] Apr 30 05:59:42.216: INFO: Creating public IP resource named service-lb-public-remain8eb4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:175] Apr 30 05:59:46.280: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-2bq6s [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:319] [1mSTEP[0m: Waiting for exposure of the original service with assigned lb private IP Apr 30 05:59:46.317: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 05:59:56.349: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:00:06.349: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:00:16.349: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:00:26.349: INFO: Exposure successfully, get external ip: 20.25.127.118 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 06:00:26.349: INFO: checking the connectivity of the public IP 20.25.127.118 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 06:00:56.350: INFO: got error Get "http://20.25.127.118:80": dial tcp 20.25.127.118:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Apr 30 06:01:16.406: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Apr 30 06:01:16.406: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Update without changing the service and wait for a while Apr 30 06:01:16.406: INFO: External IP is now 20.25.127.118 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:334] Apr 30 06:01:16.444: INFO: testlabel8eb4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:337] Apr 30 06:01:16.521: INFO: External IP is still 20.25.127.118 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:358] ... skipping 46 lines ... Apr 30 06:08:13.329: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 06:08:13.333: INFO: Creating a test namespace [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:89] Apr 30 06:08:13.370: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57] Apr 30 06:08:13.370: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 06:08:13.485: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] Apr 30 06:08:13.522: INFO: Creating public IP resource named service-lb-public-remainebb8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:175] Apr 30 06:08:16.969: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:08:27.002: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:08:37.002: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:08:47.003: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:08:57.011: INFO: Exposure successfully, get external ip: 20.25.57.105 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 06:08:57.011: INFO: checking the connectivity of the public IP 20.25.57.105 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 06:08:57.068: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Apr 30 06:08:57.068: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] Apr 30 06:08:57.068: INFO: Successfully created LoadBalancer service1 in namespace e2e-tests-service-lb-ct9x9 with IP 20.25.57.105 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:379] Apr 30 06:08:57.167: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:09:07.199: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:09:17.202: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:09:27.200: INFO: Exposure successfully, get external ip: 20.25.57.105 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 06:09:27.200: INFO: checking the connectivity of the public IP 20.25.57.105 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 06:09:27.200: INFO: Successfully created LoadBalancer service2 in namespace e2e-tests-service-lb-ct9x9 with IP 20.25.57.105 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:391] [1mSTEP[0m: Cleaning up Apr 30 06:09:27.200: INFO: Deleting service service1 in namespace e2e-tests-service-lb-ct9x9 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] Apr 30 06:09:45.356: INFO: Deleting service service2 in namespace e2e-tests-service-lb-ct9x9 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] ... skipping 12 lines ... Apr 30 06:11:04.059: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57] Apr 30 06:11:04.059: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 06:11:04.063: INFO: Creating a test namespace [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:89] Apr 30 06:11:04.100: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57] Apr 30 06:11:04.100: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 06:11:04.216: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] Apr 30 06:11:04.390: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:11:14.427: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:11:24.421: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:11:34.423: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:11:44.426: INFO: Exposure successfully, get external ip: 20.228.221.239 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 06:11:44.426: INFO: checking the connectivity of the public IP 20.228.221.239 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 06:12:14.430: INFO: got error Get "http://20.228.221.239:80": dial tcp 20.228.221.239:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Apr 30 06:12:34.492: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Apr 30 06:12:34.492: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] Apr 30 06:12:34.492: INFO: Successfully created LoadBalancer service1 in namespace e2e-tests-service-lb-l948w with IP 20.228.221.239 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:410] Apr 30 06:12:34.584: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:12:44.616: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:12:54.618: INFO: Exposure successfully, get external ip: 20.228.221.239 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 06:12:54.618: INFO: checking the connectivity of the public IP 20.228.221.239 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 06:12:54.618: INFO: Successfully created LoadBalancer service2 in namespace e2e-tests-service-lb-l948w with IP 20.228.221.239 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:422] [1mSTEP[0m: Deleting one service and check if the other service works well Apr 30 06:12:54.618: INFO: Deleting service service1 in namespace e2e-tests-service-lb-l948w [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] Apr 30 06:14:02.782: INFO: Exposure successfully, get external ip: 20.228.221.239 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] ... skipping 15 lines ... Apr 30 06:15:33.500: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57] Apr 30 06:15:33.500: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 06:15:33.502: INFO: Creating a test namespace [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:89] Apr 30 06:15:33.538: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57] Apr 30 06:15:33.538: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 06:15:33.653: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] Apr 30 06:15:33.809: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:15:43.845: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:15:53.844: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:16:03.841: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:16:13.846: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:16:23.844: INFO: Exposure successfully, get external ip: 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 06:16:23.845: INFO: Successfully created LoadBalancer service1 in namespace e2e-tests-service-lb-nrqpn with IP 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:459] Apr 30 06:16:23.940: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:16:33.976: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:16:43.974: INFO: Exposure successfully, get external ip: 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 06:16:43.974: INFO: Successfully created LoadBalancer service2 in namespace e2e-tests-service-lb-nrqpn with IP 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:471] [1mSTEP[0m: Cleaning up Apr 30 06:16:43.974: INFO: Deleting service service1 in namespace e2e-tests-service-lb-nrqpn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] Apr 30 06:16:58.111: INFO: Deleting service service2 in namespace e2e-tests-service-lb-nrqpn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] Apr 30 06:18:00.285: INFO: Deleting namespace e2e-tests-service-lb-nrqpn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:137] ... skipping 39 lines ... [1mSTEP[0m: Getting agent nodes list [1mSTEP[0m: Get vmss names from node providerIDs Apr 30 06:18:25.036: INFO: Got vmss names [k8s-agentpool1-18522079-vmss k8s-agentpool2-18522079-vmss] [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:557] [1mSTEP[0m: Creating service vmss-test-k8s-agentpool1-18522079-vmss in namespace e2e-tests-vmssservice-l9nc5 Apr 30 06:18:25.085: INFO: Successfully created LoadBalancer service vmss-test-k8s-agentpool1-18522079-vmss in namespace e2e-tests-vmssservice-l9nc5 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:834] [1mSTEP[0m: Waiting for service exposure Apr 30 06:18:25.115: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:18:35.151: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:18:45.148: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:18:55.147: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:19:05.159: INFO: Exposure successfully, get external ip: 137.117.70.173 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 06:19:05.159: INFO: checking the connectivity of the public IP 137.117.70.173 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 06:19:12.281: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Apr 30 06:19:12.281: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Getting public IPs in the resourceGroup kubetest-wecn1lqd [1mSTEP[0m: Getting public IP frontend configuration ID ... skipping 2 lines ... [1mSTEP[0m: Getting loadBalancer [1mSTEP[0m: Getting loadBalancer backendPoolID [1mSTEP[0m: Validating loadBalancer backendPool [1mSTEP[0m: Creating service vmss-test-k8s-agentpool2-18522079-vmss in namespace e2e-tests-vmssservice-l9nc5 Apr 30 06:19:13.010: INFO: Successfully created LoadBalancer service vmss-test-k8s-agentpool2-18522079-vmss in namespace e2e-tests-vmssservice-l9nc5 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:834] [1mSTEP[0m: Waiting for service exposure Apr 30 06:19:13.042: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:19:23.074: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:19:33.076: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:19:43.076: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:19:53.077: INFO: Exposure successfully, get external ip: 137.117.78.66 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 06:19:53.077: INFO: checking the connectivity of the public IP 137.117.78.66 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 06:20:23.078: INFO: got error Get "http://137.117.78.66:80": dial tcp 137.117.78.66:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Apr 30 06:20:43.139: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Apr 30 06:20:43.139: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Getting public IPs in the resourceGroup kubetest-wecn1lqd [1mSTEP[0m: Getting public IP frontend configuration ID [1mSTEP[0m: Getting loadBalancer name from pipFrontendConfigurationID Apr 30 06:20:43.372: INFO: Got loadBalancerName "k8s-agentpool2-18522079-vmss" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:866] ... skipping 18 lines ... Apr 30 06:23:59.750: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 06:23:59.864: INFO: Creating deployment nsg-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:68] [1mSTEP[0m: Creating a service and expose it Apr 30 06:23:59.902: INFO: Creating service nsg-test in namespace e2e-tests-nsg-g75q7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:772] Apr 30 06:24:00.013: INFO: Successfully created LoadBalancer service nsg-test in namespace e2e-tests-nsg-g75q7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:776] Apr 30 06:24:00.013: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:779] Apr 30 06:24:00.047: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:24:10.079: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:24:20.080: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:24:30.081: INFO: Exposure successfully, get external ip: 137.135.69.17 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 06:24:30.081: INFO: checking the connectivity of the public IP 137.135.69.17 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 06:24:45.593: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Apr 30 06:24:45.593: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Validating ip exists in Security Group Apr 30 06:24:45.593: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:124] ... skipping 27 lines ... Apr 30 06:26:44.697: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 06:26:44.812: INFO: Creating deployment nsg-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:68] [1mSTEP[0m: Creating service and wait it to expose Apr 30 06:26:44.849: INFO: Creating service nsg-test in namespace e2e-tests-nsg-kzjp7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:145] Apr 30 06:26:44.931: INFO: Successfully created LoadBalancer service nsg-test in namespace e2e-tests-nsg-kzjp7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:149] [1mSTEP[0m: Waiting for the service to be exposed Apr 30 06:26:44.974: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:26:55.010: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:27:05.009: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:27:15.006: INFO: Exposure successfully, get external ip: 137.135.75.176 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] [1mSTEP[0m: Validating if the corresponding IP prefix existing in nsg Apr 30 06:27:15.007: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:124] Apr 30 06:27:15.422: INFO: got sg list, length = 1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:146] Apr 30 06:27:15.459: INFO: Deleting namespace e2e-tests-nsg-kzjp7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:137] ... skipping 11 lines ... Apr 30 06:27:57.565: INFO: Creating a test namespace [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:89] Apr 30 06:27:57.599: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57] Apr 30 06:27:57.599: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 06:27:57.716: INFO: Creating deployment nsg-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:68] [1mSTEP[0m: Creating a test service with the deny rule annotation but without `service.Spec.LoadBalancerSourceRanges` [1mSTEP[0m: Waiting for the service to expose Apr 30 06:27:57.853: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:28:07.885: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:28:17.887: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:28:27.887: INFO: Exposure successfully, get external ip: 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] [1mSTEP[0m: Checking if there is a deny_all rule Apr 30 06:28:27.887: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:124] Apr 30 06:28:28.156: INFO: got sg list, length = 1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:146] [1mSTEP[0m: Deleting the service Apr 30 06:28:28.156: INFO: Deleting service nsg-test in namespace e2e-tests-nsg-6shht [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] [1mSTEP[0m: Creating a test service with the deny rule annotation and `service.Spec.LoadBalancerSourceRanges` [1mSTEP[0m: Waiting for the service to expose Apr 30 06:29:30.394: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:29:40.428: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:29:50.431: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:30:00.426: INFO: Exposure successfully, get external ip: 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] [1mSTEP[0m: Checking if there is a LoadBalancerSourceRanges rule Apr 30 06:30:00.426: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:124] Apr 30 06:30:00.660: INFO: got sg list, length = 1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:146] [1mSTEP[0m: Checking if there is a deny_all rule Apr 30 06:30:00.697: INFO: Deleting namespace e2e-tests-nsg-6shht [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:137] ... skipping 125 lines ... Apr 30 06:46:46.492: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57] Apr 30 06:46:46.492: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] [1mSTEP[0m: Create service Apr 30 06:46:46.608: INFO: Creating service annotation-test in namespace e2e-tests-service-h5qvg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:772] Apr 30 06:46:46.661: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-h5qvg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:776] Apr 30 06:46:46.661: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:779] Apr 30 06:46:46.692: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:46:56.724: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:47:06.727: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:47:16.724: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:47:26.725: INFO: Exposure successfully, get external ip: 20.25.70.89 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 06:47:26.726: INFO: checking the connectivity of the public IP 20.25.70.89 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 06:47:26.780: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Apr 30 06:47:26.780: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Validating External domain name Apr 30 06:47:26.782: INFO: Get domain name: annotation-test75c5cacc-e268-4c2d-9a56-9fb7f4ea480e.eastus.cloudapp.azure.com [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:75] ... skipping 20 lines ... Apr 30 06:50:03.381: INFO: Creating Azure clients [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:95] Apr 30 06:50:03.381: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57] Apr 30 06:50:03.381: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 06:50:03.472: INFO: Creating service annotation-test in namespace e2e-tests-service-wk5cg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:772] Apr 30 06:50:03.555: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-wk5cg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:776] Apr 30 06:50:03.555: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:779] Apr 30 06:50:03.595: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:50:13.627: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:50:23.629: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:50:33.627: INFO: Exposure successfully, get external ip: 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 06:50:33.628: INFO: cleaning up test service annotation-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:164] Apr 30 06:50:33.628: INFO: Deleting service annotation-test in namespace e2e-tests-service-wk5cg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] Apr 30 06:51:41.798: INFO: Deleting namespace e2e-tests-service-wk5cg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:137] [32m• [SLOW TEST:120.701 seconds][0m ... skipping 18 lines ... Apr 30 06:51:54.128: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:35] [1mSTEP[0m: Test subnet doesn't exist. Creating a new one... Apr 30 06:51:56.720: INFO: creating a new subnet a--------------------------------------------------z, 10.0.0.0/24 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:72] Apr 30 06:51:57.025: INFO: Creating service annotation-test in namespace e2e-tests-service-j7mp8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:772] Apr 30 06:51:57.092: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-j7mp8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:776] Apr 30 06:51:57.092: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:779] Apr 30 06:51:57.135: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:52:07.169: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:52:17.168: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:52:27.170: INFO: Exposure successfully, get external ip: 10.0.0.4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 06:52:27.170: INFO: Get External IP: 10.0.0.4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:212] [1mSTEP[0m: Validating external ip in target subnet Apr 30 06:52:27.170: INFO: cleaning up test service annotation-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:208] Apr 30 06:52:27.170: INFO: Deleting service annotation-test in namespace e2e-tests-service-j7mp8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] Apr 30 06:53:37.298: INFO: cleaning up test subnet a--------------------------------------------------z [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:194] ... skipping 18 lines ... Apr 30 06:53:50.149: INFO: Creating Azure clients [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:95] Apr 30 06:53:50.149: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57] Apr 30 06:53:50.149: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] Apr 30 06:53:50.274: INFO: Creating service annotation-test in namespace e2e-tests-service-6tjxb [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:772] Apr 30 06:53:50.332: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-6tjxb [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:776] Apr 30 06:53:50.332: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:779] Apr 30 06:53:50.366: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:54:00.404: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:54:10.400: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:54:20.399: INFO: Exposure successfully, get external ip: 20.228.155.192 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 06:54:20.400: INFO: checking the connectivity of the public IP 20.228.155.192 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 06:54:50.401: INFO: got error Get "http://20.228.155.192:80": dial tcp 20.228.155.192:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Apr 30 06:55:10.455: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Apr 30 06:55:10.455: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] Apr 30 06:55:10.455: INFO: Getting public IPs in the resourceGroup kubetest-wecn1lqd [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:734] Apr 30 06:55:10.860: INFO: Getting public IP frontend configuration ID [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:738] Apr 30 06:55:10.861: INFO: Successfully obtained PIP front config id: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/a22b410bc9781487f9692384a32a9123 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:751] Apr 30 06:55:10.861: INFO: Getting loadBalancer name from pipFrontendConfigurationID [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:753] ... skipping 23 lines ... [1mSTEP[0m: resource group e2e-21c4 created [1mSTEP[0m: creating test PIP in the test resource group Apr 30 06:56:27.963: INFO: Creating public IP resource named testPIP-3a8b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:175] [1mSTEP[0m: Creating service annotation-test in namespace e2e-tests-service-gv2nx Apr 30 06:56:31.705: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-gv2nx [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:285] [1mSTEP[0m: Waiting service to expose... Apr 30 06:56:31.740: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:56:41.772: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 06:56:51.777: INFO: Exposure successfully, get external ip: 20.231.200.47 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 06:56:51.777: INFO: checking the connectivity of the public IP 20.231.200.47 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 06:57:21.778: INFO: got error Get "http://20.231.200.47:80": dial tcp 20.231.200.47:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Apr 30 06:57:41.832: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Apr 30 06:57:41.832: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] Apr 30 06:57:41.832: INFO: Getting public IPs in the resourceGroup e2e-21c4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:734] Apr 30 06:57:41.919: INFO: Getting public IP frontend configuration ID [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:738] Apr 30 06:57:41.919: INFO: Successfully obtained PIP front config id: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/ad7116166d90047e9a2b7ff157a453c9 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:751] Apr 30 06:57:41.919: INFO: Getting loadBalancer name from pipFrontendConfigurationID [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:753] ... skipping 25 lines ... Apr 30 07:00:43.255: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57] Apr 30 07:00:43.255: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] [1mSTEP[0m: Exposing two services with shared security rule Apr 30 07:00:43.377: INFO: Creating service annotation-test in namespace e2e-tests-service-fxsh7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:772] Apr 30 07:00:43.440: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-fxsh7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:776] Apr 30 07:00:43.440: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:779] Apr 30 07:00:43.475: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 07:00:53.509: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 07:01:03.513: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 07:01:13.507: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 07:01:23.510: INFO: Exposure successfully, get external ip: 20.232.150.158 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 07:01:23.510: INFO: checking the connectivity of the public IP 20.232.150.158 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 07:01:53.512: INFO: got error Get "http://20.232.150.158:80": dial tcp 20.232.150.158:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Apr 30 07:02:13.574: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Apr 30 07:02:13.574: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] Apr 30 07:02:13.574: INFO: Creating service annotation-test-share in namespace e2e-tests-service-fxsh7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:772] Apr 30 07:02:13.643: INFO: Successfully created LoadBalancer service annotation-test-share in namespace e2e-tests-service-fxsh7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:776] Apr 30 07:02:13.643: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:779] Apr 30 07:02:13.680: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 07:02:23.712: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 07:02:33.711: INFO: Exposure successfully, get external ip: 20.232.98.135 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 07:02:33.711: INFO: checking the connectivity of the public IP 20.232.98.135 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 07:03:03.718: INFO: got error Get "http://20.232.98.135:80": dial tcp 20.232.98.135:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Apr 30 07:03:23.780: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Apr 30 07:03:23.780: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Validate shared security rule exists Apr 30 07:03:23.780: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:124] Apr 30 07:03:24.184: INFO: got sg list, length = 1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:146] Apr 30 07:03:24.184: INFO: Found target security rule [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:254] ... skipping 19 lines ... Apr 30 07:06:02.693: INFO: 0 pods in namespace e2e-tests-service-fg9b7 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:83] Apr 30 07:06:02.693: INFO: Creating Azure clients [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:95] Apr 30 07:06:02.693: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57] Apr 30 07:06:02.693: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65] [1mSTEP[0m: Creating a service with custom tags [1mSTEP[0m: Waiting service to expose... Apr 30 07:06:02.905: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 07:06:12.937: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 07:06:22.938: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Apr 30 07:06:32.938: INFO: Exposure successfully, get external ip: 20.25.99.235 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Apr 30 07:06:32.938: INFO: checking the connectivity of the public IP 20.25.99.235 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Apr 30 07:06:48.481: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Apr 30 07:06:48.481: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Checking tags on the corresponding public IP Apr 30 07:06:49.569: INFO: ... skipping 13 lines ...