This job view page is being replaced by Spyglass soon. Check out the new job view.
PRMartinForReal: [Release-1.0]backport #1567 #826 #1587 #1607
ResultABORTED
Tests 0 failed / 0 succeeded
Started2022-04-30 05:09
Elapsed2h13m
Revision84222a6a2aea66917255a70ee8841cf3100f0d2d
Refs 1622

No Test Failures!


Error lines from build-log.txt

... skipping 17 lines ...
2022/04/30 05:09:46 aksengine.go:843: Reusing k8sprow.azurecr.io/kube-proxy-amd64:v1.21.13-rc.0-14-ge74362de849
2022/04/30 05:09:49 aksengine.go:843: Reusing k8sprow.azurecr.io/kube-scheduler-amd64:v1.21.13-rc.0-14-ge74362de849
2022/04/30 05:09:52 aksengine.go:854: Reusing https://k8sprowstorage.blob.core.windows.net/mystoragecontainer/kubernetes-node-linux-amd64-v1.21.13-rc.0-14-ge74362de849.tar.gz
2022/04/30 05:09:53 aksengine.go:840: k8sprow.azurecr.io/azure-cloud-controller-manager:v1.0.17-33-g0bc1582f does not exist
2022/04/30 05:09:53 aksengine.go:870: Building cloud controller manager and cloud node manager.
2022/04/30 05:09:53 process.go:153: Running: make -C /home/prow/go/src/sigs.k8s.io/cloud-provider-azure image push
error: no builder "img-builder" found
Unable to find image 'tonistiigi/binfmt:latest' locally
latest: Pulling from tonistiigi/binfmt
2b4d0e08bd75: Pulling fs layer
c331be51c382: Pulling fs layer
c331be51c382: Verifying Checksum
c331be51c382: Download complete
... skipping 1368 lines ...
Apr 30 05:41:25.807: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 05:41:25.816: INFO: Creating a test namespace [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:89]
Apr 30 05:41:26.015: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57]
Apr 30 05:41:26.015: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 05:41:26.147: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82]
STEP: creating a mixed protocol service
Apr 30 05:41:26.404: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:41:36.438: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:41:46.437: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:41:56.437: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:42:06.441: INFO: Exposure successfully, get external ip: 20.127.31.195 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 05:42:06.441: INFO: checking the connectivity of the public IP 20.127.31.195 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 05:42:06.511: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178]
Apr 30 05:42:06.511: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186]
STEP: checking load balancing rules
Apr 30 05:42:06.511: INFO: Getting public IPs in the resourceGroup kubetest-wecn1lqd [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:734]
... skipping 20 lines ...
Apr 30 05:43:39.538: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 05:43:39.653: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82]
STEP: creating a public IP with tags
Apr 30 05:43:39.695: INFO: Creating public IP resource named service-lb-public-IP2b75 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:175]
Apr 30 05:43:43.511: INFO: created pip with address 20.25.9.143 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:153]
STEP: creating a service referencing the public IP
Apr 30 05:43:43.606: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:43:53.642: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:44:03.640: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:44:13.639: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:44:23.639: INFO: Exposure successfully, get external ip: 20.25.9.143 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 05:44:23.639: INFO: checking the connectivity of the public IP 20.25.9.143 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 05:44:23.700: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178]
Apr 30 05:44:23.700: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186]
STEP: deleting the service
STEP: test if the pip still exists
STEP: test if the tags are changed
STEP: cleaning up
Apr 30 05:44:23.873: INFO: Deleting public IP resource named service-lb-public-IP2b75 in resource group kubetest-wecn1lqd [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:200]
Apr 30 05:44:24.071: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:44:26.290: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:44:28.356: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:44:30.272: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:44:32.340: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:44:34.328: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:44:36.330: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:44:38.318: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:44:40.276: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:44:42.275: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:44:44.352: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:44:46.288: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:44:48.264: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:44:50.307: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:44:52.342: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:44:54.398: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:44:56.404: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:44:58.349: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:45:00.344: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:45:02.406: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:45:04.350: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:45:06.331: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:45:08.331: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:45:10.251: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:45:12.350: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:45:14.252: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:45:16.361: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:45:18.335: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:45:20.251: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:45:22.343: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:45:24.342: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=400 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/publicIPAddresses/service-lb-public-IP2b75 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/aacdd9899779442cd86bae121b37e880. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:205]
Apr 30 05:45:26.336: INFO: Deleting namespace e2e-tests-service-lb-lhctg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:137]

• [SLOW TEST:124.944 seconds]
Ensure LoadBalancer
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:56
  should support BYO public IP
... skipping 9 lines ...
Apr 30 05:45:44.479: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 05:45:44.596: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82]
Apr 30 05:45:44.705: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-tz2mj [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:187]
Apr 30 05:45:44.705: INFO: Creating public IP resource named service-lb-public-none-IPb5d0 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:175]
Apr 30 05:45:48.262: INFO: PIP to 20.25.9.109 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:192]
STEP: Waiting for exposure of the original service without assigned lb IP
Apr 30 05:45:48.299: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:45:58.334: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:46:08.333: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:46:18.334: INFO: Exposure successfully, get external ip: 20.228.128.151 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 05:46:18.334: INFO: checking the connectivity of the public IP 20.228.128.151 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 05:46:33.887: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178]
Apr 30 05:46:33.888: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186]
STEP: Updating service to bound to specific public IP
Apr 30 05:46:33.888: INFO: will update IP to 20.25.9.109 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:209]
... skipping 20 lines ...
Apr 30 05:49:54.035: INFO: expected IP is 20.25.9.109, current IP is 20.228.128.151, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:138]
Apr 30 05:50:04.034: INFO: expected IP is 20.25.9.109, current IP is 20.228.128.151, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:138]
Apr 30 05:50:14.035: INFO: expected IP is 20.25.9.109, current IP is 20.228.128.151, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:138]
Apr 30 05:50:24.037: INFO: expected IP is 20.25.9.109, current IP is 20.228.128.151, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:138]
Apr 30 05:50:34.035: INFO: Exposure successfully, get external ip: 20.25.9.109 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 05:50:34.035: INFO: checking the connectivity of the public IP 20.25.9.109 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 05:51:04.036: INFO: got error Get "http://20.25.9.109:80": dial tcp 20.25.9.109:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
Apr 30 05:51:24.094: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178]
Apr 30 05:51:24.094: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186]
STEP: Cleaning up
Apr 30 05:51:24.094: INFO: Deleting service servicelb-test in namespace e2e-tests-service-lb-tz2mj [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48]
Apr 30 05:52:52.222: INFO: Deleting public IP resource named service-lb-public-none-IPb5d0 in resource group kubetest-wecn1lqd [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:200]
Apr 30 05:52:52.744: INFO: Deleting namespace e2e-tests-service-lb-tz2mj [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:137]
... skipping 13 lines ...
Apr 30 05:53:04.891: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57]
Apr 30 05:53:04.891: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 05:53:05.004: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82]
Apr 30 05:53:05.044: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:35]
Apr 30 05:53:06.679: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-qm4pj [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:230]
STEP: Waiting for exposure of internal service with specific IP
Apr 30 05:53:06.720: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:53:16.752: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:53:26.754: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:53:36.753: INFO: Exposure successfully, get external ip: 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 05:53:36.813: INFO: Events list: [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:243]
Apr 30 05:53:36.813: INFO: 0. {{ } {servicelb-test-76bf687774-4f2pq.16ea96c4bebd4953  e2e-tests-service-lb-qm4pj  6cd7f4b7-3011-4876-8d85-5c4541e3e34b 5510 0 2022-04-30 05:53:05 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-scheduler Update events.k8s.io/v1 2022-04-30 05:53:05 +0000 UTC FieldsV1 {"f:action":{},"f:eventTime":{},"f:note":{},"f:reason":{},"f:regarding":{"f:apiVersion":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:reportingController":{},"f:reportingInstance":{},"f:type":{}}}]} {Pod e2e-tests-service-lb-qm4pj servicelb-test-76bf687774-4f2pq 4ead1a7a-0fd6-4e7c-b923-4bc0cecd8361 v1 5497 } Scheduled Successfully assigned e2e-tests-service-lb-qm4pj/servicelb-test-76bf687774-4f2pq to k8s-agentpool1-18522079-vmss000000 { } 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC 0 Normal 2022-04-30 05:53:05.142536 +0000 UTC nil Binding nil default-scheduler default-scheduler-k8s-master-18522079-2} [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245]
Apr 30 05:53:36.814: INFO: 1. {{ } {servicelb-test-76bf687774-4f2pq.16ea96c4f04f9e1a  e2e-tests-service-lb-qm4pj  80951ea9-8888-4bbb-8929-1d81a3f50ed5 5523 0 2022-04-30 05:53:05 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-04-30 05:53:05 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-qm4pj servicelb-test-76bf687774-4f2pq 4ead1a7a-0fd6-4e7c-b923-4bc0cecd8361 v1 5505 spec.containers{test-app}} Pulling Pulling image "nginx:1.15" {kubelet k8s-agentpool1-18522079-vmss000000} 2022-04-30 05:53:05 +0000 UTC 2022-04-30 05:53:05 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245]
Apr 30 05:53:36.814: INFO: 2. {{ } {servicelb-test-76bf687774-4f2pq.16ea96c4f878ad97  e2e-tests-service-lb-qm4pj  70abb050-8f70-4a4d-8a55-a44bbd66f353 5531 0 2022-04-30 05:53:06 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-04-30 05:53:06 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-qm4pj servicelb-test-76bf687774-4f2pq 4ead1a7a-0fd6-4e7c-b923-4bc0cecd8361 v1 5505 spec.containers{test-app}} Pulled Successfully pulled image "nginx:1.15" in 136.895369ms {kubelet k8s-agentpool1-18522079-vmss000000} 2022-04-30 05:53:06 +0000 UTC 2022-04-30 05:53:06 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245]
Apr 30 05:53:36.814: INFO: 3. {{ } {servicelb-test-76bf687774-4f2pq.16ea96c4fd9ac14b  e2e-tests-service-lb-qm4pj  9778cc58-aed4-4639-ad82-f5c30af8bd7e 5535 0 2022-04-30 05:53:06 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-04-30 05:53:06 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-qm4pj servicelb-test-76bf687774-4f2pq 4ead1a7a-0fd6-4e7c-b923-4bc0cecd8361 v1 5505 spec.containers{test-app}} Created Created container test-app {kubelet k8s-agentpool1-18522079-vmss000000} 2022-04-30 05:53:06 +0000 UTC 2022-04-30 05:53:06 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245]
... skipping 55 lines ...
Apr 30 05:55:52.733: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57]
Apr 30 05:55:52.733: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 05:55:52.849: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82]
Apr 30 05:55:52.964: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-zl626 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:270]
Apr 30 05:55:52.964: INFO: Creating public IP resource named service-lb-internal-none-public-IP0e3c [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:175]
STEP: Waiting for exposure of the original service without assigned lb private IP
Apr 30 05:55:56.991: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:56:07.028: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:56:17.025: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:56:27.023: INFO: Exposure successfully, get external ip: 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 05:56:27.083: INFO: Events list: [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:290]
Apr 30 05:56:27.084: INFO: 0. {{ } {servicelb-test-76bf687774-8qkfs.16ea96ebd11fd457  e2e-tests-service-lb-zl626  64f988e4-5da7-4979-8ed5-4c6e6075e2c4 6333 0 2022-04-30 05:55:52 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-scheduler Update events.k8s.io/v1 2022-04-30 05:55:52 +0000 UTC FieldsV1 {"f:action":{},"f:eventTime":{},"f:note":{},"f:reason":{},"f:regarding":{"f:apiVersion":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:reportingController":{},"f:reportingInstance":{},"f:type":{}}}]} {Pod e2e-tests-service-lb-zl626 servicelb-test-76bf687774-8qkfs 84d24054-3fe6-4136-a275-45b651869142 v1 6316 } Scheduled Successfully assigned e2e-tests-service-lb-zl626/servicelb-test-76bf687774-8qkfs to k8s-agentpool1-18522079-vmss000001 { } 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC 0 Normal 2022-04-30 05:55:52.954707 +0000 UTC nil Binding nil default-scheduler default-scheduler-k8s-master-18522079-2} [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:292]
Apr 30 05:56:27.084: INFO: 1. {{ } {servicelb-test-76bf687774-8qkfs.16ea96ebffcd3962  e2e-tests-service-lb-zl626  d2ba3da4-3a06-4cb4-b81e-61a444435995 6351 0 2022-04-30 05:55:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-04-30 05:55:53 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-zl626 servicelb-test-76bf687774-8qkfs 84d24054-3fe6-4136-a275-45b651869142 v1 6322 spec.containers{test-app}} Pulling Pulling image "nginx:1.15" {kubelet k8s-agentpool1-18522079-vmss000001} 2022-04-30 05:55:53 +0000 UTC 2022-04-30 05:55:53 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:292]
Apr 30 05:56:27.084: INFO: 2. {{ } {servicelb-test-76bf687774-8qkfs.16ea96ec09948ca2  e2e-tests-service-lb-zl626  090671fe-912d-4314-9561-4687643a2db6 6357 0 2022-04-30 05:55:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-04-30 05:55:53 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-zl626 servicelb-test-76bf687774-8qkfs 84d24054-3fe6-4136-a275-45b651869142 v1 6322 spec.containers{test-app}} Pulled Successfully pulled image "nginx:1.15" in 164.046119ms {kubelet k8s-agentpool1-18522079-vmss000001} 2022-04-30 05:55:53 +0000 UTC 2022-04-30 05:55:53 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:292]
Apr 30 05:56:27.084: INFO: 3. {{ } {servicelb-test-76bf687774-8qkfs.16ea96ec0e4a9c97  e2e-tests-service-lb-zl626  c72f96d2-63c0-44e2-9990-69dc870bb79a 6360 0 2022-04-30 05:55:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-04-30 05:55:53 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-zl626 servicelb-test-76bf687774-8qkfs 84d24054-3fe6-4136-a275-45b651869142 v1 6322 spec.containers{test-app}} Created Created container test-app {kubelet k8s-agentpool1-18522079-vmss000001} 2022-04-30 05:55:53 +0000 UTC 2022-04-30 05:55:53 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:292]
... skipping 62 lines ...
Apr 30 05:59:42.058: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57]
Apr 30 05:59:42.058: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 05:59:42.173: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82]
Apr 30 05:59:42.216: INFO: Creating public IP resource named service-lb-public-remain8eb4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:175]
Apr 30 05:59:46.280: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-2bq6s [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:319]
STEP: Waiting for exposure of the original service with assigned lb private IP
Apr 30 05:59:46.317: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 05:59:56.349: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:00:06.349: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:00:16.349: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:00:26.349: INFO: Exposure successfully, get external ip: 20.25.127.118 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 06:00:26.349: INFO: checking the connectivity of the public IP 20.25.127.118 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 06:00:56.350: INFO: got error Get "http://20.25.127.118:80": dial tcp 20.25.127.118:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
Apr 30 06:01:16.406: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178]
Apr 30 06:01:16.406: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186]
STEP: Update without changing the service and wait for a while
Apr 30 06:01:16.406: INFO: External IP is now 20.25.127.118 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:334]
Apr 30 06:01:16.444: INFO: testlabel8eb4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:337]
Apr 30 06:01:16.521: INFO: External IP is still 20.25.127.118 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:358]
... skipping 46 lines ...
Apr 30 06:08:13.329: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 06:08:13.333: INFO: Creating a test namespace [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:89]
Apr 30 06:08:13.370: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57]
Apr 30 06:08:13.370: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 06:08:13.485: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82]
Apr 30 06:08:13.522: INFO: Creating public IP resource named service-lb-public-remainebb8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:175]
Apr 30 06:08:16.969: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:08:27.002: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:08:37.002: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:08:47.003: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:08:57.011: INFO: Exposure successfully, get external ip: 20.25.57.105 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 06:08:57.011: INFO: checking the connectivity of the public IP 20.25.57.105 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 06:08:57.068: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178]
Apr 30 06:08:57.068: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186]
Apr 30 06:08:57.068: INFO: Successfully created LoadBalancer service1 in namespace e2e-tests-service-lb-ct9x9 with IP 20.25.57.105 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:379]
Apr 30 06:08:57.167: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:09:07.199: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:09:17.202: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:09:27.200: INFO: Exposure successfully, get external ip: 20.25.57.105 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 06:09:27.200: INFO: checking the connectivity of the public IP 20.25.57.105 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 06:09:27.200: INFO: Successfully created LoadBalancer service2 in namespace e2e-tests-service-lb-ct9x9 with IP 20.25.57.105 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:391]
STEP: Cleaning up
Apr 30 06:09:27.200: INFO: Deleting service service1 in namespace e2e-tests-service-lb-ct9x9 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48]
Apr 30 06:09:45.356: INFO: Deleting service service2 in namespace e2e-tests-service-lb-ct9x9 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48]
... skipping 12 lines ...
Apr 30 06:11:04.059: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57]
Apr 30 06:11:04.059: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 06:11:04.063: INFO: Creating a test namespace [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:89]
Apr 30 06:11:04.100: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57]
Apr 30 06:11:04.100: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 06:11:04.216: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82]
Apr 30 06:11:04.390: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:11:14.427: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:11:24.421: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:11:34.423: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:11:44.426: INFO: Exposure successfully, get external ip: 20.228.221.239 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 06:11:44.426: INFO: checking the connectivity of the public IP 20.228.221.239 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 06:12:14.430: INFO: got error Get "http://20.228.221.239:80": dial tcp 20.228.221.239:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
Apr 30 06:12:34.492: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178]
Apr 30 06:12:34.492: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186]
Apr 30 06:12:34.492: INFO: Successfully created LoadBalancer service1 in namespace e2e-tests-service-lb-l948w with IP 20.228.221.239 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:410]
Apr 30 06:12:34.584: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:12:44.616: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:12:54.618: INFO: Exposure successfully, get external ip: 20.228.221.239 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 06:12:54.618: INFO: checking the connectivity of the public IP 20.228.221.239 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 06:12:54.618: INFO: Successfully created LoadBalancer service2 in namespace e2e-tests-service-lb-l948w with IP 20.228.221.239 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:422]
STEP: Deleting one service and check if the other service works well
Apr 30 06:12:54.618: INFO: Deleting service service1 in namespace e2e-tests-service-lb-l948w [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48]
Apr 30 06:14:02.782: INFO: Exposure successfully, get external ip: 20.228.221.239 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
... skipping 15 lines ...
Apr 30 06:15:33.500: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57]
Apr 30 06:15:33.500: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 06:15:33.502: INFO: Creating a test namespace [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:89]
Apr 30 06:15:33.538: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57]
Apr 30 06:15:33.538: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 06:15:33.653: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82]
Apr 30 06:15:33.809: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:15:43.845: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:15:53.844: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:16:03.841: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:16:13.846: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:16:23.844: INFO: Exposure successfully, get external ip: 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 06:16:23.845: INFO: Successfully created LoadBalancer service1 in namespace e2e-tests-service-lb-nrqpn with IP 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:459]
Apr 30 06:16:23.940: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:16:33.976: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:16:43.974: INFO: Exposure successfully, get external ip: 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 06:16:43.974: INFO: Successfully created LoadBalancer service2 in namespace e2e-tests-service-lb-nrqpn with IP 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:471]
STEP: Cleaning up
Apr 30 06:16:43.974: INFO: Deleting service service1 in namespace e2e-tests-service-lb-nrqpn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48]
Apr 30 06:16:58.111: INFO: Deleting service service2 in namespace e2e-tests-service-lb-nrqpn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48]
Apr 30 06:18:00.285: INFO: Deleting namespace e2e-tests-service-lb-nrqpn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:137]
... skipping 39 lines ...
STEP: Getting agent nodes list
STEP: Get vmss names from node providerIDs
Apr 30 06:18:25.036: INFO: Got vmss names [k8s-agentpool1-18522079-vmss k8s-agentpool2-18522079-vmss] [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:557]
STEP: Creating service vmss-test-k8s-agentpool1-18522079-vmss in namespace e2e-tests-vmssservice-l9nc5
Apr 30 06:18:25.085: INFO: Successfully created LoadBalancer service vmss-test-k8s-agentpool1-18522079-vmss in namespace e2e-tests-vmssservice-l9nc5 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:834]
STEP: Waiting for service exposure
Apr 30 06:18:25.115: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:18:35.151: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:18:45.148: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:18:55.147: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:19:05.159: INFO: Exposure successfully, get external ip: 137.117.70.173 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 06:19:05.159: INFO: checking the connectivity of the public IP 137.117.70.173 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 06:19:12.281: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178]
Apr 30 06:19:12.281: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186]
STEP: Getting public IPs in the resourceGroup kubetest-wecn1lqd
STEP: Getting public IP frontend configuration ID
... skipping 2 lines ...
STEP: Getting loadBalancer
STEP: Getting loadBalancer backendPoolID
STEP: Validating loadBalancer backendPool
STEP: Creating service vmss-test-k8s-agentpool2-18522079-vmss in namespace e2e-tests-vmssservice-l9nc5
Apr 30 06:19:13.010: INFO: Successfully created LoadBalancer service vmss-test-k8s-agentpool2-18522079-vmss in namespace e2e-tests-vmssservice-l9nc5 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:834]
STEP: Waiting for service exposure
Apr 30 06:19:13.042: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:19:23.074: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:19:33.076: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:19:43.076: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:19:53.077: INFO: Exposure successfully, get external ip: 137.117.78.66 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 06:19:53.077: INFO: checking the connectivity of the public IP 137.117.78.66 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 06:20:23.078: INFO: got error Get "http://137.117.78.66:80": dial tcp 137.117.78.66:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
Apr 30 06:20:43.139: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178]
Apr 30 06:20:43.139: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186]
STEP: Getting public IPs in the resourceGroup kubetest-wecn1lqd
STEP: Getting public IP frontend configuration ID
STEP: Getting loadBalancer name from pipFrontendConfigurationID
Apr 30 06:20:43.372: INFO: Got loadBalancerName "k8s-agentpool2-18522079-vmss" [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:866]
... skipping 18 lines ...
Apr 30 06:23:59.750: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 06:23:59.864: INFO: Creating deployment nsg-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:68]
STEP: Creating a service and expose it
Apr 30 06:23:59.902: INFO: Creating service nsg-test in namespace e2e-tests-nsg-g75q7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:772]
Apr 30 06:24:00.013: INFO: Successfully created LoadBalancer service nsg-test in namespace e2e-tests-nsg-g75q7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:776]
Apr 30 06:24:00.013: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:779]
Apr 30 06:24:00.047: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:24:10.079: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:24:20.080: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:24:30.081: INFO: Exposure successfully, get external ip: 137.135.69.17 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 06:24:30.081: INFO: checking the connectivity of the public IP 137.135.69.17 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 06:24:45.593: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178]
Apr 30 06:24:45.593: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186]
STEP: Validating ip exists in Security Group
Apr 30 06:24:45.593: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:124]
... skipping 27 lines ...
Apr 30 06:26:44.697: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 06:26:44.812: INFO: Creating deployment nsg-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:68]
STEP: Creating service and wait it to expose
Apr 30 06:26:44.849: INFO: Creating service nsg-test in namespace e2e-tests-nsg-kzjp7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:145]
Apr 30 06:26:44.931: INFO: Successfully created LoadBalancer service nsg-test in namespace e2e-tests-nsg-kzjp7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:149]
STEP: Waiting for the service to be exposed
Apr 30 06:26:44.974: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:26:55.010: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:27:05.009: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:27:15.006: INFO: Exposure successfully, get external ip: 137.135.75.176 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
STEP: Validating if the corresponding IP prefix existing in nsg
Apr 30 06:27:15.007: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:124]
Apr 30 06:27:15.422: INFO: got sg list, length = 1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:146]
Apr 30 06:27:15.459: INFO: Deleting namespace e2e-tests-nsg-kzjp7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:137]

... skipping 11 lines ...
Apr 30 06:27:57.565: INFO: Creating a test namespace [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:89]
Apr 30 06:27:57.599: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57]
Apr 30 06:27:57.599: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 06:27:57.716: INFO: Creating deployment nsg-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:68]
STEP: Creating a test service with the deny rule annotation but without `service.Spec.LoadBalancerSourceRanges`
STEP: Waiting for the service to expose
Apr 30 06:27:57.853: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:28:07.885: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:28:17.887: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:28:27.887: INFO: Exposure successfully, get external ip: 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
STEP: Checking if there is a deny_all rule
Apr 30 06:28:27.887: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:124]
Apr 30 06:28:28.156: INFO: got sg list, length = 1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:146]
STEP: Deleting the service
Apr 30 06:28:28.156: INFO: Deleting service nsg-test in namespace e2e-tests-nsg-6shht [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48]
STEP: Creating a test service with the deny rule annotation and `service.Spec.LoadBalancerSourceRanges`
STEP: Waiting for the service to expose
Apr 30 06:29:30.394: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:29:40.428: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:29:50.431: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:30:00.426: INFO: Exposure successfully, get external ip: 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
STEP: Checking if there is a LoadBalancerSourceRanges rule
Apr 30 06:30:00.426: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:124]
Apr 30 06:30:00.660: INFO: got sg list, length = 1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:146]
STEP: Checking if there is a deny_all rule
Apr 30 06:30:00.697: INFO: Deleting namespace e2e-tests-nsg-6shht [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:137]
... skipping 125 lines ...
Apr 30 06:46:46.492: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57]
Apr 30 06:46:46.492: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
STEP: Create service
Apr 30 06:46:46.608: INFO: Creating service annotation-test in namespace e2e-tests-service-h5qvg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:772]
Apr 30 06:46:46.661: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-h5qvg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:776]
Apr 30 06:46:46.661: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:779]
Apr 30 06:46:46.692: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:46:56.724: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:47:06.727: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:47:16.724: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:47:26.725: INFO: Exposure successfully, get external ip: 20.25.70.89 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 06:47:26.726: INFO: checking the connectivity of the public IP 20.25.70.89 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 06:47:26.780: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178]
Apr 30 06:47:26.780: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186]
STEP: Validating External domain name
Apr 30 06:47:26.782: INFO: Get domain name: annotation-test75c5cacc-e268-4c2d-9a56-9fb7f4ea480e.eastus.cloudapp.azure.com [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:75]
... skipping 20 lines ...
Apr 30 06:50:03.381: INFO: Creating Azure clients [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:95]
Apr 30 06:50:03.381: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57]
Apr 30 06:50:03.381: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 06:50:03.472: INFO: Creating service annotation-test in namespace e2e-tests-service-wk5cg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:772]
Apr 30 06:50:03.555: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-wk5cg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:776]
Apr 30 06:50:03.555: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:779]
Apr 30 06:50:03.595: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:50:13.627: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:50:23.629: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:50:33.627: INFO: Exposure successfully, get external ip: 10.240.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 06:50:33.628: INFO: cleaning up test service annotation-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:164]
Apr 30 06:50:33.628: INFO: Deleting service annotation-test in namespace e2e-tests-service-wk5cg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48]
Apr 30 06:51:41.798: INFO: Deleting namespace e2e-tests-service-wk5cg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:137]

• [SLOW TEST:120.701 seconds]
... skipping 18 lines ...
Apr 30 06:51:54.128: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:35]
STEP: Test subnet doesn't exist. Creating a new one...
Apr 30 06:51:56.720: INFO: creating a new subnet a--------------------------------------------------z, 10.0.0.0/24 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:72]
Apr 30 06:51:57.025: INFO: Creating service annotation-test in namespace e2e-tests-service-j7mp8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:772]
Apr 30 06:51:57.092: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-j7mp8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:776]
Apr 30 06:51:57.092: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:779]
Apr 30 06:51:57.135: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:52:07.169: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:52:17.168: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:52:27.170: INFO: Exposure successfully, get external ip: 10.0.0.4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 06:52:27.170: INFO: Get External IP: 10.0.0.4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:212]
STEP: Validating external ip in target subnet
Apr 30 06:52:27.170: INFO: cleaning up test service annotation-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:208]
Apr 30 06:52:27.170: INFO: Deleting service annotation-test in namespace e2e-tests-service-j7mp8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48]
Apr 30 06:53:37.298: INFO: cleaning up test subnet a--------------------------------------------------z [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:194]
... skipping 18 lines ...
Apr 30 06:53:50.149: INFO: Creating Azure clients [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:95]
Apr 30 06:53:50.149: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57]
Apr 30 06:53:50.149: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
Apr 30 06:53:50.274: INFO: Creating service annotation-test in namespace e2e-tests-service-6tjxb [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:772]
Apr 30 06:53:50.332: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-6tjxb [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:776]
Apr 30 06:53:50.332: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:779]
Apr 30 06:53:50.366: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:54:00.404: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:54:10.400: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:54:20.399: INFO: Exposure successfully, get external ip: 20.228.155.192 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 06:54:20.400: INFO: checking the connectivity of the public IP 20.228.155.192 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 06:54:50.401: INFO: got error Get "http://20.228.155.192:80": dial tcp 20.228.155.192:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
Apr 30 06:55:10.455: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178]
Apr 30 06:55:10.455: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186]
Apr 30 06:55:10.455: INFO: Getting public IPs in the resourceGroup kubetest-wecn1lqd [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:734]
Apr 30 06:55:10.860: INFO: Getting public IP frontend configuration ID [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:738]
Apr 30 06:55:10.861: INFO: Successfully obtained PIP front config id: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/a22b410bc9781487f9692384a32a9123 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:751]
Apr 30 06:55:10.861: INFO: Getting loadBalancer name from pipFrontendConfigurationID [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:753]
... skipping 23 lines ...
STEP: resource group e2e-21c4 created
STEP: creating test PIP in the test resource group
Apr 30 06:56:27.963: INFO: Creating public IP resource named testPIP-3a8b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:175]
STEP: Creating service annotation-test in namespace e2e-tests-service-gv2nx
Apr 30 06:56:31.705: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-gv2nx [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:285]
STEP: Waiting service to expose...
Apr 30 06:56:31.740: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:56:41.772: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 06:56:51.777: INFO: Exposure successfully, get external ip: 20.231.200.47 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 06:56:51.777: INFO: checking the connectivity of the public IP 20.231.200.47 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 06:57:21.778: INFO: got error Get "http://20.231.200.47:80": dial tcp 20.231.200.47:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
Apr 30 06:57:41.832: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178]
Apr 30 06:57:41.832: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186]
Apr 30 06:57:41.832: INFO: Getting public IPs in the resourceGroup e2e-21c4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:734]
Apr 30 06:57:41.919: INFO: Getting public IP frontend configuration ID [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:738]
Apr 30 06:57:41.919: INFO: Successfully obtained PIP front config id: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-wecn1lqd/providers/Microsoft.Network/loadBalancers/kubetest-wecn1lqd/frontendIPConfigurations/ad7116166d90047e9a2b7ff157a453c9 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:751]
Apr 30 06:57:41.919: INFO: Getting loadBalancer name from pipFrontendConfigurationID [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:753]
... skipping 25 lines ...
Apr 30 07:00:43.255: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57]
Apr 30 07:00:43.255: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
STEP: Exposing two services with shared security rule
Apr 30 07:00:43.377: INFO: Creating service annotation-test in namespace e2e-tests-service-fxsh7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:772]
Apr 30 07:00:43.440: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-fxsh7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:776]
Apr 30 07:00:43.440: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:779]
Apr 30 07:00:43.475: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 07:00:53.509: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 07:01:03.513: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 07:01:13.507: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 07:01:23.510: INFO: Exposure successfully, get external ip: 20.232.150.158 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 07:01:23.510: INFO: checking the connectivity of the public IP 20.232.150.158 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 07:01:53.512: INFO: got error Get "http://20.232.150.158:80": dial tcp 20.232.150.158:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
Apr 30 07:02:13.574: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178]
Apr 30 07:02:13.574: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186]
Apr 30 07:02:13.574: INFO: Creating service annotation-test-share in namespace e2e-tests-service-fxsh7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:772]
Apr 30 07:02:13.643: INFO: Successfully created LoadBalancer service annotation-test-share in namespace e2e-tests-service-fxsh7 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:776]
Apr 30 07:02:13.643: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:779]
Apr 30 07:02:13.680: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 07:02:23.712: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 07:02:33.711: INFO: Exposure successfully, get external ip: 20.232.98.135 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 07:02:33.711: INFO: checking the connectivity of the public IP 20.232.98.135 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 07:03:03.718: INFO: got error Get "http://20.232.98.135:80": dial tcp 20.232.98.135:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173]
Apr 30 07:03:23.780: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178]
Apr 30 07:03:23.780: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186]
STEP: Validate shared security rule exists
Apr 30 07:03:23.780: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:124]
Apr 30 07:03:24.184: INFO: got sg list, length = 1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:146]
Apr 30 07:03:24.184: INFO: Found target security rule [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:254]
... skipping 19 lines ...
Apr 30 07:06:02.693: INFO: 0 pods in namespace e2e-tests-service-fg9b7 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:83]
Apr 30 07:06:02.693: INFO: Creating Azure clients [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:95]
Apr 30 07:06:02.693: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:57]
Apr 30 07:06:02.693: INFO: Kubernetes configuration file name: /root/tmp661367792/kubeconfig/kubeconfig.eastus.json [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:65]
STEP: Creating a service with custom tags
STEP: Waiting service to expose...
Apr 30 07:06:02.905: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 07:06:12.937: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 07:06:22.938: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132]
Apr 30 07:06:32.938: INFO: Exposure successfully, get external ip: 20.25.99.235 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147]
Apr 30 07:06:32.938: INFO: checking the connectivity of the public IP 20.25.99.235 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96]
Apr 30 07:06:48.481: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178]
Apr 30 07:06:48.481: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186]
STEP: Checking tags on the corresponding public IP
Apr 30 07:06:49.569: INFO: 
... skipping 13 lines ...