Recent runs || View in Spyglass
Result | FAILURE |
Tests | 115 failed / 178 succeeded |
Started | |
Elapsed | 2h7m |
Revision | master |
job-version | v1.21.0-alpha.1.108+85663458773416 |
revision | v1.21.0-alpha.1.108+85663458773416 |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\spoststart\sexec\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:52 Jan 16 18:53:34.777: Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103from junit_06.xml
[BeforeEach] [k8s.io] Container Lifecycle Hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 18:48:33.699: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename container-lifecycle-hook �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-lifecycle-hook-4675 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] when create a pod with lifecycle hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:52 �[1mSTEP�[0m: create the container to handle the HTTPGet hook request. Jan 16 18:53:34.777: FAIL: Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc0037f6ce0, 0xc000426000, 0x0) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func15.1.1() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:55 +0xb3 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003255980) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc003255980) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc003255980, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Container Lifecycle Hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-lifecycle-hook-4675". �[1mSTEP�[0m: Found 5 events. Jan 16 18:53:34.833: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-handle-http-request: { } Scheduled: Successfully assigned container-lifecycle-hook-4675/pod-handle-http-request to 3570k8s000 Jan 16 18:53:34.833: INFO: At 2021-01-16 18:48:38 +0000 UTC - event for pod-handle-http-request: {kubelet 3570k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 18:53:34.833: INFO: At 2021-01-16 18:48:39 +0000 UTC - event for pod-handle-http-request: {kubelet 3570k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 16 18:53:34.833: INFO: At 2021-01-16 18:48:40 +0000 UTC - event for pod-handle-http-request: {kubelet 3570k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 16 18:53:34.833: INFO: At 2021-01-16 18:48:44 +0000 UTC - event for pod-handle-http-request: {kubelet 3570k8s000} Failed: Error: ImagePullBackOff Jan 16 18:53:34.887: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 18:53:34.887: INFO: pod-handle-http-request 3570k8s000 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 18:48:34 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 18:48:34 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 18:48:34 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 18:48:34 +0000 UTC }] Jan 16 18:53:34.888: INFO: Jan 16 18:53:34.999: INFO: Logging node info for node 3570k8s000 Jan 16 18:53:35.056: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 3058 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 18:53:22 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 18:53:22 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 18:53:22 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 18:53:22 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 18:53:35.057: INFO: Logging kubelet events for node 3570k8s000 Jan 16 18:53:35.115: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 18:53:35.180: INFO: pod-secrets-7557816f-f847-4be3-9b4d-be85f2d1dcf9 started at 2021-01-16 18:50:38 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:35.180: INFO: Container secret-volume-test ready: false, restart count 0 Jan 16 18:53:35.180: INFO: sample-crd-conversion-webhook-deployment-9b58d4985-g5wv7 started at 2021-01-16 18:52:35 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:35.180: INFO: Container sample-crd-conversion-webhook ready: false, restart count 0 Jan 16 18:53:35.180: INFO: pod-handle-http-request started at 2021-01-16 18:48:34 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:35.180: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 18:53:35.180: INFO: externalname-service-q4hsm started at 2021-01-16 18:51:45 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:35.181: INFO: Container externalname-service ready: false, restart count 0 Jan 16 18:53:35.181: INFO: pod-projected-configmaps-5c3eb221-e4e3-408a-b826-6a70344b66fa started at 2021-01-16 18:50:42 +0000 UTC (0+3 container statuses recorded) Jan 16 18:53:35.181: INFO: Container createcm-volume-test ready: false, restart count 0 Jan 16 18:53:35.181: INFO: Container delcm-volume-test ready: false, restart count 0 Jan 16 18:53:35.181: INFO: Container updcm-volume-test ready: false, restart count 0 W0116 18:53:35.289821 87660 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 18:53:35.468: INFO: Latency metrics for node 3570k8s000 Jan 16 18:53:35.468: INFO: Logging node info for node 3570k8s001 Jan 16 18:53:35.523: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 2801 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 18:52:42 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 18:52:42 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 18:52:42 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 18:52:42 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 18:53:35.524: INFO: Logging kubelet events for node 3570k8s001 Jan 16 18:53:35.581: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 18:53:35.638: INFO: downwardapi-volume-33023ab4-0633-4bf6-8f28-d5f82d898df3 started at 2021-01-16 18:50:56 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:35.638: INFO: Container client-container ready: false, restart count 0 Jan 16 18:53:35.638: INFO: externalname-service-sqnz7 started at 2021-01-16 18:51:45 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:35.638: INFO: Container externalname-service ready: false, restart count 0 Jan 16 18:53:35.638: INFO: busybox-13368655-5fa8-4a4a-878e-21af5ace8318 started at 2021-01-16 18:53:06 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:35.638: INFO: Container busybox ready: true, restart count 0 Jan 16 18:53:35.638: INFO: downwardapi-volume-baa359f0-59af-4112-902b-e7651b4e8437 started at 2021-01-16 18:50:49 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:35.638: INFO: Container client-container ready: false, restart count 0 W0116 18:53:35.698917 87660 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 18:53:35.888: INFO: Latency metrics for node 3570k8s001 Jan 16 18:53:35.888: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 18:53:35.943: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 3057 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 18:53:22 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 18:53:22 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 18:53:22 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 18:53:22 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 18:53:35.943: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 18:53:36.001: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 18:53:36.065: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:36.065: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 18:53:36.065: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:36.065: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 18:53:36.065: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:36.065: INFO: Container kube-proxy ready: true, restart count 0 Jan 16 18:53:36.065: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 18:53:36.065: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 18:53:36.065: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 18:53:36.065: INFO: Container secrets-store ready: true, restart count 0 Jan 16 18:53:36.065: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:36.065: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 16 18:53:36.065: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:36.065: INFO: Container kube-apiserver ready: true, restart count 0 Jan 16 18:53:36.065: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:36.065: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 16 18:53:36.065: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:36.065: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 18:53:36.065: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:36.065: INFO: Container metrics-server ready: true, restart count 1 Jan 16 18:53:36.065: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:36.065: INFO: Container azure-cnms ready: true, restart count 0 Jan 16 18:53:36.065: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:36.065: INFO: Container autoscaler ready: true, restart count 0 Jan 16 18:53:36.065: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:36.065: INFO: Container coredns ready: true, restart count 0 Jan 16 18:53:36.065: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 18:53:36.065: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 W0116 18:53:36.127957 87660 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 18:53:36.381: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 18:53:36.381: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-lifecycle-hook-4675" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\spoststart\shttp\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:52 Jan 16 20:17:03.062: Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103from junit_01.xml
[BeforeEach] [k8s.io] Container Lifecycle Hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 20:12:02.343: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename container-lifecycle-hook �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-lifecycle-hook-3921 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] when create a pod with lifecycle hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:52 �[1mSTEP�[0m: create the container to handle the HTTPGet hook request. Jan 16 20:17:03.062: FAIL: Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc002ae2a40, 0xc000181c00, 0x0) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func15.1.1() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:55 +0xb3 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0038c5e00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc0038c5e00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc0038c5e00, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Container Lifecycle Hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-lifecycle-hook-3921". �[1mSTEP�[0m: Found 6 events. Jan 16 20:17:03.118: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-handle-http-request: { } Scheduled: Successfully assigned container-lifecycle-hook-3921/pod-handle-http-request to 3570k8s000 Jan 16 20:17:03.118: INFO: At 2021-01-16 20:12:06 +0000 UTC - event for pod-handle-http-request: {kubelet 3570k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 20:17:03.118: INFO: At 2021-01-16 20:12:07 +0000 UTC - event for pod-handle-http-request: {kubelet 3570k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 16 20:17:03.118: INFO: At 2021-01-16 20:12:08 +0000 UTC - event for pod-handle-http-request: {kubelet 3570k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 16 20:17:03.118: INFO: At 2021-01-16 20:12:13 +0000 UTC - event for pod-handle-http-request: {kubelet 3570k8s000} BackOff: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 20:17:03.118: INFO: At 2021-01-16 20:12:13 +0000 UTC - event for pod-handle-http-request: {kubelet 3570k8s000} Failed: Error: ImagePullBackOff Jan 16 20:17:03.173: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 20:17:03.173: INFO: pod-handle-http-request 3570k8s000 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:02 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:02 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:02 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:02 +0000 UTC }] Jan 16 20:17:03.173: INFO: Jan 16 20:17:03.283: INFO: Logging node info for node 3570k8s000 Jan 16 20:17:03.338: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 26582 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 20:16:46 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 20:16:46 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 20:16:46 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 20:16:46 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 20:17:03.338: INFO: Logging kubelet events for node 3570k8s000 Jan 16 20:17:03.393: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 20:17:03.459: INFO: externalname-service-fl7f8 started at 2021-01-16 20:14:51 +0000 UTC (0+1 container statuses recorded) Jan 16 20:17:03.459: INFO: Container externalname-service ready: false, restart count 0 Jan 16 20:17:03.459: INFO: sample-webhook-deployment-65bfd79dc5-5gtps started at 2021-01-16 20:12:40 +0000 UTC (0+1 container statuses recorded) Jan 16 20:17:03.459: INFO: Container sample-webhook ready: false, restart count 0 Jan 16 20:17:03.459: INFO: pod-handle-http-request started at 2021-01-16 20:12:02 +0000 UTC (0+1 container statuses recorded) Jan 16 20:17:03.459: INFO: Container agnhost-container ready: false, restart count 0 W0116 20:17:03.568415 87665 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 20:17:03.740: INFO: Latency metrics for node 3570k8s000 Jan 16 20:17:03.740: INFO: Logging node info for node 3570k8s001 Jan 16 20:17:03.795: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 26351 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 20:16:02 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 20:16:02 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 20:16:02 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 20:16:02 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 20:17:03.795: INFO: Logging kubelet events for node 3570k8s001 Jan 16 20:17:03.850: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 20:17:03.908: INFO: externalname-service-94n6c started at 2021-01-16 20:14:51 +0000 UTC (0+1 container statuses recorded) Jan 16 20:17:03.908: INFO: Container externalname-service ready: false, restart count 0 Jan 16 20:17:03.908: INFO: dns-test-4db39994-57cf-4f80-af1c-c438049c1fec started at 2021-01-16 20:08:10 +0000 UTC (0+3 container statuses recorded) Jan 16 20:17:03.908: INFO: Container jessie-querier ready: true, restart count 0 Jan 16 20:17:03.908: INFO: Container querier ready: false, restart count 0 Jan 16 20:17:03.908: INFO: Container webserver ready: false, restart count 0 Jan 16 20:17:03.908: INFO: pod-host-path-test started at 2021-01-16 20:12:36 +0000 UTC (0+2 container statuses recorded) Jan 16 20:17:03.908: INFO: Container test-container-1 ready: false, restart count 0 Jan 16 20:17:03.908: INFO: Container test-container-2 ready: false, restart count 0 W0116 20:17:03.967914 87665 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 20:17:04.196: INFO: Latency metrics for node 3570k8s001 Jan 16 20:17:04.196: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 20:17:04.251: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 25656 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 20:14:01 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 20:14:01 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 20:14:01 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 20:14:01 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 20:17:04.252: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 20:17:04.305: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 20:17:04.372: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 20:17:04.372: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 20:17:04.372: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 20:17:04.372: INFO: Container secrets-store ready: true, restart count 0 Jan 16 20:17:04.372: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 20:17:04.372: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 16 20:17:04.372: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 20:17:04.372: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 16 20:17:04.372: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 20:17:04.372: INFO: Container azure-cnms ready: true, restart count 0 Jan 16 20:17:04.372: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 20:17:04.372: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 20:17:04.372: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 20:17:04.372: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 20:17:04.372: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 20:17:04.372: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 20:17:04.372: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 20:17:04.372: INFO: Container kube-proxy ready: true, restart count 0 Jan 16 20:17:04.372: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 20:17:04.372: INFO: Container kube-apiserver ready: true, restart count 0 Jan 16 20:17:04.372: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 20:17:04.372: INFO: Container coredns ready: true, restart count 0 Jan 16 20:17:04.372: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 20:17:04.372: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 16 20:17:04.372: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 20:17:04.372: INFO: Container metrics-server ready: true, restart count 1 Jan 16 20:17:04.372: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 20:17:04.372: INFO: Container autoscaler ready: true, restart count 0 W0116 20:17:04.431225 87665 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 20:17:04.671: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 20:17:04.671: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-lifecycle-hook-3921" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\sprestop\sexec\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:52 Jan 16 19:13:36.082: Unexpected error: <*errors.errorString | 0xc0001f6200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103from junit_04.xml
{"msg":"PASSED [k8s.io] [sig-node] Pods Extended [k8s.io] Pods Set QOS Class should be set on Pods with matching resource requests and limits for memory and cpu [Conformance]","total":-1,"completed":8,"skipped":305,"failed":4,"failures":["[sig-storage] Downward API volume should provide container's memory limit [NodeConformance] [Conformance]","[sig-storage] Projected configMap optional updates should be reflected in volume [NodeConformance] [Conformance]","[sig-storage] Secrets should be able to mount in a volume regardless of a different secret existing with same name in different namespace [NodeConformance] [Conformance]","[k8s.io] Probing container should be restarted with a /healthz http liveness probe [NodeConformance] [Conformance]"]} [BeforeEach] [k8s.io] Container Lifecycle Hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 19:08:35.398: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename container-lifecycle-hook �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-lifecycle-hook-9701 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] when create a pod with lifecycle hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:52 �[1mSTEP�[0m: create the container to handle the HTTPGet hook request. Jan 16 19:13:36.082: FAIL: Unexpected error: <*errors.errorString | 0xc0001f6200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc002baa5a0, 0xc000100800, 0x0) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func15.1.1() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:55 +0xb3 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003ac1b00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc003ac1b00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc003ac1b00, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Container Lifecycle Hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-lifecycle-hook-9701". �[1mSTEP�[0m: Found 4 events. Jan 16 19:13:36.135: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-handle-http-request: { } Scheduled: Successfully assigned container-lifecycle-hook-9701/pod-handle-http-request to 3570k8s000 Jan 16 19:13:36.135: INFO: At 2021-01-16 19:08:40 +0000 UTC - event for pod-handle-http-request: {kubelet 3570k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:13:36.135: INFO: At 2021-01-16 19:08:41 +0000 UTC - event for pod-handle-http-request: {kubelet 3570k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 16 19:13:36.135: INFO: At 2021-01-16 19:08:42 +0000 UTC - event for pod-handle-http-request: {kubelet 3570k8s000} Failed: Error: ImagePullBackOff Jan 16 19:13:36.188: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 19:13:36.188: INFO: pod-handle-http-request 3570k8s000 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:08:35 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:08:35 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:08:35 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:08:35 +0000 UTC }] Jan 16 19:13:36.188: INFO: Jan 16 19:13:36.288: INFO: Logging node info for node 3570k8s000 Jan 16 19:13:36.341: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 7366 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:11:31 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:11:31 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:11:31 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:11:31 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:13:36.341: INFO: Logging kubelet events for node 3570k8s000 Jan 16 19:13:36.395: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 19:13:36.450: INFO: back-off-cap started at 2021-01-16 19:00:52 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:36.450: INFO: Container back-off-cap ready: false, restart count 7 Jan 16 19:13:36.450: INFO: pod-handle-http-request started at 2021-01-16 19:08:35 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:36.450: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:13:36.450: INFO: agnhost-primary-5srhv started at 2021-01-16 19:09:53 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:36.450: INFO: Container agnhost-primary ready: false, restart count 0 Jan 16 19:13:36.450: INFO: liveness-709e0435-6d3d-4bc5-ab34-8632868596b6 started at 2021-01-16 19:11:35 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:36.450: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:13:36.450: INFO: pod-projected-configmaps-cf39b4b9-d4f3-4e29-be8a-d464cc83aaf8 started at 2021-01-16 19:12:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:36.450: INFO: Container agnhost-container ready: false, restart count 0 W0116 19:13:36.556079 87655 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:13:36.733: INFO: Latency metrics for node 3570k8s000 Jan 16 19:13:36.733: INFO: Logging node info for node 3570k8s001 Jan 16 19:13:36.785: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 6860 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:09:20 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:09:20 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:09:20 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:09:20 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:13:36.786: INFO: Logging kubelet events for node 3570k8s001 Jan 16 19:13:36.839: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 19:13:36.894: INFO: pod-projected-configmaps-e9ecb050-377d-4781-8e8d-55eec9b34136 started at 2021-01-16 19:09:48 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:36.894: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:13:36.894: INFO: pod-projected-configmaps-819085cd-1ae0-4313-8b5f-1ba3921f7700 started at 2021-01-16 19:09:37 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:36.894: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:13:36.894: INFO: downwardapi-volume-ab82b898-30e6-4d5b-9088-36fddd301231 started at 2021-01-16 19:08:42 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:36.894: INFO: Container client-container ready: false, restart count 0 W0116 19:13:36.952727 87655 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:13:37.107: INFO: Latency metrics for node 3570k8s001 Jan 16 19:13:37.107: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 19:13:37.159: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 7663 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:13:32 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:13:32 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:13:32 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:13:32 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:13:37.160: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 19:13:37.213: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 19:13:37.272: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:37.272: INFO: Container autoscaler ready: true, restart count 0 Jan 16 19:13:37.272: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:37.272: INFO: Container coredns ready: true, restart count 0 Jan 16 19:13:37.272: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:37.272: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 16 19:13:37.272: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:37.272: INFO: Container metrics-server ready: true, restart count 1 Jan 16 19:13:37.272: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:37.272: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 16 19:13:37.272: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 19:13:37.272: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 19:13:37.272: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 19:13:37.272: INFO: Container secrets-store ready: true, restart count 0 Jan 16 19:13:37.272: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:37.272: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 16 19:13:37.272: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:37.272: INFO: Container azure-cnms ready: true, restart count 0 Jan 16 19:13:37.272: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:37.272: INFO: Container kube-apiserver ready: true, restart count 0 Jan 16 19:13:37.272: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:37.272: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 19:13:37.272: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:37.272: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 19:13:37.272: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:37.272: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 19:13:37.272: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:13:37.272: INFO: Container kube-proxy ready: true, restart count 0 W0116 19:13:37.329802 87655 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:13:37.599: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 19:13:37.599: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-lifecycle-hook-9701" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\sprestop\shttp\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:52 Jan 16 19:19:58.803: Unexpected error: <*errors.errorString | 0xc0001f6200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103from junit_03.xml
[BeforeEach] [k8s.io] Container Lifecycle Hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 19:14:58.048: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename container-lifecycle-hook �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-lifecycle-hook-7368 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] when create a pod with lifecycle hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:52 �[1mSTEP�[0m: create the container to handle the HTTPGet hook request. Jan 16 19:19:58.803: FAIL: Unexpected error: <*errors.errorString | 0xc0001f6200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc0044677a0, 0xc000101c00, 0x0) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func15.1.1() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:55 +0xb3 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000382f00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc000382f00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc000382f00, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Container Lifecycle Hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-lifecycle-hook-7368". �[1mSTEP�[0m: Found 5 events. Jan 16 19:19:58.859: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-handle-http-request: { } Scheduled: Successfully assigned container-lifecycle-hook-7368/pod-handle-http-request to 3570k8s001 Jan 16 19:19:58.859: INFO: At 2021-01-16 19:15:07 +0000 UTC - event for pod-handle-http-request: {kubelet 3570k8s001} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:19:58.859: INFO: At 2021-01-16 19:15:08 +0000 UTC - event for pod-handle-http-request: {kubelet 3570k8s001} Failed: Error: ErrImagePull Jan 16 19:19:58.859: INFO: At 2021-01-16 19:15:09 +0000 UTC - event for pod-handle-http-request: {kubelet 3570k8s001} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 16 19:19:58.859: INFO: At 2021-01-16 19:15:15 +0000 UTC - event for pod-handle-http-request: {kubelet 3570k8s001} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:19:58.915: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 19:19:58.915: INFO: pod-handle-http-request 3570k8s001 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:14:58 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:14:58 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:14:58 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:14:58 +0000 UTC }] Jan 16 19:19:58.915: INFO: Jan 16 19:19:59.024: INFO: Logging node info for node 3570k8s000 Jan 16 19:19:59.079: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 8352 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:16:33 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:16:33 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:16:33 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:16:33 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:19:59.080: INFO: Logging kubelet events for node 3570k8s000 Jan 16 19:19:59.136: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 19:19:59.196: INFO: annotationupdate50cb9039-c190-4120-9e2a-1e16d9f35a8b started at 2021-01-16 19:18:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:19:59.196: INFO: Container client-container ready: false, restart count 0 Jan 16 19:19:59.196: INFO: back-off-cap started at 2021-01-16 19:00:52 +0000 UTC (0+1 container statuses recorded) Jan 16 19:19:59.196: INFO: Container back-off-cap ready: false, restart count 8 Jan 16 19:19:59.196: INFO: sample-webhook-deployment-65bfd79dc5-mbp5c started at 2021-01-16 19:17:06 +0000 UTC (0+1 container statuses recorded) Jan 16 19:19:59.196: INFO: Container sample-webhook ready: false, restart count 0 W0116 19:19:59.306977 87662 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:19:59.476: INFO: Latency metrics for node 3570k8s000 Jan 16 19:19:59.476: INFO: Logging node info for node 3570k8s001 Jan 16 19:19:59.532: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 9121 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:19:15 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:19:15 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:19:15 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:19:15 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:19:59.533: INFO: Logging kubelet events for node 3570k8s001 Jan 16 19:19:59.589: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 19:19:59.649: INFO: pod-handle-http-request started at 2021-01-16 19:14:58 +0000 UTC (0+1 container statuses recorded) Jan 16 19:19:59.649: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:19:59.649: INFO: pod-configmaps-d0acbeed-737d-4a8f-9fdf-61e2bad9d1b6 started at 2021-01-16 19:14:59 +0000 UTC (0+2 container statuses recorded) Jan 16 19:19:59.649: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:19:59.649: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Jan 16 19:19:59.649: INFO: pod-configmaps-e5fb0ba9-022b-4844-ab0b-3630206078ba started at 2021-01-16 19:17:12 +0000 UTC (0+1 container statuses recorded) Jan 16 19:19:59.649: INFO: Container agnhost-container ready: false, restart count 0 W0116 19:19:59.714995 87662 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:19:59.889: INFO: Latency metrics for node 3570k8s001 Jan 16 19:19:59.890: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 19:19:59.945: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 8865 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:18:34 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:18:34 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:18:34 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:18:34 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:19:59.946: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 19:20:00.004: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 19:20:00.069: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:20:00.069: INFO: Container coredns ready: true, restart count 0 Jan 16 19:20:00.069: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:20:00.069: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 16 19:20:00.069: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 19:20:00.069: INFO: Container metrics-server ready: true, restart count 1 Jan 16 19:20:00.069: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:20:00.069: INFO: Container autoscaler ready: true, restart count 0 Jan 16 19:20:00.069: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 19:20:00.069: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 19:20:00.069: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 19:20:00.069: INFO: Container secrets-store ready: true, restart count 0 Jan 16 19:20:00.069: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:20:00.069: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 16 19:20:00.069: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 19:20:00.069: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 16 19:20:00.069: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 19:20:00.069: INFO: Container azure-cnms ready: true, restart count 0 Jan 16 19:20:00.069: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:20:00.069: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 19:20:00.069: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 19:20:00.069: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 19:20:00.069: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:20:00.069: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 19:20:00.069: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:20:00.069: INFO: Container kube-proxy ready: true, restart count 0 Jan 16 19:20:00.069: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 19:20:00.069: INFO: Container kube-apiserver ready: true, restart count 0 W0116 19:20:00.135561 87662 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:20:00.391: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 19:20:00.391: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-lifecycle-hook-7368" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sContainer\sRuntime\sblackbox\stest\swhen\srunning\sa\scontainer\swith\sa\snew\simage\sshould\sbe\sable\sto\spull\simage\s\[NodeConformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:382 Jan 16 19:46:08.362: All 3 attempts failed: expected container state: Running, got: "Waiting" /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:385from junit_03.xml
[BeforeEach] [k8s.io] Container Runtime /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 19:31:05.989: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename container-runtime �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-runtime-5030 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should be able to pull image [NodeConformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:382 �[1mSTEP�[0m: create the container �[1mSTEP�[0m: check the container status �[1mSTEP�[0m: delete the container Jan 16 19:36:07.483: INFO: No.1 attempt failed: expected container state: Running, got: "Waiting", retrying... �[1mSTEP�[0m: create the container �[1mSTEP�[0m: check the container status �[1mSTEP�[0m: delete the container Jan 16 19:41:07.671: INFO: No.2 attempt failed: expected container state: Running, got: "Waiting", retrying... �[1mSTEP�[0m: create the container �[1mSTEP�[0m: check the container status �[1mSTEP�[0m: delete the container Jan 16 19:46:08.362: FAIL: All 3 attempts failed: expected container state: Running, got: "Waiting" Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func25.1.3.3() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:385 +0x1b4 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000382f00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc000382f00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc000382f00, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Container Runtime /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-runtime-5030". �[1mSTEP�[0m: Found 14 events. Jan 16 19:46:08.419: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for image-pull-test48722816-2196-4e27-9c4b-9a86571b57c2: { } Scheduled: Successfully assigned container-runtime-5030/image-pull-test48722816-2196-4e27-9c4b-9a86571b57c2 to 3570k8s000 Jan 16 19:46:08.419: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for image-pull-testdeba7134-b417-44d9-ae6a-43160f40b6a4: { } Scheduled: Successfully assigned container-runtime-5030/image-pull-testdeba7134-b417-44d9-ae6a-43160f40b6a4 to 3570k8s001 Jan 16 19:46:08.419: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for image-pull-teste3b5bd26-5abe-457f-9192-418309f2d73b: { } Scheduled: Successfully assigned container-runtime-5030/image-pull-teste3b5bd26-5abe-457f-9192-418309f2d73b to 3570k8s000 Jan 16 19:46:08.419: INFO: At 2021-01-16 19:31:10 +0000 UTC - event for image-pull-test48722816-2196-4e27-9c4b-9a86571b57c2: {kubelet 3570k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:46:08.419: INFO: At 2021-01-16 19:31:11 +0000 UTC - event for image-pull-test48722816-2196-4e27-9c4b-9a86571b57c2: {kubelet 3570k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 16 19:46:08.419: INFO: At 2021-01-16 19:31:12 +0000 UTC - event for image-pull-test48722816-2196-4e27-9c4b-9a86571b57c2: {kubelet 3570k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 16 19:46:08.419: INFO: At 2021-01-16 19:31:20 +0000 UTC - event for image-pull-test48722816-2196-4e27-9c4b-9a86571b57c2: {kubelet 3570k8s000} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:46:08.419: INFO: At 2021-01-16 19:36:17 +0000 UTC - event for image-pull-teste3b5bd26-5abe-457f-9192-418309f2d73b: {kubelet 3570k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:46:08.419: INFO: At 2021-01-16 19:36:18 +0000 UTC - event for image-pull-teste3b5bd26-5abe-457f-9192-418309f2d73b: {kubelet 3570k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 16 19:46:08.419: INFO: At 2021-01-16 19:36:18 +0000 UTC - event for image-pull-teste3b5bd26-5abe-457f-9192-418309f2d73b: {kubelet 3570k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 16 19:46:08.419: INFO: At 2021-01-16 19:36:37 +0000 UTC - event for image-pull-teste3b5bd26-5abe-457f-9192-418309f2d73b: {kubelet 3570k8s000} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:46:08.419: INFO: At 2021-01-16 19:41:10 +0000 UTC - event for image-pull-testdeba7134-b417-44d9-ae6a-43160f40b6a4: {kubelet 3570k8s001} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:46:08.419: INFO: At 2021-01-16 19:41:11 +0000 UTC - event for image-pull-testdeba7134-b417-44d9-ae6a-43160f40b6a4: {kubelet 3570k8s001} Failed: Error: ImagePullBackOff Jan 16 19:46:08.419: INFO: At 2021-01-16 19:41:11 +0000 UTC - event for image-pull-testdeba7134-b417-44d9-ae6a-43160f40b6a4: {kubelet 3570k8s001} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 16 19:46:08.474: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 19:46:08.474: INFO: Jan 16 19:46:08.582: INFO: Logging node info for node 3570k8s000 Jan 16 19:46:08.636: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 17199 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:44:07 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:44:07 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:44:07 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:44:07 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:46:08.637: INFO: Logging kubelet events for node 3570k8s000 Jan 16 19:46:08.692: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 19:46:08.765: INFO: dns-test-1c753686-7221-4361-a1d6-b87fe654724a started at 2021-01-16 19:33:34 +0000 UTC (0+3 container statuses recorded) Jan 16 19:46:08.765: INFO: Container jessie-querier ready: true, restart count 0 Jan 16 19:46:08.765: INFO: Container querier ready: false, restart count 0 Jan 16 19:46:08.765: INFO: Container webserver ready: false, restart count 0 Jan 16 19:46:08.765: INFO: pod-projected-secrets-4863f3f4-7f13-4082-aed8-c3b8f3c96200 started at 2021-01-16 19:44:51 +0000 UTC (0+3 container statuses recorded) Jan 16 19:46:08.765: INFO: Container creates-volume-test ready: false, restart count 0 Jan 16 19:46:08.765: INFO: Container dels-volume-test ready: false, restart count 0 Jan 16 19:46:08.765: INFO: Container upds-volume-test ready: false, restart count 0 W0116 19:46:08.876454 87662 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:46:09.132: INFO: Latency metrics for node 3570k8s000 Jan 16 19:46:09.132: INFO: Logging node info for node 3570k8s001 Jan 16 19:46:09.187: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 16609 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:41:15 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:41:15 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:41:15 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:41:15 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:46:09.188: INFO: Logging kubelet events for node 3570k8s001 Jan 16 19:46:09.243: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 19:46:09.302: INFO: downwardapi-volume-015b895e-145e-4e93-b8c0-b66cadf18c56 started at 2021-01-16 19:43:36 +0000 UTC (0+1 container statuses recorded) Jan 16 19:46:09.302: INFO: Container client-container ready: false, restart count 0 Jan 16 19:46:09.302: INFO: pod-projected-configmaps-cb805205-6f93-4095-8321-92cb829cfb83 started at 2021-01-16 19:41:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:46:09.302: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:46:09.302: INFO: e2e-dns-utils started at 2021-01-16 19:45:40 +0000 UTC (0+1 container statuses recorded) Jan 16 19:46:09.302: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:46:09.302: INFO: dns-test-22afc0c3-9e70-4bb7-bad9-ee6e146dbcab started at 2021-01-16 19:45:44 +0000 UTC (0+3 container statuses recorded) Jan 16 19:46:09.302: INFO: Container jessie-querier ready: true, restart count 0 Jan 16 19:46:09.302: INFO: Container querier ready: false, restart count 0 Jan 16 19:46:09.302: INFO: Container webserver ready: false, restart count 0 Jan 16 19:46:09.302: INFO: sample-webhook-deployment-65bfd79dc5-lpnlc started at 2021-01-16 19:41:58 +0000 UTC (0+1 container statuses recorded) Jan 16 19:46:09.302: INFO: Container sample-webhook ready: false, restart count 0 W0116 19:46:09.361538 87662 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:46:09.555: INFO: Latency metrics for node 3570k8s001 Jan 16 19:46:09.555: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 19:46:09.612: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 17158 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:43:47 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:43:47 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:43:47 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:43:47 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:46:09.613: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 19:46:09.668: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 19:46:09.732: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 19:46:09.732: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 16 19:46:09.732: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 19:46:09.732: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 19:46:09.732: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 19:46:09.732: INFO: Container secrets-store ready: true, restart count 0 Jan 16 19:46:09.732: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:46:09.732: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 16 19:46:09.732: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 19:46:09.732: INFO: Container azure-cnms ready: true, restart count 0 Jan 16 19:46:09.732: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 19:46:09.732: INFO: Container kube-apiserver ready: true, restart count 0 Jan 16 19:46:09.732: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:46:09.732: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 19:46:09.732: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 19:46:09.732: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 19:46:09.732: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:46:09.732: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 19:46:09.732: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:46:09.732: INFO: Container kube-proxy ready: true, restart count 0 Jan 16 19:46:09.732: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:46:09.732: INFO: Container autoscaler ready: true, restart count 0 Jan 16 19:46:09.732: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:46:09.732: INFO: Container coredns ready: true, restart count 0 Jan 16 19:46:09.732: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:46:09.732: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 16 19:46:09.732: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 19:46:09.732: INFO: Container metrics-server ready: true, restart count 1 W0116 19:46:09.791915 87662 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:46:10.078: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 19:46:10.078: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-runtime-5030" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sDocker\sContainers\sshould\sbe\sable\sto\soverride\sthe\simage\'s\sdefault\sarguments\s\(docker\scmd\)\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 16 19:29:27.457: Unexpected error: <*errors.errorString | 0xc00452f1e0>: { s: "expected pod \"client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b\" success: Gave up after waiting 5m0s for pod \"client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b\" to be \"Succeeded or Failed\"", } expected pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b" success: Gave up after waiting 5m0s for pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b" to be "Succeeded or Failed" occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:742from junit_04.xml
[BeforeEach] [k8s.io] Docker Containers /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 19:24:20.246: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename containers �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in containers-2890 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should be able to override the image's default arguments (docker cmd) [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: Creating a pod to test override arguments Jan 16 19:24:20.787: INFO: Waiting up to 5m0s for pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b" in namespace "containers-2890" to be "Succeeded or Failed" Jan 16 19:24:20.845: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 57.574127ms Jan 16 19:24:22.898: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2.110890633s Jan 16 19:24:24.953: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4.165973469s Jan 16 19:24:27.006: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 6.218600121s Jan 16 19:24:29.061: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 8.274221987s Jan 16 19:24:31.114: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 10.327309613s Jan 16 19:24:33.167: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 12.380396833s Jan 16 19:24:35.220: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 14.432788473s Jan 16 19:24:37.273: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 16.485689364s Jan 16 19:24:39.325: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 18.53764077s Jan 16 19:24:41.377: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 20.590292469s Jan 16 19:24:43.430: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 22.64346972s Jan 16 19:24:45.485: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 24.6982516s Jan 16 19:24:47.539: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 26.751745263s Jan 16 19:24:49.592: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 28.805062006s Jan 16 19:24:51.663: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 30.875925378s Jan 16 19:24:53.716: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 32.92898078s Jan 16 19:24:55.769: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 34.982225977s Jan 16 19:24:57.822: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 37.03486466s Jan 16 19:24:59.875: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 39.087609632s Jan 16 19:25:01.928: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 41.141001871s Jan 16 19:25:03.982: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 43.194868273s Jan 16 19:25:06.035: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 45.247606806s Jan 16 19:25:08.140: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 47.353156604s Jan 16 19:25:10.193: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 49.406095644s Jan 16 19:25:12.248: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 51.461063897s Jan 16 19:25:14.302: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 53.514851522s Jan 16 19:25:16.354: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 55.567516095s Jan 16 19:25:18.409: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 57.62200403s Jan 16 19:25:20.462: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 59.674978533s Jan 16 19:25:22.517: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.729551184s Jan 16 19:25:24.569: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.782100208s Jan 16 19:25:26.625: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.838321036s Jan 16 19:25:28.678: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.891513811s Jan 16 19:25:30.732: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.944730896s Jan 16 19:25:32.784: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.997370886s Jan 16 19:25:34.838: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.051167136s Jan 16 19:25:36.891: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.104448762s Jan 16 19:25:38.944: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.157016697s Jan 16 19:25:40.997: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.210138101s Jan 16 19:25:43.050: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.263164267s Jan 16 19:25:45.105: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.318026276s Jan 16 19:25:47.158: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.370586281s Jan 16 19:25:49.210: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.423050766s Jan 16 19:25:51.287: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.500463065s Jan 16 19:25:53.341: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.553605655s Jan 16 19:25:55.393: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.606275351s Jan 16 19:25:57.446: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.659241613s Jan 16 19:25:59.499: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.711579152s Jan 16 19:26:01.551: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.764220557s Jan 16 19:26:03.607: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.820533347s Jan 16 19:26:05.660: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.872542242s Jan 16 19:26:07.713: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.925948351s Jan 16 19:26:09.767: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.97953935s Jan 16 19:26:11.819: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m51.032472051s Jan 16 19:26:13.872: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m53.084986924s Jan 16 19:26:15.929: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m55.141684692s Jan 16 19:26:17.982: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m57.194979139s Jan 16 19:26:20.036: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m59.248717644s Jan 16 19:26:22.089: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m1.301669452s Jan 16 19:26:24.142: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m3.354721156s Jan 16 19:26:26.195: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m5.407656947s Jan 16 19:26:28.247: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m7.460345676s Jan 16 19:26:30.300: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m9.513022555s Jan 16 19:26:32.356: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m11.568824684s Jan 16 19:26:34.412: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m13.625297185s Jan 16 19:26:36.465: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m15.67845667s Jan 16 19:26:38.518: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m17.73152566s Jan 16 19:26:40.572: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m19.784907769s Jan 16 19:26:42.625: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m21.837663332s Jan 16 19:26:44.677: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m23.890433483s Jan 16 19:26:46.731: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m25.943606688s Jan 16 19:26:48.785: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m27.997602002s Jan 16 19:26:50.838: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.050864681s Jan 16 19:26:52.892: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.104628214s Jan 16 19:26:54.945: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.157748156s Jan 16 19:26:56.998: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.211374532s Jan 16 19:26:59.050: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.263385198s Jan 16 19:27:01.103: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.316364655s Jan 16 19:27:03.156: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.369252248s Jan 16 19:27:05.212: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.42500199s Jan 16 19:27:07.265: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.477887911s Jan 16 19:27:09.317: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.530425418s Jan 16 19:27:11.370: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.583372161s Jan 16 19:27:13.424: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.63655902s Jan 16 19:27:15.492: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.705266508s Jan 16 19:27:17.545: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.758520272s Jan 16 19:27:19.599: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.811620316s Jan 16 19:27:21.651: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.864388468s Jan 16 19:27:23.705: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.91815608s Jan 16 19:27:25.758: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.971423794s Jan 16 19:27:27.811: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m7.024366324s Jan 16 19:27:29.864: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m9.076540628s Jan 16 19:27:31.919: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m11.13248066s Jan 16 19:27:33.972: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m13.185405004s Jan 16 19:27:36.035: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m15.248322143s Jan 16 19:27:38.102: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m17.314665362s Jan 16 19:27:40.154: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m19.367525181s Jan 16 19:27:42.215: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m21.428122463s Jan 16 19:27:44.268: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m23.481226503s Jan 16 19:27:46.322: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m25.535474144s Jan 16 19:27:48.378: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m27.590966974s Jan 16 19:27:50.436: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m29.648551334s Jan 16 19:27:52.595: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m31.808192052s Jan 16 19:27:54.666: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m33.878856072s Jan 16 19:27:56.720: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m35.933530689s Jan 16 19:27:58.780: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m37.992981892s Jan 16 19:28:00.833: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.046255292s Jan 16 19:28:02.886: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.099386859s Jan 16 19:28:04.939: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.152135765s Jan 16 19:28:06.992: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.204932775s Jan 16 19:28:09.045: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.258123772s Jan 16 19:28:11.098: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.311368594s Jan 16 19:28:13.150: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.363299437s Jan 16 19:28:15.204: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.416610368s Jan 16 19:28:17.257: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.469571464s Jan 16 19:28:19.310: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.522783991s Jan 16 19:28:21.363: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.575795919s Jan 16 19:28:23.416: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.628576298s Jan 16 19:28:25.468: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.68104386s Jan 16 19:28:27.521: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.733656654s Jan 16 19:28:29.574: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.786756457s Jan 16 19:28:31.627: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.840443507s Jan 16 19:28:33.680: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.893256613s Jan 16 19:28:35.735: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.947647754s Jan 16 19:28:37.788: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m17.000906991s Jan 16 19:28:39.877: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m19.08996659s Jan 16 19:28:41.929: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m21.142369305s Jan 16 19:28:43.985: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m23.197712052s Jan 16 19:28:46.038: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m25.250617615s Jan 16 19:28:48.093: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m27.30635833s Jan 16 19:28:50.146: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m29.359303475s Jan 16 19:28:52.201: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m31.414051004s Jan 16 19:28:54.254: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m33.466655206s Jan 16 19:28:56.308: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m35.520618794s Jan 16 19:28:58.587: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m37.799839391s Jan 16 19:29:00.643: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m39.855859422s Jan 16 19:29:02.699: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m41.911580073s Jan 16 19:29:04.754: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m43.966884966s Jan 16 19:29:06.810: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.022694502s Jan 16 19:29:08.866: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.078626564s Jan 16 19:29:10.922: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.134570672s Jan 16 19:29:12.979: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.19177434s Jan 16 19:29:15.035: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.247738663s Jan 16 19:29:17.090: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.302958127s Jan 16 19:29:19.146: INFO: Pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.359350063s Jan 16 19:29:21.276: INFO: Failed to get logs from node "3570k8s000" pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b" container "agnhost-container": the server rejected our request for an unknown reason (get pods client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b) �[1mSTEP�[0m: delete the pod Jan 16 19:29:21.347: INFO: Waiting for pod client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b to disappear Jan 16 19:29:21.402: INFO: Pod client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b still exists Jan 16 19:29:23.402: INFO: Waiting for pod client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b to disappear Jan 16 19:29:23.459: INFO: Pod client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b still exists Jan 16 19:29:25.402: INFO: Waiting for pod client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b to disappear Jan 16 19:29:25.458: INFO: Pod client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b still exists Jan 16 19:29:27.402: INFO: Waiting for pod client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b to disappear Jan 16 19:29:27.457: INFO: Pod client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b no longer exists Jan 16 19:29:27.457: FAIL: Unexpected error: <*errors.errorString | 0xc00452f1e0>: { s: "expected pod \"client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b\" success: Gave up after waiting 5m0s for pod \"client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b\" to be \"Succeeded or Failed\"", } expected pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b" success: Gave up after waiting 5m0s for pod "client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc00095c000, 0x4e1824f, 0x12, 0xc003a20c00, 0x0, 0xc007399350, 0x1, 0x1, 0x4fef7e8) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:742 +0x1e5 k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:568 k8s.io/kubernetes/test/e2e/common.glob..func4.2() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/docker_containers.go:58 +0x128 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003ac1b00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc003ac1b00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc003ac1b00, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Docker Containers /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "containers-2890". �[1mSTEP�[0m: Found 5 events. Jan 16 19:29:27.513: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b: { } Scheduled: Successfully assigned containers-2890/client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b to 3570k8s000 Jan 16 19:29:27.513: INFO: At 2021-01-16 19:24:24 +0000 UTC - event for client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b: {kubelet 3570k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:29:27.513: INFO: At 2021-01-16 19:24:25 +0000 UTC - event for client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b: {kubelet 3570k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 16 19:29:27.513: INFO: At 2021-01-16 19:24:26 +0000 UTC - event for client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b: {kubelet 3570k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 16 19:29:27.513: INFO: At 2021-01-16 19:24:31 +0000 UTC - event for client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b: {kubelet 3570k8s000} Failed: Error: ImagePullBackOff Jan 16 19:29:27.568: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 19:29:27.568: INFO: Jan 16 19:29:27.678: INFO: Logging node info for node 3570k8s000 Jan 16 19:29:27.734: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 10645 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:26:38 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:26:38 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:26:38 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:26:38 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:29:27.735: INFO: Logging kubelet events for node 3570k8s000 Jan 16 19:29:27.792: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 19:29:27.850: INFO: pod-configmaps-75f94476-2ed8-4a99-8277-45d2f354e0d3 started at 2021-01-16 19:25:06 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:27.850: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:29:27.850: INFO: pod-secrets-ca5395dd-86ad-4f24-8b59-27a9bb54c78b started at 2021-01-16 19:24:39 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:27.850: INFO: Container secret-test ready: false, restart count 0 Jan 16 19:29:27.850: INFO: pod-adoption started at 2021-01-16 19:29:00 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:27.850: INFO: Container pod-adoption ready: true, restart count 0 Jan 16 19:29:27.850: INFO: e2e-test-httpd-pod started at 2021-01-16 19:29:14 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:27.850: INFO: Container e2e-test-httpd-pod ready: false, restart count 0 W0116 19:29:27.961971 87655 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:29:28.158: INFO: Latency metrics for node 3570k8s000 Jan 16 19:29:28.158: INFO: Logging node info for node 3570k8s001 Jan 16 19:29:28.213: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 11692 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:27:49 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:27:49 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:27:49 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:27:49 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:29:28.213: INFO: Logging kubelet events for node 3570k8s001 Jan 16 19:29:28.269: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 19:29:28.327: INFO: test-dns-nameservers started at 2021-01-16 19:28:21 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:28.327: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:29:28.327: INFO: sample-webhook-deployment-65bfd79dc5-9p7dl started at 2021-01-16 19:26:04 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:28.327: INFO: Container sample-webhook ready: false, restart count 0 Jan 16 19:29:28.327: INFO: proxy-service-j5n6x-nr6r9 started at 2021-01-16 19:29:13 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:28.327: INFO: Container proxy-service-j5n6x ready: false, restart count 0 Jan 16 19:29:28.327: INFO: labelsupdateb051b724-c566-404f-a8d2-c4c63e67b7c5 started at 2021-01-16 19:28:08 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:28.327: INFO: Container client-container ready: false, restart count 0 W0116 19:29:28.388551 87655 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:29:28.546: INFO: Latency metrics for node 3570k8s001 Jan 16 19:29:28.546: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 19:29:28.601: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 12834 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:28:39 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:28:39 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:28:39 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:28:39 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:29:28.602: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 19:29:28.658: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 19:29:28.718: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:28.718: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 16 19:29:28.718: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 19:29:28.718: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 19:29:28.718: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 19:29:28.718: INFO: Container secrets-store ready: true, restart count 0 Jan 16 19:29:28.718: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:28.718: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 16 19:29:28.718: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:28.718: INFO: Container azure-cnms ready: true, restart count 0 Jan 16 19:29:28.718: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:28.718: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 19:29:28.718: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:28.718: INFO: Container kube-proxy ready: true, restart count 0 Jan 16 19:29:28.718: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:28.718: INFO: Container kube-apiserver ready: true, restart count 0 Jan 16 19:29:28.718: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:28.718: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 19:29:28.718: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:28.718: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 19:29:28.718: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:28.718: INFO: Container metrics-server ready: true, restart count 1 Jan 16 19:29:28.718: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:28.718: INFO: Container autoscaler ready: true, restart count 0 Jan 16 19:29:28.718: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:28.718: INFO: Container coredns ready: true, restart count 0 Jan 16 19:29:28.719: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:29:28.719: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 W0116 19:29:28.778044 87655 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:29:29.056: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 19:29:29.056: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "containers-2890" for this suite.
Find client-containers-483e3008-c56e-4ea1-a084-133a3509fb7b mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sDocker\sContainers\sshould\sbe\sable\sto\soverride\sthe\simage\'s\sdefault\scommand\s\(docker\sentrypoint\)\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 16 18:50:54.259: Unexpected error: <*errors.errorString | 0xc003384e80>: { s: "expected pod \"client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0\" success: Gave up after waiting 5m0s for pod \"client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0\" to be \"Succeeded or Failed\"", } expected pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0" success: Gave up after waiting 5m0s for pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0" to be "Succeeded or Failed" occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:742from junit_03.xml
{"msg":"PASSED [sig-api-machinery] Garbage collector should delete pods created by rc when not orphaning [Conformance]","total":-1,"completed":1,"skipped":0,"failed":0} [BeforeEach] [k8s.io] Docker Containers /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 18:45:48.535: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename containers �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in containers-3083 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should be able to override the image's default command (docker entrypoint) [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: Creating a pod to test override command Jan 16 18:45:49.164: INFO: Waiting up to 5m0s for pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0" in namespace "containers-3083" to be "Succeeded or Failed" Jan 16 18:45:49.244: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 80.098634ms Jan 16 18:45:51.300: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2.135797367s Jan 16 18:45:53.355: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4.191463118s Jan 16 18:45:55.412: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 6.248429468s Jan 16 18:45:57.471: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 8.306748244s Jan 16 18:45:59.526: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 10.362477422s Jan 16 18:46:01.583: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 12.418968222s Jan 16 18:46:03.648: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 14.484208484s Jan 16 18:46:05.717: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 16.553057735s Jan 16 18:46:07.772: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 18.608412632s Jan 16 18:46:09.828: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 20.664291372s Jan 16 18:46:11.884: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 22.719777947s Jan 16 18:46:13.940: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 24.776174839s Jan 16 18:46:15.996: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 26.831994107s Jan 16 18:46:18.053: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 28.888673949s Jan 16 18:46:20.108: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 30.944425246s Jan 16 18:46:22.165: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 33.000836248s Jan 16 18:46:24.221: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 35.057401031s Jan 16 18:46:26.280: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 37.116475579s Jan 16 18:46:28.337: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 39.172736636s Jan 16 18:46:30.393: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 41.229408557s Jan 16 18:46:32.450: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 43.285498408s Jan 16 18:46:34.507: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 45.342832144s Jan 16 18:46:36.563: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 47.399090333s Jan 16 18:46:38.620: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 49.455700458s Jan 16 18:46:40.676: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 51.512338515s Jan 16 18:46:42.733: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 53.568577649s Jan 16 18:46:44.789: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 55.625181215s Jan 16 18:46:46.846: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 57.681586931s Jan 16 18:46:48.904: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 59.740001028s Jan 16 18:46:50.960: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.795925045s Jan 16 18:46:53.015: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.85144276s Jan 16 18:46:55.072: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.907621452s Jan 16 18:46:57.127: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.963394958s Jan 16 18:46:59.184: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.020060529s Jan 16 18:47:01.240: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.076295298s Jan 16 18:47:03.298: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.134266784s Jan 16 18:47:05.354: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.18997537s Jan 16 18:47:07.439: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.274718626s Jan 16 18:47:09.495: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.33147828s Jan 16 18:47:11.553: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.388616565s Jan 16 18:47:13.608: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.443899905s Jan 16 18:47:15.664: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.500396841s Jan 16 18:47:17.721: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.557271163s Jan 16 18:47:19.777: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.61303386s Jan 16 18:47:21.836: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.671824384s Jan 16 18:47:23.903: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.738635675s Jan 16 18:47:26.061: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.897113591s Jan 16 18:47:28.117: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.953353721s Jan 16 18:47:30.173: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m41.009334694s Jan 16 18:47:32.256: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m43.092251246s Jan 16 18:47:34.314: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m45.150092234s Jan 16 18:47:36.369: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m47.205073777s Jan 16 18:47:38.426: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m49.262445411s Jan 16 18:47:40.482: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m51.317874267s Jan 16 18:47:42.538: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m53.37396467s Jan 16 18:47:44.594: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m55.430059034s Jan 16 18:47:46.652: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m57.488285223s Jan 16 18:47:48.731: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m59.567396772s Jan 16 18:47:50.789: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m1.625444278s Jan 16 18:47:52.849: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m3.684923957s Jan 16 18:47:54.905: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m5.740660244s Jan 16 18:47:56.960: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m7.796375963s Jan 16 18:47:59.017: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m9.853050727s Jan 16 18:48:01.073: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m11.908706856s Jan 16 18:48:03.133: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m13.968521881s Jan 16 18:48:05.189: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.024586162s Jan 16 18:48:07.244: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.080422345s Jan 16 18:48:09.301: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.136915736s Jan 16 18:48:11.358: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.193521586s Jan 16 18:48:13.414: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.250060808s Jan 16 18:48:15.471: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.306711515s Jan 16 18:48:17.527: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.362912989s Jan 16 18:48:19.602: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.437768532s Jan 16 18:48:21.658: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.494334911s Jan 16 18:48:23.717: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.553010191s Jan 16 18:48:25.772: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.608123091s Jan 16 18:48:27.828: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.663669654s Jan 16 18:48:29.884: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.720314112s Jan 16 18:48:31.954: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.789566856s Jan 16 18:48:34.197: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m45.033442507s Jan 16 18:48:36.253: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m47.089344109s Jan 16 18:48:38.309: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m49.145177084s Jan 16 18:48:40.365: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m51.201212683s Jan 16 18:48:42.421: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m53.257172897s Jan 16 18:48:44.477: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m55.312924372s Jan 16 18:48:46.533: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m57.368578946s Jan 16 18:48:48.591: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m59.426571578s Jan 16 18:48:50.646: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m1.48178606s Jan 16 18:48:52.702: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m3.538385229s Jan 16 18:48:54.758: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m5.594200758s Jan 16 18:48:56.814: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m7.65038645s Jan 16 18:48:58.870: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m9.705920696s Jan 16 18:49:00.926: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m11.761950144s Jan 16 18:49:02.988: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m13.823850342s Jan 16 18:49:05.045: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m15.88082274s Jan 16 18:49:07.101: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m17.936709305s Jan 16 18:49:09.158: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m19.994071811s Jan 16 18:49:11.216: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.051865057s Jan 16 18:49:13.280: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.115503795s Jan 16 18:49:15.347: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.183299951s Jan 16 18:49:17.403: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.239235207s Jan 16 18:49:19.460: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.295622754s Jan 16 18:49:21.516: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.351751915s Jan 16 18:49:23.571: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.407457958s Jan 16 18:49:25.628: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.463870611s Jan 16 18:49:27.684: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.519787969s Jan 16 18:49:29.740: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.575647369s Jan 16 18:49:31.795: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.630732492s Jan 16 18:49:33.852: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.6880123s Jan 16 18:49:35.907: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.743445424s Jan 16 18:49:37.964: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.799526929s Jan 16 18:49:40.019: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.855090343s Jan 16 18:49:42.075: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.911151892s Jan 16 18:49:44.132: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.967973803s Jan 16 18:49:46.190: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m57.025499098s Jan 16 18:49:48.245: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m59.081166732s Jan 16 18:49:50.305: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m1.141098297s Jan 16 18:49:52.361: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m3.197163291s Jan 16 18:49:54.434: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m5.269537174s Jan 16 18:49:56.493: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m7.329302367s Jan 16 18:49:58.550: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m9.385572949s Jan 16 18:50:00.606: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m11.441634799s Jan 16 18:50:02.682: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m13.51828445s Jan 16 18:50:04.738: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m15.573854404s Jan 16 18:50:06.794: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m17.630176558s Jan 16 18:50:08.853: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m19.688916853s Jan 16 18:50:10.909: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m21.745075475s Jan 16 18:50:12.965: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m23.801115858s Jan 16 18:50:15.021: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m25.856961438s Jan 16 18:50:17.083: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m27.919317092s Jan 16 18:50:19.139: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m29.974779528s Jan 16 18:50:21.225: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.060897614s Jan 16 18:50:23.281: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.116791117s Jan 16 18:50:25.338: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.173501761s Jan 16 18:50:27.397: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.23272071s Jan 16 18:50:29.453: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.288904094s Jan 16 18:50:31.509: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.345098185s Jan 16 18:50:33.566: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.401672987s Jan 16 18:50:35.621: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.456974438s Jan 16 18:50:37.678: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.514090998s Jan 16 18:50:39.745: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.580546105s Jan 16 18:50:41.800: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.636230522s Jan 16 18:50:43.859: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.695444038s Jan 16 18:50:45.917: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.752551506s Jan 16 18:50:47.973: INFO: Pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.808553387s Jan 16 18:50:50.088: INFO: Failed to get logs from node "3570k8s001" pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0" container "agnhost-container": the server rejected our request for an unknown reason (get pods client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0) �[1mSTEP�[0m: delete the pod Jan 16 18:50:50.146: INFO: Waiting for pod client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0 to disappear Jan 16 18:50:50.201: INFO: Pod client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0 still exists Jan 16 18:50:52.202: INFO: Waiting for pod client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0 to disappear Jan 16 18:50:52.258: INFO: Pod client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0 still exists Jan 16 18:50:54.202: INFO: Waiting for pod client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0 to disappear Jan 16 18:50:54.258: INFO: Pod client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0 no longer exists Jan 16 18:50:54.259: FAIL: Unexpected error: <*errors.errorString | 0xc003384e80>: { s: "expected pod \"client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0\" success: Gave up after waiting 5m0s for pod \"client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0\" to be \"Succeeded or Failed\"", } expected pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0" success: Gave up after waiting 5m0s for pod "client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc000271ce0, 0x4e0da14, 0x10, 0xc000501000, 0x0, 0xc00150f350, 0x1, 0x1, 0x4fef7e8) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:742 +0x1e5 k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:568 k8s.io/kubernetes/test/e2e/common.glob..func4.3() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/docker_containers.go:74 +0x16f k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000382f00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc000382f00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc000382f00, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Docker Containers /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "containers-3083". �[1mSTEP�[0m: Found 5 events. Jan 16 18:50:54.317: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0: { } Scheduled: Successfully assigned containers-3083/client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0 to 3570k8s001 Jan 16 18:50:54.317: INFO: At 2021-01-16 18:45:58 +0000 UTC - event for client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0: {kubelet 3570k8s001} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 18:50:54.317: INFO: At 2021-01-16 18:46:00 +0000 UTC - event for client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0: {kubelet 3570k8s001} Failed: Error: ErrImagePull Jan 16 18:50:54.317: INFO: At 2021-01-16 18:46:01 +0000 UTC - event for client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0: {kubelet 3570k8s001} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 16 18:50:54.317: INFO: At 2021-01-16 18:46:27 +0000 UTC - event for client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0: {kubelet 3570k8s001} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 18:50:54.384: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 18:50:54.384: INFO: Jan 16 18:50:54.492: INFO: Logging node info for node 3570k8s000 Jan 16 18:50:54.550: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 1317 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 18:46:49 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 18:46:49 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 18:46:49 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 18:46:49 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 18:50:54.551: INFO: Logging kubelet events for node 3570k8s000 Jan 16 18:50:54.622: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 18:50:54.710: INFO: pod-handle-http-request started at 2021-01-16 18:48:34 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:54.710: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 18:50:54.710: INFO: pod-secrets-7557816f-f847-4be3-9b4d-be85f2d1dcf9 started at 2021-01-16 18:50:38 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:54.710: INFO: Container secret-volume-test ready: false, restart count 0 Jan 16 18:50:54.710: INFO: pod-projected-secrets-6318939c-ecd2-4f73-95a5-1956a975beab started at 2021-01-16 18:46:37 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:54.710: INFO: Container projected-secret-volume-test ready: false, restart count 0 Jan 16 18:50:54.710: INFO: pod-projected-configmaps-5c3eb221-e4e3-408a-b826-6a70344b66fa started at 2021-01-16 18:50:42 +0000 UTC (0+3 container statuses recorded) Jan 16 18:50:54.710: INFO: Container createcm-volume-test ready: false, restart count 0 Jan 16 18:50:54.710: INFO: Container delcm-volume-test ready: false, restart count 0 Jan 16 18:50:54.710: INFO: Container updcm-volume-test ready: false, restart count 0 W0116 18:50:54.826042 87662 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 18:50:55.046: INFO: Latency metrics for node 3570k8s000 Jan 16 18:50:55.046: INFO: Logging node info for node 3570k8s001 Jan 16 18:50:55.101: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 1579 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 18:47:40 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 18:47:40 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 18:47:40 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 18:47:40 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 18:50:55.102: INFO: Logging kubelet events for node 3570k8s001 Jan 16 18:50:55.164: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 18:50:55.223: INFO: test-recreate-deployment-b65d5894b-2rsxc started at 2021-01-16 18:47:13 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:55.223: INFO: Container agnhost ready: false, restart count 0 Jan 16 18:50:55.223: INFO: agnhost-primary-d2knm started at 2021-01-16 18:47:26 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:55.223: INFO: Container agnhost-primary ready: false, restart count 0 Jan 16 18:50:55.223: INFO: downwardapi-volume-baa359f0-59af-4112-902b-e7651b4e8437 started at 2021-01-16 18:50:49 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:55.223: INFO: Container client-container ready: false, restart count 0 W0116 18:50:55.285284 87662 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 18:50:55.436: INFO: Latency metrics for node 3570k8s001 Jan 16 18:50:55.436: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 18:50:55.492: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 1778 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 18:48:20 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 18:48:20 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 18:48:20 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 18:48:20 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 18:50:55.493: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 18:50:55.551: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 18:50:55.613: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:55.613: INFO: Container autoscaler ready: true, restart count 0 Jan 16 18:50:55.613: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:55.613: INFO: Container coredns ready: true, restart count 0 Jan 16 18:50:55.613: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:55.613: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 16 18:50:55.613: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:55.613: INFO: Container metrics-server ready: true, restart count 1 Jan 16 18:50:55.613: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:55.613: INFO: Container azure-cnms ready: true, restart count 0 Jan 16 18:50:55.613: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 18:50:55.613: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 18:50:55.613: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 18:50:55.613: INFO: Container secrets-store ready: true, restart count 0 Jan 16 18:50:55.613: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:55.613: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 16 18:50:55.613: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:55.613: INFO: Container kube-apiserver ready: true, restart count 0 Jan 16 18:50:55.613: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:55.613: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 16 18:50:55.613: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:55.613: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 18:50:55.613: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:55.613: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 18:50:55.613: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:55.613: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 18:50:55.613: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:55.613: INFO: Container kube-proxy ready: true, restart count 0 W0116 18:50:55.680276 87662 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 18:50:55.945: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 18:50:55.945: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "containers-3083" for this suite.
Find client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sDocker\sContainers\sshould\sbe\sable\sto\soverride\sthe\simage\'s\sdefault\scommand\sand\sarguments\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 16 19:53:45.162: Unexpected error: <*errors.errorString | 0xc00381f1b0>: { s: "expected pod \"client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1\" success: Gave up after waiting 5m0s for pod \"client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1\" to be \"Succeeded or Failed\"", } expected pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1" success: Gave up after waiting 5m0s for pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1" to be "Succeeded or Failed" occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:742from junit_05.xml
[BeforeEach] [k8s.io] Docker Containers /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 19:48:36.530: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename containers �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in containers-953 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should be able to override the image's default command and arguments [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: Creating a pod to test override all Jan 16 19:48:37.055: INFO: Waiting up to 5m0s for pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1" in namespace "containers-953" to be "Succeeded or Failed" Jan 16 19:48:37.107: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 51.504397ms Jan 16 19:48:39.169: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2.113527089s Jan 16 19:48:41.222: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4.166834206s Jan 16 19:48:43.274: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 6.218541579s Jan 16 19:48:45.330: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 8.274156171s Jan 16 19:48:47.382: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 10.326133588s Jan 16 19:48:49.433: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 12.378093551s Jan 16 19:48:51.486: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 14.430131697s Jan 16 19:48:53.540: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 16.484820604s Jan 16 19:48:55.592: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 18.536884169s Jan 16 19:48:57.646: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 20.591047347s Jan 16 19:48:59.710: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 22.65483636s Jan 16 19:49:01.762: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 24.706256571s Jan 16 19:49:03.813: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 26.757119956s Jan 16 19:49:05.864: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 28.808980653s Jan 16 19:49:07.916: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 30.860796718s Jan 16 19:49:09.968: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 32.912597628s Jan 16 19:49:12.020: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 34.96412974s Jan 16 19:49:14.071: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 37.015786946s Jan 16 19:49:16.123: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 39.067964281s Jan 16 19:49:18.176: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 41.120700499s Jan 16 19:49:20.228: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 43.172723474s Jan 16 19:49:22.283: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 45.227529092s Jan 16 19:49:24.335: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 47.279692923s Jan 16 19:49:26.387: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 49.331521412s Jan 16 19:49:28.438: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 51.382825893s Jan 16 19:49:30.490: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 53.435054294s Jan 16 19:49:32.543: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 55.487240144s Jan 16 19:49:34.595: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 57.539676054s Jan 16 19:49:36.647: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 59.591922262s Jan 16 19:49:38.703: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.64759281s Jan 16 19:49:40.755: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.699749235s Jan 16 19:49:42.808: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.752860753s Jan 16 19:49:44.860: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.804403443s Jan 16 19:49:46.912: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.85702054s Jan 16 19:49:48.964: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.90857837s Jan 16 19:49:51.016: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.960355729s Jan 16 19:49:53.069: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.01347037s Jan 16 19:49:55.121: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.065249232s Jan 16 19:49:57.173: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.117529805s Jan 16 19:49:59.225: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.169185321s Jan 16 19:50:01.277: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.222087409s Jan 16 19:50:03.330: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.274391769s Jan 16 19:50:05.382: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.326896988s Jan 16 19:50:07.434: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.378766167s Jan 16 19:50:09.490: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.434319869s Jan 16 19:50:11.542: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.486573301s Jan 16 19:50:13.594: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.538557442s Jan 16 19:50:15.647: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.591588204s Jan 16 19:50:17.699: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.643873806s Jan 16 19:50:19.751: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.695337967s Jan 16 19:50:21.806: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.750530411s Jan 16 19:50:23.857: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.801989852s Jan 16 19:50:25.910: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.854426545s Jan 16 19:50:27.962: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.906451008s Jan 16 19:50:30.014: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.958741075s Jan 16 19:50:32.067: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m55.011299119s Jan 16 19:50:34.118: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m57.062846917s Jan 16 19:50:36.171: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m59.115207343s Jan 16 19:50:38.222: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m1.166443872s Jan 16 19:50:40.338: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m3.282382143s Jan 16 19:50:42.390: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m5.334161026s Jan 16 19:50:44.441: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m7.385735659s Jan 16 19:50:46.493: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m9.437406426s Jan 16 19:50:48.547: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m11.491541509s Jan 16 19:50:50.601: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m13.545774724s Jan 16 19:50:52.656: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m15.60038852s Jan 16 19:50:54.708: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m17.652798414s Jan 16 19:50:56.762: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m19.706735315s Jan 16 19:50:58.826: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m21.770744275s Jan 16 19:51:00.878: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m23.822880235s Jan 16 19:51:02.931: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m25.875551067s Jan 16 19:51:04.983: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m27.927587759s Jan 16 19:51:07.037: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m29.981610624s Jan 16 19:51:09.092: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.03663139s Jan 16 19:51:11.146: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.090291991s Jan 16 19:51:13.198: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.142749859s Jan 16 19:51:15.253: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.197557837s Jan 16 19:51:17.305: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.249420999s Jan 16 19:51:19.356: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.300285025s Jan 16 19:51:21.408: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.352253654s Jan 16 19:51:23.460: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.404631423s Jan 16 19:51:25.512: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.456576568s Jan 16 19:51:27.564: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.508696584s Jan 16 19:51:29.617: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.561721958s Jan 16 19:51:31.673: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.61730583s Jan 16 19:51:33.725: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.669678808s Jan 16 19:51:35.777: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.721613296s Jan 16 19:51:37.829: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.773623184s Jan 16 19:51:39.885: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.829248973s Jan 16 19:51:41.936: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.880957095s Jan 16 19:51:43.988: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.932856667s Jan 16 19:51:46.040: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.984650977s Jan 16 19:51:48.092: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m11.036977676s Jan 16 19:51:50.147: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m13.091371456s Jan 16 19:51:52.198: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m15.142823035s Jan 16 19:51:54.251: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m17.195327398s Jan 16 19:51:56.303: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m19.247977952s Jan 16 19:51:58.355: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m21.300106357s Jan 16 19:52:00.407: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m23.351509885s Jan 16 19:52:02.463: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m25.407998996s Jan 16 19:52:04.515: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m27.459592192s Jan 16 19:52:06.574: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m29.518454901s Jan 16 19:52:08.625: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m31.570113983s Jan 16 19:52:10.677: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m33.621776289s Jan 16 19:52:12.729: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m35.673659469s Jan 16 19:52:14.782: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m37.726214014s Jan 16 19:52:16.836: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m39.780648538s Jan 16 19:52:18.888: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m41.832948417s Jan 16 19:52:20.941: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m43.885352427s Jan 16 19:52:22.998: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m45.942266439s Jan 16 19:52:25.050: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m47.995031996s Jan 16 19:52:27.103: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.047845249s Jan 16 19:52:29.155: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.099785549s Jan 16 19:52:31.213: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.15714104s Jan 16 19:52:33.265: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.209586914s Jan 16 19:52:35.316: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.261054313s Jan 16 19:52:37.369: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.313160913s Jan 16 19:52:39.421: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.365502751s Jan 16 19:52:41.473: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.417414789s Jan 16 19:52:43.525: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.470013972s Jan 16 19:52:45.578: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.522375164s Jan 16 19:52:47.632: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.57697484s Jan 16 19:52:49.684: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.628602612s Jan 16 19:52:51.735: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.679960106s Jan 16 19:52:53.787: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.732023733s Jan 16 19:52:55.839: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.783522345s Jan 16 19:52:57.895: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.839655265s Jan 16 19:52:59.947: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.891289972s Jan 16 19:53:01.999: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.943691084s Jan 16 19:53:04.051: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.995714315s Jan 16 19:53:06.103: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m29.047870558s Jan 16 19:53:08.155: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m31.100069901s Jan 16 19:53:10.207: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m33.151992062s Jan 16 19:53:12.259: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m35.203932645s Jan 16 19:53:14.310: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m37.255104427s Jan 16 19:53:16.363: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m39.307371273s Jan 16 19:53:18.415: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m41.359785752s Jan 16 19:53:20.467: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m43.411858984s Jan 16 19:53:22.520: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m45.464300363s Jan 16 19:53:24.572: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m47.516890486s Jan 16 19:53:26.625: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m49.569283229s Jan 16 19:53:28.678: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m51.622758666s Jan 16 19:53:30.730: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m53.675043771s Jan 16 19:53:32.783: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m55.727191467s Jan 16 19:53:34.835: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m57.779802032s Jan 16 19:53:36.888: INFO: Pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m59.832140157s Jan 16 19:53:38.999: INFO: Failed to get logs from node "3570k8s000" pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1" container "agnhost-container": the server rejected our request for an unknown reason (get pods client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1) �[1mSTEP�[0m: delete the pod Jan 16 19:53:39.058: INFO: Waiting for pod client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1 to disappear Jan 16 19:53:39.109: INFO: Pod client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1 still exists Jan 16 19:53:41.110: INFO: Waiting for pod client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1 to disappear Jan 16 19:53:41.163: INFO: Pod client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1 still exists Jan 16 19:53:43.110: INFO: Waiting for pod client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1 to disappear Jan 16 19:53:43.162: INFO: Pod client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1 still exists Jan 16 19:53:45.110: INFO: Waiting for pod client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1 to disappear Jan 16 19:53:45.162: INFO: Pod client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1 no longer exists Jan 16 19:53:45.162: FAIL: Unexpected error: <*errors.errorString | 0xc00381f1b0>: { s: "expected pod \"client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1\" success: Gave up after waiting 5m0s for pod \"client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1\" to be \"Succeeded or Failed\"", } expected pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1" success: Gave up after waiting 5m0s for pod "client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc0003ebe40, 0x4dfc0f0, 0xc, 0xc0026ec800, 0x0, 0xc00145f350, 0x1, 0x1, 0x4fef7e8) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:742 +0x1e5 k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:568 k8s.io/kubernetes/test/e2e/common.glob..func4.4() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/docker_containers.go:88 +0x191 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0033b5e00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc0033b5e00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc0033b5e00, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Docker Containers /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "containers-953". �[1mSTEP�[0m: Found 5 events. Jan 16 19:53:45.216: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1: { } Scheduled: Successfully assigned containers-953/client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1 to 3570k8s000 Jan 16 19:53:45.216: INFO: At 2021-01-16 19:48:40 +0000 UTC - event for client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1: {kubelet 3570k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:53:45.216: INFO: At 2021-01-16 19:48:41 +0000 UTC - event for client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1: {kubelet 3570k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 16 19:53:45.216: INFO: At 2021-01-16 19:48:42 +0000 UTC - event for client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1: {kubelet 3570k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 16 19:53:45.216: INFO: At 2021-01-16 19:48:47 +0000 UTC - event for client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1: {kubelet 3570k8s000} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:53:45.267: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 19:53:45.268: INFO: Jan 16 19:53:45.368: INFO: Logging node info for node 3570k8s000 Jan 16 19:53:45.419: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 19026 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:51:30 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:51:30 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:51:30 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:51:30 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:53:45.419: INFO: Logging kubelet events for node 3570k8s000 Jan 16 19:53:45.471: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 19:53:45.525: INFO: annotationupdate003357b8-a5b1-4a2a-a85f-3b6df7bd56ca started at 2021-01-16 19:50:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:53:45.525: INFO: Container client-container ready: false, restart count 0 Jan 16 19:53:45.525: INFO: downwardapi-volume-117e2e1f-15b3-4b70-81e1-042114e5fd45 started at 2021-01-16 19:53:17 +0000 UTC (0+1 container statuses recorded) Jan 16 19:53:45.525: INFO: Container client-container ready: false, restart count 0 Jan 16 19:53:45.525: INFO: server started at 2021-01-16 19:49:53 +0000 UTC (0+1 container statuses recorded) Jan 16 19:53:45.525: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:53:45.525: INFO: my-hostname-basic-2b49e6c3-536f-44ce-9019-2621abe6fd33-mf8dp started at 2021-01-16 19:52:03 +0000 UTC (0+1 container statuses recorded) Jan 16 19:53:45.525: INFO: Container my-hostname-basic-2b49e6c3-536f-44ce-9019-2621abe6fd33 ready: false, restart count 0 W0116 19:53:45.628134 87659 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:53:45.829: INFO: Latency metrics for node 3570k8s000 Jan 16 19:53:45.829: INFO: Logging node info for node 3570k8s001 Jan 16 19:53:45.881: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 18887 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:50:50 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:50:50 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:50:50 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:50:50 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:53:45.881: INFO: Logging kubelet events for node 3570k8s001 Jan 16 19:53:45.932: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 19:53:46.044: INFO: sample-webhook-deployment-65bfd79dc5-n9q94 started at 2021-01-16 19:52:15 +0000 UTC (0+1 container statuses recorded) Jan 16 19:53:46.044: INFO: Container sample-webhook ready: false, restart count 0 Jan 16 19:53:46.044: INFO: dns-test-22afc0c3-9e70-4bb7-bad9-ee6e146dbcab started at 2021-01-16 19:45:44 +0000 UTC (0+3 container statuses recorded) Jan 16 19:53:46.044: INFO: Container jessie-querier ready: false, restart count 5 Jan 16 19:53:46.044: INFO: Container querier ready: false, restart count 0 Jan 16 19:53:46.044: INFO: Container webserver ready: false, restart count 0 W0116 19:53:46.101275 87659 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:53:46.255: INFO: Latency metrics for node 3570k8s001 Jan 16 19:53:46.255: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 19:53:46.310: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 18347 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:48:49 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:48:49 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:48:49 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:48:49 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:53:46.311: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 19:53:46.362: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 19:53:46.469: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 19:53:46.469: INFO: Container kube-apiserver ready: true, restart count 0 Jan 16 19:53:46.469: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:53:46.469: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 19:53:46.469: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 19:53:46.469: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 19:53:46.469: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:53:46.469: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 19:53:46.469: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:53:46.469: INFO: Container kube-proxy ready: true, restart count 0 Jan 16 19:53:46.469: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:53:46.469: INFO: Container autoscaler ready: true, restart count 0 Jan 16 19:53:46.469: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:53:46.469: INFO: Container coredns ready: true, restart count 0 Jan 16 19:53:46.469: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:53:46.469: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 16 19:53:46.469: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 19:53:46.469: INFO: Container metrics-server ready: true, restart count 1 Jan 16 19:53:46.469: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 19:53:46.469: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 16 19:53:46.469: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 19:53:46.469: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 19:53:46.469: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 19:53:46.469: INFO: Container secrets-store ready: true, restart count 0 Jan 16 19:53:46.469: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:53:46.469: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 16 19:53:46.469: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 19:53:46.469: INFO: Container azure-cnms ready: true, restart count 0 W0116 19:53:46.528708 87659 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:53:46.776: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 19:53:46.776: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "containers-953" for this suite.
Find client-containers-b52e977e-e523-4c85-9cc7-326c5f3376a1 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sDocker\sContainers\sshould\suse\sthe\simage\sdefaults\sif\scommand\sand\sargs\sare\sblank\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 16 19:41:47.218: Expected pod "client-containers-fd725568-a432-4baf-9589-ee0d3458b152" to be running, got error: timed out waiting for the condition Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/docker_containers.go:41from junit_01.xml
[BeforeEach] [k8s.io] Docker Containers /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 19:36:46.479: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename containers �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in containers-4929 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should use the image defaults if command and args are blank [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 16 19:41:47.218: FAIL: Expected pod "client-containers-fd725568-a432-4baf-9589-ee0d3458b152" to be running, got error: timed out waiting for the condition Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func4.1() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/docker_containers.go:41 +0x225 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0038c5e00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc0038c5e00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc0038c5e00, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Docker Containers /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "containers-4929". �[1mSTEP�[0m: Found 5 events. Jan 16 19:41:47.274: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for client-containers-fd725568-a432-4baf-9589-ee0d3458b152: { } Scheduled: Successfully assigned containers-4929/client-containers-fd725568-a432-4baf-9589-ee0d3458b152 to 3570k8s001 Jan 16 19:41:47.274: INFO: At 2021-01-16 19:36:50 +0000 UTC - event for client-containers-fd725568-a432-4baf-9589-ee0d3458b152: {kubelet 3570k8s001} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:41:47.274: INFO: At 2021-01-16 19:36:51 +0000 UTC - event for client-containers-fd725568-a432-4baf-9589-ee0d3458b152: {kubelet 3570k8s001} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 16 19:41:47.274: INFO: At 2021-01-16 19:36:54 +0000 UTC - event for client-containers-fd725568-a432-4baf-9589-ee0d3458b152: {kubelet 3570k8s001} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 16 19:41:47.274: INFO: At 2021-01-16 19:37:09 +0000 UTC - event for client-containers-fd725568-a432-4baf-9589-ee0d3458b152: {kubelet 3570k8s001} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:41:47.329: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 19:41:47.329: INFO: client-containers-fd725568-a432-4baf-9589-ee0d3458b152 3570k8s001 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:36:47 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:36:47 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:36:47 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:36:47 +0000 UTC }] Jan 16 19:41:47.329: INFO: Jan 16 19:41:47.436: INFO: Logging node info for node 3570k8s000 Jan 16 19:41:47.491: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 16082 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:39:04 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:39:04 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:39:04 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:39:04 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:41:47.491: INFO: Logging kubelet events for node 3570k8s000 Jan 16 19:41:47.548: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 19:41:47.621: INFO: externalsvc-zcz55 started at 2021-01-16 19:36:39 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:47.621: INFO: Container externalsvc ready: false, restart count 0 Jan 16 19:41:47.621: INFO: pod-secrets-250c8d31-cd62-4053-aa67-e36821c1a135 started at 2021-01-16 19:40:38 +0000 UTC (0+3 container statuses recorded) Jan 16 19:41:47.621: INFO: Container creates-volume-test ready: false, restart count 0 Jan 16 19:41:47.621: INFO: Container dels-volume-test ready: false, restart count 0 Jan 16 19:41:47.621: INFO: Container upds-volume-test ready: false, restart count 0 Jan 16 19:41:47.621: INFO: dns-test-1c753686-7221-4361-a1d6-b87fe654724a started at 2021-01-16 19:33:34 +0000 UTC (0+3 container statuses recorded) Jan 16 19:41:47.621: INFO: Container jessie-querier ready: true, restart count 0 Jan 16 19:41:47.621: INFO: Container querier ready: false, restart count 0 Jan 16 19:41:47.621: INFO: Container webserver ready: false, restart count 0 W0116 19:41:47.734371 87665 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:41:48.430: INFO: Latency metrics for node 3570k8s000 Jan 16 19:41:48.430: INFO: Logging node info for node 3570k8s001 Jan 16 19:41:48.484: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 16609 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:41:15 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:41:15 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:41:15 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:41:15 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:41:48.485: INFO: Logging kubelet events for node 3570k8s001 Jan 16 19:41:48.541: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 19:41:48.601: INFO: image-pull-testdeba7134-b417-44d9-ae6a-43160f40b6a4 started at 2021-01-16 19:41:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:48.602: INFO: Container image-pull-test ready: false, restart count 0 Jan 16 19:41:48.602: INFO: logs-generator started at 2021-01-16 19:39:05 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:48.602: INFO: Container logs-generator ready: false, restart count 0 Jan 16 19:41:48.602: INFO: my-hostname-basic-1e0b9906-ff72-407b-b216-4f87a29a2db4-dnsjw started at 2021-01-16 19:40:40 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:48.602: INFO: Container my-hostname-basic-1e0b9906-ff72-407b-b216-4f87a29a2db4 ready: false, restart count 0 Jan 16 19:41:48.602: INFO: client-containers-fd725568-a432-4baf-9589-ee0d3458b152 started at 2021-01-16 19:36:47 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:48.602: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:41:48.602: INFO: downwardapi-volume-7acb737a-aaf8-4404-b1e1-09edfc9f7c5a started at 2021-01-16 19:38:13 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:48.602: INFO: Container client-container ready: false, restart count 0 Jan 16 19:41:48.602: INFO: externalsvc-2bxzp started at 2021-01-16 19:36:39 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:48.602: INFO: Container externalsvc ready: false, restart count 0 W0116 19:41:48.728294 87665 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:41:48.932: INFO: Latency metrics for node 3570k8s001 Jan 16 19:41:48.932: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 19:41:49.005: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 15947 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:38:44 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:38:44 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:38:44 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:38:44 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:41:49.006: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 19:41:49.063: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 19:41:49.126: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:49.126: INFO: Container azure-cnms ready: true, restart count 0 Jan 16 19:41:49.126: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:49.126: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 19:41:49.126: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:49.126: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 19:41:49.126: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:49.126: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 19:41:49.126: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:49.126: INFO: Container kube-proxy ready: true, restart count 0 Jan 16 19:41:49.126: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:49.126: INFO: Container kube-apiserver ready: true, restart count 0 Jan 16 19:41:49.126: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:49.126: INFO: Container coredns ready: true, restart count 0 Jan 16 19:41:49.126: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:49.126: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 16 19:41:49.127: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:49.127: INFO: Container metrics-server ready: true, restart count 1 Jan 16 19:41:49.127: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:49.127: INFO: Container autoscaler ready: true, restart count 0 Jan 16 19:41:49.127: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 19:41:49.127: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 19:41:49.127: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 19:41:49.127: INFO: Container secrets-store ready: true, restart count 0 Jan 16 19:41:49.127: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:49.127: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 16 19:41:49.127: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 19:41:49.127: INFO: Container kube-controller-manager ready: true, restart count 0 W0116 19:41:49.185712 87665 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:41:49.534: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 19:41:49.534: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "containers-4929" for this suite.
Find client-containers-fd725568-a432-4baf-9589-ee0d3458b152 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sPods\sshould\scontain\senvironment\svariables\sfor\sservices\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 16 19:58:59.463: Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103from junit_01.xml
[BeforeEach] [k8s.io] Pods /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 19:53:58.745: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename pods �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in pods-5515 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pods /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:187 [It] should contain environment variables for services [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 16 19:58:59.463: FAIL: Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc0024e4540, 0xc001076000, 0x4de694b) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func18.6() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:469 +0x24d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0038c5e00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc0038c5e00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc0038c5e00, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Pods /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "pods-5515". �[1mSTEP�[0m: Found 5 events. Jan 16 19:58:59.519: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for server-envvars-72bb33d2-2fa5-46cd-9fcb-7414e12cc81b: { } Scheduled: Successfully assigned pods-5515/server-envvars-72bb33d2-2fa5-46cd-9fcb-7414e12cc81b to 3570k8s000 Jan 16 19:58:59.519: INFO: At 2021-01-16 19:54:09 +0000 UTC - event for server-envvars-72bb33d2-2fa5-46cd-9fcb-7414e12cc81b: {kubelet 3570k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:58:59.519: INFO: At 2021-01-16 19:54:11 +0000 UTC - event for server-envvars-72bb33d2-2fa5-46cd-9fcb-7414e12cc81b: {kubelet 3570k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 16 19:58:59.519: INFO: At 2021-01-16 19:54:12 +0000 UTC - event for server-envvars-72bb33d2-2fa5-46cd-9fcb-7414e12cc81b: {kubelet 3570k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 16 19:58:59.519: INFO: At 2021-01-16 19:54:38 +0000 UTC - event for server-envvars-72bb33d2-2fa5-46cd-9fcb-7414e12cc81b: {kubelet 3570k8s000} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:58:59.573: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 19:58:59.573: INFO: server-envvars-72bb33d2-2fa5-46cd-9fcb-7414e12cc81b 3570k8s000 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:53:59 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:53:59 +0000 UTC ContainersNotReady containers with unready status: [srv]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:53:59 +0000 UTC ContainersNotReady containers with unready status: [srv]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:53:59 +0000 UTC }] Jan 16 19:58:59.574: INFO: Jan 16 19:58:59.679: INFO: Logging node info for node 3570k8s000 Jan 16 19:58:59.733: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 20460 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:56:32 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:56:32 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:56:32 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:56:32 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:58:59.734: INFO: Logging kubelet events for node 3570k8s000 Jan 16 19:58:59.787: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 19:58:59.845: INFO: pod-c009431a-4bf1-4717-b897-40a799e5d9bc started at 2021-01-16 19:54:03 +0000 UTC (0+1 container statuses recorded) Jan 16 19:58:59.845: INFO: Container windows-container ready: false, restart count 0 Jan 16 19:58:59.845: INFO: pod-back-off-image started at 2021-01-16 19:55:28 +0000 UTC (0+1 container statuses recorded) Jan 16 19:58:59.845: INFO: Container back-off ready: false, restart count 4 Jan 16 19:58:59.845: INFO: pod1 started at 2021-01-16 19:58:22 +0000 UTC (0+1 container statuses recorded) Jan 16 19:58:59.845: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:58:59.845: INFO: server-envvars-72bb33d2-2fa5-46cd-9fcb-7414e12cc81b started at 2021-01-16 19:53:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:58:59.845: INFO: Container srv ready: false, restart count 0 Jan 16 19:58:59.845: INFO: netserver-0 started at 2021-01-16 19:56:13 +0000 UTC (0+1 container statuses recorded) Jan 16 19:58:59.845: INFO: Container webserver ready: false, restart count 0 W0116 19:58:59.954575 87665 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:59:00.165: INFO: Latency metrics for node 3570k8s000 Jan 16 19:59:00.165: INFO: Logging node info for node 3570k8s001 Jan 16 19:59:00.220: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 20311 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:55:52 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:55:52 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:55:52 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:55:52 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:59:00.220: INFO: Logging kubelet events for node 3570k8s001 Jan 16 19:59:00.274: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 19:59:00.357: INFO: netserver-1 started at 2021-01-16 19:56:13 +0000 UTC (0+1 container statuses recorded) Jan 16 19:59:00.357: INFO: Container webserver ready: false, restart count 0 Jan 16 19:59:00.357: INFO: sample-webhook-deployment-65bfd79dc5-s7vqw started at 2021-01-16 19:57:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:59:00.357: INFO: Container sample-webhook ready: false, restart count 0 Jan 16 19:59:00.357: INFO: dns-test-22afc0c3-9e70-4bb7-bad9-ee6e146dbcab started at 2021-01-16 19:45:44 +0000 UTC (0+3 container statuses recorded) Jan 16 19:59:00.357: INFO: Container jessie-querier ready: false, restart count 6 Jan 16 19:59:00.357: INFO: Container querier ready: false, restart count 0 Jan 16 19:59:00.357: INFO: Container webserver ready: false, restart count 0 Jan 16 19:59:00.357: INFO: pod-projected-secrets-b6dd058b-4d23-4784-b86f-3263323f727b started at 2021-01-16 19:57:19 +0000 UTC (0+1 container statuses recorded) Jan 16 19:59:00.357: INFO: Container projected-secret-volume-test ready: false, restart count 0 W0116 19:59:00.421293 87665 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:59:00.591: INFO: Latency metrics for node 3570k8s001 Jan 16 19:59:00.591: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 19:59:00.645: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 20912 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:58:54 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:58:54 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:58:54 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:58:54 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:59:00.646: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 19:59:00.701: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 19:59:00.762: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 19:59:00.762: INFO: Container azure-cnms ready: true, restart count 0 Jan 16 19:59:00.762: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:59:00.762: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 19:59:00.762: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 19:59:00.762: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 19:59:00.762: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:59:00.762: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 19:59:00.762: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:59:00.762: INFO: Container kube-proxy ready: true, restart count 0 Jan 16 19:59:00.762: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 19:59:00.762: INFO: Container kube-apiserver ready: true, restart count 0 Jan 16 19:59:00.762: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:59:00.762: INFO: Container coredns ready: true, restart count 0 Jan 16 19:59:00.762: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:59:00.762: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 16 19:59:00.763: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 19:59:00.763: INFO: Container metrics-server ready: true, restart count 1 Jan 16 19:59:00.763: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:59:00.763: INFO: Container autoscaler ready: true, restart count 0 Jan 16 19:59:00.763: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 19:59:00.763: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 19:59:00.763: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 19:59:00.763: INFO: Container secrets-store ready: true, restart count 0 Jan 16 19:59:00.763: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:59:00.763: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 16 19:59:00.763: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 19:59:00.763: INFO: Container kube-controller-manager ready: true, restart count 0 W0116 19:59:00.822294 87665 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:59:01.069: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 19:59:01.069: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "pods-5515" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sPods\sshould\srun\sthrough\sthe\slifecycle\sof\sPods\sand\sPodStatus\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 16 20:13:21.710: failed to see Pod pod-test in namespace pods-2859 running Unexpected error: <*errors.errorString | 0xc0002701f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:951from junit_02.xml
[BeforeEach] [k8s.io] Pods /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 20:12:21.132: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename pods �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in pods-2859 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pods /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:187 [It] should run through the lifecycle of Pods and PodStatus [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: creating a Pod with a static label �[1mSTEP�[0m: watching for Pod to be ready Jan 16 20:12:21.760: INFO: observed Pod pod-test in namespace pods-2859 in phase Pending with labels: map[test-pod-static:true] & conditions [] Jan 16 20:12:21.760: INFO: observed Pod pod-test in namespace pods-2859 in phase Pending with labels: map[test-pod-static:true] & conditions [{PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC }] Jan 16 20:12:21.760: INFO: observed Pod pod-test in namespace pods-2859 in phase Pending with labels: map[test-pod-static:true] & conditions [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC }] Jan 16 20:12:33.507: INFO: observed Pod pod-test in namespace pods-2859 in phase Pending with labels: map[test-pod-static:true] & conditions [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC }] Jan 16 20:12:52.179: INFO: observed Pod pod-test in namespace pods-2859 in phase Pending with labels: map[test-pod-static:true] & conditions [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC }] Jan 16 20:12:53.236: INFO: observed Pod pod-test in namespace pods-2859 in phase Pending with labels: map[test-pod-static:true] & conditions [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC }] Jan 16 20:13:21.710: FAIL: failed to see Pod pod-test in namespace pods-2859 running Unexpected error: <*errors.errorString | 0xc0002701f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func18.13() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:951 +0xbd7 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00338dc80) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc00338dc80) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc00338dc80, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Pods /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "pods-2859". �[1mSTEP�[0m: Found 5 events. Jan 16 20:13:21.762: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-test: { } Scheduled: Successfully assigned pods-2859/pod-test to 3570k8s000 Jan 16 20:13:21.762: INFO: At 2021-01-16 20:12:29 +0000 UTC - event for pod-test: {kubelet 3570k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 20:13:21.762: INFO: At 2021-01-16 20:12:31 +0000 UTC - event for pod-test: {kubelet 3570k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 16 20:13:21.762: INFO: At 2021-01-16 20:12:33 +0000 UTC - event for pod-test: {kubelet 3570k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 16 20:13:21.762: INFO: At 2021-01-16 20:12:52 +0000 UTC - event for pod-test: {kubelet 3570k8s000} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 20:13:21.814: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 20:13:21.814: INFO: pod-test 3570k8s000 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:12:21 +0000 UTC }] Jan 16 20:13:21.814: INFO: Jan 16 20:13:21.916: INFO: Logging node info for node 3570k8s000 Jan 16 20:13:21.968: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 24904 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 20:11:44 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 20:11:44 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 20:11:44 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 20:11:44 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 20:13:21.969: INFO: Logging kubelet events for node 3570k8s000 Jan 16 20:13:22.020: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 20:13:22.077: INFO: pod-handle-http-request started at 2021-01-16 20:12:02 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.077: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 20:13:22.077: INFO: pod-test started at 2021-01-16 20:12:21 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.077: INFO: Container pod-test ready: false, restart count 0 Jan 16 20:13:22.077: INFO: sample-webhook-deployment-65bfd79dc5-5gtps started at 2021-01-16 20:12:40 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.077: INFO: Container sample-webhook ready: false, restart count 0 Jan 16 20:13:22.077: INFO: netserver-0 started at 2021-01-16 20:09:08 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.077: INFO: Container webserver ready: false, restart count 0 Jan 16 20:13:22.077: INFO: downwardapi-volume-b8ecf660-37de-442a-8a0f-95850488d1eb started at 2021-01-16 20:10:37 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.077: INFO: Container client-container ready: false, restart count 0 W0116 20:13:22.182324 87668 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 20:13:22.372: INFO: Latency metrics for node 3570k8s000 Jan 16 20:13:22.372: INFO: Logging node info for node 3570k8s001 Jan 16 20:13:22.424: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 24749 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 20:11:00 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 20:11:00 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 20:11:00 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 20:11:00 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 20:13:22.424: INFO: Logging kubelet events for node 3570k8s001 Jan 16 20:13:22.476: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 20:13:22.531: INFO: dns-test-4db39994-57cf-4f80-af1c-c438049c1fec started at 2021-01-16 20:08:10 +0000 UTC (0+3 container statuses recorded) Jan 16 20:13:22.531: INFO: Container jessie-querier ready: true, restart count 0 Jan 16 20:13:22.531: INFO: Container querier ready: false, restart count 0 Jan 16 20:13:22.531: INFO: Container webserver ready: false, restart count 0 Jan 16 20:13:22.531: INFO: pod-host-path-test started at 2021-01-16 20:12:36 +0000 UTC (0+2 container statuses recorded) Jan 16 20:13:22.531: INFO: Container test-container-1 ready: false, restart count 0 Jan 16 20:13:22.531: INFO: Container test-container-2 ready: false, restart count 0 Jan 16 20:13:22.531: INFO: netserver-1 started at 2021-01-16 20:09:08 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.531: INFO: Container webserver ready: false, restart count 0 Jan 16 20:13:22.531: INFO: sample-webhook-deployment-65bfd79dc5-6f5jd started at 2021-01-16 20:09:03 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.531: INFO: Container sample-webhook ready: false, restart count 0 W0116 20:13:22.588619 87668 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 20:13:22.822: INFO: Latency metrics for node 3570k8s001 Jan 16 20:13:22.822: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 20:13:22.880: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 24247 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 20:08:59 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 20:08:59 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 20:08:59 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 20:08:59 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 20:13:22.881: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 20:13:22.933: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 20:13:22.992: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.992: INFO: Container autoscaler ready: true, restart count 0 Jan 16 20:13:22.992: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.992: INFO: Container coredns ready: true, restart count 0 Jan 16 20:13:22.992: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.992: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 16 20:13:22.992: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.992: INFO: Container metrics-server ready: true, restart count 1 Jan 16 20:13:22.992: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.992: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 16 20:13:22.992: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 20:13:22.992: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 20:13:22.992: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 20:13:22.992: INFO: Container secrets-store ready: true, restart count 0 Jan 16 20:13:22.992: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.992: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 16 20:13:22.992: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.992: INFO: Container azure-cnms ready: true, restart count 0 Jan 16 20:13:22.992: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.992: INFO: Container kube-apiserver ready: true, restart count 0 Jan 16 20:13:22.992: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.992: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 20:13:22.992: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.992: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 20:13:22.992: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.992: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 20:13:22.992: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 20:13:22.992: INFO: Container kube-proxy ready: true, restart count 0 W0116 20:13:23.048992 87668 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 20:13:23.296: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 20:13:23.296: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "pods-2859" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sProbing\scontainer\sshould\s\*not\*\sbe\srestarted\swith\sa\s\/healthz\shttp\sliveness\sprobe\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 16 19:12:56.650: starting pod test-webserver-c4eb1c86-1840-43e4-b826-d084994c7ca9 in namespace container-probe-5828 Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:589from junit_01.xml
[BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 19:07:55.930: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename container-probe �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-probe-5828 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:53 [It] should *not* be restarted with a /healthz http liveness probe [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: Creating pod test-webserver-c4eb1c86-1840-43e4-b826-d084994c7ca9 in namespace container-probe-5828 Jan 16 19:12:56.650: FAIL: starting pod test-webserver-c4eb1c86-1840-43e4-b826-d084994c7ca9 in namespace container-probe-5828 Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.RunLivenessTest(0xc0003e6580, 0xc0020a2400, 0x0, 0x37e11d6000) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:589 +0x4b9 k8s.io/kubernetes/test/e2e/common.glob..func3.9() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:208 +0x165 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0038c5e00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc0038c5e00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc0038c5e00, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 �[1mSTEP�[0m: deleting the pod [AfterEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-probe-5828". �[1mSTEP�[0m: Found 5 events. Jan 16 19:12:56.776: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for test-webserver-c4eb1c86-1840-43e4-b826-d084994c7ca9: { } Scheduled: Successfully assigned container-probe-5828/test-webserver-c4eb1c86-1840-43e4-b826-d084994c7ca9 to 3570k8s001 Jan 16 19:12:56.776: INFO: At 2021-01-16 19:08:05 +0000 UTC - event for test-webserver-c4eb1c86-1840-43e4-b826-d084994c7ca9: {kubelet 3570k8s001} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:12:56.776: INFO: At 2021-01-16 19:08:06 +0000 UTC - event for test-webserver-c4eb1c86-1840-43e4-b826-d084994c7ca9: {kubelet 3570k8s001} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 16 19:12:56.776: INFO: At 2021-01-16 19:08:06 +0000 UTC - event for test-webserver-c4eb1c86-1840-43e4-b826-d084994c7ca9: {kubelet 3570k8s001} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 16 19:12:56.776: INFO: At 2021-01-16 19:08:13 +0000 UTC - event for test-webserver-c4eb1c86-1840-43e4-b826-d084994c7ca9: {kubelet 3570k8s001} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:12:56.830: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 19:12:56.830: INFO: Jan 16 19:12:56.936: INFO: Logging node info for node 3570k8s000 Jan 16 19:12:56.991: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 7366 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:11:31 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:11:31 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:11:31 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:11:31 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:12:56.991: INFO: Logging kubelet events for node 3570k8s000 Jan 16 19:12:57.050: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 19:12:57.108: INFO: agnhost-primary-5srhv started at 2021-01-16 19:09:53 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.108: INFO: Container agnhost-primary ready: false, restart count 0 Jan 16 19:12:57.108: INFO: liveness-709e0435-6d3d-4bc5-ab34-8632868596b6 started at 2021-01-16 19:11:35 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.108: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:12:57.108: INFO: back-off-cap started at 2021-01-16 19:00:52 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.108: INFO: Container back-off-cap ready: false, restart count 7 Jan 16 19:12:57.108: INFO: pod-handle-http-request started at 2021-01-16 19:08:35 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.108: INFO: Container agnhost-container ready: false, restart count 0 W0116 19:12:57.219055 87665 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:12:57.390: INFO: Latency metrics for node 3570k8s000 Jan 16 19:12:57.390: INFO: Logging node info for node 3570k8s001 Jan 16 19:12:57.445: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 6860 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:09:20 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:09:20 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:09:20 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:09:20 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:12:57.445: INFO: Logging kubelet events for node 3570k8s001 Jan 16 19:12:57.501: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 19:12:57.559: INFO: pod-projected-configmaps-e9ecb050-377d-4781-8e8d-55eec9b34136 started at 2021-01-16 19:09:48 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.559: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:12:57.559: INFO: downwardapi-volume-ab82b898-30e6-4d5b-9088-36fddd301231 started at 2021-01-16 19:08:42 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.559: INFO: Container client-container ready: false, restart count 0 Jan 16 19:12:57.559: INFO: pod-projected-configmaps-819085cd-1ae0-4313-8b5f-1ba3921f7700 started at 2021-01-16 19:09:37 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.559: INFO: Container agnhost-container ready: false, restart count 0 W0116 19:12:57.619134 87665 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:12:57.770: INFO: Latency metrics for node 3570k8s001 Jan 16 19:12:57.770: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 19:12:57.827: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 6652 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:08:30 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:08:30 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:08:30 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:08:30 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:12:57.828: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 19:12:57.884: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 19:12:57.945: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.945: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 16 19:12:57.945: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 19:12:57.945: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 19:12:57.945: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 19:12:57.945: INFO: Container secrets-store ready: true, restart count 0 Jan 16 19:12:57.945: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.945: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 16 19:12:57.945: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.945: INFO: Container azure-cnms ready: true, restart count 0 Jan 16 19:12:57.945: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.945: INFO: Container kube-proxy ready: true, restart count 0 Jan 16 19:12:57.945: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.945: INFO: Container kube-apiserver ready: true, restart count 0 Jan 16 19:12:57.945: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.945: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 19:12:57.945: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.945: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 19:12:57.945: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.945: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 19:12:57.945: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.945: INFO: Container autoscaler ready: true, restart count 0 Jan 16 19:12:57.945: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.945: INFO: Container coredns ready: true, restart count 0 Jan 16 19:12:57.945: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.945: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 16 19:12:57.945: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 19:12:57.945: INFO: Container metrics-server ready: true, restart count 1 W0116 19:12:58.004856 87665 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:12:58.258: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 19:12:58.258: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-probe-5828" for this suite.
Find test-webserver-c4eb1c86-1840-43e4-b826-d084994c7ca9 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sProbing\scontainer\sshould\s\*not\*\sbe\srestarted\swith\sa\stcp\:8080\sliveness\sprobe\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 16 18:50:35.840: starting pod liveness-78d167b5-2cea-415e-b18a-9aa13ae530f5 in namespace container-probe-2628 Unexpected error: <*errors.errorString | 0xc000276200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:589from junit_08.xml
[BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 18:45:34.634: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename container-probe W0116 18:45:34.977078 87657 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+ Jan 16 18:45:34.977: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled Jan 16 18:45:35.034: INFO: PSP annotation exists on dry run pod: "privileged"; assuming PodSecurityPolicy is enabled W0116 18:45:35.085601 87657 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+ Jan 16 18:45:35.236: INFO: Found ClusterRoles; assuming RBAC is enabled. �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-probe-2628 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:53 [It] should *not* be restarted with a tcp:8080 liveness probe [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: Creating pod liveness-78d167b5-2cea-415e-b18a-9aa13ae530f5 in namespace container-probe-2628 Jan 16 18:50:35.840: FAIL: starting pod liveness-78d167b5-2cea-415e-b18a-9aa13ae530f5 in namespace container-probe-2628 Unexpected error: <*errors.errorString | 0xc000276200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.RunLivenessTest(0xc0008f2160, 0xc000620400, 0x0, 0x37e11d6000) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:589 +0x4b9 k8s.io/kubernetes/test/e2e/common.glob..func3.7() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:177 +0x137 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002e71980) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc002e71980) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002e71980, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 �[1mSTEP�[0m: deleting the pod [AfterEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-probe-2628". �[1mSTEP�[0m: Found 5 events. Jan 16 18:50:35.964: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for liveness-78d167b5-2cea-415e-b18a-9aa13ae530f5: { } Scheduled: Successfully assigned container-probe-2628/liveness-78d167b5-2cea-415e-b18a-9aa13ae530f5 to 3570k8s001 Jan 16 18:50:35.964: INFO: At 2021-01-16 18:45:58 +0000 UTC - event for liveness-78d167b5-2cea-415e-b18a-9aa13ae530f5: {kubelet 3570k8s001} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 18:50:35.964: INFO: At 2021-01-16 18:46:02 +0000 UTC - event for liveness-78d167b5-2cea-415e-b18a-9aa13ae530f5: {kubelet 3570k8s001} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 16 18:50:35.964: INFO: At 2021-01-16 18:46:03 +0000 UTC - event for liveness-78d167b5-2cea-415e-b18a-9aa13ae530f5: {kubelet 3570k8s001} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 16 18:50:35.964: INFO: At 2021-01-16 18:46:32 +0000 UTC - event for liveness-78d167b5-2cea-415e-b18a-9aa13ae530f5: {kubelet 3570k8s001} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 18:50:36.035: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 18:50:36.035: INFO: Jan 16 18:50:36.138: INFO: Logging node info for node 3570k8s000 Jan 16 18:50:36.190: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 1317 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 18:46:49 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 18:46:49 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 18:46:49 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 18:46:49 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 18:50:36.190: INFO: Logging kubelet events for node 3570k8s000 Jan 16 18:50:36.245: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 18:50:36.311: INFO: pod-handle-http-request started at 2021-01-16 18:48:34 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:36.311: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 18:50:36.311: INFO: downwardapi-volume-f1bad0fd-cbe1-426b-a70f-9e5df49b601b started at 2021-01-16 18:45:35 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:36.311: INFO: Container client-container ready: false, restart count 0 Jan 16 18:50:36.311: INFO: pod-projected-secrets-6318939c-ecd2-4f73-95a5-1956a975beab started at 2021-01-16 18:46:37 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:36.311: INFO: Container projected-secret-volume-test ready: false, restart count 0 W0116 18:50:36.416038 87657 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 18:50:36.665: INFO: Latency metrics for node 3570k8s000 Jan 16 18:50:36.665: INFO: Logging node info for node 3570k8s001 Jan 16 18:50:36.717: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 1579 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 18:47:40 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 18:47:40 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 18:47:40 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 18:47:40 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 18:50:36.717: INFO: Logging kubelet events for node 3570k8s001 Jan 16 18:50:36.771: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 18:50:36.885: INFO: client-containers-9a1748bf-59ba-42f8-be4b-31d589c801c0 started at 2021-01-16 18:45:49 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:36.885: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 18:50:36.885: INFO: test-recreate-deployment-b65d5894b-2rsxc started at 2021-01-16 18:47:13 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:36.885: INFO: Container agnhost ready: false, restart count 0 Jan 16 18:50:36.885: INFO: agnhost-primary-d2knm started at 2021-01-16 18:47:26 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:36.885: INFO: Container agnhost-primary ready: false, restart count 0 Jan 16 18:50:36.885: INFO: pod-projected-secrets-3da035fc-b570-4cc7-aded-f3ba89925dae started at 2021-01-16 18:45:42 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:36.885: INFO: Container projected-secret-volume-test ready: false, restart count 0 W0116 18:50:36.942317 87657 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 18:50:37.431: INFO: Latency metrics for node 3570k8s001 Jan 16 18:50:37.431: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 18:50:37.483: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 1778 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 18:48:20 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 18:48:20 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 18:48:20 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 18:48:20 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 18:50:37.484: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 18:50:37.539: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 18:50:37.682: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:37.682: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 18:50:37.682: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:37.682: INFO: Container kube-proxy ready: true, restart count 0 Jan 16 18:50:37.682: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 18:50:37.682: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 18:50:37.682: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 18:50:37.682: INFO: Container secrets-store ready: true, restart count 0 Jan 16 18:50:37.682: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:37.682: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 16 18:50:37.682: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:37.682: INFO: Container kube-apiserver ready: true, restart count 0 Jan 16 18:50:37.682: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:37.682: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 16 18:50:37.682: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:37.682: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 18:50:37.682: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:37.682: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 18:50:37.682: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:37.682: INFO: Container azure-cnms ready: true, restart count 0 Jan 16 18:50:37.682: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:37.682: INFO: Container autoscaler ready: true, restart count 0 Jan 16 18:50:37.682: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:37.682: INFO: Container coredns ready: true, restart count 0 Jan 16 18:50:37.682: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:37.682: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 16 18:50:37.682: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 18:50:37.682: INFO: Container metrics-server ready: true, restart count 1 W0116 18:50:37.743846 87657 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 18:50:37.966: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 18:50:37.966: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-probe-2628" for this suite.
Find liveness-78d167b5-2cea-415e-b18a-9aa13ae530f5 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sProbing\scontainer\sshould\sbe\srestarted\swith\sa\s\/healthz\shttp\sliveness\sprobe\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 16 19:08:24.443: starting pod liveness-409d4b0e-d9d7-4581-8b97-d30b56c77d75 in namespace container-probe-7871 Unexpected error: <*errors.errorString | 0xc0001f6200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:589from junit_04.xml
[BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 19:03:23.729: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename container-probe �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-probe-7871 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:53 [It] should be restarted with a /healthz http liveness probe [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: Creating pod liveness-409d4b0e-d9d7-4581-8b97-d30b56c77d75 in namespace container-probe-7871 Jan 16 19:08:24.443: FAIL: starting pod liveness-409d4b0e-d9d7-4581-8b97-d30b56c77d75 in namespace container-probe-7871 Unexpected error: <*errors.errorString | 0xc0001f6200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.RunLivenessTest(0xc00039d1e0, 0xc002de0000, 0x1, 0x37e11d6000) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:589 +0x4b9 k8s.io/kubernetes/test/e2e/common.glob..func3.6() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:162 +0x156 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003ac1b00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc003ac1b00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc003ac1b00, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 �[1mSTEP�[0m: deleting the pod [AfterEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-probe-7871". �[1mSTEP�[0m: Found 4 events. Jan 16 19:08:24.572: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for liveness-409d4b0e-d9d7-4581-8b97-d30b56c77d75: { } Scheduled: Successfully assigned container-probe-7871/liveness-409d4b0e-d9d7-4581-8b97-d30b56c77d75 to 3570k8s000 Jan 16 19:08:24.572: INFO: At 2021-01-16 19:03:29 +0000 UTC - event for liveness-409d4b0e-d9d7-4581-8b97-d30b56c77d75: {kubelet 3570k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:08:24.572: INFO: At 2021-01-16 19:03:30 +0000 UTC - event for liveness-409d4b0e-d9d7-4581-8b97-d30b56c77d75: {kubelet 3570k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 16 19:08:24.572: INFO: At 2021-01-16 19:03:33 +0000 UTC - event for liveness-409d4b0e-d9d7-4581-8b97-d30b56c77d75: {kubelet 3570k8s000} Failed: Error: ImagePullBackOff Jan 16 19:08:24.624: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 19:08:24.624: INFO: Jan 16 19:08:24.727: INFO: Logging node info for node 3570k8s000 Jan 16 19:08:24.779: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 6149 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:06:29 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:06:29 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:06:29 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:06:29 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:08:24.780: INFO: Logging kubelet events for node 3570k8s000 Jan 16 19:08:24.843: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 19:08:24.909: INFO: pod-init-7e1d7cc8-2ace-452f-b408-daf1b8b3a16d started at 2021-01-16 19:08:18 +0000 UTC (2+1 container statuses recorded) Jan 16 19:08:24.910: INFO: Init container init1 ready: false, restart count 0 Jan 16 19:08:24.910: INFO: Init container init2 ready: false, restart count 0 Jan 16 19:08:24.910: INFO: Container run1 ready: false, restart count 0 Jan 16 19:08:24.910: INFO: pod-21f85a70-6fda-443d-b407-1b7ef65ec024 started at 2021-01-16 19:04:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:08:24.910: INFO: Container windows-container ready: false, restart count 0 Jan 16 19:08:24.910: INFO: pod-configmaps-b5d9bbe1-28fe-4f4d-b3a9-70b3587ee23b started at 2021-01-16 19:06:32 +0000 UTC (0+3 container statuses recorded) Jan 16 19:08:24.910: INFO: Container createcm-volume-test ready: false, restart count 0 Jan 16 19:08:24.910: INFO: Container delcm-volume-test ready: false, restart count 0 Jan 16 19:08:24.910: INFO: Container updcm-volume-test ready: false, restart count 0 Jan 16 19:08:24.910: INFO: back-off-cap started at 2021-01-16 19:00:52 +0000 UTC (0+1 container statuses recorded) Jan 16 19:08:24.910: INFO: Container back-off-cap ready: false, restart count 6 W0116 19:08:25.014216 87655 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:08:28.301: INFO: Latency metrics for node 3570k8s000 Jan 16 19:08:28.301: INFO: Logging node info for node 3570k8s001 Jan 16 19:08:28.353: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 5666 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:04:17 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:04:17 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:04:17 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:04:17 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:08:28.353: INFO: Logging kubelet events for node 3570k8s001 Jan 16 19:08:28.408: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 19:08:28.464: INFO: pod1 started at 2021-01-16 19:06:34 +0000 UTC (0+1 container statuses recorded) Jan 16 19:08:28.464: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:08:28.464: INFO: test-webserver-c4eb1c86-1840-43e4-b826-d084994c7ca9 started at 2021-01-16 19:07:56 +0000 UTC (0+1 container statuses recorded) Jan 16 19:08:28.464: INFO: Container test-webserver ready: false, restart count 0 Jan 16 19:08:28.464: INFO: dns-test-11dc9e5b-f391-4d2c-a5db-91fbc2f68555 started at 2021-01-16 18:53:38 +0000 UTC (0+3 container statuses recorded) Jan 16 19:08:28.464: INFO: Container jessie-querier ready: true, restart count 0 Jan 16 19:08:28.464: INFO: Container querier ready: false, restart count 0 Jan 16 19:08:28.464: INFO: Container webserver ready: false, restart count 0 W0116 19:08:28.570361 87655 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:08:34.030: INFO: Latency metrics for node 3570k8s001 Jan 16 19:08:34.030: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 19:08:34.083: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 6652 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:08:30 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:08:30 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:08:30 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:08:30 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:08:34.083: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 19:08:34.137: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 19:08:34.247: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 19:08:34.248: INFO: Container kube-apiserver ready: true, restart count 0 Jan 16 19:08:34.248: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:08:34.248: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 19:08:34.248: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 19:08:34.248: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 19:08:34.248: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:08:34.248: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 19:08:34.248: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:08:34.248: INFO: Container kube-proxy ready: true, restart count 0 Jan 16 19:08:34.248: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:08:34.248: INFO: Container autoscaler ready: true, restart count 0 Jan 16 19:08:34.248: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:08:34.248: INFO: Container coredns ready: true, restart count 0 Jan 16 19:08:34.248: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:08:34.248: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 16 19:08:34.248: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 19:08:34.248: INFO: Container metrics-server ready: true, restart count 1 Jan 16 19:08:34.248: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 19:08:34.248: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 16 19:08:34.248: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 19:08:34.248: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 19:08:34.248: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 19:08:34.248: INFO: Container secrets-store ready: true, restart count 0 Jan 16 19:08:34.248: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:08:34.248: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 16 19:08:34.248: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 19:08:34.248: INFO: Container azure-cnms ready: true, restart count 0 Jan 16 19:08:34.248: INFO: pod-1624976b-7282-42ea-8d39-d61d2a2d0cb2 started at 2021-01-16 19:04:40 +0000 UTC (0+1 container statuses recorded) Jan 16 19:08:34.248: INFO: Container linux-container ready: true, restart count 0 W0116 19:08:34.308985 87655 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:08:34.585: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 19:08:34.585: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-probe-7871" for this suite.
Find liveness-409d4b0e-d9d7-4581-8b97-d30b56c77d75 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sProbing\scontainer\sshould\shave\smonotonically\sincreasing\srestart\scount\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 16 19:16:35.451: starting pod liveness-709e0435-6d3d-4bc5-ab34-8632868596b6 in namespace container-probe-9692 Unexpected error: <*errors.errorString | 0xc000276200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:589from junit_05.xml
[BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 19:11:34.765: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename container-probe �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-probe-9692 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:53 [It] should have monotonically increasing restart count [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: Creating pod liveness-709e0435-6d3d-4bc5-ab34-8632868596b6 in namespace container-probe-9692 Jan 16 19:16:35.451: FAIL: starting pod liveness-709e0435-6d3d-4bc5-ab34-8632868596b6 in namespace container-probe-9692 Unexpected error: <*errors.errorString | 0xc000276200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.RunLivenessTest(0xc0003eba20, 0xc002d70400, 0x5, 0x45d964b800) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:589 +0x4b9 k8s.io/kubernetes/test/e2e/common.glob..func3.8() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:192 +0x156 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0033b5e00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc0033b5e00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc0033b5e00, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 �[1mSTEP�[0m: deleting the pod [AfterEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-probe-9692". �[1mSTEP�[0m: Found 5 events. Jan 16 19:16:35.574: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for liveness-709e0435-6d3d-4bc5-ab34-8632868596b6: { } Scheduled: Successfully assigned container-probe-9692/liveness-709e0435-6d3d-4bc5-ab34-8632868596b6 to 3570k8s000 Jan 16 19:16:35.574: INFO: At 2021-01-16 19:11:38 +0000 UTC - event for liveness-709e0435-6d3d-4bc5-ab34-8632868596b6: {kubelet 3570k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:16:35.574: INFO: At 2021-01-16 19:11:39 +0000 UTC - event for liveness-709e0435-6d3d-4bc5-ab34-8632868596b6: {kubelet 3570k8s000} Failed: Error: ErrImagePull Jan 16 19:16:35.574: INFO: At 2021-01-16 19:11:39 +0000 UTC - event for liveness-709e0435-6d3d-4bc5-ab34-8632868596b6: {kubelet 3570k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 16 19:16:35.574: INFO: At 2021-01-16 19:11:45 +0000 UTC - event for liveness-709e0435-6d3d-4bc5-ab34-8632868596b6: {kubelet 3570k8s000} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:16:35.625: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 19:16:35.626: INFO: Jan 16 19:16:35.726: INFO: Logging node info for node 3570k8s000 Jan 16 19:16:35.777: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 8352 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:16:33 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:16:33 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:16:33 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:16:33 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:16:35.778: INFO: Logging kubelet events for node 3570k8s000 Jan 16 19:16:35.834: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 19:16:35.965: INFO: pod-projected-configmaps-cf39b4b9-d4f3-4e29-be8a-d464cc83aaf8 started at 2021-01-16 19:12:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:35.965: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:16:35.965: INFO: pod-secrets-d5687a70-d493-4a47-b68b-4dffa1f85596 started at 2021-01-16 19:13:38 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:35.965: INFO: Container secret-volume-test ready: false, restart count 0 Jan 16 19:16:35.965: INFO: back-off-cap started at 2021-01-16 19:00:52 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:35.965: INFO: Container back-off-cap ready: false, restart count 7 W0116 19:16:36.069583 87659 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:16:36.272: INFO: Latency metrics for node 3570k8s000 Jan 16 19:16:36.272: INFO: Logging node info for node 3570k8s001 Jan 16 19:16:36.324: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 7873 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:14:22 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:14:22 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:14:22 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:14:22 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:16:36.324: INFO: Logging kubelet events for node 3570k8s001 Jan 16 19:16:36.378: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 19:16:36.470: INFO: nodeport-test-6nsvr started at 2021-01-16 19:14:52 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:36.471: INFO: Container netexec ready: false, restart count 0 Jan 16 19:16:36.471: INFO: pod-handle-http-request started at 2021-01-16 19:14:58 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:36.471: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:16:36.471: INFO: pod-configmaps-d0acbeed-737d-4a8f-9fdf-61e2bad9d1b6 started at 2021-01-16 19:14:59 +0000 UTC (0+2 container statuses recorded) Jan 16 19:16:36.471: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:16:36.471: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Jan 16 19:16:36.471: INFO: sample-webhook-deployment-65bfd79dc5-fq892 started at 2021-01-16 19:13:49 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:36.471: INFO: Container sample-webhook ready: false, restart count 0 W0116 19:16:36.532687 87659 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:16:36.700: INFO: Latency metrics for node 3570k8s001 Jan 16 19:16:36.700: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 19:16:36.754: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 7663 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:13:32 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:13:32 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:13:32 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:13:32 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:16:36.755: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 19:16:36.808: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 19:16:36.919: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:36.919: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 19:16:36.919: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:36.919: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 19:16:36.919: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:36.919: INFO: Container kube-proxy ready: true, restart count 0 Jan 16 19:16:36.919: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:36.919: INFO: Container kube-apiserver ready: true, restart count 0 Jan 16 19:16:36.919: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:36.919: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 19:16:36.919: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:36.919: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 16 19:16:36.919: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:36.919: INFO: Container metrics-server ready: true, restart count 1 Jan 16 19:16:36.919: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:36.919: INFO: Container autoscaler ready: true, restart count 0 Jan 16 19:16:36.919: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:36.919: INFO: Container coredns ready: true, restart count 0 Jan 16 19:16:36.919: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:36.919: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 16 19:16:36.919: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:36.919: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 16 19:16:36.919: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 19:16:36.919: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 19:16:36.919: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 19:16:36.919: INFO: Container secrets-store ready: true, restart count 0 Jan 16 19:16:36.919: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 19:16:36.919: INFO: Container azure-cnms ready: true, restart count 0 W0116 19:16:36.974425 87659 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:16:37.200: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 19:16:37.200: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-probe-9692" for this suite.
Find liveness-709e0435-6d3d-4bc5-ab34-8632868596b6 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sProbing\scontainer\swith\sreadiness\sprobe\sshould\snot\sbe\sready\sbefore\sinitial\sdelay\sand\snever\srestart\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 16 19:34:29.955: Unexpected error: <*errors.errorString | 0xc0034aa240>: { s: "want pod 'test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76' on '3570k8s001' to be 'Running' but was 'Pending'", } want pod 'test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76' on '3570k8s001' to be 'Running' but was 'Pending' occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:70from junit_04.xml
[BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 19:29:29.185: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename container-probe �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-probe-3391 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:53 [It] with readiness probe should not be ready before initial delay and never restart [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 16 19:29:29.789: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:29:31.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:29:33.847: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:29:35.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:29:37.843: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:29:39.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:29:41.848: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:29:43.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:29:45.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:29:47.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:29:49.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:29:51.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:29:53.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:29:55.852: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:29:57.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:29:59.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:01.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:03.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:05.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:07.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:09.850: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:11.843: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:13.861: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:15.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:17.867: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:19.855: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:21.847: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:23.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:25.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:27.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:29.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:31.855: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:33.847: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:35.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:37.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:39.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:41.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:43.849: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:45.848: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:47.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:49.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:51.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:53.852: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:55.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:57.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:30:59.851: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:01.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:03.847: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:05.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:07.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:09.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:11.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:13.848: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:15.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:17.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:19.850: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:21.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:23.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:25.850: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:27.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:29.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:31.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:33.848: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:35.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:37.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:39.847: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:41.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:43.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:45.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:47.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:49.855: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:51.855: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:53.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:55.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:57.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:31:59.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:01.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:03.847: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:05.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:07.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:09.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:11.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:13.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:15.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:17.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:19.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:21.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:23.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:25.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:27.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:29.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:31.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:33.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:35.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:37.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:39.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:41.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:43.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:45.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:47.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:49.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:51.849: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:53.850: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:55.851: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:57.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:32:59.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:01.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:03.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:05.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:07.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:09.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:11.874: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:13.851: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:15.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:17.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:19.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:21.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:23.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:25.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:27.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:29.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:31.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:33.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:35.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:37.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:39.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:41.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:43.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:45.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:47.848: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:49.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:51.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:53.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:55.847: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:57.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:33:59.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:34:01.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:34:03.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:34:05.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:34:07.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:34:09.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:34:11.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:34:13.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:34:15.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:34:17.846: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:34:19.847: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:34:21.871: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:34:23.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:34:25.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:34:27.845: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:34:29.844: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:34:29.899: INFO: The status of Pod test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 is Pending, waiting for it to be Running (with Ready = true) Jan 16 19:34:29.955: FAIL: Unexpected error: <*errors.errorString | 0xc0034aa240>: { s: "want pod 'test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76' on '3570k8s001' to be 'Running' but was 'Pending'", } want pod 'test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76' on '3570k8s001' to be 'Running' but was 'Pending' occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func3.2() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:70 +0x205 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003ac1b00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc003ac1b00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc003ac1b00, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-probe-3391". �[1mSTEP�[0m: Found 4 events. Jan 16 19:34:30.010: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76: { } Scheduled: Successfully assigned container-probe-3391/test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 to 3570k8s001 Jan 16 19:34:30.010: INFO: At 2021-01-16 19:29:32 +0000 UTC - event for test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76: {kubelet 3570k8s001} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:34:30.010: INFO: At 2021-01-16 19:29:34 +0000 UTC - event for test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76: {kubelet 3570k8s001} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 16 19:34:30.010: INFO: At 2021-01-16 19:29:35 +0000 UTC - event for test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76: {kubelet 3570k8s001} Failed: Error: ImagePullBackOff Jan 16 19:34:30.065: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 19:34:30.065: INFO: test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 3570k8s001 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:29:29 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:29:29 +0000 UTC ContainersNotReady containers with unready status: [test-webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:29:29 +0000 UTC ContainersNotReady containers with unready status: [test-webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 19:29:29 +0000 UTC }] Jan 16 19:34:30.065: INFO: Jan 16 19:34:30.172: INFO: Logging node info for node 3570k8s000 Jan 16 19:34:30.227: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 14185 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:34:02 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:34:02 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:34:02 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:34:02 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:34:30.227: INFO: Logging kubelet events for node 3570k8s000 Jan 16 19:34:30.284: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 19:34:30.345: INFO: pod-configmaps-2ac6d5f6-2ef8-431c-9f4d-5628736126ff started at 2021-01-16 19:31:09 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:30.345: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 19:34:30.345: INFO: sample-webhook-deployment-65bfd79dc5-df4m2 started at 2021-01-16 19:30:19 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:30.345: INFO: Container sample-webhook ready: false, restart count 0 Jan 16 19:34:30.345: INFO: dns-test-1c753686-7221-4361-a1d6-b87fe654724a started at 2021-01-16 19:33:34 +0000 UTC (0+3 container statuses recorded) Jan 16 19:34:30.345: INFO: Container jessie-querier ready: true, restart count 0 Jan 16 19:34:30.345: INFO: Container querier ready: false, restart count 0 Jan 16 19:34:30.345: INFO: Container webserver ready: false, restart count 0 Jan 16 19:34:30.345: INFO: image-pull-test48722816-2196-4e27-9c4b-9a86571b57c2 started at 2021-01-16 19:31:06 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:30.345: INFO: Container image-pull-test ready: false, restart count 0 W0116 19:34:30.454852 87655 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:34:30.656: INFO: Latency metrics for node 3570k8s000 Jan 16 19:34:30.656: INFO: Logging node info for node 3570k8s001 Jan 16 19:34:30.711: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 13497 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:30:40 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:30:40 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:30:40 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:30:40 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:34:30.711: INFO: Logging kubelet events for node 3570k8s001 Jan 16 19:34:30.768: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 19:34:30.828: INFO: pod-projected-secrets-6159e4ad-8dfd-4390-8796-48226abb13ba started at 2021-01-16 19:30:05 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:30.828: INFO: Container secret-volume-test ready: false, restart count 0 Jan 16 19:34:30.828: INFO: pod-projected-configmaps-93a33183-941c-48f8-badc-e6068c75ef61 started at 2021-01-16 19:33:23 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:30.828: INFO: Container projected-configmap-volume-test ready: false, restart count 0 Jan 16 19:34:30.828: INFO: test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 started at 2021-01-16 19:29:29 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:30.828: INFO: Container test-webserver ready: false, restart count 0 W0116 19:34:30.888854 87655 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:34:31.060: INFO: Latency metrics for node 3570k8s001 Jan 16 19:34:31.060: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 19:34:31.115: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 14138 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:33:42 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:33:42 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:33:42 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:33:42 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:34:31.116: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 19:34:31.182: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 19:34:31.246: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:31.246: INFO: Container autoscaler ready: true, restart count 0 Jan 16 19:34:31.246: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:31.246: INFO: Container coredns ready: true, restart count 0 Jan 16 19:34:31.246: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:31.246: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 16 19:34:31.246: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:31.246: INFO: Container metrics-server ready: true, restart count 1 Jan 16 19:34:31.246: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:31.246: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 16 19:34:31.246: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 19:34:31.246: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 19:34:31.246: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 19:34:31.246: INFO: Container secrets-store ready: true, restart count 0 Jan 16 19:34:31.246: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:31.246: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 16 19:34:31.246: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:31.246: INFO: Container azure-cnms ready: true, restart count 0 Jan 16 19:34:31.246: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:31.246: INFO: Container kube-apiserver ready: true, restart count 0 Jan 16 19:34:31.246: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:31.246: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 19:34:31.246: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:31.246: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 19:34:31.246: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:31.246: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 19:34:31.246: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:34:31.246: INFO: Container kube-proxy ready: true, restart count 0 W0116 19:34:31.305814 87655 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:34:31.532: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 19:34:31.532: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-probe-3391" for this suite.
Find test-webserver-094260eb-c9f4-4a85-9a38-b50f33079b76 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sEvents\sshould\sbe\ssent\sby\skubelets\sand\sthe\sscheduler\sabout\spods\sscheduling\sand\srunning\s\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 16 20:08:22.106: Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/node/events.go:80from junit_06.xml
[BeforeEach] [k8s.io] [sig-node] Events /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 20:03:21.393: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename events �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in events-6216 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should be sent by kubelets and the scheduler about pods scheduling and running [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: creating the pod �[1mSTEP�[0m: submitting the pod to kubernetes Jan 16 20:08:22.106: FAIL: Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/node.glob..func3.1() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/node/events.go:80 +0x577 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003255980) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc003255980) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc003255980, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 �[1mSTEP�[0m: deleting the pod [AfterEach] [k8s.io] [sig-node] Events /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "events-6216". �[1mSTEP�[0m: Found 5 events. Jan 16 20:08:22.223: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for send-events-60ba0d7c-6cc7-4a9f-8e7a-005dab298dae: { } Scheduled: Successfully assigned events-6216/send-events-60ba0d7c-6cc7-4a9f-8e7a-005dab298dae to 3570k8s000 Jan 16 20:08:22.223: INFO: At 2021-01-16 20:03:25 +0000 UTC - event for send-events-60ba0d7c-6cc7-4a9f-8e7a-005dab298dae: {kubelet 3570k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 20:08:22.223: INFO: At 2021-01-16 20:03:27 +0000 UTC - event for send-events-60ba0d7c-6cc7-4a9f-8e7a-005dab298dae: {kubelet 3570k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 16 20:08:22.223: INFO: At 2021-01-16 20:03:30 +0000 UTC - event for send-events-60ba0d7c-6cc7-4a9f-8e7a-005dab298dae: {kubelet 3570k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 16 20:08:22.223: INFO: At 2021-01-16 20:03:34 +0000 UTC - event for send-events-60ba0d7c-6cc7-4a9f-8e7a-005dab298dae: {kubelet 3570k8s000} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 20:08:22.279: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 20:08:22.279: INFO: send-events-60ba0d7c-6cc7-4a9f-8e7a-005dab298dae 3570k8s000 Pending 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:03:21 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:03:21 +0000 UTC ContainersNotReady containers with unready status: [p]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:03:21 +0000 UTC ContainersNotReady containers with unready status: [p]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-16 20:03:21 +0000 UTC }] Jan 16 20:08:22.279: INFO: Jan 16 20:08:22.383: INFO: Logging node info for node 3570k8s000 Jan 16 20:08:22.437: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 23078 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 20:06:40 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 20:06:40 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 20:06:40 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 20:06:40 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 20:08:22.438: INFO: Logging kubelet events for node 3570k8s000 Jan 16 20:08:22.496: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 20:08:22.553: INFO: downwardapi-volume-0afd0322-9b89-44b9-9641-49d87877836c started at 2021-01-16 20:06:47 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:22.553: INFO: Container client-container ready: false, restart count 0 Jan 16 20:08:22.553: INFO: send-events-60ba0d7c-6cc7-4a9f-8e7a-005dab298dae started at 2021-01-16 20:03:21 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:22.553: INFO: Container p ready: false, restart count 0 Jan 16 20:08:22.553: INFO: pod-projected-configmaps-36346d59-3cd4-4cf1-9e89-ccf50b6764f8 started at 2021-01-16 20:04:15 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:22.553: INFO: Container agnhost-container ready: false, restart count 0 Jan 16 20:08:22.553: INFO: externalsvc-7zwj9 started at 2021-01-16 20:05:32 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:22.553: INFO: Container externalsvc ready: false, restart count 0 W0116 20:08:22.664193 87660 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 20:08:22.905: INFO: Latency metrics for node 3570k8s000 Jan 16 20:08:22.905: INFO: Logging node info for node 3570k8s001 Jan 16 20:08:22.960: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 22894 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 20:05:57 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 20:05:57 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 20:05:57 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 20:05:57 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 20:08:22.961: INFO: Logging kubelet events for node 3570k8s001 Jan 16 20:08:23.017: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 20:08:23.082: INFO: externalsvc-w2k98 started at 2021-01-16 20:05:32 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:23.082: INFO: Container externalsvc ready: false, restart count 0 Jan 16 20:08:23.082: INFO: concurrent-1610827620-2vsdm started at 2021-01-16 20:07:08 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:23.082: INFO: Container c ready: true, restart count 0 Jan 16 20:08:23.082: INFO: sample-webhook-deployment-65bfd79dc5-ss8p5 started at 2021-01-16 20:07:31 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:23.082: INFO: Container sample-webhook ready: false, restart count 0 Jan 16 20:08:23.082: INFO: sample-webhook-deployment-65bfd79dc5-s2j76 started at 2021-01-16 20:07:21 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:23.082: INFO: Container sample-webhook ready: false, restart count 0 Jan 16 20:08:23.082: INFO: dns-test-4db39994-57cf-4f80-af1c-c438049c1fec started at 2021-01-16 20:08:10 +0000 UTC (0+3 container statuses recorded) Jan 16 20:08:23.082: INFO: Container jessie-querier ready: true, restart count 0 Jan 16 20:08:23.082: INFO: Container querier ready: false, restart count 0 Jan 16 20:08:23.082: INFO: Container webserver ready: false, restart count 0 Jan 16 20:08:23.082: INFO: terminate-cmd-rpa852b3c5a-3299-47b6-a5d8-0dde40638b43 started at 2021-01-16 20:07:09 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:23.082: INFO: Container terminate-cmd-rpa ready: false, restart count 1 W0116 20:08:23.143188 87660 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 20:08:23.411: INFO: Latency metrics for node 3570k8s001 Jan 16 20:08:23.411: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 20:08:23.465: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 22411 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 20:03:56 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 20:03:56 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 20:03:56 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 20:03:56 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 20:08:23.466: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 20:08:23.519: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 20:08:23.580: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:23.580: INFO: Container azure-cnms ready: true, restart count 0 Jan 16 20:08:23.580: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:23.580: INFO: Container kube-proxy ready: true, restart count 0 Jan 16 20:08:23.580: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:23.580: INFO: Container kube-apiserver ready: true, restart count 0 Jan 16 20:08:23.580: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:23.580: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 20:08:23.580: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:23.580: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 20:08:23.580: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:23.580: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 20:08:23.580: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:23.580: INFO: Container autoscaler ready: true, restart count 0 Jan 16 20:08:23.580: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:23.580: INFO: Container coredns ready: true, restart count 0 Jan 16 20:08:23.580: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:23.580: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 16 20:08:23.580: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:23.580: INFO: Container metrics-server ready: true, restart count 1 Jan 16 20:08:23.580: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:23.580: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 16 20:08:23.580: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 20:08:23.580: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 20:08:23.580: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 20:08:23.580: INFO: Container secrets-store ready: true, restart count 0 Jan 16 20:08:23.580: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 20:08:23.580: INFO: Container provider-azure-installer ready: true, restart count 0 W0116 20:08:23.639385 87660 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 20:08:23.861: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 20:08:23.861: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "events-6216" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sPreStop\sshould\scall\sprestop\swhen\skilling\sa\spod\s\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 16 19:54:53.892: waiting for server pod to start Unexpected error: <*errors.errorString | 0xc000276200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:60from junit_08.xml
{"msg":"FAILED [sig-storage] Projected secret optional updates should be reflected in volume [NodeConformance] [Conformance]","total":-1,"completed":8,"skipped":340,"failed":7,"failures":["[k8s.io] Probing container should *not* be restarted with a tcp:8080 liveness probe [NodeConformance] [Conformance]","[sig-storage] Secrets should be consumable in multiple volumes in a pod [NodeConformance] [Conformance]","[sig-storage] ConfigMap should be consumable from pods in volume as non-root [NodeConformance] [Conformance]","[sig-network] DNS should support configurable pod DNS nameservers [Conformance]","[sig-storage] Projected configMap should be consumable in multiple volumes in the same pod [NodeConformance] [Conformance]","[sig-cli] Kubectl client Kubectl logs should be able to retrieve and filter logs [Conformance]","[sig-storage] Projected secret optional updates should be reflected in volume [NodeConformance] [Conformance]"]} [BeforeEach] [k8s.io] [sig-node] PreStop /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 19:49:53.126: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename prestop �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in prestop-4036 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] [sig-node] PreStop /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:157 [It] should call prestop when killing a pod [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: Creating server pod server in namespace prestop-4036 �[1mSTEP�[0m: Waiting for pods to come up. Jan 16 19:54:53.891: FAIL: waiting for server pod to start Unexpected error: <*errors.errorString | 0xc000276200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/node.testPreStop(0x5636c20, 0xc00100f1e0, 0xc002c8f6b0, 0xc) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:60 +0x574 k8s.io/kubernetes/test/e2e/node.glob..func10.2() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:167 +0x4d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002e71980) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc002e71980) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002e71980, 0x4feb9e8) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 �[1mSTEP�[0m: Deleting the server pod [AfterEach] [k8s.io] [sig-node] PreStop /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "prestop-4036". �[1mSTEP�[0m: Found 5 events. Jan 16 19:54:54.025: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for server: { } Scheduled: Successfully assigned prestop-4036/server to 3570k8s000 Jan 16 19:54:54.025: INFO: At 2021-01-16 19:49:56 +0000 UTC - event for server: {kubelet 3570k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 16 19:54:54.025: INFO: At 2021-01-16 19:49:58 +0000 UTC - event for server: {kubelet 3570k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 16 19:54:54.025: INFO: At 2021-01-16 19:49:58 +0000 UTC - event for server: {kubelet 3570k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 16 19:54:54.025: INFO: At 2021-01-16 19:50:04 +0000 UTC - event for server: {kubelet 3570k8s000} Failed: Error: ImagePullBackOff Jan 16 19:54:54.082: INFO: POD NODE PHASE GRACE CONDITIONS Jan 16 19:54:54.082: INFO: Jan 16 19:54:54.194: INFO: Logging node info for node 3570k8s000 Jan 16 19:54:54.253: INFO: Node Info: &Node{ObjectMeta:{3570k8s000 c4a64ddf-2627-4bc1-a73c-749b43ad91bb 19026 0 2021-01-16 18:44:18 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet.exe Update v1 2021-01-16 18:44:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:44:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:51:30 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:51:30 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:51:30 +0000 UTC,LastTransitionTime:2021-01-16 18:44:18 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:51:30 +0000 UTC,LastTransitionTime:2021-01-16 18:44:28 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.65,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s000,SystemUUID:BCF409FD-6D07-43EC-BA5C-5ADE911A5E90,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:54:54.253: INFO: Logging kubelet events for node 3570k8s000 Jan 16 19:54:54.310: INFO: Logging pods the kubelet thinks is on node 3570k8s000 Jan 16 19:54:54.380: INFO: pod-c009431a-4bf1-4717-b897-40a799e5d9bc started at 2021-01-16 19:54:03 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:54.380: INFO: Container windows-container ready: false, restart count 0 Jan 16 19:54:54.380: INFO: annotationupdate003357b8-a5b1-4a2a-a85f-3b6df7bd56ca started at 2021-01-16 19:50:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:54.380: INFO: Container client-container ready: false, restart count 0 Jan 16 19:54:54.380: INFO: downwardapi-volume-117e2e1f-15b3-4b70-81e1-042114e5fd45 started at 2021-01-16 19:53:17 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:54.380: INFO: Container client-container ready: false, restart count 0 Jan 16 19:54:54.380: INFO: server-envvars-72bb33d2-2fa5-46cd-9fcb-7414e12cc81b started at 2021-01-16 19:53:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:54.380: INFO: Container srv ready: false, restart count 0 Jan 16 19:54:54.380: INFO: my-hostname-basic-2b49e6c3-536f-44ce-9019-2621abe6fd33-mf8dp started at 2021-01-16 19:52:03 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:54.380: INFO: Container my-hostname-basic-2b49e6c3-536f-44ce-9019-2621abe6fd33 ready: false, restart count 0 W0116 19:54:54.494702 87657 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:54:54.760: INFO: Latency metrics for node 3570k8s000 Jan 16 19:54:54.760: INFO: Logging node info for node 3570k8s001 Jan 16 19:54:54.817: INFO: Node Info: &Node{ObjectMeta:{3570k8s001 b55d9509-eb5c-47f9-971d-91c9c5dabdc4 18887 0 2021-01-16 18:43:38 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:3570k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-16 18:43:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-16 18:44:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/3570k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:50:50 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:50:50 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:50:50 +0000 UTC,LastTransitionTime:2021-01-16 18:43:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:50:50 +0000 UTC,LastTransitionTime:2021-01-16 18:43:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:3570k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.34,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3570k8s001,SystemUUID:FE07BFE2-234E-4FC5-8C26-252378740721,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:54:54.817: INFO: Logging kubelet events for node 3570k8s001 Jan 16 19:54:54.874: INFO: Logging pods the kubelet thinks is on node 3570k8s001 Jan 16 19:54:54.933: INFO: dns-test-22afc0c3-9e70-4bb7-bad9-ee6e146dbcab started at 2021-01-16 19:45:44 +0000 UTC (0+3 container statuses recorded) Jan 16 19:54:54.933: INFO: Container jessie-querier ready: false, restart count 5 Jan 16 19:54:54.933: INFO: Container querier ready: false, restart count 0 Jan 16 19:54:54.933: INFO: Container webserver ready: false, restart count 0 Jan 16 19:54:54.933: INFO: sample-webhook-deployment-65bfd79dc5-n9q94 started at 2021-01-16 19:52:15 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:54.933: INFO: Container sample-webhook ready: false, restart count 0 W0116 19:54:54.995509 87657 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:54:55.150: INFO: Latency metrics for node 3570k8s001 Jan 16 19:54:55.150: INFO: Logging node info for node k8s-master-35701211-0 Jan 16 19:54:55.206: INFO: Node Info: &Node{ObjectMeta:{k8s-master-35701211-0 a6c414d0-a08d-40d6-ad3e-f0008ffdfe60 19750 0 2021-01-16 18:42:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-e880b607-5827-11eb-a604-8aaa456874f2 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-35701211-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-35701211-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubectl-label Update v1 2021-01-16 18:42:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-01-16 18:42:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet Update v1 2021-01-16 18:43:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-16 18:44:31 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-e880b607-5827-11eb-a604-8aaa456874f2/providers/Microsoft.Compute/virtualMachines/k8s-master-35701211-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-16 19:53:51 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-16 19:53:51 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-16 19:53:51 +0000 UTC,LastTransitionTime:2021-01-16 18:42:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-16 19:53:51 +0000 UTC,LastTransitionTime:2021-01-16 18:42:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-35701211-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bd9fc3d5f4cf4e5186e9d17857a0c218,SystemUUID:9e93070f-5fd2-b948-aa08-1e1eae8eafac,BootID:0f94d926-43db-4a93-8742-d6d96296b9bc,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.108+85663458773416,KubeProxyVersion:v1.21.0-alpha.1.108+85663458773416,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c2b5ac56981da3feceeddf93d03ca6272efaa1b2d11a3fc65b8de7259648973b k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:f07afd58c179d3f2f695abc8b2c6c3a5c163be38f609f54bca502e4202f360c3 k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:46561b4c1b1b25e6359878752a3ac88309ce5a03d42a49a80c752555f9cedc89 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-108-g85663458773],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 16 19:54:55.207: INFO: Logging kubelet events for node k8s-master-35701211-0 Jan 16 19:54:55.264: INFO: Logging pods the kubelet thinks is on node k8s-master-35701211-0 Jan 16 19:54:55.331: INFO: coredns-autoscaler-87b67c5fd-z7t79 started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:55.331: INFO: Container autoscaler ready: true, restart count 0 Jan 16 19:54:55.331: INFO: coredns-6bbfb77cb5-bmhsf started at 2021-01-16 18:42:50 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:55.331: INFO: Container coredns ready: true, restart count 0 Jan 16 19:54:55.331: INFO: blobfuse-flexvol-installer-lhht7 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:55.331: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 16 19:54:55.331: INFO: metrics-server-6c8cc7585b-pzmvf started at 2021-01-16 18:43:00 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:55.331: INFO: Container metrics-server ready: true, restart count 1 Jan 16 19:54:55.331: INFO: kube-controller-manager-k8s-master-35701211-0 started at 2021-01-16 18:41:57 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:55.331: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 16 19:54:55.331: INFO: csi-secrets-store-4jspl started at 2021-01-16 18:43:05 +0000 UTC (0+3 container statuses recorded) Jan 16 19:54:55.331: INFO: Container liveness-probe ready: true, restart count 0 Jan 16 19:54:55.331: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 16 19:54:55.331: INFO: Container secrets-store ready: true, restart count 0 Jan 16 19:54:55.331: INFO: csi-secrets-store-provider-azure-4bvb5 started at 2021-01-16 18:43:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:55.331: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 16 19:54:55.331: INFO: azure-cni-networkmonitor-z4fjk started at 2021-01-16 18:43:05 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:55.331: INFO: Container azure-cnms ready: true, restart count 0 Jan 16 19:54:55.331: INFO: kube-apiserver-k8s-master-35701211-0 started at 2021-01-16 18:41:47 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:55.331: INFO: Container kube-apiserver ready: true, restart count 0 Jan 16 19:54:55.331: INFO: kube-scheduler-k8s-master-35701211-0 started at 2021-01-16 18:42:07 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:55.331: INFO: Container kube-scheduler ready: true, restart count 0 Jan 16 19:54:55.331: INFO: kube-addon-manager-k8s-master-35701211-0 started at 2021-01-16 18:42:41 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:55.331: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 16 19:54:55.331: INFO: azure-ip-masq-agent-tsz8k started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:55.331: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 16 19:54:55.331: INFO: kube-proxy-p55w5 started at 2021-01-16 18:42:59 +0000 UTC (0+1 container statuses recorded) Jan 16 19:54:55.331: INFO: Container kube-proxy ready: true, restart count 0 W0116 19:54:55.393176 87657 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 16 19:54:55.618: INFO: Latency metrics for node k8s-master-35701211-0 Jan 16 19:54:55.618: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "prestop-4036" for this suite.
Find to mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\slisting\smutating\swebhooks\sshould\swork\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:86 Jan 16 20:05:21.178: waiting for the deployment status valid%!(EXTRA string=k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26, string=sample-webhook-deployment, string=webhook-7578) Unexpected error: <*errors.errorString | 0xc0034119d0>: { s: "error waiting for deployment \"sample-webhook-deployment\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"False\", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, Reason:\"MinimumReplicasUnavailable\", Message:\"Deployment does not have minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"sample-webhook-deployment-65bfd79dc5\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}", } error waiting for deployment "sample-webhook-deployment" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-65bfd79dc5\" is progressing."}}, CollisionCount:(*int32)(nil)} occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:845
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 16 20:00:19.046: INFO: >>> kubeConfig: /root/tmp526046122/kubeconfig/kubeconfig.westus2.json �[1mSTEP�[0m: Building a namespace api object, basename webhook �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in webhook-7578 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:86 �[1mSTEP�[0m: Setting up server cert �[1mSTEP�[0m: Create role binding to let webhook read extension-apiserver-authentication �[1mSTEP�[0m: Deploying the webhook pod �[1mSTEP�[0m: Wait for the deployment to be ready Jan 16 20:00:21.075: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-65bfd79dc5\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 16 20:00:23.127: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-65bfd79dc5\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 16 20:00:25.127: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-65bfd79dc5\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 16 20:00:27.127: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-65bfd79dc5\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 16 20:00:29.127: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-65bfd79dc5\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 16 20:00:31.127: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-65bfd79dc5\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 16 20:00:33.127: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63746424020, loc:(*time.Location)(0x79c5580)}}, LastTransitionTime:v1.Time