Recent runs || View in Spyglass
Result | FAILURE |
Tests | 115 failed / 178 succeeded |
Started | |
Elapsed | 1h56m |
Revision | master |
job-version | v1.21.0-alpha.1.114+d72c056260e771 |
revision | v1.21.0-alpha.1.114+d72c056260e771 |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\spoststart\sexec\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:52 Jan 18 03:08:55.853: Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103from junit_07.xml
[BeforeEach] [k8s.io] Container Lifecycle Hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 03:03:55.336: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename container-lifecycle-hook �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-lifecycle-hook-7437 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] when create a pod with lifecycle hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:52 �[1mSTEP�[0m: create the container to handle the HTTPGet hook request. Jan 18 03:08:55.853: FAIL: Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc002404dc0, 0xc000180c00, 0x0) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func15.1.1() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:55 +0xb3 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002217080) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc002217080) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002217080, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Container Lifecycle Hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-lifecycle-hook-7437". �[1mSTEP�[0m: Found 5 events. Jan 18 03:08:55.893: INFO: At 2021-01-18 03:03:55 +0000 UTC - event for pod-handle-http-request: {default-scheduler } Scheduled: Successfully assigned container-lifecycle-hook-7437/pod-handle-http-request to 1168k8s000 Jan 18 03:08:55.893: INFO: At 2021-01-18 03:03:58 +0000 UTC - event for pod-handle-http-request: {kubelet 1168k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 03:08:55.893: INFO: At 2021-01-18 03:03:59 +0000 UTC - event for pod-handle-http-request: {kubelet 1168k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 03:08:55.893: INFO: At 2021-01-18 03:04:03 +0000 UTC - event for pod-handle-http-request: {kubelet 1168k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 18 03:08:55.893: INFO: At 2021-01-18 03:04:13 +0000 UTC - event for pod-handle-http-request: {kubelet 1168k8s000} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 03:08:55.931: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 03:08:55.931: INFO: pod-handle-http-request 1168k8s000 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:03:55 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:03:55 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:03:55 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:03:55 +0000 UTC }] Jan 18 03:08:55.931: INFO: Jan 18 03:08:56.003: INFO: Logging node info for node 1168k8s000 Jan 18 03:08:56.039: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 8001 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:05:19 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:05:19 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:05:19 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:05:19 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:08:56.040: INFO: Logging kubelet events for node 1168k8s000 Jan 18 03:08:56.078: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 03:08:56.182: INFO: pod-handle-http-request started at 2021-01-18 03:03:55 +0000 UTC (0+1 container statuses recorded) Jan 18 03:08:56.182: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 03:08:56.182: INFO: dns-test-ed5e90a5-688f-4640-a528-4c8cd0fa5da9 started at 2021-01-18 03:07:22 +0000 UTC (0+3 container statuses recorded) Jan 18 03:08:56.182: INFO: Container jessie-querier ready: false, restart count 1 Jan 18 03:08:56.182: INFO: Container querier ready: false, restart count 0 Jan 18 03:08:56.182: INFO: Container webserver ready: false, restart count 0 Jan 18 03:08:56.182: INFO: dns-test-518e46aa-c9a9-4719-b58e-770160c87a4e started at 2021-01-18 03:05:01 +0000 UTC (0+3 container statuses recorded) Jan 18 03:08:56.182: INFO: Container jessie-querier ready: true, restart count 0 Jan 18 03:08:56.182: INFO: Container querier ready: false, restart count 0 Jan 18 03:08:56.182: INFO: Container webserver ready: false, restart count 0 Jan 18 03:08:56.182: INFO: pod-secrets-611467e7-f141-49e4-b84f-0afdf9d90bc8 started at 2021-01-18 03:04:05 +0000 UTC (0+1 container statuses recorded) Jan 18 03:08:56.182: INFO: Container secret-volume-test ready: false, restart count 0 Jan 18 03:08:56.182: INFO: externalname-service-5bxcc started at 2021-01-18 03:04:27 +0000 UTC (0+1 container statuses recorded) Jan 18 03:08:56.182: INFO: Container externalname-service ready: false, restart count 0 W0118 03:08:56.255476 40167 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:08:56.672: INFO: Latency metrics for node 1168k8s000 Jan 18 03:08:56.672: INFO: Logging node info for node 1168k8s001 Jan 18 03:08:56.709: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 8565 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:08:50 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:08:50 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:08:50 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:08:50 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:08:56.709: INFO: Logging kubelet events for node 1168k8s001 Jan 18 03:08:56.749: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 03:08:56.849: INFO: externalname-service-khlmd started at 2021-01-18 03:04:27 +0000 UTC (0+1 container statuses recorded) Jan 18 03:08:56.849: INFO: Container externalname-service ready: false, restart count 0 Jan 18 03:08:56.849: INFO: pod-projected-secrets-7cc3b52b-f70a-4538-8933-239b05c32119 started at 2021-01-18 03:05:01 +0000 UTC (0+3 container statuses recorded) Jan 18 03:08:56.849: INFO: Container creates-volume-test ready: false, restart count 0 Jan 18 03:08:56.849: INFO: Container dels-volume-test ready: false, restart count 0 Jan 18 03:08:56.849: INFO: Container upds-volume-test ready: false, restart count 0 Jan 18 03:08:56.849: INFO: my-hostname-basic-4a609e8d-385b-41b6-8c60-2f11a2c6e300-pmrrr started at 2021-01-18 03:04:09 +0000 UTC (0+1 container statuses recorded) Jan 18 03:08:56.849: INFO: Container my-hostname-basic-4a609e8d-385b-41b6-8c60-2f11a2c6e300 ready: false, restart count 0 W0118 03:08:56.923240 40167 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:08:57.052: INFO: Latency metrics for node 1168k8s001 Jan 18 03:08:57.052: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 03:08:57.089: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 7626 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:04:20 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:04:20 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:04:20 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:04:20 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:08:57.090: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 03:08:57.129: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 03:08:57.223: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 03:08:57.223: INFO: Container liveness-probe ready: true, restart count 0 Jan 18 03:08:57.223: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 18 03:08:57.223: INFO: Container secrets-store ready: true, restart count 0 Jan 18 03:08:57.224: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:08:57.224: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 18 03:08:57.224: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:08:57.224: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 03:08:57.224: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 03:08:57.224: INFO: Container kube-apiserver ready: true, restart count 0 Jan 18 03:08:57.224: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:08:57.224: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 18 03:08:57.224: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:08:57.224: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 03:08:57.224: INFO: metrics-server-6c8cc7585b-f7l2w started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:08:57.224: INFO: Container metrics-server ready: true, restart count 0 Jan 18 03:08:57.224: INFO: csi-secrets-store-provider-azure-4dnqk started at 2021-01-18 02:38:54 +0000 UTC (0+1 container statuses recorded) Jan 18 03:08:57.224: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 18 03:08:57.224: INFO: kube-addon-manager-k8s-master-11684159-0 started at 2021-01-18 02:38:21 +0000 UTC (0+1 container statuses recorded) Jan 18 03:08:57.224: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 18 03:08:57.224: INFO: coredns-autoscaler-87b67c5fd-7jfwj started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:08:57.224: INFO: Container autoscaler ready: true, restart count 0 Jan 18 03:08:57.224: INFO: coredns-6bbfb77cb5-4gfdd started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:08:57.224: INFO: Container coredns ready: true, restart count 0 Jan 18 03:08:57.224: INFO: blobfuse-flexvol-installer-dvjv8 started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:08:57.224: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 18 03:08:57.224: INFO: kube-proxy-r9btf started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:08:57.224: INFO: Container kube-proxy ready: true, restart count 0 W0118 03:08:57.264101 40167 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:08:57.456: INFO: Latency metrics for node k8s-master-11684159-0 Jan 18 03:08:57.456: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-lifecycle-hook-7437" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\spoststart\shttp\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:52 Jan 18 04:11:45.277: Unexpected error: <*errors.errorString | 0xc0002f01f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103from junit_01.xml
[BeforeEach] [k8s.io] Container Lifecycle Hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 04:06:44.766: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename container-lifecycle-hook �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-lifecycle-hook-142 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] when create a pod with lifecycle hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:52 �[1mSTEP�[0m: create the container to handle the HTTPGet hook request. Jan 18 04:11:45.277: FAIL: Unexpected error: <*errors.errorString | 0xc0002f01f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc004663620, 0xc000100800, 0x0) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func15.1.1() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:55 +0xb3 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002dfbb00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc002dfbb00) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002dfbb00, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Container Lifecycle Hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-lifecycle-hook-142". �[1mSTEP�[0m: Found 4 events. Jan 18 04:11:45.313: INFO: At 2021-01-18 04:06:45 +0000 UTC - event for pod-handle-http-request: {default-scheduler } Scheduled: Successfully assigned container-lifecycle-hook-142/pod-handle-http-request to 1168k8s000 Jan 18 04:11:45.314: INFO: At 2021-01-18 04:06:48 +0000 UTC - event for pod-handle-http-request: {kubelet 1168k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 04:11:45.314: INFO: At 2021-01-18 04:06:48 +0000 UTC - event for pod-handle-http-request: {kubelet 1168k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 04:11:45.314: INFO: At 2021-01-18 04:06:49 +0000 UTC - event for pod-handle-http-request: {kubelet 1168k8s000} Failed: Error: ImagePullBackOff Jan 18 04:11:45.349: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 04:11:45.349: INFO: pod-handle-http-request 1168k8s000 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 04:06:45 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 04:06:45 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 04:06:45 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 04:06:45 +0000 UTC }] Jan 18 04:11:45.349: INFO: Jan 18 04:11:45.418: INFO: Logging node info for node 1168k8s000 Jan 18 04:11:45.454: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 25749 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 04:08:02 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 04:08:02 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 04:08:02 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 04:08:02 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 04:11:45.454: INFO: Logging kubelet events for node 1168k8s000 Jan 18 04:11:45.490: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 04:11:45.535: INFO: pod-back-off-image started at 2021-01-18 04:07:40 +0000 UTC (0+1 container statuses recorded) Jan 18 04:11:45.535: INFO: Container back-off ready: false, restart count 7 Jan 18 04:11:45.535: INFO: nodeport-test-q54gr started at 2021-01-18 04:06:51 +0000 UTC (0+1 container statuses recorded) Jan 18 04:11:45.535: INFO: Container nodeport-test ready: false, restart count 0 Jan 18 04:11:45.535: INFO: pod-handle-http-request started at 2021-01-18 04:06:45 +0000 UTC (0+1 container statuses recorded) Jan 18 04:11:45.535: INFO: Container agnhost-container ready: false, restart count 0 W0118 04:11:45.608618 40156 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 04:11:45.731: INFO: Latency metrics for node 1168k8s000 Jan 18 04:11:45.731: INFO: Logging node info for node 1168k8s001 Jan 18 04:11:45.767: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 26336 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 04:11:04 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 04:11:04 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 04:11:04 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 04:11:04 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 04:11:45.767: INFO: Logging kubelet events for node 1168k8s001 Jan 18 04:11:45.803: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 04:11:45.845: INFO: pod-secrets-5ef841c1-7d90-4098-ae34-78a5bb562821 started at 2021-01-18 04:08:19 +0000 UTC (0+3 container statuses recorded) Jan 18 04:11:45.845: INFO: Container creates-volume-test ready: false, restart count 0 Jan 18 04:11:45.845: INFO: Container dels-volume-test ready: false, restart count 0 Jan 18 04:11:45.845: INFO: Container upds-volume-test ready: false, restart count 0 Jan 18 04:11:45.845: INFO: nodeport-test-rsrrg started at 2021-01-18 04:06:51 +0000 UTC (0+1 container statuses recorded) Jan 18 04:11:45.845: INFO: Container nodeport-test ready: false, restart count 0 W0118 04:11:45.884528 40156 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 04:11:45.996: INFO: Latency metrics for node 1168k8s001 Jan 18 04:11:45.996: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 04:11:46.032: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 26172 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 04:09:44 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 04:09:44 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 04:09:44 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 04:09:44 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 04:11:46.033: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 04:11:46.068: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 04:11:46.111: INFO: metrics-server-6c8cc7585b-f7l2w started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:11:46.111: INFO: Container metrics-server ready: true, restart count 0 Jan 18 04:11:46.111: INFO: csi-secrets-store-provider-azure-4dnqk started at 2021-01-18 02:38:54 +0000 UTC (0+1 container statuses recorded) Jan 18 04:11:46.111: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 18 04:11:46.111: INFO: kube-addon-manager-k8s-master-11684159-0 started at 2021-01-18 02:38:21 +0000 UTC (0+1 container statuses recorded) Jan 18 04:11:46.111: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 18 04:11:46.111: INFO: coredns-autoscaler-87b67c5fd-7jfwj started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 04:11:46.111: INFO: Container autoscaler ready: true, restart count 0 Jan 18 04:11:46.111: INFO: blobfuse-flexvol-installer-dvjv8 started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:11:46.111: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 18 04:11:46.111: INFO: kube-proxy-r9btf started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:11:46.111: INFO: Container kube-proxy ready: true, restart count 0 Jan 18 04:11:46.111: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 04:11:46.111: INFO: Container kube-apiserver ready: true, restart count 0 Jan 18 04:11:46.111: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:11:46.111: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 18 04:11:46.111: INFO: coredns-6bbfb77cb5-4gfdd started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 04:11:46.111: INFO: Container coredns ready: true, restart count 0 Jan 18 04:11:46.111: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:11:46.111: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 18 04:11:46.111: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 04:11:46.111: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 04:11:46.111: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 04:11:46.111: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 04:11:46.111: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 04:11:46.111: INFO: Container liveness-probe ready: true, restart count 0 Jan 18 04:11:46.111: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 18 04:11:46.111: INFO: Container secrets-store ready: true, restart count 0 W0118 04:11:46.153783 40156 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 04:11:46.374: INFO: Latency metrics for node k8s-master-11684159-0 Jan 18 04:11:46.374: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-lifecycle-hook-142" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\sprestop\sexec\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:52 Jan 18 02:56:52.879: Unexpected error: <*errors.errorString | 0xc000115e10>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103from junit_06.xml
[BeforeEach] [k8s.io] Container Lifecycle Hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 02:51:52.342: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename container-lifecycle-hook �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-lifecycle-hook-6759 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] when create a pod with lifecycle hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:52 �[1mSTEP�[0m: create the container to handle the HTTPGet hook request. Jan 18 02:56:52.879: FAIL: Unexpected error: <*errors.errorString | 0xc000115e10>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc0043e7700, 0xc000182c00, 0x0) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func15.1.1() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:55 +0xb3 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002377200) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc002377200) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002377200, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Container Lifecycle Hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-lifecycle-hook-6759". �[1mSTEP�[0m: Found 5 events. Jan 18 02:56:52.918: INFO: At 2021-01-18 02:51:52 +0000 UTC - event for pod-handle-http-request: {default-scheduler } Scheduled: Successfully assigned container-lifecycle-hook-6759/pod-handle-http-request to 1168k8s000 Jan 18 02:56:52.918: INFO: At 2021-01-18 02:51:56 +0000 UTC - event for pod-handle-http-request: {kubelet 1168k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 02:56:52.918: INFO: At 2021-01-18 02:51:57 +0000 UTC - event for pod-handle-http-request: {kubelet 1168k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 02:56:52.918: INFO: At 2021-01-18 02:51:58 +0000 UTC - event for pod-handle-http-request: {kubelet 1168k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 18 02:56:52.918: INFO: At 2021-01-18 02:52:01 +0000 UTC - event for pod-handle-http-request: {kubelet 1168k8s000} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 02:56:52.956: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 02:56:52.956: INFO: pod-handle-http-request 1168k8s000 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 02:51:52 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 02:51:52 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 02:51:52 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 02:51:52 +0000 UTC }] Jan 18 02:56:52.956: INFO: Jan 18 02:56:53.030: INFO: Logging node info for node 1168k8s000 Jan 18 02:56:53.068: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 4591 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 02:53:47 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 02:53:47 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 02:53:47 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 02:53:47 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 02:56:53.069: INFO: Logging kubelet events for node 1168k8s000 Jan 18 02:56:53.107: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 02:56:53.149: INFO: pod-projected-configmaps-a2230d72-158a-4f01-9862-92a3435edff7 started at 2021-01-18 02:53:54 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:53.149: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 02:56:53.149: INFO: pod-handle-http-request started at 2021-01-18 02:51:52 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:53.149: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 02:56:53.149: INFO: sample-webhook-deployment-65bfd79dc5-9qjbh started at 2021-01-18 02:53:08 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:53.149: INFO: Container sample-webhook ready: false, restart count 0 Jan 18 02:56:53.149: INFO: ss2-0 started at 2021-01-18 02:56:47 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:53.149: INFO: Container webserver ready: false, restart count 0 W0118 02:56:53.226954 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 02:56:53.510: INFO: Latency metrics for node 1168k8s000 Jan 18 02:56:53.510: INFO: Logging node info for node 1168k8s001 Jan 18 02:56:53.548: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 4522 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 02:53:19 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 02:53:19 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 02:53:19 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 02:53:19 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 02:56:53.549: INFO: Logging kubelet events for node 1168k8s001 Jan 18 02:56:53.623: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 02:56:53.664: INFO: my-hostname-basic-32cf8f01-0bc1-4d92-99d8-15f8e9e97c9f-6kts6 started at 2021-01-18 02:55:54 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:53.664: INFO: Container my-hostname-basic-32cf8f01-0bc1-4d92-99d8-15f8e9e97c9f ready: false, restart count 0 Jan 18 02:56:53.664: INFO: downwardapi-volume-f3ee7a39-20e1-44d0-9bae-10beaccb11d4 started at 2021-01-18 02:56:51 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:53.664: INFO: Container client-container ready: false, restart count 0 Jan 18 02:56:53.664: INFO: sample-webhook-deployment-65bfd79dc5-f59d4 started at 2021-01-18 02:52:42 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:53.664: INFO: Container sample-webhook ready: false, restart count 0 Jan 18 02:56:53.664: INFO: ss2-1 started at 2021-01-18 02:56:05 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:53.664: INFO: Container webserver ready: true, restart count 0 W0118 02:56:53.716615 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 02:56:54.013: INFO: Latency metrics for node 1168k8s001 Jan 18 02:56:54.013: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 02:56:54.054: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 4703 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 02:54:17 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 02:54:17 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 02:54:17 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 02:54:17 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 02:56:54.055: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 02:56:54.095: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 02:56:54.182: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:54.182: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 02:56:54.182: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:54.182: INFO: Container kube-apiserver ready: true, restart count 0 Jan 18 02:56:54.182: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:54.182: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 18 02:56:54.182: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:54.182: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 02:56:54.182: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 02:56:54.182: INFO: Container liveness-probe ready: true, restart count 0 Jan 18 02:56:54.182: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 18 02:56:54.182: INFO: Container secrets-store ready: true, restart count 0 Jan 18 02:56:54.182: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:54.182: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 18 02:56:54.182: INFO: coredns-autoscaler-87b67c5fd-7jfwj started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:54.182: INFO: Container autoscaler ready: true, restart count 0 Jan 18 02:56:54.182: INFO: coredns-6bbfb77cb5-4gfdd started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:54.182: INFO: Container coredns ready: true, restart count 0 Jan 18 02:56:54.182: INFO: blobfuse-flexvol-installer-dvjv8 started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:54.182: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 18 02:56:54.182: INFO: kube-proxy-r9btf started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:54.182: INFO: Container kube-proxy ready: true, restart count 0 Jan 18 02:56:54.182: INFO: metrics-server-6c8cc7585b-f7l2w started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:54.182: INFO: Container metrics-server ready: true, restart count 0 Jan 18 02:56:54.182: INFO: csi-secrets-store-provider-azure-4dnqk started at 2021-01-18 02:38:54 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:54.182: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 18 02:56:54.182: INFO: kube-addon-manager-k8s-master-11684159-0 started at 2021-01-18 02:38:21 +0000 UTC (0+1 container statuses recorded) Jan 18 02:56:54.182: INFO: Container kube-addon-manager ready: true, restart count 0 W0118 02:56:54.224593 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 02:56:54.380: INFO: Latency metrics for node k8s-master-11684159-0 Jan 18 02:56:54.380: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-lifecycle-hook-6759" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\sprestop\shttp\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:52 Jan 18 03:40:34.715: Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103from junit_07.xml
[BeforeEach] [k8s.io] Container Lifecycle Hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 03:35:34.215: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename container-lifecycle-hook �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-lifecycle-hook-5435 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] when create a pod with lifecycle hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:52 �[1mSTEP�[0m: create the container to handle the HTTPGet hook request. Jan 18 03:40:34.715: FAIL: Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc004383c60, 0xc000180c00, 0x0) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func15.1.1() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:55 +0xb3 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002217080) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc002217080) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002217080, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Container Lifecycle Hook /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-lifecycle-hook-5435". �[1mSTEP�[0m: Found 4 events. Jan 18 03:40:34.749: INFO: At 2021-01-18 03:35:34 +0000 UTC - event for pod-handle-http-request: {default-scheduler } Scheduled: Successfully assigned container-lifecycle-hook-5435/pod-handle-http-request to 1168k8s000 Jan 18 03:40:34.749: INFO: At 2021-01-18 03:35:38 +0000 UTC - event for pod-handle-http-request: {kubelet 1168k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 03:40:34.749: INFO: At 2021-01-18 03:35:39 +0000 UTC - event for pod-handle-http-request: {kubelet 1168k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 03:40:34.749: INFO: At 2021-01-18 03:35:40 +0000 UTC - event for pod-handle-http-request: {kubelet 1168k8s000} Failed: Error: ImagePullBackOff Jan 18 03:40:34.782: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 03:40:34.782: INFO: pod-handle-http-request 1168k8s000 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:35:34 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:35:34 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:35:34 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:35:34 +0000 UTC }] Jan 18 03:40:34.782: INFO: Jan 18 03:40:34.845: INFO: Logging node info for node 1168k8s000 Jan 18 03:40:34.878: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 15812 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:37:52 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:37:52 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:37:52 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:37:52 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:40:34.878: INFO: Logging kubelet events for node 1168k8s000 Jan 18 03:40:34.912: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 03:40:34.951: INFO: labelsupdate8b208d87-4a46-443a-b4f2-09dbafe2d63d started at 2021-01-18 03:37:45 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:34.951: INFO: Container client-container ready: false, restart count 0 Jan 18 03:40:34.951: INFO: back-off-cap started at 2021-01-18 03:19:11 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:34.951: INFO: Container back-off-cap ready: false, restart count 8 Jan 18 03:40:34.951: INFO: dns-test-882943de-919d-4b87-a069-29edefe7434d started at 2021-01-18 03:32:26 +0000 UTC (0+3 container statuses recorded) Jan 18 03:40:34.951: INFO: Container jessie-querier ready: true, restart count 0 Jan 18 03:40:34.951: INFO: Container querier ready: false, restart count 0 Jan 18 03:40:34.951: INFO: Container webserver ready: false, restart count 0 Jan 18 03:40:34.951: INFO: pod-handle-http-request started at 2021-01-18 03:35:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:34.951: INFO: Container agnhost-container ready: false, restart count 0 W0118 03:40:35.018196 40167 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:40:35.202: INFO: Latency metrics for node 1168k8s000 Jan 18 03:40:35.202: INFO: Logging node info for node 1168k8s001 Jan 18 03:40:35.235: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 16078 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:39:02 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:39:02 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:39:02 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:39:02 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:40:35.236: INFO: Logging kubelet events for node 1168k8s001 Jan 18 03:40:35.268: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 03:40:35.304: INFO: downwardapi-volume-a83a1145-bdd2-40bf-801b-d5e0853306fb started at 2021-01-18 03:36:21 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:35.304: INFO: Container client-container ready: false, restart count 0 Jan 18 03:40:35.304: INFO: pod-projected-secrets-2b1ce0d6-6a1c-4811-8f0d-6899f7becc34 started at 2021-01-18 03:38:46 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:35.304: INFO: Container projected-secret-volume-test ready: false, restart count 0 Jan 18 03:40:35.304: INFO: pod-configmaps-693ce35a-0b59-4c6c-bc87-6aba2b16f125 started at 2021-01-18 03:37:54 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:35.304: INFO: Container agnhost-container ready: false, restart count 0 W0118 03:40:35.347016 40167 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:40:35.456: INFO: Latency metrics for node 1168k8s001 Jan 18 03:40:35.456: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 03:40:35.493: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 16137 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:39:32 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:39:32 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:39:32 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:39:32 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:40:35.494: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 03:40:35.526: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 03:40:35.586: INFO: blobfuse-flexvol-installer-dvjv8 started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:35.586: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 18 03:40:35.586: INFO: kube-proxy-r9btf started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:35.586: INFO: Container kube-proxy ready: true, restart count 0 Jan 18 03:40:35.586: INFO: metrics-server-6c8cc7585b-f7l2w started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:35.586: INFO: Container metrics-server ready: true, restart count 0 Jan 18 03:40:35.586: INFO: csi-secrets-store-provider-azure-4dnqk started at 2021-01-18 02:38:54 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:35.586: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 18 03:40:35.586: INFO: kube-addon-manager-k8s-master-11684159-0 started at 2021-01-18 02:38:21 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:35.586: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 18 03:40:35.586: INFO: coredns-autoscaler-87b67c5fd-7jfwj started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:35.586: INFO: Container autoscaler ready: true, restart count 0 Jan 18 03:40:35.586: INFO: coredns-6bbfb77cb5-4gfdd started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:35.586: INFO: Container coredns ready: true, restart count 0 Jan 18 03:40:35.586: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:35.586: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 18 03:40:35.586: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:35.586: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 03:40:35.586: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 03:40:35.586: INFO: Container liveness-probe ready: true, restart count 0 Jan 18 03:40:35.586: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 18 03:40:35.586: INFO: Container secrets-store ready: true, restart count 0 Jan 18 03:40:35.586: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:35.586: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 18 03:40:35.586: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:35.586: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 03:40:35.586: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 03:40:35.586: INFO: Container kube-apiserver ready: true, restart count 0 W0118 03:40:35.627904 40167 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:40:35.919: INFO: Latency metrics for node k8s-master-11684159-0 Jan 18 03:40:35.919: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-lifecycle-hook-5435" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sContainer\sRuntime\sblackbox\stest\swhen\srunning\sa\scontainer\swith\sa\snew\simage\sshould\sbe\sable\sto\spull\simage\s\[NodeConformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:382 Jan 18 03:37:49.383: All 3 attempts failed: expected container state: Running, got: "Waiting" /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:385from junit_05.xml
[BeforeEach] [k8s.io] Container Runtime /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 03:22:48.175: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename container-runtime �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-runtime-4792 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should be able to pull image [NodeConformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:382 �[1mSTEP�[0m: create the container �[1mSTEP�[0m: check the container status �[1mSTEP�[0m: delete the container Jan 18 03:27:48.716: INFO: No.1 attempt failed: expected container state: Running, got: "Waiting", retrying... �[1mSTEP�[0m: create the container �[1mSTEP�[0m: check the container status �[1mSTEP�[0m: delete the container Jan 18 03:32:49.052: INFO: No.2 attempt failed: expected container state: Running, got: "Waiting", retrying... �[1mSTEP�[0m: create the container �[1mSTEP�[0m: check the container status �[1mSTEP�[0m: delete the container Jan 18 03:37:49.382: FAIL: All 3 attempts failed: expected container state: Running, got: "Waiting" Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func25.1.3.3() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:385 +0x1b4 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00221b380) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc00221b380) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc00221b380, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Container Runtime /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-runtime-4792". �[1mSTEP�[0m: Found 12 events. Jan 18 03:37:49.421: INFO: At 2021-01-18 03:22:48 +0000 UTC - event for image-pull-testf6f2402a-5fce-4b46-b2bf-edc825bb9dfa: {default-scheduler } Scheduled: Successfully assigned container-runtime-4792/image-pull-testf6f2402a-5fce-4b46-b2bf-edc825bb9dfa to 1168k8s000 Jan 18 03:37:49.421: INFO: At 2021-01-18 03:22:52 +0000 UTC - event for image-pull-testf6f2402a-5fce-4b46-b2bf-edc825bb9dfa: {kubelet 1168k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 03:37:49.421: INFO: At 2021-01-18 03:22:52 +0000 UTC - event for image-pull-testf6f2402a-5fce-4b46-b2bf-edc825bb9dfa: {kubelet 1168k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 03:37:49.421: INFO: At 2021-01-18 03:22:53 +0000 UTC - event for image-pull-testf6f2402a-5fce-4b46-b2bf-edc825bb9dfa: {kubelet 1168k8s000} Failed: Error: ImagePullBackOff Jan 18 03:37:49.421: INFO: At 2021-01-18 03:27:48 +0000 UTC - event for image-pull-test008adb58-8741-4046-ad2c-f1aa49578790: {default-scheduler } Scheduled: Successfully assigned container-runtime-4792/image-pull-test008adb58-8741-4046-ad2c-f1aa49578790 to 1168k8s001 Jan 18 03:37:49.421: INFO: At 2021-01-18 03:27:51 +0000 UTC - event for image-pull-test008adb58-8741-4046-ad2c-f1aa49578790: {kubelet 1168k8s001} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 03:37:49.421: INFO: At 2021-01-18 03:27:52 +0000 UTC - event for image-pull-test008adb58-8741-4046-ad2c-f1aa49578790: {kubelet 1168k8s001} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 03:37:49.421: INFO: At 2021-01-18 03:27:53 +0000 UTC - event for image-pull-test008adb58-8741-4046-ad2c-f1aa49578790: {kubelet 1168k8s001} Failed: Error: ImagePullBackOff Jan 18 03:37:49.421: INFO: At 2021-01-18 03:32:49 +0000 UTC - event for image-pull-test8c2fc96f-28ed-4f4d-9877-5e2dd7129ef8: {default-scheduler } Scheduled: Successfully assigned container-runtime-4792/image-pull-test8c2fc96f-28ed-4f4d-9877-5e2dd7129ef8 to 1168k8s001 Jan 18 03:37:49.421: INFO: At 2021-01-18 03:32:51 +0000 UTC - event for image-pull-test8c2fc96f-28ed-4f4d-9877-5e2dd7129ef8: {kubelet 1168k8s001} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 03:37:49.421: INFO: At 2021-01-18 03:32:52 +0000 UTC - event for image-pull-test8c2fc96f-28ed-4f4d-9877-5e2dd7129ef8: {kubelet 1168k8s001} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 03:37:49.421: INFO: At 2021-01-18 03:32:53 +0000 UTC - event for image-pull-test8c2fc96f-28ed-4f4d-9877-5e2dd7129ef8: {kubelet 1168k8s001} Failed: Error: ImagePullBackOff Jan 18 03:37:49.458: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 03:37:49.458: INFO: Jan 18 03:37:49.529: INFO: Logging node info for node 1168k8s000 Jan 18 03:37:49.566: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 14860 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:33:00 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:33:00 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:33:00 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:33:00 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:37:49.567: INFO: Logging kubelet events for node 1168k8s000 Jan 18 03:37:49.609: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 03:37:49.653: INFO: dns-test-882943de-919d-4b87-a069-29edefe7434d started at 2021-01-18 03:32:26 +0000 UTC (0+3 container statuses recorded) Jan 18 03:37:49.653: INFO: Container jessie-querier ready: true, restart count 0 Jan 18 03:37:49.653: INFO: Container querier ready: false, restart count 0 Jan 18 03:37:49.653: INFO: Container webserver ready: false, restart count 0 Jan 18 03:37:49.653: INFO: pod-handle-http-request started at 2021-01-18 03:35:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:49.653: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 03:37:49.653: INFO: pod-service-account-defaultsa-mountspec started at 2021-01-18 03:37:44 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:49.653: INFO: Container token-test ready: false, restart count 0 Jan 18 03:37:49.653: INFO: pod-service-account-nomountsa-mountspec started at 2021-01-18 03:37:44 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:49.653: INFO: Container token-test ready: false, restart count 0 Jan 18 03:37:49.653: INFO: proxy-service-l58rk-6c2dn started at 2021-01-18 03:35:21 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:49.653: INFO: Container proxy-service-l58rk ready: false, restart count 0 Jan 18 03:37:49.653: INFO: pod-service-account-defaultsa started at 2021-01-18 03:37:44 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:49.653: INFO: Container token-test ready: false, restart count 0 Jan 18 03:37:49.653: INFO: pod-service-account-mountsa started at 2021-01-18 03:37:44 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:49.653: INFO: Container token-test ready: false, restart count 0 Jan 18 03:37:49.653: INFO: rc-test-fjvkc started at 2021-01-18 03:37:20 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:49.653: INFO: Container rc-test ready: true, restart count 0 Jan 18 03:37:49.653: INFO: pod-service-account-mountsa-nomountspec started at 2021-01-18 03:37:44 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:49.653: INFO: Container token-test ready: false, restart count 0 Jan 18 03:37:49.653: INFO: labelsupdate8b208d87-4a46-443a-b4f2-09dbafe2d63d started at 2021-01-18 03:37:45 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:49.653: INFO: Container client-container ready: false, restart count 0 Jan 18 03:37:49.653: INFO: back-off-cap started at 2021-01-18 03:19:11 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:49.653: INFO: Container back-off-cap ready: false, restart count 8 W0118 03:37:49.695886 40164 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:37:51.601: INFO: Latency metrics for node 1168k8s000 Jan 18 03:37:51.602: INFO: Logging node info for node 1168k8s001 Jan 18 03:37:51.638: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 15019 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:34:00 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:34:00 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:34:00 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:34:00 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:37:51.639: INFO: Logging kubelet events for node 1168k8s001 Jan 18 03:37:51.677: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 03:37:51.717: INFO: rc-test-hhnz8 started at 2021-01-18 03:37:27 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:51.717: INFO: Container rc-test ready: true, restart count 0 Jan 18 03:37:51.717: INFO: pod-service-account-mountsa-mountspec started at 2021-01-18 03:37:44 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:51.717: INFO: Container token-test ready: false, restart count 0 Jan 18 03:37:51.717: INFO: downwardapi-volume-7b533965-03aa-4f05-816e-700989413dc8 started at 2021-01-18 03:33:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:51.717: INFO: Container client-container ready: false, restart count 0 Jan 18 03:37:51.717: INFO: downwardapi-volume-a83a1145-bdd2-40bf-801b-d5e0853306fb started at 2021-01-18 03:36:21 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:51.717: INFO: Container client-container ready: false, restart count 0 W0118 03:37:51.792087 40164 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:37:51.993: INFO: Latency metrics for node 1168k8s001 Jan 18 03:37:51.993: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 03:37:52.029: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 15085 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:34:30 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:34:30 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:34:30 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:34:30 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:37:52.030: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 03:37:52.068: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 03:37:52.112: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:52.112: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 18 03:37:52.112: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:52.112: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 03:37:52.112: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:52.112: INFO: Container kube-apiserver ready: true, restart count 0 Jan 18 03:37:52.112: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:52.112: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 18 03:37:52.112: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:52.112: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 03:37:52.112: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 03:37:52.112: INFO: Container liveness-probe ready: true, restart count 0 Jan 18 03:37:52.112: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 18 03:37:52.112: INFO: Container secrets-store ready: true, restart count 0 Jan 18 03:37:52.113: INFO: kube-addon-manager-k8s-master-11684159-0 started at 2021-01-18 02:38:21 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:52.113: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 18 03:37:52.113: INFO: coredns-autoscaler-87b67c5fd-7jfwj started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:52.113: INFO: Container autoscaler ready: true, restart count 0 Jan 18 03:37:52.113: INFO: coredns-6bbfb77cb5-4gfdd started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:52.113: INFO: Container coredns ready: true, restart count 0 Jan 18 03:37:52.113: INFO: blobfuse-flexvol-installer-dvjv8 started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:52.113: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 18 03:37:52.113: INFO: kube-proxy-r9btf started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:52.113: INFO: Container kube-proxy ready: true, restart count 0 Jan 18 03:37:52.113: INFO: metrics-server-6c8cc7585b-f7l2w started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:52.113: INFO: Container metrics-server ready: true, restart count 0 Jan 18 03:37:52.113: INFO: csi-secrets-store-provider-azure-4dnqk started at 2021-01-18 02:38:54 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:52.113: INFO: Container provider-azure-installer ready: true, restart count 0 W0118 03:37:52.190095 40164 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:37:52.364: INFO: Latency metrics for node k8s-master-11684159-0 Jan 18 03:37:52.364: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-runtime-4792" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sDocker\sContainers\sshould\sbe\sable\sto\soverride\sthe\simage\'s\sdefault\sarguments\s\(docker\scmd\)\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 18 03:21:35.984: Unexpected error: <*errors.errorString | 0xc0043f9280>: { s: "expected pod \"client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7\" success: Gave up after waiting 5m0s for pod \"client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7\" to be \"Succeeded or Failed\"", } expected pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7" success: Gave up after waiting 5m0s for pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7" to be "Succeeded or Failed" occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:742from junit_06.xml
[BeforeEach] [k8s.io] Docker Containers /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 03:16:31.293: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename containers �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in containers-311 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should be able to override the image's default arguments (docker cmd) [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: Creating a pod to test override arguments Jan 18 03:16:31.706: INFO: Waiting up to 5m0s for pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7" in namespace "containers-311" to be "Succeeded or Failed" Jan 18 03:16:31.752: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 45.244577ms Jan 18 03:16:33.812: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.105604251s Jan 18 03:16:35.862: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4.155702699s Jan 18 03:16:37.902: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 6.195371324s Jan 18 03:16:39.940: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 8.233193968s Jan 18 03:16:41.980: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 10.273231011s Jan 18 03:16:44.018: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 12.311594168s Jan 18 03:16:46.057: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 14.350423087s Jan 18 03:16:48.096: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 16.389420739s Jan 18 03:16:50.135: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 18.428519085s Jan 18 03:16:52.174: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 20.467447846s Jan 18 03:16:54.213: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 22.506495761s Jan 18 03:16:56.252: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 24.545169591s Jan 18 03:16:58.290: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 26.583884598s Jan 18 03:17:00.329: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 28.622556379s Jan 18 03:17:02.368: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 30.661528917s Jan 18 03:17:04.407: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 32.700651059s Jan 18 03:17:06.446: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 34.739521082s Jan 18 03:17:08.485: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 36.778615781s Jan 18 03:17:10.525: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 38.81834072s Jan 18 03:17:12.564: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 40.857661112s Jan 18 03:17:14.603: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 42.896219248s Jan 18 03:17:16.642: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 44.935251982s Jan 18 03:17:18.681: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 46.974195205s Jan 18 03:17:20.720: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 49.013361697s Jan 18 03:17:22.760: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 51.05296477s Jan 18 03:17:24.799: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 53.092581004s Jan 18 03:17:26.838: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 55.131390654s Jan 18 03:17:28.878: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 57.171085201s Jan 18 03:17:30.917: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 59.210186113s Jan 18 03:17:32.957: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.250291914s Jan 18 03:17:34.996: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.289543689s Jan 18 03:17:37.034: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.327873995s Jan 18 03:17:39.073: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.366394077s Jan 18 03:17:41.112: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.405057587s Jan 18 03:17:43.151: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.444004229s Jan 18 03:17:45.189: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.482186056s Jan 18 03:17:47.227: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.520126966s Jan 18 03:17:49.266: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m17.558987671s Jan 18 03:17:51.304: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m19.597560675s Jan 18 03:17:53.343: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m21.636911459s Jan 18 03:17:55.384: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m23.676995794s Jan 18 03:17:57.422: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m25.715762571s Jan 18 03:17:59.461: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m27.754497518s Jan 18 03:18:01.500: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m29.793398745s Jan 18 03:18:03.539: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m31.832347807s Jan 18 03:18:05.579: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m33.872589028s Jan 18 03:18:07.635: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m35.928484683s Jan 18 03:18:09.674: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m37.967617975s Jan 18 03:18:11.717: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.010679279s Jan 18 03:18:13.756: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.049820673s Jan 18 03:18:15.796: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.089559678s Jan 18 03:18:17.836: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.129697079s Jan 18 03:18:19.876: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.169943342s Jan 18 03:18:21.916: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.209697728s Jan 18 03:18:23.962: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.255193516s Jan 18 03:18:26.001: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.293993755s Jan 18 03:18:28.039: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.33274329s Jan 18 03:18:30.099: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.391966481s Jan 18 03:18:32.141: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.434959128s Jan 18 03:18:34.180: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.47310303s Jan 18 03:18:36.219: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.512056483s Jan 18 03:18:38.257: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.550635611s Jan 18 03:18:40.299: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.591989466s Jan 18 03:18:42.339: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.632446143s Jan 18 03:18:44.388: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.681894591s Jan 18 03:18:46.428: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.721191488s Jan 18 03:18:48.469: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.762583786s Jan 18 03:18:50.507: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.800649729s Jan 18 03:18:52.546: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.839441907s Jan 18 03:18:54.614: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.907010587s Jan 18 03:18:56.657: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.950558053s Jan 18 03:18:58.697: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.990413523s Jan 18 03:19:00.736: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m29.029353601s Jan 18 03:19:02.774: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m31.067929792s Jan 18 03:19:04.814: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m33.107103721s Jan 18 03:19:06.857: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m35.150521202s Jan 18 03:19:08.896: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m37.189407511s Jan 18 03:19:10.935: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m39.228376546s Jan 18 03:19:12.974: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m41.267528919s Jan 18 03:19:15.013: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m43.306402422s Jan 18 03:19:17.053: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m45.346427027s Jan 18 03:19:19.093: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m47.386281146s Jan 18 03:19:21.131: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m49.424419783s Jan 18 03:19:23.171: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m51.464283735s Jan 18 03:19:25.209: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m53.502507169s Jan 18 03:19:27.248: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m55.54115504s Jan 18 03:19:29.289: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m57.582525087s Jan 18 03:19:31.330: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m59.623465806s Jan 18 03:19:33.373: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m1.666646146s Jan 18 03:19:35.422: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m3.715018868s Jan 18 03:19:37.466: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m5.759040965s Jan 18 03:19:39.518: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m7.811179138s Jan 18 03:19:41.556: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m9.849812672s Jan 18 03:19:43.603: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m11.896609137s Jan 18 03:19:45.643: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m13.936207844s Jan 18 03:19:47.682: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m15.975680172s Jan 18 03:19:49.721: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.014926548s Jan 18 03:19:51.760: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.053778872s Jan 18 03:19:53.809: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.102021122s Jan 18 03:19:55.852: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.145575172s Jan 18 03:19:57.892: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.185062501s Jan 18 03:19:59.931: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.224460061s Jan 18 03:20:01.971: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.26408956s Jan 18 03:20:04.010: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.303415546s Jan 18 03:20:06.048: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.341904032s Jan 18 03:20:08.089: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.382426935s Jan 18 03:20:10.143: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.436605482s Jan 18 03:20:12.182: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.475135194s Jan 18 03:20:14.225: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.518768658s Jan 18 03:20:16.269: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.562425594s Jan 18 03:20:18.309: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.602452927s Jan 18 03:20:20.351: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.644280929s Jan 18 03:20:22.393: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.686549592s Jan 18 03:20:24.433: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.726625288s Jan 18 03:20:26.472: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.765406679s Jan 18 03:20:28.512: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.805337977s Jan 18 03:20:30.561: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.854409086s Jan 18 03:20:32.602: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.895815724s Jan 18 03:20:34.645: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.938415998s Jan 18 03:20:36.688: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.981764803s Jan 18 03:20:38.727: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m7.020167342s Jan 18 03:20:40.769: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m9.062435693s Jan 18 03:20:42.817: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m11.110596989s Jan 18 03:20:44.857: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m13.15000467s Jan 18 03:20:46.896: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m15.18937808s Jan 18 03:20:48.935: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m17.228433829s Jan 18 03:20:50.974: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m19.267664276s Jan 18 03:20:53.015: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m21.308607713s Jan 18 03:20:55.054: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m23.347277343s Jan 18 03:20:57.097: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m25.390442508s Jan 18 03:20:59.141: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m27.43441225s Jan 18 03:21:01.185: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m29.478564672s Jan 18 03:21:03.227: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m31.520069892s Jan 18 03:21:05.266: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m33.55941862s Jan 18 03:21:07.309: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m35.602439356s Jan 18 03:21:09.348: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m37.640987791s Jan 18 03:21:11.390: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m39.683851568s Jan 18 03:21:13.428: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m41.721937414s Jan 18 03:21:15.479: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m43.771962045s Jan 18 03:21:17.523: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m45.816763668s Jan 18 03:21:19.565: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m47.858436851s Jan 18 03:21:21.608: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m49.901186384s Jan 18 03:21:23.649: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m51.942520288s Jan 18 03:21:25.693: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m53.986541182s Jan 18 03:21:27.732: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.025826925s Jan 18 03:21:29.771: INFO: Pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.064743209s Jan 18 03:21:31.857: INFO: Failed to get logs from node "1168k8s000" pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7" container "agnhost-container": the server rejected our request for an unknown reason (get pods client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7) �[1mSTEP�[0m: delete the pod Jan 18 03:21:31.899: INFO: Waiting for pod client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7 to disappear Jan 18 03:21:31.937: INFO: Pod client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7 still exists Jan 18 03:21:33.938: INFO: Waiting for pod client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7 to disappear Jan 18 03:21:33.976: INFO: Pod client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7 still exists Jan 18 03:21:35.938: INFO: Waiting for pod client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7 to disappear Jan 18 03:21:35.984: INFO: Pod client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7 no longer exists Jan 18 03:21:35.984: FAIL: Unexpected error: <*errors.errorString | 0xc0043f9280>: { s: "expected pod \"client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7\" success: Gave up after waiting 5m0s for pod \"client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7\" to be \"Succeeded or Failed\"", } expected pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7" success: Gave up after waiting 5m0s for pod "client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc0003b0c60, 0x4e1a244, 0x12, 0xc003080000, 0x0, 0xc0015a9350, 0x1, 0x1, 0x4ff1868) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:742 +0x1e5 k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:568 k8s.io/kubernetes/test/e2e/common.glob..func4.2() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/docker_containers.go:58 +0x128 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002377200) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc002377200) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002377200, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Docker Containers /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "containers-311". �[1mSTEP�[0m: Found 5 events. Jan 18 03:21:36.024: INFO: At 2021-01-18 03:16:31 +0000 UTC - event for client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7: {default-scheduler } Scheduled: Successfully assigned containers-311/client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7 to 1168k8s000 Jan 18 03:21:36.024: INFO: At 2021-01-18 03:16:37 +0000 UTC - event for client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7: {kubelet 1168k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 03:21:36.024: INFO: At 2021-01-18 03:16:37 +0000 UTC - event for client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7: {kubelet 1168k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 03:21:36.024: INFO: At 2021-01-18 03:16:37 +0000 UTC - event for client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7: {kubelet 1168k8s000} Failed: Error: ErrImagePull Jan 18 03:21:36.024: INFO: At 2021-01-18 03:16:38 +0000 UTC - event for client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7: {kubelet 1168k8s000} Failed: Error: ImagePullBackOff Jan 18 03:21:36.062: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 03:21:36.062: INFO: Jan 18 03:21:36.136: INFO: Logging node info for node 1168k8s000 Jan 18 03:21:36.174: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 11867 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:20:25 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:20:25 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:20:25 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:20:25 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:21:36.175: INFO: Logging kubelet events for node 1168k8s000 Jan 18 03:21:36.215: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 03:21:36.256: INFO: dns-test-ed5e90a5-688f-4640-a528-4c8cd0fa5da9 started at 2021-01-18 03:07:22 +0000 UTC (0+3 container statuses recorded) Jan 18 03:21:36.256: INFO: Container jessie-querier ready: false, restart count 6 Jan 18 03:21:36.256: INFO: Container querier ready: false, restart count 0 Jan 18 03:21:36.256: INFO: Container webserver ready: false, restart count 0 Jan 18 03:21:36.256: INFO: downwardapi-volume-03736428-ef5e-4d09-bd5c-711f6dbb3963 started at 2021-01-18 03:20:03 +0000 UTC (0+1 container statuses recorded) Jan 18 03:21:36.256: INFO: Container client-container ready: false, restart count 0 Jan 18 03:21:36.256: INFO: back-off-cap started at 2021-01-18 03:19:11 +0000 UTC (0+1 container statuses recorded) Jan 18 03:21:36.256: INFO: Container back-off-cap ready: false, restart count 4 W0118 03:21:36.331596 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:21:36.457: INFO: Latency metrics for node 1168k8s000 Jan 18 03:21:36.457: INFO: Logging node info for node 1168k8s001 Jan 18 03:21:36.495: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 11480 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:18:54 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:18:54 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:18:54 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:18:54 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:21:36.495: INFO: Logging kubelet events for node 1168k8s001 Jan 18 03:21:36.534: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 03:21:36.574: INFO: client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189 started at 2021-01-18 03:19:19 +0000 UTC (0+1 container statuses recorded) Jan 18 03:21:36.574: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 03:21:36.574: INFO: pod-secrets-419c0efc-8910-4230-a85e-74b45752f670 started at 2021-01-18 03:19:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:21:36.574: INFO: Container secret-volume-test ready: false, restart count 0 Jan 18 03:21:36.574: INFO: pod-submit-remove-103e5f93-9439-48fd-9a61-5d27c2e6408f started at 2021-01-18 03:21:25 +0000 UTC (0+1 container statuses recorded) Jan 18 03:21:36.574: INFO: Container nginx ready: true, restart count 0 W0118 03:21:36.617804 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:21:38.636: INFO: Latency metrics for node 1168k8s001 Jan 18 03:21:38.636: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 03:21:38.674: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 11638 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:19:24 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:19:24 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:19:24 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:19:24 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:21:38.674: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 03:21:38.717: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 03:21:38.804: INFO: csi-secrets-store-provider-azure-4dnqk started at 2021-01-18 02:38:54 +0000 UTC (0+1 container statuses recorded) Jan 18 03:21:38.804: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 18 03:21:38.804: INFO: kube-addon-manager-k8s-master-11684159-0 started at 2021-01-18 02:38:21 +0000 UTC (0+1 container statuses recorded) Jan 18 03:21:38.804: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 18 03:21:38.804: INFO: coredns-autoscaler-87b67c5fd-7jfwj started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:21:38.804: INFO: Container autoscaler ready: true, restart count 0 Jan 18 03:21:38.804: INFO: coredns-6bbfb77cb5-4gfdd started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:21:38.804: INFO: Container coredns ready: true, restart count 0 Jan 18 03:21:38.804: INFO: blobfuse-flexvol-installer-dvjv8 started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:21:38.804: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 18 03:21:38.804: INFO: kube-proxy-r9btf started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:21:38.804: INFO: Container kube-proxy ready: true, restart count 0 Jan 18 03:21:38.804: INFO: metrics-server-6c8cc7585b-f7l2w started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:21:38.804: INFO: Container metrics-server ready: true, restart count 0 Jan 18 03:21:38.804: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:21:38.804: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 18 03:21:38.804: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:21:38.804: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 03:21:38.804: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 03:21:38.804: INFO: Container kube-apiserver ready: true, restart count 0 Jan 18 03:21:38.804: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:21:38.804: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 18 03:21:38.804: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:21:38.804: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 03:21:38.804: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 03:21:38.804: INFO: Container liveness-probe ready: true, restart count 0 Jan 18 03:21:38.804: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 18 03:21:38.804: INFO: Container secrets-store ready: true, restart count 0 W0118 03:21:38.850406 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:21:39.003: INFO: Latency metrics for node k8s-master-11684159-0 Jan 18 03:21:39.003: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "containers-311" for this suite.
Find client-containers-4143d0ed-334a-4f08-96b9-449cadd7fdc7 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sDocker\sContainers\sshould\sbe\sable\sto\soverride\sthe\simage\'s\sdefault\scommand\s\(docker\sentrypoint\)\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 18 03:51:54.643: Unexpected error: <*errors.errorString | 0xc002cae2c0>: { s: "expected pod \"client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e\" success: Gave up after waiting 5m0s for pod \"client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e\" to be \"Succeeded or Failed\"", } expected pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e" success: Gave up after waiting 5m0s for pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e" to be "Succeeded or Failed" occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:742from junit_04.xml
[BeforeEach] [k8s.io] Docker Containers /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 03:46:48.322: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename containers �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in containers-8333 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should be able to override the image's default command (docker entrypoint) [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: Creating a pod to test override command Jan 18 03:46:48.738: INFO: Waiting up to 5m0s for pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e" in namespace "containers-8333" to be "Succeeded or Failed" Jan 18 03:46:48.776: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 38.453743ms Jan 18 03:46:50.813: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2.075256767s Jan 18 03:46:52.850: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4.112755777s Jan 18 03:46:54.889: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 6.151256689s Jan 18 03:46:56.948: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 8.210164631s Jan 18 03:46:58.987: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 10.248962334s Jan 18 03:47:01.024: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 12.286181778s Jan 18 03:47:03.060: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 14.322092028s Jan 18 03:47:05.097: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 16.359505093s Jan 18 03:47:07.134: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 18.396416735s Jan 18 03:47:09.176: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 20.438626882s Jan 18 03:47:11.213: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 22.475789118s Jan 18 03:47:13.251: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 24.51315057s Jan 18 03:47:15.288: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 26.55021188s Jan 18 03:47:17.326: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 28.588485396s Jan 18 03:47:19.363: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 30.625730416s Jan 18 03:47:21.400: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 32.662605467s Jan 18 03:47:23.436: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 34.69860814s Jan 18 03:47:25.473: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 36.73511345s Jan 18 03:47:27.510: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 38.772290465s Jan 18 03:47:29.547: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 40.809438134s Jan 18 03:47:31.584: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 42.846445926s Jan 18 03:47:33.622: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 44.884317887s Jan 18 03:47:35.659: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 46.92133261s Jan 18 03:47:37.696: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 48.95878418s Jan 18 03:47:39.733: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 50.995156089s Jan 18 03:47:41.770: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 53.032525685s Jan 18 03:47:43.807: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 55.069598825s Jan 18 03:47:45.844: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 57.106190808s Jan 18 03:47:47.880: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 59.142868174s Jan 18 03:47:49.917: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.179815009s Jan 18 03:47:51.956: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.218778362s Jan 18 03:47:53.993: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.255696688s Jan 18 03:47:56.043: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.305572858s Jan 18 03:47:58.080: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.342704121s Jan 18 03:48:00.118: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.380154789s Jan 18 03:48:02.171: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.433124271s Jan 18 03:48:04.222: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.484531091s Jan 18 03:48:06.259: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m17.521263306s Jan 18 03:48:08.296: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m19.558194723s Jan 18 03:48:10.333: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m21.595206458s Jan 18 03:48:12.370: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m23.63209615s Jan 18 03:48:14.406: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m25.668710538s Jan 18 03:48:16.444: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m27.705909162s Jan 18 03:48:18.480: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m29.742483974s Jan 18 03:48:20.518: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m31.780707754s Jan 18 03:48:22.556: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m33.818364421s Jan 18 03:48:24.594: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m35.856153874s Jan 18 03:48:26.631: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m37.893167693s Jan 18 03:48:28.667: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m39.92969682s Jan 18 03:48:30.705: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m41.967172628s Jan 18 03:48:32.742: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.004574707s Jan 18 03:48:34.779: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.041314402s Jan 18 03:48:36.816: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.078874907s Jan 18 03:48:38.854: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.116123536s Jan 18 03:48:40.890: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.152844663s Jan 18 03:48:42.928: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.190109626s Jan 18 03:48:44.964: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.226711607s Jan 18 03:48:47.001: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.263731063s Jan 18 03:48:49.038: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.300800943s Jan 18 03:48:51.075: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.337732161s Jan 18 03:48:53.112: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.374690888s Jan 18 03:48:55.149: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.411666837s Jan 18 03:48:57.188: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.450028152s Jan 18 03:48:59.225: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.487652854s Jan 18 03:49:01.263: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.525084647s Jan 18 03:49:03.300: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.562350375s Jan 18 03:49:05.336: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.598636003s Jan 18 03:49:07.373: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.635361827s Jan 18 03:49:09.409: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.671729091s Jan 18 03:49:11.451: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.713752833s Jan 18 03:49:13.488: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.75035738s Jan 18 03:49:15.526: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.788534842s Jan 18 03:49:17.563: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.825701242s Jan 18 03:49:19.600: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.862486695s Jan 18 03:49:21.637: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.899458574s Jan 18 03:49:23.674: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.936085854s Jan 18 03:49:25.711: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.973235123s Jan 18 03:49:27.749: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m39.011159931s Jan 18 03:49:29.786: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m41.048282976s Jan 18 03:49:31.824: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m43.085900709s Jan 18 03:49:33.890: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m45.152211173s Jan 18 03:49:35.928: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m47.190322504s Jan 18 03:49:37.964: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m49.226509496s Jan 18 03:49:40.001: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m51.263314114s Jan 18 03:49:42.038: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m53.300164741s Jan 18 03:49:44.100: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m55.362570739s Jan 18 03:49:46.139: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m57.400907333s Jan 18 03:49:48.175: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m59.437506536s Jan 18 03:49:50.213: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m1.475331141s Jan 18 03:49:52.249: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m3.511782441s Jan 18 03:49:54.288: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m5.550034323s Jan 18 03:49:56.325: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m7.587148039s Jan 18 03:49:58.363: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m9.625100524s Jan 18 03:50:00.400: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m11.662542499s Jan 18 03:50:02.437: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m13.699569419s Jan 18 03:50:04.474: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m15.736447606s Jan 18 03:50:06.512: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m17.774437418s Jan 18 03:50:08.550: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m19.812347738s Jan 18 03:50:10.589: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m21.85091736s Jan 18 03:50:12.626: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m23.888572474s Jan 18 03:50:14.664: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m25.926369306s Jan 18 03:50:16.706: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m27.968772999s Jan 18 03:50:18.743: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.005646977s Jan 18 03:50:20.781: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.043059662s Jan 18 03:50:22.818: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.080202001s Jan 18 03:50:24.856: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.118508269s Jan 18 03:50:26.894: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.156159753s Jan 18 03:50:28.931: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.193858012s Jan 18 03:50:30.973: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.235218005s Jan 18 03:50:33.010: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.272728031s Jan 18 03:50:35.057: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.319574449s Jan 18 03:50:37.095: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.357096834s Jan 18 03:50:39.131: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.393667269s Jan 18 03:50:41.168: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.430179794s Jan 18 03:50:43.211: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.472917834s Jan 18 03:50:45.248: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.510725769s Jan 18 03:50:47.285: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.547554515s Jan 18 03:50:49.322: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.584710895s Jan 18 03:50:51.359: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.620958365s Jan 18 03:50:53.406: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.668023342s Jan 18 03:50:55.442: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.70487796s Jan 18 03:50:57.480: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.7421348s Jan 18 03:50:59.520: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.782070339s Jan 18 03:51:01.563: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.825747156s Jan 18 03:51:03.600: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.862619719s Jan 18 03:51:05.637: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.89973261s Jan 18 03:51:07.674: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.936831023s Jan 18 03:51:09.732: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.994115382s Jan 18 03:51:11.770: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m23.031951512s Jan 18 03:51:13.806: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m25.068799487s Jan 18 03:51:15.844: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m27.106237019s Jan 18 03:51:17.881: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m29.143466246s Jan 18 03:51:19.918: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m31.180222359s Jan 18 03:51:21.954: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m33.216780371s Jan 18 03:51:23.991: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m35.253685193s Jan 18 03:51:26.029: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m37.290936569s Jan 18 03:51:28.066: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m39.328294255s Jan 18 03:51:30.109: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m41.371729476s Jan 18 03:51:32.147: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m43.409445492s Jan 18 03:51:34.184: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m45.445941936s Jan 18 03:51:36.221: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m47.482935356s Jan 18 03:51:38.258: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m49.520044584s Jan 18 03:51:40.294: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m51.556648724s Jan 18 03:51:42.331: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m53.593498476s Jan 18 03:51:44.368: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m55.630224516s Jan 18 03:51:46.417: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m57.679584627s Jan 18 03:51:48.454: INFO: Pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m59.716393428s Jan 18 03:51:50.530: INFO: Failed to get logs from node "1168k8s001" pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e" container "agnhost-container": the server rejected our request for an unknown reason (get pods client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e) �[1mSTEP�[0m: delete the pod Jan 18 03:51:50.569: INFO: Waiting for pod client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e to disappear Jan 18 03:51:50.606: INFO: Pod client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e still exists Jan 18 03:51:52.606: INFO: Waiting for pod client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e to disappear Jan 18 03:51:52.643: INFO: Pod client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e still exists Jan 18 03:51:54.606: INFO: Waiting for pod client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e to disappear Jan 18 03:51:54.643: INFO: Pod client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e no longer exists Jan 18 03:51:54.643: FAIL: Unexpected error: <*errors.errorString | 0xc002cae2c0>: { s: "expected pod \"client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e\" success: Gave up after waiting 5m0s for pod \"client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e\" to be \"Succeeded or Failed\"", } expected pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e" success: Gave up after waiting 5m0s for pod "client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc000165080, 0x4e0fa09, 0x10, 0xc00154ac00, 0x0, 0xc00233b350, 0x1, 0x1, 0x4ff1868) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:742 +0x1e5 k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:568 k8s.io/kubernetes/test/e2e/common.glob..func4.3() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/docker_containers.go:74 +0x16f k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002b17800) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc002b17800) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002b17800, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Docker Containers /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "containers-8333". �[1mSTEP�[0m: Found 4 events. Jan 18 03:51:54.681: INFO: At 2021-01-18 03:46:48 +0000 UTC - event for client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e: {default-scheduler } Scheduled: Successfully assigned containers-8333/client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e to 1168k8s001 Jan 18 03:51:54.681: INFO: At 2021-01-18 03:46:51 +0000 UTC - event for client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e: {kubelet 1168k8s001} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 03:51:54.681: INFO: At 2021-01-18 03:46:51 +0000 UTC - event for client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e: {kubelet 1168k8s001} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 03:51:54.681: INFO: At 2021-01-18 03:46:52 +0000 UTC - event for client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e: {kubelet 1168k8s001} Failed: Error: ImagePullBackOff Jan 18 03:51:54.717: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 03:51:54.717: INFO: Jan 18 03:51:54.787: INFO: Logging node info for node 1168k8s000 Jan 18 03:51:54.824: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 19768 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:47:55 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:47:55 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:47:55 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:47:55 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:51:54.824: INFO: Logging kubelet events for node 1168k8s000 Jan 18 03:51:54.861: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 03:51:54.901: INFO: dns-test-8a4f9407-261f-4e87-8bd0-f52ccba522eb started at 2021-01-18 03:41:25 +0000 UTC (0+3 container statuses recorded) Jan 18 03:51:54.901: INFO: Container jessie-querier ready: true, restart count 0 Jan 18 03:51:54.901: INFO: Container querier ready: false, restart count 0 Jan 18 03:51:54.901: INFO: Container webserver ready: false, restart count 0 Jan 18 03:51:54.901: INFO: netserver-0 started at 2021-01-18 03:48:09 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:54.901: INFO: Container webserver ready: false, restart count 0 Jan 18 03:51:54.901: INFO: sample-webhook-deployment-65bfd79dc5-flt4p started at 2021-01-18 03:47:29 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:54.901: INFO: Container sample-webhook ready: false, restart count 0 Jan 18 03:51:54.901: INFO: client-containers-feb4a587-79af-4324-91a5-6ec4e5233445 started at 2021-01-18 03:51:43 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:54.901: INFO: Container agnhost-container ready: false, restart count 0 W0118 03:51:54.973854 40159 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:51:55.131: INFO: Latency metrics for node 1168k8s000 Jan 18 03:51:55.131: INFO: Logging node info for node 1168k8s001 Jan 18 03:51:55.167: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 20607 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:50:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:50:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:50:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:50:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:51:55.168: INFO: Logging kubelet events for node 1168k8s001 Jan 18 03:51:55.203: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 03:51:55.243: INFO: agnhost-primary-ds8s5 started at 2021-01-18 03:51:06 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:55.243: INFO: Container agnhost-primary ready: false, restart count 0 Jan 18 03:51:55.243: INFO: netserver-1 started at 2021-01-18 03:48:09 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:55.243: INFO: Container webserver ready: false, restart count 0 Jan 18 03:51:55.243: INFO: pod-secrets-dd5a0a64-7811-4175-87dc-d2a80b60a8da started at 2021-01-18 03:50:24 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:55.243: INFO: Container secret-volume-test ready: false, restart count 0 Jan 18 03:51:55.243: INFO: test-dns-nameservers started at 2021-01-18 03:47:03 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:55.243: INFO: Container agnhost-container ready: false, restart count 0 W0118 03:51:55.285837 40159 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:51:55.406: INFO: Latency metrics for node 1168k8s001 Jan 18 03:51:55.406: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 03:51:55.443: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 20134 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:49:38 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:49:38 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:49:38 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:49:38 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:51:55.443: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 03:51:55.479: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 03:51:55.534: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:55.536: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 03:51:55.536: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 03:51:55.536: INFO: Container liveness-probe ready: true, restart count 0 Jan 18 03:51:55.536: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 18 03:51:55.536: INFO: Container secrets-store ready: true, restart count 0 Jan 18 03:51:55.536: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:55.536: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 18 03:51:55.536: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:55.536: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 03:51:55.536: INFO: blobfuse-flexvol-installer-dvjv8 started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:55.536: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 18 03:51:55.536: INFO: kube-proxy-r9btf started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:55.536: INFO: Container kube-proxy ready: true, restart count 0 Jan 18 03:51:55.536: INFO: metrics-server-6c8cc7585b-f7l2w started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:55.536: INFO: Container metrics-server ready: true, restart count 0 Jan 18 03:51:55.536: INFO: csi-secrets-store-provider-azure-4dnqk started at 2021-01-18 02:38:54 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:55.536: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 18 03:51:55.536: INFO: kube-addon-manager-k8s-master-11684159-0 started at 2021-01-18 02:38:21 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:55.536: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 18 03:51:55.536: INFO: coredns-autoscaler-87b67c5fd-7jfwj started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:55.536: INFO: Container autoscaler ready: true, restart count 0 Jan 18 03:51:55.536: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:55.536: INFO: Container kube-apiserver ready: true, restart count 0 Jan 18 03:51:55.536: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:55.536: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 18 03:51:55.536: INFO: coredns-6bbfb77cb5-4gfdd started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:51:55.536: INFO: Container coredns ready: true, restart count 0 W0118 03:51:55.577078 40159 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:51:55.724: INFO: Latency metrics for node k8s-master-11684159-0 Jan 18 03:51:55.724: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "containers-8333" for this suite.
Find client-containers-89f0ffcf-fe79-4a24-b8bc-e844c3f7e26e mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sDocker\sContainers\sshould\sbe\sable\sto\soverride\sthe\simage\'s\sdefault\scommand\sand\sarguments\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 18 03:24:25.743: Unexpected error: <*errors.errorString | 0xc00339aae0>: { s: "expected pod \"client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189\" success: Gave up after waiting 5m0s for pod \"client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189\" to be \"Succeeded or Failed\"", } expected pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189" success: Gave up after waiting 5m0s for pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189" to be "Succeeded or Failed" occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:742from junit_07.xml
[BeforeEach] [k8s.io] Docker Containers /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 03:19:19.261: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename containers �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in containers-8876 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should be able to override the image's default command and arguments [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: Creating a pod to test override all Jan 18 03:19:19.672: INFO: Waiting up to 5m0s for pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189" in namespace "containers-8876" to be "Succeeded or Failed" Jan 18 03:19:19.713: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 41.104514ms Jan 18 03:19:21.759: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2.08696725s Jan 18 03:19:23.796: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4.124601007s Jan 18 03:19:25.837: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 6.165426489s Jan 18 03:19:27.881: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 8.209306759s Jan 18 03:19:29.919: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 10.247275962s Jan 18 03:19:31.956: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 12.28458725s Jan 18 03:19:33.997: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 14.324961764s Jan 18 03:19:36.034: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 16.362249215s Jan 18 03:19:38.077: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 18.405615693s Jan 18 03:19:40.116: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 20.444472161s Jan 18 03:19:42.157: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 22.485383826s Jan 18 03:19:44.197: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 24.525099494s Jan 18 03:19:46.235: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 26.562839832s Jan 18 03:19:48.273: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 28.600826282s Jan 18 03:19:50.311: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 30.639644624s Jan 18 03:19:52.352: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 32.68040923s Jan 18 03:19:54.389: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 34.717657875s Jan 18 03:19:56.427: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 36.755326382s Jan 18 03:19:58.464: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 38.792192865s Jan 18 03:20:00.504: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 40.831792141s Jan 18 03:20:02.542: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 42.869764481s Jan 18 03:20:04.581: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 44.909225097s Jan 18 03:20:06.619: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 46.947345676s Jan 18 03:20:08.657: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 48.985598306s Jan 18 03:20:10.695: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 51.02306967s Jan 18 03:20:12.733: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 53.061348027s Jan 18 03:20:14.774: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 55.101907959s Jan 18 03:20:16.812: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 57.139899802s Jan 18 03:20:18.850: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 59.178623703s Jan 18 03:20:20.889: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.217708203s Jan 18 03:20:22.927: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.25496117s Jan 18 03:20:24.969: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.29744322s Jan 18 03:20:27.009: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.337171643s Jan 18 03:20:29.046: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.374364509s Jan 18 03:20:31.089: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.417253489s Jan 18 03:20:33.126: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.454293121s Jan 18 03:20:35.197: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.525205513s Jan 18 03:20:37.236: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m17.563861035s Jan 18 03:20:39.283: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m19.611346441s Jan 18 03:20:41.324: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m21.652268699s Jan 18 03:20:43.362: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m23.690301138s Jan 18 03:20:45.401: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m25.729272468s Jan 18 03:20:47.438: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m27.766389541s Jan 18 03:20:49.481: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m29.809257074s Jan 18 03:20:51.519: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m31.84677214s Jan 18 03:20:53.555: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m33.883684924s Jan 18 03:20:55.597: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m35.924990675s Jan 18 03:20:57.634: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m37.962291693s Jan 18 03:20:59.671: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m39.999581058s Jan 18 03:21:01.709: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.03686211s Jan 18 03:21:03.753: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.081241249s Jan 18 03:21:05.790: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.118181719s Jan 18 03:21:07.829: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.157214301s Jan 18 03:21:09.866: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.19471971s Jan 18 03:21:11.904: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.231937761s Jan 18 03:21:13.945: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.273441614s Jan 18 03:21:15.983: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.311056292s Jan 18 03:21:18.020: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.348421072s Jan 18 03:21:20.058: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.3863207s Jan 18 03:21:22.095: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.423702349s Jan 18 03:21:24.137: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.464864769s Jan 18 03:21:26.177: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.504877915s Jan 18 03:21:28.221: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.549275323s Jan 18 03:21:30.265: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.593255938s Jan 18 03:21:32.309: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.637238244s Jan 18 03:21:34.346: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.674581597s Jan 18 03:21:36.383: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.711136485s Jan 18 03:21:38.421: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.748892201s Jan 18 03:21:40.459: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.787204227s Jan 18 03:21:42.496: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.824425743s Jan 18 03:21:44.533: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.86162094s Jan 18 03:21:46.571: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.899254527s Jan 18 03:21:48.613: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.940992341s Jan 18 03:21:50.650: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.978520752s Jan 18 03:21:52.688: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m33.015909969s Jan 18 03:21:54.724: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m35.052681896s Jan 18 03:21:56.762: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m37.089953536s Jan 18 03:21:58.799: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m39.127317718s Jan 18 03:22:00.836: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m41.163766954s Jan 18 03:22:02.874: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m43.202403727s Jan 18 03:22:04.911: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m45.239580158s Jan 18 03:22:06.949: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m47.277516914s Jan 18 03:22:08.987: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m49.314842748s Jan 18 03:22:11.023: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m51.351261762s Jan 18 03:22:13.060: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m53.387871975s Jan 18 03:22:15.097: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m55.425161311s Jan 18 03:22:17.134: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m57.462246428s Jan 18 03:22:19.171: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 2m59.499504992s Jan 18 03:22:21.208: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m1.536168776s Jan 18 03:22:23.245: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m3.573040078s Jan 18 03:22:25.281: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m5.609380455s Jan 18 03:22:27.318: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m7.646061193s Jan 18 03:22:29.355: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m9.683526138s Jan 18 03:22:31.392: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m11.720665662s Jan 18 03:22:33.431: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m13.759323553s Jan 18 03:22:35.468: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m15.796309615s Jan 18 03:22:37.505: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m17.833180488s Jan 18 03:22:39.542: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m19.869783664s Jan 18 03:22:41.578: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m21.906627443s Jan 18 03:22:43.615: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m23.943527014s Jan 18 03:22:45.652: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m25.980680994s Jan 18 03:22:47.690: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.017814874s Jan 18 03:22:49.728: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.056282721s Jan 18 03:22:51.766: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.09402757s Jan 18 03:22:53.804: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.132287418s Jan 18 03:22:55.848: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.176328123s Jan 18 03:22:57.886: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.214237546s Jan 18 03:22:59.924: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.251880585s Jan 18 03:23:01.962: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.290046835s Jan 18 03:23:04.002: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.330074098s Jan 18 03:23:06.089: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.417514646s Jan 18 03:23:08.134: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.462263098s Jan 18 03:23:10.182: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.509918494s Jan 18 03:23:12.247: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.575608012s Jan 18 03:23:14.284: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.61270989s Jan 18 03:23:16.323: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.651263562s Jan 18 03:23:18.361: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.689019355s Jan 18 03:23:20.398: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.726067462s Jan 18 03:23:22.436: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.764739894s Jan 18 03:23:24.474: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.801878524s Jan 18 03:23:26.511: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.839188931s Jan 18 03:23:28.548: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.876203502s Jan 18 03:23:30.586: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.914149511s Jan 18 03:23:32.624: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.95181022s Jan 18 03:23:34.662: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.989882533s Jan 18 03:23:36.699: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m17.027306583s Jan 18 03:23:38.737: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m19.06502128s Jan 18 03:23:40.775: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m21.103213867s Jan 18 03:23:42.813: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m23.141482104s Jan 18 03:23:44.851: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m25.179101659s Jan 18 03:23:46.888: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m27.216206023s Jan 18 03:23:48.926: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m29.25396084s Jan 18 03:23:50.963: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m31.291006686s Jan 18 03:23:53.000: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m33.328731641s Jan 18 03:23:55.039: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m35.366946726s Jan 18 03:23:57.077: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m37.40493391s Jan 18 03:23:59.114: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m39.442411948s Jan 18 03:24:01.152: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m41.480133742s Jan 18 03:24:03.189: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m43.517618423s Jan 18 03:24:05.227: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m45.55522569s Jan 18 03:24:07.265: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m47.593055067s Jan 18 03:24:09.302: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m49.630371537s Jan 18 03:24:11.340: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m51.667753455s Jan 18 03:24:13.378: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m53.706127793s Jan 18 03:24:15.416: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m55.744067236s Jan 18 03:24:17.455: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m57.783100116s Jan 18 03:24:19.493: INFO: Pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189": Phase="Pending", Reason="", readiness=false. Elapsed: 4m59.820809704s Jan 18 03:24:21.631: INFO: Failed to get logs from node "1168k8s001" pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189" container "agnhost-container": the server rejected our request for an unknown reason (get pods client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189) �[1mSTEP�[0m: delete the pod Jan 18 03:24:21.669: INFO: Waiting for pod client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189 to disappear Jan 18 03:24:21.705: INFO: Pod client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189 still exists Jan 18 03:24:23.705: INFO: Waiting for pod client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189 to disappear Jan 18 03:24:23.743: INFO: Pod client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189 still exists Jan 18 03:24:25.705: INFO: Waiting for pod client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189 to disappear Jan 18 03:24:25.743: INFO: Pod client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189 no longer exists Jan 18 03:24:25.743: FAIL: Unexpected error: <*errors.errorString | 0xc00339aae0>: { s: "expected pod \"client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189\" success: Gave up after waiting 5m0s for pod \"client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189\" to be \"Succeeded or Failed\"", } expected pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189" success: Gave up after waiting 5m0s for pod "client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc0001e4c60, 0x4dfe0e5, 0xc, 0xc0025f1c00, 0x0, 0xc001805350, 0x1, 0x1, 0x4ff1868) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:742 +0x1e5 k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:568 k8s.io/kubernetes/test/e2e/common.glob..func4.4() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/docker_containers.go:88 +0x191 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002217080) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc002217080) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002217080, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Docker Containers /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "containers-8876". �[1mSTEP�[0m: Found 4 events. Jan 18 03:24:25.782: INFO: At 2021-01-18 03:19:19 +0000 UTC - event for client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189: {default-scheduler } Scheduled: Successfully assigned containers-8876/client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189 to 1168k8s001 Jan 18 03:24:25.782: INFO: At 2021-01-18 03:19:21 +0000 UTC - event for client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189: {kubelet 1168k8s001} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 03:24:25.782: INFO: At 2021-01-18 03:19:22 +0000 UTC - event for client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189: {kubelet 1168k8s001} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 03:24:25.782: INFO: At 2021-01-18 03:19:23 +0000 UTC - event for client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189: {kubelet 1168k8s001} Failed: Error: ImagePullBackOff Jan 18 03:24:25.818: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 03:24:25.818: INFO: Jan 18 03:24:25.890: INFO: Logging node info for node 1168k8s000 Jan 18 03:24:25.927: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 12588 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:22:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:22:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:22:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:22:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:24:25.928: INFO: Logging kubelet events for node 1168k8s000 Jan 18 03:24:25.966: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 03:24:26.038: INFO: downwardapi-volume-03736428-ef5e-4d09-bd5c-711f6dbb3963 started at 2021-01-18 03:20:03 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.038: INFO: Container client-container ready: false, restart count 0 Jan 18 03:24:26.038: INFO: back-off-cap started at 2021-01-18 03:19:11 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.038: INFO: Container back-off-cap ready: false, restart count 5 Jan 18 03:24:26.038: INFO: image-pull-testf6f2402a-5fce-4b46-b2bf-edc825bb9dfa started at 2021-01-18 03:22:48 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.038: INFO: Container image-pull-test ready: false, restart count 0 Jan 18 03:24:26.038: INFO: pod-projected-configmaps-3c943ec7-3360-4f6a-b513-4d6bd43c71dd started at 2021-01-18 03:22:36 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.038: INFO: Container agnhost-container ready: false, restart count 0 W0118 03:24:26.117498 40167 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:24:26.253: INFO: Latency metrics for node 1168k8s000 Jan 18 03:24:26.253: INFO: Logging node info for node 1168k8s001 Jan 18 03:24:26.290: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 12725 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:23:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:23:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:23:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:23:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:24:26.290: INFO: Logging kubelet events for node 1168k8s001 Jan 18 03:24:26.329: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 03:24:26.368: INFO: liveness-578c255d-afa5-4ab5-b764-f8e14de0e22d started at 2021-01-18 03:21:40 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.369: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 03:24:26.369: INFO: pod-secrets-419c0efc-8910-4230-a85e-74b45752f670 started at 2021-01-18 03:19:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.369: INFO: Container secret-volume-test ready: false, restart count 0 Jan 18 03:24:26.369: INFO: pod-host-path-test started at 2021-01-18 03:22:12 +0000 UTC (0+2 container statuses recorded) Jan 18 03:24:26.369: INFO: Container test-container-1 ready: false, restart count 0 Jan 18 03:24:26.369: INFO: Container test-container-2 ready: false, restart count 0 W0118 03:24:26.409758 40167 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:24:26.526: INFO: Latency metrics for node 1168k8s001 Jan 18 03:24:26.526: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 03:24:26.604: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 11638 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:19:24 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:19:24 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:19:24 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:19:24 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:24:26.605: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 03:24:26.644: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 03:24:26.745: INFO: blobfuse-flexvol-installer-dvjv8 started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.745: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 18 03:24:26.745: INFO: kube-proxy-r9btf started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.745: INFO: Container kube-proxy ready: true, restart count 0 Jan 18 03:24:26.745: INFO: metrics-server-6c8cc7585b-f7l2w started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.745: INFO: Container metrics-server ready: true, restart count 0 Jan 18 03:24:26.745: INFO: csi-secrets-store-provider-azure-4dnqk started at 2021-01-18 02:38:54 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.745: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 18 03:24:26.745: INFO: kube-addon-manager-k8s-master-11684159-0 started at 2021-01-18 02:38:21 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.745: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 18 03:24:26.745: INFO: coredns-autoscaler-87b67c5fd-7jfwj started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.745: INFO: Container autoscaler ready: true, restart count 0 Jan 18 03:24:26.745: INFO: coredns-6bbfb77cb5-4gfdd started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.745: INFO: Container coredns ready: true, restart count 0 Jan 18 03:24:26.745: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.745: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 18 03:24:26.745: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.745: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 03:24:26.745: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 03:24:26.745: INFO: Container liveness-probe ready: true, restart count 0 Jan 18 03:24:26.745: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 18 03:24:26.745: INFO: Container secrets-store ready: true, restart count 0 Jan 18 03:24:26.745: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.745: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 18 03:24:26.745: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.745: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 03:24:26.745: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 03:24:26.745: INFO: Container kube-apiserver ready: true, restart count 0 W0118 03:24:26.785240 40167 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:24:26.950: INFO: Latency metrics for node k8s-master-11684159-0 Jan 18 03:24:26.950: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "containers-8876" for this suite.
Find client-containers-82ecf167-4eb7-4823-8bcf-63a7916b8189 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sDocker\sContainers\sshould\suse\sthe\simage\sdefaults\sif\scommand\sand\sargs\sare\sblank\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 18 03:56:43.585: Expected pod "client-containers-feb4a587-79af-4324-91a5-6ec4e5233445" to be running, got error: timed out waiting for the condition Unexpected error: <*errors.errorString | 0xc0002f61f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/docker_containers.go:41from junit_02.xml
[BeforeEach] [k8s.io] Docker Containers /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 03:51:43.077: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename containers �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in containers-4459 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should use the image defaults if command and args are blank [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 18 03:56:43.585: FAIL: Expected pod "client-containers-feb4a587-79af-4324-91a5-6ec4e5233445" to be running, got error: timed out waiting for the condition Unexpected error: <*errors.errorString | 0xc0002f61f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func4.1() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/docker_containers.go:41 +0x225 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00355a300) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc00355a300) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc00355a300, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Docker Containers /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "containers-4459". �[1mSTEP�[0m: Found 4 events. Jan 18 03:56:43.620: INFO: At 2021-01-18 03:51:43 +0000 UTC - event for client-containers-feb4a587-79af-4324-91a5-6ec4e5233445: {default-scheduler } Scheduled: Successfully assigned containers-4459/client-containers-feb4a587-79af-4324-91a5-6ec4e5233445 to 1168k8s000 Jan 18 03:56:43.620: INFO: At 2021-01-18 03:51:46 +0000 UTC - event for client-containers-feb4a587-79af-4324-91a5-6ec4e5233445: {kubelet 1168k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 03:56:43.620: INFO: At 2021-01-18 03:51:47 +0000 UTC - event for client-containers-feb4a587-79af-4324-91a5-6ec4e5233445: {kubelet 1168k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 03:56:43.620: INFO: At 2021-01-18 03:51:47 +0000 UTC - event for client-containers-feb4a587-79af-4324-91a5-6ec4e5233445: {kubelet 1168k8s000} Failed: Error: ImagePullBackOff Jan 18 03:56:43.655: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 03:56:43.655: INFO: client-containers-feb4a587-79af-4324-91a5-6ec4e5233445 1168k8s000 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:51:43 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:51:43 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:51:43 +0000 UTC ContainersNotReady containers with unready status: [agnhost-container]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:51:43 +0000 UTC }] Jan 18 03:56:43.655: INFO: Jan 18 03:56:43.722: INFO: Logging node info for node 1168k8s000 Jan 18 03:56:43.757: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 21219 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:52:57 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:52:57 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:52:57 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:52:57 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:56:43.758: INFO: Logging kubelet events for node 1168k8s000 Jan 18 03:56:43.793: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 03:56:43.839: INFO: client-containers-feb4a587-79af-4324-91a5-6ec4e5233445 started at 2021-01-18 03:51:43 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:43.839: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 03:56:43.839: INFO: labelsupdatef2b34f7a-5c12-4654-bc08-5a9596c5a624 started at 2021-01-18 03:53:10 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:43.839: INFO: Container client-container ready: false, restart count 0 Jan 18 03:56:43.839: INFO: pod-projected-secrets-20872352-377b-4280-a940-ce43fd0b1b5a started at 2021-01-18 03:56:27 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:43.839: INFO: Container secret-volume-test ready: false, restart count 0 Jan 18 03:56:43.839: INFO: test-deployment-67744c7984-rlz55 started at 2021-01-18 03:56:37 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:43.839: INFO: Container test-deployment ready: false, restart count 0 W0118 03:56:43.911453 40162 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:56:44.040: INFO: Latency metrics for node 1168k8s000 Jan 18 03:56:44.040: INFO: Logging node info for node 1168k8s001 Jan 18 03:56:44.075: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 21748 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:55:58 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:55:58 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:55:58 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:55:58 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:56:44.076: INFO: Logging kubelet events for node 1168k8s001 Jan 18 03:56:44.110: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 03:56:44.149: INFO: test-deployment-67744c7984-kjpd7 started at 2021-01-18 03:56:37 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:44.149: INFO: Container test-deployment ready: false, restart count 0 Jan 18 03:56:44.149: INFO: pod-projected-configmaps-6c9d2066-53a3-440e-8f5f-87337d414eda started at 2021-01-18 03:51:56 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:44.149: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 03:56:44.149: INFO: pod-configmaps-6d6d3ac0-c323-4886-9dfa-e142c9e12a5b started at 2021-01-18 03:52:05 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:44.149: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 03:56:44.149: INFO: sample-webhook-deployment-65bfd79dc5-k6hqv started at 2021-01-18 03:56:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:44.149: INFO: Container sample-webhook ready: false, restart count 0 Jan 18 03:56:44.149: INFO: agnhost-primary-zmdvf started at 2021-01-18 03:52:33 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:44.149: INFO: Container agnhost-primary ready: false, restart count 0 W0118 03:56:44.190374 40162 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:56:44.367: INFO: Latency metrics for node 1168k8s001 Jan 18 03:56:44.367: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 03:56:44.401: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 21489 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:54:39 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:54:39 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:54:39 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:54:39 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:56:44.402: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 03:56:44.436: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 03:56:44.477: INFO: coredns-6bbfb77cb5-4gfdd started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:44.477: INFO: Container coredns ready: true, restart count 0 Jan 18 03:56:44.477: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:44.477: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 18 03:56:44.477: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:44.477: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 03:56:44.477: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:44.477: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 03:56:44.477: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 03:56:44.477: INFO: Container liveness-probe ready: true, restart count 0 Jan 18 03:56:44.477: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 18 03:56:44.477: INFO: Container secrets-store ready: true, restart count 0 Jan 18 03:56:44.477: INFO: kube-addon-manager-k8s-master-11684159-0 started at 2021-01-18 02:38:21 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:44.477: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 18 03:56:44.477: INFO: coredns-autoscaler-87b67c5fd-7jfwj started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:44.477: INFO: Container autoscaler ready: true, restart count 0 Jan 18 03:56:44.477: INFO: blobfuse-flexvol-installer-dvjv8 started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:44.477: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 18 03:56:44.477: INFO: kube-proxy-r9btf started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:44.477: INFO: Container kube-proxy ready: true, restart count 0 Jan 18 03:56:44.477: INFO: metrics-server-6c8cc7585b-f7l2w started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:44.477: INFO: Container metrics-server ready: true, restart count 0 Jan 18 03:56:44.477: INFO: csi-secrets-store-provider-azure-4dnqk started at 2021-01-18 02:38:54 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:44.477: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 18 03:56:44.477: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:44.477: INFO: Container kube-apiserver ready: true, restart count 0 Jan 18 03:56:44.477: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:56:44.477: INFO: Container azure-ip-masq-agent ready: true, restart count 0 W0118 03:56:44.516554 40162 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:56:44.676: INFO: Latency metrics for node k8s-master-11684159-0 Jan 18 03:56:44.676: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "containers-4459" for this suite.
Find client-containers-feb4a587-79af-4324-91a5-6ec4e5233445 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sPods\sshould\scontain\senvironment\svariables\sfor\sservices\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 18 02:45:35.924: Unexpected error: <*errors.errorString | 0xc0001fe1f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103from junit_03.xml
[BeforeEach] [k8s.io] Pods /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 02:40:34.857: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename pods W0118 02:40:35.184339 40161 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+ Jan 18 02:40:35.186: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled Jan 18 02:40:35.233: INFO: PSP annotation exists on dry run pod: "e2e-test-privileged-psp"; assuming PodSecurityPolicy is enabled W0118 02:40:35.273647 40161 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+ Jan 18 02:40:35.525: INFO: Found ClusterRoles; assuming RBAC is enabled. �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in pods-223 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pods /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:187 [It] should contain environment variables for services [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 18 02:45:35.924: FAIL: Unexpected error: <*errors.errorString | 0xc0001fe1f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc003498320, 0xc003ed7000, 0x4de894b) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func18.6() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:469 +0x24d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00398a480) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc00398a480) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc00398a480, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Pods /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "pods-223". �[1mSTEP�[0m: Found 5 events. Jan 18 02:45:35.961: INFO: At 2021-01-18 02:40:35 +0000 UTC - event for server-envvars-43bac199-120a-4c5b-a62d-22ba1d3304ba: {default-scheduler } Scheduled: Successfully assigned pods-223/server-envvars-43bac199-120a-4c5b-a62d-22ba1d3304ba to 1168k8s000 Jan 18 02:45:35.961: INFO: At 2021-01-18 02:40:52 +0000 UTC - event for server-envvars-43bac199-120a-4c5b-a62d-22ba1d3304ba: {kubelet 1168k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 02:45:35.961: INFO: At 2021-01-18 02:40:54 +0000 UTC - event for server-envvars-43bac199-120a-4c5b-a62d-22ba1d3304ba: {kubelet 1168k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 02:45:35.961: INFO: At 2021-01-18 02:40:55 +0000 UTC - event for server-envvars-43bac199-120a-4c5b-a62d-22ba1d3304ba: {kubelet 1168k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 18 02:45:35.961: INFO: At 2021-01-18 02:41:00 +0000 UTC - event for server-envvars-43bac199-120a-4c5b-a62d-22ba1d3304ba: {kubelet 1168k8s000} Failed: Error: ImagePullBackOff Jan 18 02:45:35.998: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 02:45:35.998: INFO: server-envvars-43bac199-120a-4c5b-a62d-22ba1d3304ba 1168k8s000 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 02:40:35 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 02:40:35 +0000 UTC ContainersNotReady containers with unready status: [srv]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 02:40:35 +0000 UTC ContainersNotReady containers with unready status: [srv]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 02:40:35 +0000 UTC }] Jan 18 02:45:35.998: INFO: Jan 18 02:45:36.067: INFO: Logging node info for node 1168k8s000 Jan 18 02:45:36.103: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 1800 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 02:42:46 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 02:42:46 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 02:42:46 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 02:42:46 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 02:45:36.104: INFO: Logging kubelet events for node 1168k8s000 Jan 18 02:45:36.140: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 02:45:36.257: INFO: server-envvars-43bac199-120a-4c5b-a62d-22ba1d3304ba started at 2021-01-18 02:40:35 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:36.257: INFO: Container srv ready: false, restart count 0 Jan 18 02:45:36.257: INFO: pod-configmaps-34cd7cb9-d235-49c3-894d-e0364949a4b1 started at 2021-01-18 02:42:35 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:36.257: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 02:45:36.257: INFO: sample-webhook-deployment-65bfd79dc5-gbnsk started at 2021-01-18 02:40:43 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:36.257: INFO: Container sample-webhook ready: false, restart count 0 Jan 18 02:45:36.257: INFO: liveness-773c4585-4db8-42de-8914-34cc8655e210 started at 2021-01-18 02:41:40 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:36.257: INFO: Container agnhost-container ready: false, restart count 0 W0118 02:45:36.330313 40161 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 02:45:36.460: INFO: Latency metrics for node 1168k8s000 Jan 18 02:45:36.460: INFO: Logging node info for node 1168k8s001 Jan 18 02:45:36.496: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 2003 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 02:43:18 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 02:43:18 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 02:43:18 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 02:43:18 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 02:45:36.496: INFO: Logging kubelet events for node 1168k8s001 Jan 18 02:45:36.533: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 02:45:36.635: INFO: sample-webhook-deployment-65bfd79dc5-69zxz started at 2021-01-18 02:40:37 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:36.635: INFO: Container sample-webhook ready: false, restart count 0 Jan 18 02:45:36.635: INFO: sample-webhook-deployment-65bfd79dc5-vmlnp started at 2021-01-18 02:42:51 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:36.635: INFO: Container sample-webhook ready: false, restart count 0 Jan 18 02:45:36.635: INFO: pod-secrets-cc366c13-18c3-4bde-b3e4-1fbf78fd69af started at 2021-01-18 02:40:36 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:36.635: INFO: Container secret-volume-test ready: false, restart count 0 Jan 18 02:45:36.635: INFO: test-rollover-controller-rqp2f started at 2021-01-18 02:42:36 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:36.635: INFO: Container httpd ready: true, restart count 0 Jan 18 02:45:36.635: INFO: test-rollover-deployment-66fd47d5d5-b6nkh started at 2021-01-18 02:43:01 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:36.635: INFO: Container agnhost ready: false, restart count 0 W0118 02:45:36.675431 40161 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 02:45:36.835: INFO: Latency metrics for node 1168k8s001 Jan 18 02:45:36.835: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 02:45:36.872: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 2155 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 02:44:13 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 02:44:13 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 02:44:13 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 02:44:13 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 02:45:36.873: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 02:45:36.913: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 02:45:37.026: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:37.026: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 18 02:45:37.026: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:37.026: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 02:45:37.026: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 02:45:37.026: INFO: Container liveness-probe ready: true, restart count 0 Jan 18 02:45:37.026: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 18 02:45:37.026: INFO: Container secrets-store ready: true, restart count 0 Jan 18 02:45:37.026: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:37.026: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 18 02:45:37.026: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:37.026: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 02:45:37.026: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:37.026: INFO: Container kube-apiserver ready: true, restart count 0 Jan 18 02:45:37.026: INFO: blobfuse-flexvol-installer-dvjv8 started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:37.026: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 18 02:45:37.026: INFO: kube-proxy-r9btf started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:37.026: INFO: Container kube-proxy ready: true, restart count 0 Jan 18 02:45:37.026: INFO: metrics-server-6c8cc7585b-f7l2w started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:37.026: INFO: Container metrics-server ready: true, restart count 0 Jan 18 02:45:37.026: INFO: csi-secrets-store-provider-azure-4dnqk started at 2021-01-18 02:38:54 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:37.026: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 18 02:45:37.026: INFO: kube-addon-manager-k8s-master-11684159-0 started at 2021-01-18 02:38:21 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:37.026: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 18 02:45:37.026: INFO: coredns-autoscaler-87b67c5fd-7jfwj started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:37.026: INFO: Container autoscaler ready: true, restart count 0 Jan 18 02:45:37.026: INFO: coredns-6bbfb77cb5-4gfdd started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 02:45:37.026: INFO: Container coredns ready: true, restart count 0 W0118 02:45:37.078423 40161 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 02:45:37.280: INFO: Latency metrics for node k8s-master-11684159-0 Jan 18 02:45:37.280: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "pods-223" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sPods\sshould\srun\sthrough\sthe\slifecycle\sof\sPods\sand\sPodStatus\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 18 03:16:24.066: failed to see Pod pod-test in namespace pods-2293 running Unexpected error: <*errors.errorString | 0xc000115e10>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:951from junit_06.xml
[BeforeEach] [k8s.io] Pods /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 03:15:23.617: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename pods �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in pods-2293 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pods /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:187 [It] should run through the lifecycle of Pods and PodStatus [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: creating a Pod with a static label �[1mSTEP�[0m: watching for Pod to be ready Jan 18 03:15:24.102: INFO: observed Pod pod-test in namespace pods-2293 in phase Pending with labels: map[test-pod-static:true] & conditions [] Jan 18 03:15:24.102: INFO: observed Pod pod-test in namespace pods-2293 in phase Pending with labels: map[test-pod-static:true] & conditions [{PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC }] Jan 18 03:15:24.102: INFO: observed Pod pod-test in namespace pods-2293 in phase Pending with labels: map[test-pod-static:true] & conditions [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC }] Jan 18 03:15:50.469: INFO: observed Pod pod-test in namespace pods-2293 in phase Pending with labels: map[test-pod-static:true] & conditions [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC }] Jan 18 03:15:54.525: INFO: observed Pod pod-test in namespace pods-2293 in phase Pending with labels: map[test-pod-static:true] & conditions [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC }] Jan 18 03:15:59.226: INFO: observed Pod pod-test in namespace pods-2293 in phase Pending with labels: map[test-pod-static:true] & conditions [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC }] Jan 18 03:16:00.231: INFO: observed Pod pod-test in namespace pods-2293 in phase Pending with labels: map[test-pod-static:true] & conditions [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC }] Jan 18 03:16:13.629: INFO: observed Pod pod-test in namespace pods-2293 in phase Pending with labels: map[test-pod-static:true] & conditions [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC }] Jan 18 03:16:24.066: FAIL: failed to see Pod pod-test in namespace pods-2293 running Unexpected error: <*errors.errorString | 0xc000115e10>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func18.13() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:951 +0xbd7 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002377200) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc002377200) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002377200, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Pods /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "pods-2293". �[1mSTEP�[0m: Found 5 events. Jan 18 03:16:24.104: INFO: At 2021-01-18 03:15:24 +0000 UTC - event for pod-test: {default-scheduler } Scheduled: Successfully assigned pods-2293/pod-test to 1168k8s001 Jan 18 03:16:24.104: INFO: At 2021-01-18 03:15:47 +0000 UTC - event for pod-test: {kubelet 1168k8s001} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 03:16:24.104: INFO: At 2021-01-18 03:15:48 +0000 UTC - event for pod-test: {kubelet 1168k8s001} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 03:16:24.104: INFO: At 2021-01-18 03:15:50 +0000 UTC - event for pod-test: {kubelet 1168k8s001} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 18 03:16:24.104: INFO: At 2021-01-18 03:15:53 +0000 UTC - event for pod-test: {kubelet 1168k8s001} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 03:16:24.142: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 03:16:24.142: INFO: pod-test 1168k8s001 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC ContainersNotReady containers with unready status: [pod-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:15:24 +0000 UTC }] Jan 18 03:16:24.142: INFO: Jan 18 03:16:24.217: INFO: Logging node info for node 1168k8s000 Jan 18 03:16:24.255: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 10457 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:15:24 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:15:24 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:15:24 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:15:24 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:16:24.256: INFO: Logging kubelet events for node 1168k8s000 Jan 18 03:16:24.295: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 03:16:24.336: INFO: dns-test-518e46aa-c9a9-4719-b58e-770160c87a4e started at 2021-01-18 03:05:01 +0000 UTC (0+3 container statuses recorded) Jan 18 03:16:24.336: INFO: Container jessie-querier ready: true, restart count 0 Jan 18 03:16:24.336: INFO: Container querier ready: false, restart count 0 Jan 18 03:16:24.336: INFO: Container webserver ready: false, restart count 0 Jan 18 03:16:24.336: INFO: ss-1 started at 2021-01-18 03:16:05 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:24.336: INFO: Container webserver ready: false, restart count 0 Jan 18 03:16:24.336: INFO: dns-test-ed5e90a5-688f-4640-a528-4c8cd0fa5da9 started at 2021-01-18 03:07:22 +0000 UTC (0+3 container statuses recorded) Jan 18 03:16:24.336: INFO: Container jessie-querier ready: false, restart count 5 Jan 18 03:16:24.336: INFO: Container querier ready: false, restart count 0 Jan 18 03:16:24.336: INFO: Container webserver ready: false, restart count 0 W0118 03:16:24.419208 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:16:24.581: INFO: Latency metrics for node 1168k8s000 Jan 18 03:16:24.581: INFO: Logging node info for node 1168k8s001 Jan 18 03:16:24.619: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 9646 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:13:52 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:13:52 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:13:52 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:13:52 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:16:24.619: INFO: Logging kubelet events for node 1168k8s001 Jan 18 03:16:24.659: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 03:16:24.703: INFO: pod-configmaps-ee9828e8-dbe0-48cd-a930-8b40eeecd2ea started at 2021-01-18 03:14:30 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:24.703: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 03:16:24.703: INFO: downwardapi-volume-46c840e2-50e7-48a8-a912-6bf049f2c9ea started at 2021-01-18 03:16:06 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:24.703: INFO: Container client-container ready: false, restart count 0 Jan 18 03:16:24.703: INFO: downwardapi-volume-e887d0f5-f2e2-41de-8051-ba64cbbdc115 started at 2021-01-18 03:12:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:24.703: INFO: Container client-container ready: false, restart count 0 Jan 18 03:16:24.703: INFO: pod-test started at 2021-01-18 03:15:24 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:24.703: INFO: Container pod-test ready: false, restart count 0 Jan 18 03:16:24.703: INFO: ss-2 started at 2021-01-18 03:16:05 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:24.703: INFO: Container webserver ready: false, restart count 0 Jan 18 03:16:24.703: INFO: test-pod-d332b962-7116-49f0-99b4-dc5a7532fee6 started at 2021-01-18 03:14:15 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:24.703: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 03:16:24.703: INFO: ss-0 started at 2021-01-18 03:15:03 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:24.703: INFO: Container webserver ready: false, restart count 0 W0118 03:16:24.748201 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:16:24.924: INFO: Latency metrics for node 1168k8s001 Jan 18 03:16:24.925: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 03:16:24.963: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 9829 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:14:23 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:14:23 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:14:23 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:14:23 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:16:24.963: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 03:16:25.002: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 03:16:25.047: INFO: kube-proxy-r9btf started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:25.047: INFO: Container kube-proxy ready: true, restart count 0 Jan 18 03:16:25.047: INFO: metrics-server-6c8cc7585b-f7l2w started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:25.047: INFO: Container metrics-server ready: true, restart count 0 Jan 18 03:16:25.047: INFO: csi-secrets-store-provider-azure-4dnqk started at 2021-01-18 02:38:54 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:25.047: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 18 03:16:25.047: INFO: kube-addon-manager-k8s-master-11684159-0 started at 2021-01-18 02:38:21 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:25.047: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 18 03:16:25.047: INFO: coredns-autoscaler-87b67c5fd-7jfwj started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:25.047: INFO: Container autoscaler ready: true, restart count 0 Jan 18 03:16:25.047: INFO: coredns-6bbfb77cb5-4gfdd started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:25.047: INFO: Container coredns ready: true, restart count 0 Jan 18 03:16:25.047: INFO: blobfuse-flexvol-installer-dvjv8 started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:25.047: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 18 03:16:25.047: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:25.047: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 03:16:25.047: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 03:16:25.047: INFO: Container liveness-probe ready: true, restart count 0 Jan 18 03:16:25.047: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 18 03:16:25.047: INFO: Container secrets-store ready: true, restart count 0 Jan 18 03:16:25.047: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:25.047: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 18 03:16:25.047: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:25.047: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 03:16:25.047: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:25.047: INFO: Container kube-apiserver ready: true, restart count 0 Jan 18 03:16:25.047: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:16:25.047: INFO: Container azure-ip-masq-agent ready: true, restart count 0 W0118 03:16:25.089509 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:16:25.243: INFO: Latency metrics for node k8s-master-11684159-0 Jan 18 03:16:25.243: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "pods-2293" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sProbing\scontainer\sshould\s\*not\*\sbe\srestarted\swith\sa\s\/healthz\shttp\sliveness\sprobe\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 18 04:01:58.121: starting pod test-webserver-95a7d94b-d15e-49e2-8210-78235a703229 in namespace container-probe-8407 Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:589from junit_04.xml
[BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 03:56:57.614: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename container-probe �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-probe-8407 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:53 [It] should *not* be restarted with a /healthz http liveness probe [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: Creating pod test-webserver-95a7d94b-d15e-49e2-8210-78235a703229 in namespace container-probe-8407 Jan 18 04:01:58.121: FAIL: starting pod test-webserver-95a7d94b-d15e-49e2-8210-78235a703229 in namespace container-probe-8407 Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.RunLivenessTest(0xc0001646e0, 0xc002915400, 0x0, 0x37e11d6000) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:589 +0x4b9 k8s.io/kubernetes/test/e2e/common.glob..func3.9() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:208 +0x165 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002b17800) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc002b17800) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002b17800, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 �[1mSTEP�[0m: deleting the pod [AfterEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-probe-8407". �[1mSTEP�[0m: Found 4 events. Jan 18 04:01:58.201: INFO: At 2021-01-18 03:56:58 +0000 UTC - event for test-webserver-95a7d94b-d15e-49e2-8210-78235a703229: {default-scheduler } Scheduled: Successfully assigned container-probe-8407/test-webserver-95a7d94b-d15e-49e2-8210-78235a703229 to 1168k8s000 Jan 18 04:01:58.201: INFO: At 2021-01-18 03:57:00 +0000 UTC - event for test-webserver-95a7d94b-d15e-49e2-8210-78235a703229: {kubelet 1168k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 04:01:58.201: INFO: At 2021-01-18 03:57:01 +0000 UTC - event for test-webserver-95a7d94b-d15e-49e2-8210-78235a703229: {kubelet 1168k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 04:01:58.201: INFO: At 2021-01-18 03:57:01 +0000 UTC - event for test-webserver-95a7d94b-d15e-49e2-8210-78235a703229: {kubelet 1168k8s000} Failed: Error: ImagePullBackOff Jan 18 04:01:58.237: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 04:01:58.237: INFO: Jan 18 04:01:58.307: INFO: Logging node info for node 1168k8s000 Jan 18 04:01:58.349: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 22654 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:57:59 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:57:59 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:57:59 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:57:59 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 04:01:58.350: INFO: Logging kubelet events for node 1168k8s000 Jan 18 04:01:58.386: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 04:01:58.455: INFO: pod-projected-configmaps-358ab0a6-5e90-4faf-8f37-6e585459cbfa started at 2021-01-18 03:57:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:58.455: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 04:01:58.455: INFO: ss2-1 started at 2021-01-18 04:01:50 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:58.455: INFO: Container webserver ready: true, restart count 0 Jan 18 04:01:58.455: INFO: liveness-483ced27-88f2-4ef9-9ce2-1527f130468a started at 2021-01-18 03:58:30 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:58.455: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 04:01:58.455: INFO: downwardapi-volume-c77d88fb-6d74-482d-a619-6bbf33820445 started at 2021-01-18 04:01:37 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:58.455: INFO: Container client-container ready: false, restart count 0 W0118 04:01:58.528811 40159 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 04:01:58.693: INFO: Latency metrics for node 1168k8s000 Jan 18 04:01:58.693: INFO: Logging node info for node 1168k8s001 Jan 18 04:01:58.730: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 23217 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 04:01:01 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 04:01:01 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 04:01:01 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 04:01:01 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 04:01:58.731: INFO: Logging kubelet events for node 1168k8s001 Jan 18 04:01:58.767: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 04:01:58.807: INFO: ss2-0 started at 2021-01-18 04:01:43 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:58.807: INFO: Container webserver ready: true, restart count 0 Jan 18 04:01:58.807: INFO: test-recreate-deployment-b65d5894b-zf6qj started at 2021-01-18 03:58:18 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:58.807: INFO: Container agnhost ready: false, restart count 0 Jan 18 04:01:58.807: INFO: pod-projected-configmaps-5c272a2c-fe19-48e1-8191-928003c19c5b started at 2021-01-18 03:57:36 +0000 UTC (0+3 container statuses recorded) Jan 18 04:01:58.807: INFO: Container createcm-volume-test ready: false, restart count 0 Jan 18 04:01:58.807: INFO: Container delcm-volume-test ready: false, restart count 0 Jan 18 04:01:58.807: INFO: Container updcm-volume-test ready: false, restart count 0 Jan 18 04:01:58.807: INFO: ss2-2 started at 2021-01-18 04:01:57 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:58.807: INFO: Container webserver ready: false, restart count 0 Jan 18 04:01:58.807: INFO: pod-configmaps-4a1ed8fb-801a-4a26-a551-3158110862cd started at 2021-01-18 04:01:49 +0000 UTC (0+2 container statuses recorded) Jan 18 04:01:58.807: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 04:01:58.807: INFO: Container configmap-volume-binary-test ready: false, restart count 0 W0118 04:01:58.846837 40159 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 04:01:59.114: INFO: Latency metrics for node 1168k8s001 Jan 18 04:01:59.114: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 04:01:59.151: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 23085 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:59:41 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:59:41 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:59:41 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:59:41 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 04:01:59.152: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 04:01:59.190: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 04:01:59.231: INFO: coredns-autoscaler-87b67c5fd-7jfwj started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:59.231: INFO: Container autoscaler ready: true, restart count 0 Jan 18 04:01:59.231: INFO: blobfuse-flexvol-installer-dvjv8 started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:59.231: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 18 04:01:59.231: INFO: kube-proxy-r9btf started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:59.231: INFO: Container kube-proxy ready: true, restart count 0 Jan 18 04:01:59.231: INFO: metrics-server-6c8cc7585b-f7l2w started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:59.231: INFO: Container metrics-server ready: true, restart count 0 Jan 18 04:01:59.231: INFO: csi-secrets-store-provider-azure-4dnqk started at 2021-01-18 02:38:54 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:59.231: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 18 04:01:59.231: INFO: kube-addon-manager-k8s-master-11684159-0 started at 2021-01-18 02:38:21 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:59.231: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 18 04:01:59.231: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:59.231: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 18 04:01:59.231: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:59.231: INFO: Container kube-apiserver ready: true, restart count 0 Jan 18 04:01:59.231: INFO: coredns-6bbfb77cb5-4gfdd started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:59.231: INFO: Container coredns ready: true, restart count 0 Jan 18 04:01:59.231: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:59.231: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 04:01:59.231: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:59.232: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 04:01:59.232: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 04:01:59.232: INFO: Container liveness-probe ready: true, restart count 0 Jan 18 04:01:59.232: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 18 04:01:59.232: INFO: Container secrets-store ready: true, restart count 0 Jan 18 04:01:59.232: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:01:59.232: INFO: Container kube-controller-manager ready: true, restart count 0 W0118 04:01:59.271286 40159 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 04:01:59.426: INFO: Latency metrics for node k8s-master-11684159-0 Jan 18 04:01:59.426: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-probe-8407" for this suite.
Find test-webserver-95a7d94b-d15e-49e2-8210-78235a703229 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sProbing\scontainer\sshould\s\*not\*\sbe\srestarted\swith\sa\stcp\:8080\sliveness\sprobe\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 18 04:03:30.620: starting pod liveness-483ced27-88f2-4ef9-9ce2-1527f130468a in namespace container-probe-7244 Unexpected error: <*errors.errorString | 0xc000288200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:589from junit_05.xml
[BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 03:58:30.106: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename container-probe �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-probe-7244 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:53 [It] should *not* be restarted with a tcp:8080 liveness probe [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: Creating pod liveness-483ced27-88f2-4ef9-9ce2-1527f130468a in namespace container-probe-7244 Jan 18 04:03:30.620: FAIL: starting pod liveness-483ced27-88f2-4ef9-9ce2-1527f130468a in namespace container-probe-7244 Unexpected error: <*errors.errorString | 0xc000288200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.RunLivenessTest(0xc0000f1760, 0xc006d0c400, 0x0, 0x37e11d6000) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:589 +0x4b9 k8s.io/kubernetes/test/e2e/common.glob..func3.7() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:177 +0x137 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00221b380) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc00221b380) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc00221b380, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 �[1mSTEP�[0m: deleting the pod [AfterEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-probe-7244". �[1mSTEP�[0m: Found 5 events. Jan 18 04:03:30.727: INFO: At 2021-01-18 03:58:30 +0000 UTC - event for liveness-483ced27-88f2-4ef9-9ce2-1527f130468a: {default-scheduler } Scheduled: Successfully assigned container-probe-7244/liveness-483ced27-88f2-4ef9-9ce2-1527f130468a to 1168k8s000 Jan 18 04:03:30.727: INFO: At 2021-01-18 03:58:32 +0000 UTC - event for liveness-483ced27-88f2-4ef9-9ce2-1527f130468a: {kubelet 1168k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 04:03:30.727: INFO: At 2021-01-18 03:58:33 +0000 UTC - event for liveness-483ced27-88f2-4ef9-9ce2-1527f130468a: {kubelet 1168k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 04:03:30.727: INFO: At 2021-01-18 03:58:34 +0000 UTC - event for liveness-483ced27-88f2-4ef9-9ce2-1527f130468a: {kubelet 1168k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 18 04:03:30.727: INFO: At 2021-01-18 03:58:37 +0000 UTC - event for liveness-483ced27-88f2-4ef9-9ce2-1527f130468a: {kubelet 1168k8s000} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 04:03:30.763: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 04:03:30.764: INFO: Jan 18 04:03:30.860: INFO: Logging node info for node 1168k8s000 Jan 18 04:03:30.915: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 24029 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 04:03:01 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 04:03:01 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 04:03:01 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 04:03:01 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 04:03:30.916: INFO: Logging kubelet events for node 1168k8s000 Jan 18 04:03:30.952: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 04:03:30.994: INFO: annotationupdate50bb8538-5f64-4688-9922-40641d67b321 started at 2021-01-18 04:02:06 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:30.994: INFO: Container client-container ready: false, restart count 0 Jan 18 04:03:30.994: INFO: downwardapi-volume-c77d88fb-6d74-482d-a619-6bbf33820445 started at 2021-01-18 04:01:37 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:30.994: INFO: Container client-container ready: false, restart count 0 Jan 18 04:03:30.994: INFO: ss2-1 started at 2021-01-18 04:02:44 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:30.994: INFO: Container webserver ready: true, restart count 0 Jan 18 04:03:30.994: INFO: ss-0 started at 2021-01-18 04:03:29 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:30.994: INFO: Container webserver ready: false, restart count 0 W0118 04:03:31.067631 40164 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 04:03:31.451: INFO: Latency metrics for node 1168k8s000 Jan 18 04:03:31.451: INFO: Logging node info for node 1168k8s001 Jan 18 04:03:31.487: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 23217 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 04:01:01 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 04:01:01 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 04:01:01 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 04:01:01 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 04:03:31.488: INFO: Logging kubelet events for node 1168k8s001 Jan 18 04:03:31.524: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 04:03:31.569: INFO: pod-configmaps-4a1ed8fb-801a-4a26-a551-3158110862cd started at 2021-01-18 04:01:49 +0000 UTC (0+2 container statuses recorded) Jan 18 04:03:31.569: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 04:03:31.569: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Jan 18 04:03:31.569: INFO: ss2-0 started at 2021-01-18 04:03:04 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:31.569: INFO: Container webserver ready: true, restart count 0 Jan 18 04:03:31.569: INFO: pod-configmaps-28fa3435-d53e-4b07-b50d-08be9b84956d started at 2021-01-18 04:02:52 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:31.569: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 04:03:31.569: INFO: sample-webhook-deployment-65bfd79dc5-75xqh started at 2021-01-18 04:02:57 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:31.569: INFO: Container sample-webhook ready: false, restart count 0 Jan 18 04:03:31.569: INFO: ss2-2 started at 2021-01-18 04:02:30 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:31.569: INFO: Container webserver ready: false, restart count 0 W0118 04:03:31.643124 40164 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 04:03:31.815: INFO: Latency metrics for node 1168k8s001 Jan 18 04:03:31.815: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 04:03:31.852: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 23085 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:59:41 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:59:41 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:59:41 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:59:41 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 04:03:31.852: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 04:03:31.889: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 04:03:31.931: INFO: coredns-6bbfb77cb5-4gfdd started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:31.931: INFO: Container coredns ready: true, restart count 0 Jan 18 04:03:31.931: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:31.931: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 18 04:03:31.931: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:31.931: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 04:03:31.931: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:31.931: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 04:03:31.931: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 04:03:31.931: INFO: Container liveness-probe ready: true, restart count 0 Jan 18 04:03:31.931: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 18 04:03:31.931: INFO: Container secrets-store ready: true, restart count 0 Jan 18 04:03:31.931: INFO: kube-addon-manager-k8s-master-11684159-0 started at 2021-01-18 02:38:21 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:31.931: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 18 04:03:31.931: INFO: coredns-autoscaler-87b67c5fd-7jfwj started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:31.931: INFO: Container autoscaler ready: true, restart count 0 Jan 18 04:03:31.931: INFO: blobfuse-flexvol-installer-dvjv8 started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:31.931: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 18 04:03:31.931: INFO: kube-proxy-r9btf started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:31.931: INFO: Container kube-proxy ready: true, restart count 0 Jan 18 04:03:31.931: INFO: metrics-server-6c8cc7585b-f7l2w started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:31.931: INFO: Container metrics-server ready: true, restart count 0 Jan 18 04:03:31.931: INFO: csi-secrets-store-provider-azure-4dnqk started at 2021-01-18 02:38:54 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:31.931: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 18 04:03:31.931: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:31.931: INFO: Container kube-apiserver ready: true, restart count 0 Jan 18 04:03:31.931: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:03:31.931: INFO: Container azure-ip-masq-agent ready: true, restart count 0 W0118 04:03:31.979916 40164 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 04:03:32.202: INFO: Latency metrics for node k8s-master-11684159-0 Jan 18 04:03:32.202: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-probe-7244" for this suite.
Find liveness-483ced27-88f2-4ef9-9ce2-1527f130468a mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sProbing\scontainer\sshould\sbe\srestarted\swith\sa\s\/healthz\shttp\sliveness\sprobe\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 18 02:46:41.119: starting pod liveness-773c4585-4db8-42de-8914-34cc8655e210 in namespace container-probe-2314 Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:589from junit_07.xml
[BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 02:41:40.528: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename container-probe �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-probe-2314 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:53 [It] should be restarted with a /healthz http liveness probe [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: Creating pod liveness-773c4585-4db8-42de-8914-34cc8655e210 in namespace container-probe-2314 Jan 18 02:46:41.119: FAIL: starting pod liveness-773c4585-4db8-42de-8914-34cc8655e210 in namespace container-probe-2314 Unexpected error: <*errors.errorString | 0xc0002761f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.RunLivenessTest(0xc0001e46e0, 0xc000180800, 0x1, 0x37e11d6000) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:589 +0x4b9 k8s.io/kubernetes/test/e2e/common.glob..func3.6() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:162 +0x156 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002217080) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc002217080) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002217080, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 �[1mSTEP�[0m: deleting the pod [AfterEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-probe-2314". �[1mSTEP�[0m: Found 5 events. Jan 18 02:46:41.211: INFO: At 2021-01-18 02:41:40 +0000 UTC - event for liveness-773c4585-4db8-42de-8914-34cc8655e210: {default-scheduler } Scheduled: Successfully assigned container-probe-2314/liveness-773c4585-4db8-42de-8914-34cc8655e210 to 1168k8s000 Jan 18 02:46:41.211: INFO: At 2021-01-18 02:41:47 +0000 UTC - event for liveness-773c4585-4db8-42de-8914-34cc8655e210: {kubelet 1168k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 02:46:41.211: INFO: At 2021-01-18 02:42:27 +0000 UTC - event for liveness-773c4585-4db8-42de-8914-34cc8655e210: {kubelet 1168k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 02:46:41.211: INFO: At 2021-01-18 02:42:27 +0000 UTC - event for liveness-773c4585-4db8-42de-8914-34cc8655e210: {kubelet 1168k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 18 02:46:41.211: INFO: At 2021-01-18 02:42:35 +0000 UTC - event for liveness-773c4585-4db8-42de-8914-34cc8655e210: {kubelet 1168k8s000} Failed: Error: ImagePullBackOff Jan 18 02:46:41.248: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 02:46:41.248: INFO: Jan 18 02:46:41.319: INFO: Logging node info for node 1168k8s000 Jan 18 02:46:41.355: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 1800 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 02:42:46 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 02:42:46 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 02:42:46 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 02:42:46 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 02:46:41.356: INFO: Logging kubelet events for node 1168k8s000 Jan 18 02:46:41.417: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 02:46:41.463: INFO: externalsvc-t6kcq started at 2021-01-18 02:45:43 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:41.463: INFO: Container externalsvc ready: false, restart count 0 Jan 18 02:46:41.463: INFO: logs-generator started at 2021-01-18 02:45:45 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:41.463: INFO: Container logs-generator ready: false, restart count 0 Jan 18 02:46:41.463: INFO: pod-configmaps-34cd7cb9-d235-49c3-894d-e0364949a4b1 started at 2021-01-18 02:42:35 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:41.463: INFO: Container agnhost-container ready: false, restart count 0 W0118 02:46:41.538016 40167 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 02:46:41.685: INFO: Latency metrics for node 1168k8s000 Jan 18 02:46:41.685: INFO: Logging node info for node 1168k8s001 Jan 18 02:46:41.722: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 2003 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 02:43:18 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 02:43:18 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 02:43:18 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 02:43:18 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 02:46:41.722: INFO: Logging kubelet events for node 1168k8s001 Jan 18 02:46:41.760: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 02:46:41.801: INFO: downwardapi-volume-9730319f-d967-41cd-925b-027dab6575a0 started at 2021-01-18 02:45:40 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:41.801: INFO: Container client-container ready: false, restart count 0 Jan 18 02:46:41.801: INFO: test-rollover-controller-rqp2f started at 2021-01-18 02:42:36 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:41.801: INFO: Container httpd ready: true, restart count 0 Jan 18 02:46:41.801: INFO: test-rollover-deployment-66fd47d5d5-b6nkh started at 2021-01-18 02:43:01 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:41.801: INFO: Container agnhost ready: false, restart count 0 Jan 18 02:46:41.801: INFO: externalsvc-9ms22 started at 2021-01-18 02:45:43 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:41.801: INFO: Container externalsvc ready: false, restart count 0 Jan 18 02:46:41.801: INFO: sample-webhook-deployment-65bfd79dc5-vmlnp started at 2021-01-18 02:42:51 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:41.801: INFO: Container sample-webhook ready: false, restart count 0 W0118 02:46:41.874859 40167 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 02:46:42.029: INFO: Latency metrics for node 1168k8s001 Jan 18 02:46:42.029: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 02:46:42.066: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 2155 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 02:44:13 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 02:44:13 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 02:44:13 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 02:44:13 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 02:46:42.067: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 02:46:42.106: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 02:46:42.148: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:42.148: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 18 02:46:42.148: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:42.148: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 02:46:42.148: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:42.148: INFO: Container kube-apiserver ready: true, restart count 0 Jan 18 02:46:42.148: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:42.148: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 18 02:46:42.148: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:42.148: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 02:46:42.148: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 02:46:42.148: INFO: Container liveness-probe ready: true, restart count 0 Jan 18 02:46:42.148: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 18 02:46:42.148: INFO: Container secrets-store ready: true, restart count 0 Jan 18 02:46:42.148: INFO: kube-addon-manager-k8s-master-11684159-0 started at 2021-01-18 02:38:21 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:42.148: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 18 02:46:42.148: INFO: coredns-autoscaler-87b67c5fd-7jfwj started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:42.148: INFO: Container autoscaler ready: true, restart count 0 Jan 18 02:46:42.148: INFO: coredns-6bbfb77cb5-4gfdd started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:42.148: INFO: Container coredns ready: true, restart count 0 Jan 18 02:46:42.148: INFO: blobfuse-flexvol-installer-dvjv8 started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:42.148: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 18 02:46:42.148: INFO: kube-proxy-r9btf started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:42.148: INFO: Container kube-proxy ready: true, restart count 0 Jan 18 02:46:42.148: INFO: metrics-server-6c8cc7585b-f7l2w started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:42.148: INFO: Container metrics-server ready: true, restart count 0 Jan 18 02:46:42.148: INFO: csi-secrets-store-provider-azure-4dnqk started at 2021-01-18 02:38:54 +0000 UTC (0+1 container statuses recorded) Jan 18 02:46:42.148: INFO: Container provider-azure-installer ready: true, restart count 0 W0118 02:46:42.190403 40167 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 02:46:42.345: INFO: Latency metrics for node k8s-master-11684159-0 Jan 18 02:46:42.345: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-probe-2314" for this suite.
Find liveness-773c4585-4db8-42de-8914-34cc8655e210 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sProbing\scontainer\sshould\shave\smonotonically\sincreasing\srestart\scount\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 18 03:26:40.746: starting pod liveness-578c255d-afa5-4ab5-b764-f8e14de0e22d in namespace container-probe-1336 Unexpected error: <*errors.errorString | 0xc000115e10>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:589from junit_06.xml
[BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 03:21:40.203: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename container-probe �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-probe-1336 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:53 [It] should have monotonically increasing restart count [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: Creating pod liveness-578c255d-afa5-4ab5-b764-f8e14de0e22d in namespace container-probe-1336 Jan 18 03:26:40.746: FAIL: starting pod liveness-578c255d-afa5-4ab5-b764-f8e14de0e22d in namespace container-probe-1336 Unexpected error: <*errors.errorString | 0xc000115e10>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.RunLivenessTest(0xc0003b0840, 0xc00157f400, 0x5, 0x45d964b800) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:589 +0x4b9 k8s.io/kubernetes/test/e2e/common.glob..func3.8() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:192 +0x156 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002377200) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc002377200) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002377200, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 �[1mSTEP�[0m: deleting the pod [AfterEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-probe-1336". �[1mSTEP�[0m: Found 4 events. Jan 18 03:26:40.839: INFO: At 2021-01-18 03:21:40 +0000 UTC - event for liveness-578c255d-afa5-4ab5-b764-f8e14de0e22d: {default-scheduler } Scheduled: Successfully assigned container-probe-1336/liveness-578c255d-afa5-4ab5-b764-f8e14de0e22d to 1168k8s001 Jan 18 03:26:40.839: INFO: At 2021-01-18 03:21:43 +0000 UTC - event for liveness-578c255d-afa5-4ab5-b764-f8e14de0e22d: {kubelet 1168k8s001} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 03:26:40.839: INFO: At 2021-01-18 03:21:44 +0000 UTC - event for liveness-578c255d-afa5-4ab5-b764-f8e14de0e22d: {kubelet 1168k8s001} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 03:26:40.839: INFO: At 2021-01-18 03:21:45 +0000 UTC - event for liveness-578c255d-afa5-4ab5-b764-f8e14de0e22d: {kubelet 1168k8s001} Failed: Error: ImagePullBackOff Jan 18 03:26:40.877: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 03:26:40.877: INFO: Jan 18 03:26:40.952: INFO: Logging node info for node 1168k8s000 Jan 18 03:26:40.989: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 12588 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:22:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:22:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:22:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:22:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:26:40.989: INFO: Logging kubelet events for node 1168k8s000 Jan 18 03:26:41.029: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 03:26:41.129: INFO: back-off-cap started at 2021-01-18 03:19:11 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.129: INFO: Container back-off-cap ready: false, restart count 6 Jan 18 03:26:41.129: INFO: pod-projected-secrets-df0f0e0d-ab16-4657-9be8-4db3c84575f2 started at 2021-01-18 03:24:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.129: INFO: Container projected-secret-volume-test ready: false, restart count 0 Jan 18 03:26:41.129: INFO: pod-projected-configmaps-3c943ec7-3360-4f6a-b513-4d6bd43c71dd started at 2021-01-18 03:22:36 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.129: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 03:26:41.129: INFO: image-pull-testf6f2402a-5fce-4b46-b2bf-edc825bb9dfa started at 2021-01-18 03:22:48 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.129: INFO: Container image-pull-test ready: false, restart count 0 W0118 03:26:41.206327 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:26:41.342: INFO: Latency metrics for node 1168k8s000 Jan 18 03:26:41.342: INFO: Logging node info for node 1168k8s001 Jan 18 03:26:41.380: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 12725 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:23:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:23:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:23:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:23:56 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:26:41.381: INFO: Logging kubelet events for node 1168k8s001 Jan 18 03:26:41.491: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 03:26:41.588: INFO: pod-host-path-test started at 2021-01-18 03:22:12 +0000 UTC (0+2 container statuses recorded) Jan 18 03:26:41.588: INFO: Container test-container-1 ready: false, restart count 0 Jan 18 03:26:41.588: INFO: Container test-container-2 ready: false, restart count 0 Jan 18 03:26:41.588: INFO: pod-projected-configmaps-0d8fcc2a-e0c5-4b6a-b035-4719b12dd25d started at 2021-01-18 03:24:47 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.588: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 03:26:41.588: INFO: downwardapi-volume-d8c78caa-9b35-4d8d-8b0d-dc4e3b203337 started at 2021-01-18 03:26:08 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.588: INFO: Container client-container ready: false, restart count 0 W0118 03:26:41.646620 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:26:41.781: INFO: Latency metrics for node 1168k8s001 Jan 18 03:26:41.781: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 03:26:41.819: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 12784 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:24:26 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:24:26 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:24:26 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:24:26 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:26:41.820: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 03:26:41.859: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 03:26:41.921: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.921: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 18 03:26:41.921: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.921: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 03:26:41.921: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.921: INFO: Container kube-apiserver ready: true, restart count 0 Jan 18 03:26:41.921: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.921: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 18 03:26:41.921: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.921: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 03:26:41.921: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 03:26:41.921: INFO: Container liveness-probe ready: true, restart count 0 Jan 18 03:26:41.921: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 18 03:26:41.921: INFO: Container secrets-store ready: true, restart count 0 Jan 18 03:26:41.921: INFO: kube-addon-manager-k8s-master-11684159-0 started at 2021-01-18 02:38:21 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.921: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 18 03:26:41.921: INFO: coredns-autoscaler-87b67c5fd-7jfwj started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.921: INFO: Container autoscaler ready: true, restart count 0 Jan 18 03:26:41.921: INFO: coredns-6bbfb77cb5-4gfdd started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.921: INFO: Container coredns ready: true, restart count 0 Jan 18 03:26:41.921: INFO: blobfuse-flexvol-installer-dvjv8 started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.921: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 18 03:26:41.921: INFO: kube-proxy-r9btf started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.921: INFO: Container kube-proxy ready: true, restart count 0 Jan 18 03:26:41.921: INFO: metrics-server-6c8cc7585b-f7l2w started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.921: INFO: Container metrics-server ready: true, restart count 0 Jan 18 03:26:41.921: INFO: csi-secrets-store-provider-azure-4dnqk started at 2021-01-18 02:38:54 +0000 UTC (0+1 container statuses recorded) Jan 18 03:26:41.921: INFO: Container provider-azure-installer ready: true, restart count 0 W0118 03:26:41.963025 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:26:42.115: INFO: Latency metrics for node k8s-master-11684159-0 Jan 18 03:26:42.115: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-probe-1336" for this suite.
Find liveness-578c255d-afa5-4ab5-b764-f8e14de0e22d mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sProbing\scontainer\swith\sreadiness\sprobe\sshould\snot\sbe\sready\sbefore\sinitial\sdelay\sand\snever\srestart\s\[NodeConformance\]\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 18 04:10:06.267: Unexpected error: <*errors.errorString | 0xc00426b010>: { s: "want pod 'test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696' on '1168k8s000' to be 'Running' but was 'Pending'", } want pod 'test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696' on '1168k8s000' to be 'Running' but was 'Pending' occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:70from junit_06.xml
[BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 04:05:05.685: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename container-probe �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-probe-8044 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:53 [It] with readiness probe should not be ready before initial delay and never restart [NodeConformance] [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 18 04:05:06.152: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:08.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:10.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:12.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:14.193: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:16.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:18.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:20.194: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:22.197: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:24.194: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:26.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:28.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:30.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:32.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:34.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:36.194: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:38.194: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:40.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:42.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:44.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:46.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:48.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:50.193: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:52.193: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:54.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:56.193: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:05:58.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:00.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:02.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:04.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:06.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:08.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:10.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:12.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:14.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:16.193: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:18.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:20.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:22.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:24.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:26.194: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:28.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:30.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:32.193: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:34.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:36.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:38.193: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:40.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:42.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:44.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:46.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:48.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:50.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:52.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:54.193: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:56.206: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:06:58.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:00.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:02.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:04.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:06.193: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:08.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:10.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:12.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:14.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:16.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:18.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:20.207: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:22.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:24.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:26.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:28.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:30.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:32.195: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:34.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:36.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:38.197: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:40.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:42.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:44.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:46.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:48.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:50.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:52.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:54.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:56.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:07:58.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:00.198: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:02.195: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:04.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:06.202: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:08.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:10.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:12.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:14.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:16.190: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:18.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:20.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:22.195: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:24.195: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:26.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:28.193: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:30.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:32.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:34.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:36.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:38.201: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:40.195: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:42.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:44.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:46.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:48.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:50.195: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:52.190: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:54.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:56.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:08:58.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:00.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:02.193: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:04.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:06.193: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:08.194: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:10.190: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:12.196: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:14.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:16.200: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:18.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:20.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:22.201: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:24.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:26.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:28.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:30.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:32.193: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:34.265: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:36.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:38.200: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:40.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:42.192: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:44.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:46.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:48.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:50.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:52.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:54.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:56.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:09:58.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:10:00.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:10:02.193: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:10:04.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:10:06.191: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:10:06.229: INFO: The status of Pod test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 is Pending, waiting for it to be Running (with Ready = true) Jan 18 04:10:06.267: FAIL: Unexpected error: <*errors.errorString | 0xc00426b010>: { s: "want pod 'test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696' on '1168k8s000' to be 'Running' but was 'Pending'", } want pod 'test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696' on '1168k8s000' to be 'Running' but was 'Pending' occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func3.2() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:70 +0x205 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002377200) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc002377200) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002377200, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Probing container /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "container-probe-8044". �[1mSTEP�[0m: Found 5 events. Jan 18 04:10:06.309: INFO: At 2021-01-18 04:05:06 +0000 UTC - event for test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696: {default-scheduler } Scheduled: Successfully assigned container-probe-8044/test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 to 1168k8s000 Jan 18 04:10:06.309: INFO: At 2021-01-18 04:05:11 +0000 UTC - event for test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696: {kubelet 1168k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 04:10:06.309: INFO: At 2021-01-18 04:05:12 +0000 UTC - event for test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696: {kubelet 1168k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 04:10:06.309: INFO: At 2021-01-18 04:05:13 +0000 UTC - event for test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696: {kubelet 1168k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 18 04:10:06.309: INFO: At 2021-01-18 04:05:16 +0000 UTC - event for test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696: {kubelet 1168k8s000} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 04:10:06.346: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 04:10:06.346: INFO: test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 1168k8s000 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 04:05:06 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 04:05:06 +0000 UTC ContainersNotReady containers with unready status: [test-webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 04:05:06 +0000 UTC ContainersNotReady containers with unready status: [test-webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 04:05:06 +0000 UTC }] Jan 18 04:10:06.347: INFO: Jan 18 04:10:06.420: INFO: Logging node info for node 1168k8s000 Jan 18 04:10:06.457: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 25749 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 04:08:02 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 04:08:02 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 04:08:02 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 04:08:02 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 04:10:06.458: INFO: Logging kubelet events for node 1168k8s000 Jan 18 04:10:06.495: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 04:10:06.601: INFO: pod1 started at 2021-01-18 04:07:25 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:06.601: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 04:10:06.601: INFO: nodeport-test-q54gr started at 2021-01-18 04:06:51 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:06.601: INFO: Container nodeport-test ready: false, restart count 0 Jan 18 04:10:06.601: INFO: pod-handle-http-request started at 2021-01-18 04:06:45 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:06.601: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 04:10:06.601: INFO: pod-back-off-image started at 2021-01-18 04:07:40 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:06.601: INFO: Container back-off ready: false, restart count 4 Jan 18 04:10:06.601: INFO: test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 started at 2021-01-18 04:05:06 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:06.601: INFO: Container test-webserver ready: false, restart count 0 W0118 04:10:06.678519 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 04:10:06.812: INFO: Latency metrics for node 1168k8s000 Jan 18 04:10:06.812: INFO: Logging node info for node 1168k8s001 Jan 18 04:10:06.850: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 25071 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 04:06:02 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 04:06:02 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 04:06:02 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 04:06:02 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot@sha256:f2f6f1468b5852fa19d7c8fb1e9b80e47bbdce2aea810ea8aea61c049bfbc818 k8sprow.azurecr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:251220298,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 04:10:06.851: INFO: Logging kubelet events for node 1168k8s001 Jan 18 04:10:06.889: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 04:10:06.986: INFO: nodeport-test-rsrrg started at 2021-01-18 04:06:51 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:06.986: INFO: Container nodeport-test ready: false, restart count 0 Jan 18 04:10:06.986: INFO: pod-secrets-5ef841c1-7d90-4098-ae34-78a5bb562821 started at 2021-01-18 04:08:19 +0000 UTC (0+3 container statuses recorded) Jan 18 04:10:06.986: INFO: Container creates-volume-test ready: false, restart count 0 Jan 18 04:10:06.986: INFO: Container dels-volume-test ready: false, restart count 0 Jan 18 04:10:06.986: INFO: Container upds-volume-test ready: false, restart count 0 W0118 04:10:07.028551 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 04:10:07.142: INFO: Latency metrics for node 1168k8s001 Jan 18 04:10:07.142: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 04:10:07.180: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 26172 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 04:09:44 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 04:09:44 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 04:09:44 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 04:09:44 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 04:10:07.181: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 04:10:07.219: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 04:10:07.319: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:07.319: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 18 04:10:07.319: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:07.319: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 04:10:07.319: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:07.319: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 04:10:07.319: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 04:10:07.319: INFO: Container liveness-probe ready: true, restart count 0 Jan 18 04:10:07.319: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 18 04:10:07.319: INFO: Container secrets-store ready: true, restart count 0 Jan 18 04:10:07.319: INFO: kube-addon-manager-k8s-master-11684159-0 started at 2021-01-18 02:38:21 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:07.319: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 18 04:10:07.319: INFO: coredns-autoscaler-87b67c5fd-7jfwj started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:07.319: INFO: Container autoscaler ready: true, restart count 0 Jan 18 04:10:07.319: INFO: blobfuse-flexvol-installer-dvjv8 started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:07.319: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 Jan 18 04:10:07.319: INFO: kube-proxy-r9btf started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:07.319: INFO: Container kube-proxy ready: true, restart count 0 Jan 18 04:10:07.319: INFO: metrics-server-6c8cc7585b-f7l2w started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:07.319: INFO: Container metrics-server ready: true, restart count 0 Jan 18 04:10:07.319: INFO: csi-secrets-store-provider-azure-4dnqk started at 2021-01-18 02:38:54 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:07.319: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 18 04:10:07.319: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:07.319: INFO: Container kube-apiserver ready: true, restart count 0 Jan 18 04:10:07.319: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:07.319: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 18 04:10:07.319: INFO: coredns-6bbfb77cb5-4gfdd started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 04:10:07.319: INFO: Container coredns ready: true, restart count 0 W0118 04:10:07.361075 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 04:10:07.553: INFO: Latency metrics for node k8s-master-11684159-0 Jan 18 04:10:07.553: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-probe-8044" for this suite.
Find test-webserver-969c0561-4620-4e48-ad9c-7dc8b4e4e696 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sEvents\sshould\sbe\ssent\sby\skubelets\sand\sthe\sscheduler\sabout\spods\sscheduling\sand\srunning\s\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 18 03:37:19.065: Unexpected error: <*errors.errorString | 0xc000115e10>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/node/events.go:80from junit_06.xml
[BeforeEach] [k8s.io] [sig-node] Events /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 03:32:18.514: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename events �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in events-2685 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should be sent by kubelets and the scheduler about pods scheduling and running [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: creating the pod �[1mSTEP�[0m: submitting the pod to kubernetes Jan 18 03:37:19.065: FAIL: Unexpected error: <*errors.errorString | 0xc000115e10>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/node.glob..func3.1() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/node/events.go:80 +0x577 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002377200) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc002377200) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002377200, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 �[1mSTEP�[0m: deleting the pod [AfterEach] [k8s.io] [sig-node] Events /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "events-2685". �[1mSTEP�[0m: Found 5 events. Jan 18 03:37:19.144: INFO: At 2021-01-18 03:32:18 +0000 UTC - event for send-events-8e3eb7b8-83c7-470d-a412-cfdfde12c364: {default-scheduler } Scheduled: Successfully assigned events-2685/send-events-8e3eb7b8-83c7-470d-a412-cfdfde12c364 to 1168k8s000 Jan 18 03:37:19.144: INFO: At 2021-01-18 03:32:21 +0000 UTC - event for send-events-8e3eb7b8-83c7-470d-a412-cfdfde12c364: {kubelet 1168k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 03:37:19.144: INFO: At 2021-01-18 03:32:22 +0000 UTC - event for send-events-8e3eb7b8-83c7-470d-a412-cfdfde12c364: {kubelet 1168k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 03:37:19.144: INFO: At 2021-01-18 03:32:22 +0000 UTC - event for send-events-8e3eb7b8-83c7-470d-a412-cfdfde12c364: {kubelet 1168k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 18 03:37:19.144: INFO: At 2021-01-18 03:32:26 +0000 UTC - event for send-events-8e3eb7b8-83c7-470d-a412-cfdfde12c364: {kubelet 1168k8s000} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 03:37:19.182: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 03:37:19.182: INFO: send-events-8e3eb7b8-83c7-470d-a412-cfdfde12c364 1168k8s000 Pending 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:32:18 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:32:18 +0000 UTC ContainersNotReady containers with unready status: [p]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:32:18 +0000 UTC ContainersNotReady containers with unready status: [p]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-01-18 03:32:18 +0000 UTC }] Jan 18 03:37:19.182: INFO: Jan 18 03:37:19.255: INFO: Logging node info for node 1168k8s000 Jan 18 03:37:19.293: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 14860 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:33:00 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:33:00 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:33:00 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:33:00 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:37:19.294: INFO: Logging kubelet events for node 1168k8s000 Jan 18 03:37:19.333: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 03:37:19.375: INFO: dns-test-882943de-919d-4b87-a069-29edefe7434d started at 2021-01-18 03:32:26 +0000 UTC (0+3 container statuses recorded) Jan 18 03:37:19.375: INFO: Container jessie-querier ready: true, restart count 0 Jan 18 03:37:19.375: INFO: Container querier ready: false, restart count 0 Jan 18 03:37:19.375: INFO: Container webserver ready: false, restart count 0 Jan 18 03:37:19.375: INFO: pod-handle-http-request started at 2021-01-18 03:35:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:19.375: INFO: Container agnhost-container ready: false, restart count 0 Jan 18 03:37:19.375: INFO: proxy-service-l58rk-6c2dn started at 2021-01-18 03:35:21 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:19.375: INFO: Container proxy-service-l58rk ready: false, restart count 0 Jan 18 03:37:19.375: INFO: send-events-8e3eb7b8-83c7-470d-a412-cfdfde12c364 started at 2021-01-18 03:32:18 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:19.375: INFO: Container p ready: false, restart count 0 Jan 18 03:37:19.375: INFO: back-off-cap started at 2021-01-18 03:19:11 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:19.375: INFO: Container back-off-cap ready: false, restart count 8 W0118 03:37:19.453602 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:37:19.669: INFO: Latency metrics for node 1168k8s000 Jan 18 03:37:19.669: INFO: Logging node info for node 1168k8s001 Jan 18 03:37:19.708: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 15019 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:34:00 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:34:00 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:34:00 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:34:00 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:37:19.709: INFO: Logging kubelet events for node 1168k8s001 Jan 18 03:37:19.748: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 03:37:19.789: INFO: image-pull-test8c2fc96f-28ed-4f4d-9877-5e2dd7129ef8 started at 2021-01-18 03:32:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:19.789: INFO: Container image-pull-test ready: false, restart count 0 Jan 18 03:37:19.789: INFO: downwardapi-volume-7b533965-03aa-4f05-816e-700989413dc8 started at 2021-01-18 03:33:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:19.789: INFO: Container client-container ready: false, restart count 0 Jan 18 03:37:19.789: INFO: downwardapi-volume-a83a1145-bdd2-40bf-801b-d5e0853306fb started at 2021-01-18 03:36:21 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:19.789: INFO: Container client-container ready: false, restart count 0 W0118 03:37:19.830541 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:37:19.950: INFO: Latency metrics for node 1168k8s001 Jan 18 03:37:19.950: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 03:37:19.988: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 15085 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:34:30 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:34:30 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:34:30 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:34:30 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:37:19.989: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 03:37:20.029: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 03:37:20.074: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:20.074: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 03:37:20.074: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 03:37:20.074: INFO: Container liveness-probe ready: true, restart count 0 Jan 18 03:37:20.074: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 18 03:37:20.074: INFO: Container secrets-store ready: true, restart count 0 Jan 18 03:37:20.074: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:20.074: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 18 03:37:20.074: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:20.074: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 03:37:20.074: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:20.074: INFO: Container kube-apiserver ready: true, restart count 0 Jan 18 03:37:20.074: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:20.074: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 18 03:37:20.074: INFO: kube-proxy-r9btf started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:20.074: INFO: Container kube-proxy ready: true, restart count 0 Jan 18 03:37:20.074: INFO: metrics-server-6c8cc7585b-f7l2w started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:20.074: INFO: Container metrics-server ready: true, restart count 0 Jan 18 03:37:20.074: INFO: csi-secrets-store-provider-azure-4dnqk started at 2021-01-18 02:38:54 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:20.074: INFO: Container provider-azure-installer ready: true, restart count 0 Jan 18 03:37:20.074: INFO: kube-addon-manager-k8s-master-11684159-0 started at 2021-01-18 02:38:21 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:20.074: INFO: Container kube-addon-manager ready: true, restart count 0 Jan 18 03:37:20.074: INFO: coredns-autoscaler-87b67c5fd-7jfwj started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:20.074: INFO: Container autoscaler ready: true, restart count 0 Jan 18 03:37:20.074: INFO: coredns-6bbfb77cb5-4gfdd started at 2021-01-18 02:38:34 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:20.074: INFO: Container coredns ready: true, restart count 0 Jan 18 03:37:20.074: INFO: blobfuse-flexvol-installer-dvjv8 started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:37:20.074: INFO: Container blobfuse-flexvol-installer ready: true, restart count 0 W0118 03:37:20.117853 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:37:20.284: INFO: Latency metrics for node k8s-master-11684159-0 Jan 18 03:37:20.284: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "events-2685" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sPreStop\sshould\scall\sprestop\swhen\skilling\sa\spod\s\s\[Conformance\]$'
/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 Jan 18 03:32:10.259: waiting for server pod to start Unexpected error: <*errors.errorString | 0xc000115e10>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:60
[BeforeEach] [k8s.io] [sig-node] PreStop /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Jan 18 03:27:09.700: INFO: >>> kubeConfig: /root/tmp205447015/kubeconfig/kubeconfig.southcentralus.json �[1mSTEP�[0m: Building a namespace api object, basename prestop �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in prestop-1018 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] [sig-node] PreStop /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:157 [It] should call prestop when killing a pod [Conformance] /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:640 �[1mSTEP�[0m: Creating server pod server in namespace prestop-1018 �[1mSTEP�[0m: Waiting for pods to come up. Jan 18 03:32:10.259: FAIL: waiting for server pod to start Unexpected error: <*errors.errorString | 0xc000115e10>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/node.testPreStop(0x5638e80, 0xc0015af340, 0xc003381100, 0xc) /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:60 +0x574 k8s.io/kubernetes/test/e2e/node.glob..func10.2() /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:167 +0x4d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002377200) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x36c k8s.io/kubernetes/test/e2e.TestE2E(0xc002377200) _output/local/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002377200, 0x4feda58) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 �[1mSTEP�[0m: Deleting the server pod [AfterEach] [k8s.io] [sig-node] PreStop /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "prestop-1018". �[1mSTEP�[0m: Found 5 events. Jan 18 03:32:10.350: INFO: At 2021-01-18 03:27:10 +0000 UTC - event for server: {default-scheduler } Scheduled: Successfully assigned prestop-1018/server to 1168k8s000 Jan 18 03:32:10.350: INFO: At 2021-01-18 03:27:13 +0000 UTC - event for server: {kubelet 1168k8s000} Pulling: Pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 03:32:10.350: INFO: At 2021-01-18 03:27:14 +0000 UTC - event for server: {kubelet 1168k8s000} Failed: Failed to pull image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26": rpc error: code = Unknown desc = Error response from daemon: manifest for k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26 not found: manifest unknown: manifest tagged by "2.26" is not found Jan 18 03:32:10.350: INFO: At 2021-01-18 03:27:14 +0000 UTC - event for server: {kubelet 1168k8s000} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 18 03:32:10.350: INFO: At 2021-01-18 03:27:17 +0000 UTC - event for server: {kubelet 1168k8s000} Failed: Back-off pulling image "k8sprow.azurecr.io/kubernetes-e2e-test-images/agnhost:2.26" Jan 18 03:32:10.387: INFO: POD NODE PHASE GRACE CONDITIONS Jan 18 03:32:10.387: INFO: Jan 18 03:32:10.461: INFO: Logging node info for node 1168k8s000 Jan 18 03:32:10.499: INFO: Node Info: &Node{ObjectMeta:{1168k8s000 a216fed3-2eb2-47d6-9ee5-25d826172e40 13713 0 2021-01-18 02:38:15 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s000 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s000,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:27:57 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:27:57 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:27:57 +0000 UTC,LastTransitionTime:2021-01-18 02:38:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:27:57 +0000 UTC,LastTransitionTime:2021-01-18 02:38:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s000,},NodeAddress{Type:InternalIP,Address:10.240.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s000,SystemUUID:4EC475D7-3AD9-4E6B-8F9C-2AB69ADF37DC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:2c1fd29c72e50e4bcc71970d0f85097b744e06ae86bad93dc78ce5e1c17f4001 k8sprow.azurecr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:421036454,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/windows-nanoserver@sha256:fb9b25770487567c02bf90dd3edea7917323556d1b7ba81ec042ffd5f9effeae gcr.io/authenticated-image-pulling/windows-nanoserver:v1],SizeBytes:251128285,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:32:10.499: INFO: Logging kubelet events for node 1168k8s000 Jan 18 03:32:10.538: INFO: Logging pods the kubelet thinks is on node 1168k8s000 Jan 18 03:32:10.579: INFO: back-off-cap started at 2021-01-18 03:19:11 +0000 UTC (0+1 container statuses recorded) Jan 18 03:32:10.579: INFO: Container back-off-cap ready: false, restart count 7 Jan 18 03:32:10.579: INFO: busybox-a87893f6-d67c-4e5c-8737-8c47a870e75b started at 2021-01-18 03:29:29 +0000 UTC (0+1 container statuses recorded) Jan 18 03:32:10.579: INFO: Container busybox ready: true, restart count 0 Jan 18 03:32:10.579: INFO: annotationupdatedb93d9ce-2d16-41a8-9fed-cf33542ecfed started at 2021-01-18 03:30:19 +0000 UTC (0+1 container statuses recorded) Jan 18 03:32:10.579: INFO: Container client-container ready: false, restart count 0 W0118 03:32:10.655918 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:32:10.831: INFO: Latency metrics for node 1168k8s000 Jan 18 03:32:10.831: INFO: Logging node info for node 1168k8s001 Jan 18 03:32:10.869: INFO: Node Info: &Node{ObjectMeta:{1168k8s001 0adf2af5-2e6c-4028-93b6-eee78ed5c561 13871 0 2021-01-18 02:38:17 +0000 UTC <nil> <nil> map[agentpool:windowspool1 beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:1 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:agent kubernetes.io/arch:amd64 kubernetes.io/hostname:1168k8s001 kubernetes.io/os:windows kubernetes.io/role:agent node-role.kubernetes.io/agent: node.kubernetes.io/instance-type:Standard_D2s_v3 node.kubernetes.io/windows-build:10.0.17763 storageprofile:managed storagetier:Premium_LRS topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:1] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubelet.exe Update v1 2021-01-18 02:38:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:agentpool":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:storageprofile":{},"f:storagetier":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/agent":{}}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/1168k8s001,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{8589463552 0} {<nil>} 8388148Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{6441979904 0} {<nil>} 6290996Ki BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:28:58 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:28:58 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:28:58 +0000 UTC,LastTransitionTime:2021-01-18 02:38:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:28:58 +0000 UTC,LastTransitionTime:2021-01-18 02:38:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:1168k8s001,},NodeAddress{Type:InternalIP,Address:10.240.0.35,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1168k8s001,SystemUUID:A3773BEF-362D-4D57-98B8-FA7C83D222BC,BootID:,KernelVersion:10.0.17763.1397,OSImage:Windows Server 2019 Datacenter,ContainerRuntimeVersion:docker://19.3.11,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:30f8f12fc7a3da27e2b9e8c6c7f564f78a7610594713ae49143e5808e1fe7b36 mcr.microsoft.com/windows/servercore:ltsc2019],SizeBytes:5028488170,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus@sha256:13c7486513b0c1762e0dfbd1cde81ba1a1fa9989975dbfb051288080a7bf996c k8sprow.azurecr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:511874927,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:fecc52d880bcedcd58c30e1b673f954455a39faf58bac061597b4e3f74377c17 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.39-alpine],SizeBytes:509374792,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd@sha256:4f43187dfc5087e8d051feb9b03cdd54b40e9ecae93d8bfc79d6ce8744800610 k8sprow.azurecr.io/kubernetes-e2e-test-images/httpd:2.4.38-alpine],SizeBytes:509169771,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx@sha256:5bf7ada0abc221cbb7ceba9485b2bee4162e456628b54e7e4038d77713935954 k8sprow.azurecr.io/kubernetes-e2e-test-images/nginx:1.14-alpine],SizeBytes:416806350,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/pause@sha256:08a6a45e840e11f030ae30035f0a7e1b6f1365b12f363413b5b7dd320e3573e7 k8sprow.azurecr.io/kubernetes-e2e-test-images/pause:3.2],SizeBytes:412260474,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox@sha256:3fcc09e9dfbb1ecd5bd36b84f500f3f486490d279f44da68d645b036a42ed9de k8sprow.azurecr.io/kubernetes-e2e-test-images/busybox:1.29],SizeBytes:409673850,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:6d93c4e9bd9913b5fcf9b46fda72100ddbe5ec0b733616b38b96f0a76367c9a2 k8sprow.azurecr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:307072503,},ContainerImage{Names:[k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd@sha256:e4adb559f86a728fc6b99f9024301b52182fb1ffd6285700ce008c32e85c8fef k8sprow.azurecr.io/kubernetes-e2e-test-images/etcd:3.4.13-0],SizeBytes:297540742,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:92dd20279c1e36282bd52e3db2679297921d517ffe4e98025c0370ce25a03fac mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v1.2.1-alpha.1-windows-1809-amd64],SizeBytes:265664693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:d07f92ef2517c99cd011391ab1182c995cdd04ec01e47324abf07ea502476409 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.0.1-alpha.1-windows-1809-amd64],SizeBytes:264960693,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/pause@sha256:0343aed381a7b6892e85ec85dc0f8862b864e75584f08f215795a4696e3adae8 kubletwin/pause:latest mcr.microsoft.com/oss/kubernetes/pause:1.4.0],SizeBytes:256011346,},ContainerImage{Names:[mcr.microsoft.com/windows/nanoserver@sha256:4e2935a71de933e3576f7053d75eb3fadc3a929a1e7a708989aa6b28ad29b78a mcr.microsoft.com/windows/nanoserver:1809],SizeBytes:251135049,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:32:10.869: INFO: Logging kubelet events for node 1168k8s001 Jan 18 03:32:10.907: INFO: Logging pods the kubelet thinks is on node 1168k8s001 Jan 18 03:32:10.950: INFO: pod-projected-secrets-2274419e-d032-406a-8332-75ee7e33562f started at 2021-01-18 03:27:20 +0000 UTC (0+1 container statuses recorded) Jan 18 03:32:10.950: INFO: Container projected-secret-volume-test ready: false, restart count 0 Jan 18 03:32:10.950: INFO: pod-secrets-1c776abf-3d31-42d5-9277-4beeca1edd99 started at 2021-01-18 03:30:20 +0000 UTC (0+1 container statuses recorded) Jan 18 03:32:10.950: INFO: Container secret-test ready: false, restart count 0 Jan 18 03:32:10.950: INFO: image-pull-test008adb58-8741-4046-ad2c-f1aa49578790 started at 2021-01-18 03:27:48 +0000 UTC (0+1 container statuses recorded) Jan 18 03:32:10.950: INFO: Container image-pull-test ready: false, restart count 0 Jan 18 03:32:10.950: INFO: downwardapi-volume-efcb9b88-6008-4e3d-b887-27e369449356 started at 2021-01-18 03:31:15 +0000 UTC (0+1 container statuses recorded) Jan 18 03:32:10.950: INFO: Container client-container ready: false, restart count 0 W0118 03:32:10.996788 40166 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Jan 18 03:32:11.122: INFO: Latency metrics for node 1168k8s001 Jan 18 03:32:11.122: INFO: Logging node info for node k8s-master-11684159-0 Jan 18 03:32:11.160: INFO: Node Info: &Node{ObjectMeta:{k8s-master-11684159-0 26eba47e-d019-491c-93ea-99183c70d67c 14009 0 2021-01-18 02:37:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:southcentralus failure-domain.beta.kubernetes.io/zone:0 kubernetes.azure.com/cluster:kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4 kubernetes.azure.com/role:master kubernetes.io/arch:amd64 kubernetes.io/hostname:k8s-master-11684159-0 kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master: node.kubernetes.io/exclude-disruption:true node.kubernetes.io/exclude-from-external-load-balancers:true node.kubernetes.io/instance-type:Standard_D2_v3 topology.kubernetes.io/region:southcentralus topology.kubernetes.io/zone:0] map[csi.volume.kubernetes.io/nodeid:{"secrets-store.csi.k8s.io":"k8s-master-11684159-0"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-01-18 02:37:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}}} {kubectl-label Update v1 2021-01-18 02:38:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-01-18 02:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.azure.com/cluster":{},"f:kubernetes.azure.com/role":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/exclude-disruption":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-azure-disk":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubectl-taint Update v1 2021-01-18 02:39:23 +0000 UTC FieldsV1 {"f:spec":{"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-97cfcffd-5934-11eb-a85e-aa088fc118c4/providers/Microsoft.Compute/virtualMachines/k8s-master-11684159-0,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{31036686336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8349163520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{27933017657 0} {<nil>} 27933017657 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7562731520 0} {<nil>} BinarySI},pods: {{30 0} {<nil>} 30 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-01-18 03:29:28 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-01-18 03:29:28 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-01-18 03:29:28 +0000 UTC,LastTransitionTime:2021-01-18 02:37:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-01-18 03:29:28 +0000 UTC,LastTransitionTime:2021-01-18 02:37:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:k8s-master-11684159-0,},NodeAddress{Type:InternalIP,Address:10.255.255.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e63677768fb041f9b246a64491594224,SystemUUID:d8823b5b-8b65-cd44-8d97-770db1221ba9,BootID:4dd5aee8-9453-4005-bfb2-c2c9c844baff,KernelVersion:5.4.0-1036-azure,OSImage:Ubuntu 18.04.5 LTS,ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.21.0-alpha.1.114+d72c056260e771,KubeProxyVersion:v1.21.0-alpha.1.114+d72c056260e771,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azurefile-csi@sha256:558b9ac2bb6cf988252222039c506da0e4703d28480b21788687b111fde9e59d mcr.microsoft.com/k8s/csi/azurefile-csi:v0.6.0],SizeBytes:346393977,},ContainerImage{Names:[mcr.microsoft.com/k8s/csi/azuredisk-csi@sha256:2536d09114a6be2b9e9a64542990996f24e66586933b02c2a4fa41331c333b55 mcr.microsoft.com/k8s/csi/azuredisk-csi:v0.7.0],SizeBytes:286182075,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/dashboard@sha256:c2aadde6c97e8ca232a31ea097d7f4248ea05c759d96e99e06156be168c94c87 mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.4],SizeBytes:224975023,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:e74361729766b602d0c41b7ff32ef17bdb02c9e23e9cc73fe9df25c2b11f285a mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.14],SizeBytes:214765685,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:0376a7321189dd2affbf08f162dd7a42695caaff5210150f91382abadd3e07f9 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.13],SizeBytes:214761589,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:99fa5a324a195018dad182be692b6fe5aa0d14676eadc51eb51a2b89e1897cf6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.18.10-azs],SizeBytes:214757322,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:392c64f5d6b8c6e88c25b73b0af47dd390d9b049af850a924c6d35ba2cfeb1b6 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.16],SizeBytes:212385292,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:4161e64373a0f0d89b77d8ce7c478bf1c1db287c9b1e81c11d5babea5dc76662 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.17.13],SizeBytes:212376524,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b17c7d526c16b4fa106d896d9c466964cf4e05fa733d8a70cd2b31c0de90312f mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.14],SizeBytes:202638511,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:cef92fb4b38a74d225415cb1a574f6ca36607b08d45fa72f51d9242307925cb4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.10-azs],SizeBytes:202625306,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:2bdef1c8ff6966486446832808a97e6686b2a65efed2eb2e189943f72ae78dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.18.13],SizeBytes:202617627,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:b19fcf64748e45f6c2ea6c813e917f0a59913ab6bda0909a9db66c9f9279f509 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.16],SizeBytes:200834027,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:1afe0dc4e1bf86f97741276b664e7454caf0c94a8b000858191d9282b73a184a mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.17.13],SizeBytes:200820821,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:be0e95895892edba61fba8ec93a78f1580c5cf2cdbfd341456001184a41c4978 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.1],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:fa00e9cc164829c7d333d84b451c153734300329a622f7fdeb9b642986b81d55 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.20.0],SizeBytes:166745227,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:1d94e50eeb6f9a6ece99078d1f8304b968b11427fb5e5bdd4d16d2d709e971cb mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.5],SizeBytes:163202101,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-apiserver@sha256:694ac7f37e090f3f5510668c3f2472aae3c697a1eb9b47e9d2dbe294619ebfd2 mcr.microsoft.com/oss/kubernetes/kube-apiserver:v1.19.6],SizeBytes:162955791,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:9ec10cc5713fc83025e66c3d01d9142560d0d3b452f0c68a90c325c5f68fb0ea mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.0],SizeBytes:160347423,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:a1524a67b7e8d215e65e63d5fcbb9f7bd095c6b257d7e2ced2aecc4adbe48dc4 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.20.1],SizeBytes:160343656,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:c01b400587cf8f62e9cfb8e4785d7b8bb0611fe6b0b5f1767e567df14fd9f545 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.5],SizeBytes:153557522,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-controller-manager@sha256:481d0a3bdecc95198ea67e6b8e58106c31b897c477f0071dea154997f9cd9c14 mcr.microsoft.com/oss/kubernetes/kube-controller-manager:v1.19.6],SizeBytes:153328000,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/azure-npm@sha256:39e711f9ece40a11cae16efc3199d9f7570ca70eaf54963a80500dc93958d741 mcr.microsoft.com/containernetworking/azure-npm:v1.2.1],SizeBytes:151332676,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:78959fe1234c10a8e765260c9f246f006a66a10ae24d9981afc7fd436c6421dd mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.17.4],SizeBytes:142026757,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:e83d3f32a7b18df91b313038ef02607bae9ff968be3318525e4f77f9920b107f mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.1],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:504ad24bee6545e83fe692c6546eb4a4dd10d4550bde83be3d661bb677b15dee mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.0],SizeBytes:134912770,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:69f0031dfd8466c0625ac06c90491c9f67e32d0d2d95a22d2168e604b2b29f61 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.5],SizeBytes:133954639,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:159203a0461b753d850ea612d4ed93c203c04a22b0a248bc34b253c9a67e9a1d mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6],SizeBytes:133856665,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:affe37948114e885376452de758db5505c4da319853340cfeb69be7a87531ebb mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-azs],SizeBytes:131606832,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:a4cefef2865fe5dc09577fddfbd98c900a498215f4b3dc39d9be4f0cf2ffa398 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.13],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:fae0cd709eb6f28cb35b4caaadb2294725e8adde6423229886a5fb916b36b820 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14],SizeBytes:131606736,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:799cc89e5b71213f94510b458b0466fb988418a3e0d81cb04f659d4ac3473591 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16],SizeBytes:130842828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:6416b54115f85a0a9c37c784c65760db4f93f019cc84ff88433ab8baed3bcd89 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13],SizeBytes:130838828,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:f2fa5f18fec582e89ffc3df711574a654c447fde0c5fe54f49113e666bb97fca mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.15],SizeBytes:130150111,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-proxy@sha256:4276c9926498742eb99f62fd1056be62510779b1c6e822916a831f7b0529af38 mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.16.14],SizeBytes:130150111,},ContainerImage{Names:[k8sprow.azurecr.io/kube-apiserver-amd64@sha256:c51063895f2e1377458521f925ffbe92fb5cf90ff8657575cd6921c52c361231 k8sprow.azurecr.io/kube-apiserver-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:121746938,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector/node-problem-detector@sha256:3b5f074cf18a38084a56ed1a145ee8748704f32b18cabc970faddb82939497e4 k8s.gcr.io/node-problem-detector/node-problem-detector:v0.8.4],SizeBytes:120609421,},ContainerImage{Names:[k8sprow.azurecr.io/kube-proxy-amd64@sha256:b32638e5691ef9f4b48fecbcbd944d571f959e7dff5c66120fc05c7a71ef163e k8sprow.azurecr.io/kube-proxy-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:118445259,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:439a356ec9f77eaf24c37166f43476d00f800d705d56e13b39be8e772d7b6a2d mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.18],SizeBytes:117130738,},ContainerImage{Names:[k8sprow.azurecr.io/kube-controller-manager-amd64@sha256:4e512ee7fd9ef4a744fef4a4c70bfbe27a51821278370cad46341bd97c4337b4 k8sprow.azurecr.io/kube-controller-manager-amd64:v1.21.0-alpha.1-114-gd72c056260e],SizeBytes:116266490,},ContainerImage{Names:[mcr.microsoft.com/containernetworking/networkmonitor@sha256:9e973ec88b31f0d5ecf3d89dfacb4a20d37a067285c6b6ee36db032358506036 mcr.microsoft.com/containernetworking/networkmonitor:v0.0.8],SizeBytes:115802477,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:84bec097c3c7096f26499d8e8a9113f7fe810c2b666cd9b53f9a82c4fb807c96 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.10-azs],SizeBytes:111602327,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:c571e4c7b2cdb349a6eb02654c31715ffea07d559be3988c6826ff11056036a6 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.14],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:1fffa81c7d33f1b2b8d6c735f0990c946e670034423a58f36a23e60331979b85 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.18.13],SizeBytes:111598272,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:6f051d0d97e6c6a6b014b4ca066121ddfbaefd1f1010a6ba984bfba264b0d4dc mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.13],SizeBytes:110445311,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/kube-scheduler@sha256:8e9a4d5ab353a80764066f1aac7f6727cee92aab9be057132df6db0027cf7d50 mcr.microsoft.com/oss/kubernetes/kube-scheduler:v1.17.16],SizeBytes:110441256,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:8573616400e554ff41ebd933d74e3da0fb19824b61060902c28f08d28cea1cfb mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.16.7],SizeBytes:93742442,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:563560a6ef0f771f8b7178e095e933a9b125ac2817d8f8f2b714bec3d03168ca mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.19.1],SizeBytes:90552714,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager@sha256:0f0c53b4d1231c7ff062ec4453fa6bb5fe1a9df81379207ad87c734eff635604 mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1],SizeBytes:88168005,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:a13c60e2a9d49f965095a1e003388926f3f2a6189ed4aecb1541f114c955f8ec mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns@sha256:c1c11d18f192f4c8616eb5481b21114c331ea8de389e433f5f141bc0e5f58a3b k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.4 mcr.microsoft.com/oss/kubernetes/k8s-dns-kube-dns:1.15.4],SizeBytes:86980681,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler@sha256:3e87c7c5a51dcfb91b75cfd2d96690fa5244484cb347e5c319f713f819f3ae08 mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-autoscaler:v1.18.3],SizeBytes:86858122,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 18 03:32:11.161: INFO: Logging kubelet events for node k8s-master-11684159-0 Jan 18 03:32:11.201: INFO: Logging pods the kubelet thinks is on node k8s-master-11684159-0 Jan 18 03:32:11.244: INFO: kube-controller-manager-k8s-master-11684159-0 started at 2021-01-18 02:36:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:32:11.244: INFO: Container kube-controller-manager ready: true, restart count 0 Jan 18 03:32:11.244: INFO: kube-scheduler-k8s-master-11684159-0 started at 2021-01-18 02:36:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:32:11.244: INFO: Container kube-scheduler ready: true, restart count 0 Jan 18 03:32:11.244: INFO: kube-apiserver-k8s-master-11684159-0 started at 2021-01-18 02:37:09 +0000 UTC (0+1 container statuses recorded) Jan 18 03:32:11.244: INFO: Container kube-apiserver ready: true, restart count 0 Jan 18 03:32:11.244: INFO: azure-ip-masq-agent-vpvnn started at 2021-01-18 02:38:39 +0000 UTC (0+1 container statuses recorded) Jan 18 03:32:11.244: INFO: Container azure-ip-masq-agent ready: true, restart count 0 Jan 18 03:32:11.244: INFO: azure-cni-networkmonitor-fzhk9 started at 2021-01-18 02:38:49 +0000 UTC (0+1 container statuses recorded) Jan 18 03:32:11.244: INFO: Container azure-cnms ready: true, restart count 0 Jan 18 03:32:11.244: INFO: csi-secrets-store-4b484 started at 2021-01-18 02:38:52 +0000 UTC (0+3 container statuses recorded) Jan 18 03:32: