Recent runs || View in Spyglass
PR | pacoxu: add --system-reserved support for swap |
Result | FAILURE |
Tests | 13 failed / 837 succeeded |
Started | |
Elapsed | 1h8m |
Revision | |
Builder | 3430c708-cab9-11ec-848e-0a0ffdffe05b |
Refs |
master:e7a2ce75 105271:520d2ad3 |
control_plane_node_os_image | ubuntu-2004-focal-v20200423 |
infra-commit | bdfbe71a3 |
job-version | v1.25.0-alpha.0.22+20b712cdede0d5 |
kubetest-version | |
repo | k8s.io/kubernetes |
repo-commit | 20b712cdede0d57bc9bfab45a28df08a25c77e3a |
repos | {u'k8s.io/kubernetes': u'master:e7a2ce75e5df96ba6ea51d904bf2735397b3e203,105271:520d2ad3fb0a97368a2e549a18a1cdf9226bafc1', u'k8s.io/release': u'master'} |
revision | v1.25.0-alpha.0.22+20b712cdede0d5 |
worker_node_os_image | ubuntu-2004-focal-v20200423 |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-cli\]\sKubectl\sclient\sSimple\spod\sshould\sreturn\scommand\sexit\scodes\sexecing\sinto\sa\scontainer\swith\sa\sfailing\scommand$'
test/e2e/kubectl/kubectl.go:506 May 3 08:59:44.030: Expected <int>: 1 to equal <int>: 42 test/e2e/kubectl/kubectl.go:512from junit_16.xml
[BeforeEach] [sig-cli] Kubectl client test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Creating a kubernetes client May 3 08:59:02.017: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename kubectl �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client test/e2e/kubectl/kubectl.go:245 [BeforeEach] Simple pod test/e2e/kubectl/kubectl.go:382 �[1mSTEP�[0m: creating the pod from May 3 08:59:02.325: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.22.140 --kubeconfig=/workspace/.kube/config --namespace=kubectl-7346 create -f -' May 3 08:59:03.449: INFO: stderr: "" May 3 08:59:03.450: INFO: stdout: "pod/httpd created\n" May 3 08:59:03.450: INFO: Waiting up to 5m0s for 1 pods to be running and ready: [httpd] May 3 08:59:03.450: INFO: Waiting up to 5m0s for pod "httpd" in namespace "kubectl-7346" to be "running and ready" May 3 08:59:03.508: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 58.2361ms May 3 08:59:05.552: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 2.101960179s May 3 08:59:07.594: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 4.144114437s May 3 08:59:09.637: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 6.187441527s May 3 08:59:11.682: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 8.232080437s May 3 08:59:13.724: INFO: Pod "httpd": Phase="Running", Reason="", readiness=true. Elapsed: 10.274016594s May 3 08:59:13.724: INFO: Pod "httpd" satisfied condition "running and ready" May 3 08:59:13.724: INFO: Wanted all 1 pods to be running and ready. Result: true. Pods: [httpd] [It] execing into a container with a failing command test/e2e/kubectl/kubectl.go:506 May 3 08:59:13.724: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.22.140 --kubeconfig=/workspace/.kube/config --namespace=kubectl-7346 exec httpd --pod-running-timeout=2m0s -- /bin/sh -c exit 42' May 3 08:59:44.029: INFO: rc: 1 May 3 08:59:44.030: FAIL: Expected <int>: 1 to equal <int>: 42 Full Stack Trace k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.7.2() test/e2e/kubectl/kubectl.go:512 +0x1fe k8s.io/kubernetes/test/e2e.RunE2ETests(0x257e5b7?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000609c00?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000aa2680, 0x73fa160) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f [AfterEach] Simple pod test/e2e/kubectl/kubectl.go:388 �[1mSTEP�[0m: using delete to clean up resources May 3 08:59:44.030: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.22.140 --kubeconfig=/workspace/.kube/config --namespace=kubectl-7346 delete --grace-period=0 --force -f -' May 3 08:59:44.277: INFO: stderr: "warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" May 3 08:59:44.277: INFO: stdout: "pod \"httpd\" force deleted\n" May 3 08:59:44.277: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.22.140 --kubeconfig=/workspace/.kube/config --namespace=kubectl-7346 get rc,svc -l name=httpd --no-headers' May 3 08:59:44.498: INFO: stderr: "No resources found in kubectl-7346 namespace.\n" May 3 08:59:44.498: INFO: stdout: "" May 3 08:59:44.498: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.22.140 --kubeconfig=/workspace/.kube/config --namespace=kubectl-7346 get pods -l name=httpd -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}' May 3 08:59:44.673: INFO: stderr: "" May 3 08:59:44.673: INFO: stdout: "" [AfterEach] [sig-cli] Kubectl client test/e2e/framework/framework.go:188 �[1mSTEP�[0m: Collecting events from namespace "kubectl-7346". �[1mSTEP�[0m: Found 5 events. May 3 08:59:44.717: INFO: At 2022-05-03 08:59:03 +0000 UTC - event for httpd: {default-scheduler } Scheduled: Successfully assigned kubectl-7346/httpd to e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:44.717: INFO: At 2022-05-03 08:59:03 +0000 UTC - event for httpd: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-2" already present on machine May 3 08:59:44.717: INFO: At 2022-05-03 08:59:04 +0000 UTC - event for httpd: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Created: Created container httpd May 3 08:59:44.717: INFO: At 2022-05-03 08:59:04 +0000 UTC - event for httpd: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Started: Started container httpd May 3 08:59:44.717: INFO: At 2022-05-03 08:59:44 +0000 UTC - event for httpd: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Killing: Stopping container httpd May 3 08:59:44.757: INFO: POD NODE PHASE GRACE CONDITIONS May 3 08:59:44.757: INFO: May 3 08:59:44.861: INFO: Logging node info for node e2e-c8a0630093-a7d53-master May 3 08:59:44.904: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-master b19f1e35-3444-417f-aa8a-059f422baac1 21446 0 2022-05-03 08:44:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-05-03 08:44:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 08:45:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3860037632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3597893632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:44:59 +0000 UTC,LastTransitionTime:2022-05-03 08:44:59 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.22.140,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bcd3f659cc761bdb6efbff38fefe4e19,SystemUUID:bcd3f659-cc76-1bdb-6efb-ff38fefe4e19,BootID:f91b8838-f530-4990-b2a6-3b369f82164e,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:131049939,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:120695609,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:52333368,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 08:59:44.904: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-master May 3 08:59:44.962: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-master May 3 08:59:45.038: INFO: kube-scheduler-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.038: INFO: Container kube-scheduler ready: true, restart count 0 May 3 08:59:45.038: INFO: kube-addon-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.038: INFO: Container kube-addon-manager ready: true, restart count 0 May 3 08:59:45.038: INFO: l7-lb-controller-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:13 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.038: INFO: Container l7-lb-controller ready: true, restart count 3 May 3 08:59:45.038: INFO: etcd-server-events-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.038: INFO: Container etcd-container ready: true, restart count 0 May 3 08:59:45.038: INFO: kube-controller-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.038: INFO: Container kube-controller-manager ready: true, restart count 2 May 3 08:59:45.038: INFO: kube-apiserver-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.038: INFO: Container kube-apiserver ready: true, restart count 1 May 3 08:59:45.038: INFO: metadata-proxy-v0.1-blclk started at 2022-05-03 08:45:06 +0000 UTC (0+2 container statuses recorded) May 3 08:59:45.038: INFO: Container metadata-proxy ready: true, restart count 0 May 3 08:59:45.038: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 08:59:45.038: INFO: etcd-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.038: INFO: Container etcd-container ready: true, restart count 0 May 3 08:59:45.038: INFO: konnectivity-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.038: INFO: Container konnectivity-server-container ready: true, restart count 0 May 3 08:59:45.286: INFO: Latency metrics for node e2e-c8a0630093-a7d53-master May 3 08:59:45.286: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:45.329: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-7bq2 bfa6e413-94d8-452c-a687-5f8ae9ea5b7c 27885 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-7bq2 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-7bq2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-6774":"e2e-c8a0630093-a7d53-minion-group-7bq2","csi-mock-csi-mock-volumes-4868":"e2e-c8a0630093-a7d53-minion-group-7bq2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 08:56:35 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 08:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-7bq2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:45:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:35.197.55.130,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f84a54b770444ef2c7de26e5ab984f78,SystemUUID:f84a54b7-7044-4ef2-c7de-26e5ab984f78,BootID:950b58bb-5fcd-4efa-a61d-cbb738103018,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 08:59:45.330: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:45.376: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:45.468: INFO: csi-mockplugin-resizer-0 started at 2022-05-03 08:56:55 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.469: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:45.469: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-7bq2 started at 2022-05-03 08:44:57 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.469: INFO: Container kube-proxy ready: true, restart count 0 May 3 08:59:45.469: INFO: netserver-0 started at 2022-05-03 08:58:07 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.469: INFO: Container webserver ready: true, restart count 0 May 3 08:59:45.469: INFO: csi-mockplugin-0 started at 2022-05-03 08:56:55 +0000 UTC (0+3 container statuses recorded) May 3 08:59:45.469: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:45.469: INFO: Container driver-registrar ready: true, restart count 0 May 3 08:59:45.469: INFO: Container mock ready: true, restart count 0 May 3 08:59:45.469: INFO: netserver-0 started at 2022-05-03 08:57:29 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.469: INFO: Container webserver ready: true, restart count 0 May 3 08:59:45.469: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:58:01 +0000 UTC (0+7 container statuses recorded) May 3 08:59:45.469: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:45.469: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:45.469: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:45.469: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:45.469: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:45.469: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:45.469: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:45.469: INFO: coredns-6b775575b5-w454s started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.469: INFO: Container coredns ready: true, restart count 0 May 3 08:59:45.469: INFO: konnectivity-agent-r2m8v started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.469: INFO: Container konnectivity-agent ready: true, restart count 0 May 3 08:59:45.469: INFO: kube-dns-autoscaler-c6c49f5f6-t54xb started at 2022-05-03 08:56:29 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.469: INFO: Container autoscaler ready: true, restart count 0 May 3 08:59:45.469: INFO: netserver-0 started at 2022-05-03 08:57:52 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.469: INFO: Container webserver ready: true, restart count 0 May 3 08:59:45.469: INFO: npd-v0.8.9-lxnv5 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.469: INFO: Container node-problem-detector ready: true, restart count 0 May 3 08:59:45.469: INFO: metadata-proxy-v0.1-27ljg started at 2022-05-03 08:44:58 +0000 UTC (0+2 container statuses recorded) May 3 08:59:45.469: INFO: Container metadata-proxy ready: true, restart count 0 May 3 08:59:45.469: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 08:59:45.469: INFO: csi-mockplugin-attacher-0 started at 2022-05-03 08:56:55 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.469: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:45.469: INFO: l7-default-backend-bb7fb94cb-jt2kv started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.469: INFO: Container default-http-backend ready: true, restart count 0 May 3 08:59:45.469: INFO: ss2-2 started at 2022-05-03 08:58:11 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.469: INFO: Container webserver ready: true, restart count 0 May 3 08:59:45.469: INFO: external-provisioner-dwb56 started at 2022-05-03 08:56:28 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.469: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 08:59:45.469: INFO: external-provisioner-skff4 started at 2022-05-03 08:58:13 +0000 UTC (0+1 container statuses recorded) May 3 08:59:45.469: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 08:59:45.759: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:45.759: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:45.813: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-c5lb e86bdeb4-972e-4590-a8a1-92d331988301 27865 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-c5lb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-c5lb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-05-03 08:57:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2022-05-03 08:59:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-05-03 08:59:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"Ready\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-c5lb,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoSchedule,TimeAdded:2022-05-03 08:59:18 +0000 UTC,},Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoExecute,TimeAdded:2022-05-03 08:59:23 +0000 UTC,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:DiskPressure,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:PIDPressure,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:Ready,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.151.125,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:97eaceafa1dcc38dfa191fea843250cf,SystemUUID:97eaceaf-a1dc-c38d-fa19-1fea843250cf,BootID:eddb2e60-9b10-4c23-9e89-f2539bba18c7,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 08:59:45.814: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:45.868: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:45.953: INFO: Unable to retrieve kubelet pods for node e2e-c8a0630093-a7d53-minion-group-c5lb: error trying to reach service: dial tcp 10.40.0.3:10250: connect: connection refused May 3 08:59:45.953: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:46.000: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-j0s7 13534811-02a2-4928-b008-80e6f39177b8 27875 0 2022-05-03 08:44:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-j0s7 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-j0s7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-132":"e2e-c8a0630093-a7d53-minion-group-j0s7","csi-hostpath-ephemeral-928":"e2e-c8a0630093-a7d53-minion-group-j0s7","csi-hostpath-provisioning-1259":"e2e-c8a0630093-a7d53-minion-group-j0s7"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:21 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 08:59:21 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-05-03 08:59:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-j0s7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817138176 0} {<nil>} 7633924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554994176 0} {<nil>} 7377924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.237.94,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:800822b6a794b56fc75d86f7afc2e1a6,SystemUUID:800822b6-a794-b56f-c75d-86f7afc2e1a6,BootID:c95dcb5d-789d-48b1-8b08-198b7583e648,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/build-image/debian-iptables@sha256:3317c4374ea30d88b64b27740b0edfaa600e410901e727b5bab4c4deac1df6f5 registry.k8s.io/build-image/debian-iptables:bullseye-v1.3.0],SizeBytes:27061409,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:00fcc441ea9f72899c25eed61d602272a2a58c5f0014332bdcb5ac24acef08e4 registry.k8s.io/sig-storage/snapshot-controller:v4.0.0],SizeBytes:18952261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-928^50cccb5b-cabf-11ec-85c1-1e399d5f0c6b],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-928^50cccb5b-cabf-11ec-85c1-1e399d5f0c6b,DevicePath:,},},Config:nil,},} May 3 08:59:46.001: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:46.064: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:46.160: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:58:08 +0000 UTC (0+7 container statuses recorded) May 3 08:59:46.160: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:46.160: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:46.160: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:46.160: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:46.160: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:46.160: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:46.160: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:46.160: INFO: npd-v0.8.9-dgf5k started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:46.160: INFO: Container node-problem-detector ready: true, restart count 0 May 3 08:59:46.160: INFO: rand-non-local-7rpz7 started at 2022-05-03 08:58:44 +0000 UTC (0+1 container statuses recorded) May 3 08:59:46.160: INFO: Container c ready: false, restart count 0 May 3 08:59:46.160: INFO: volume-snapshot-controller-0 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:46.160: INFO: Container volume-snapshot-controller ready: true, restart count 0 May 3 08:59:46.160: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:59:16 +0000 UTC (0+7 container statuses recorded) May 3 08:59:46.160: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:46.160: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:46.160: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:46.160: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:46.160: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:46.160: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:46.160: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:46.160: INFO: inline-volume-tester-8x7vv started at 2022-05-03 08:59:20 +0000 UTC (0+1 container statuses recorded) May 3 08:59:46.160: INFO: Container csi-volume-tester ready: true, restart count 0 May 3 08:59:46.160: INFO: metadata-proxy-v0.1-86pbj started at 2022-05-03 08:44:57 +0000 UTC (0+2 container statuses recorded) May 3 08:59:46.160: INFO: Container metadata-proxy ready: true, restart count 0 May 3 08:59:46.160: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 08:59:46.160: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:56:40 +0000 UTC (0+7 container statuses recorded) May 3 08:59:46.160: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:46.160: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:46.160: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:46.160: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:46.160: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:46.160: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:46.160: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:46.160: INFO: ss2-0 started at 2022-05-03 08:57:52 +0000 UTC (0+1 container statuses recorded) May 3 08:59:46.160: INFO: Container webserver ready: true, restart count 0 May 3 08:59:46.160: INFO: test-container-pod started at 2022-05-03 08:57:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:46.160: INFO: Container webserver ready: true, restart count 0 May 3 08:59:46.160: INFO: netserver-2 started at 2022-05-03 08:58:07 +0000 UTC (0+1 container statuses recorded) May 3 08:59:46.160: INFO: Container webserver ready: true, restart count 0 May 3 08:59:46.160: INFO: konnectivity-agent-98km6 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:46.160: INFO: Container konnectivity-agent ready: true, restart count 0 May 3 08:59:46.160: INFO: netserver-2 started at 2022-05-03 08:57:29 +0000 UTC (0+1 container statuses recorded) May 3 08:59:46.160: INFO: Container webserver ready: true, restart count 0 May 3 08:59:46.160: INFO: external-provisioner-mh5tk started at 2022-05-03 08:57:54 +0000 UTC (0+1 container statuses recorded) May 3 08:59:46.160: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 08:59:46.160: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-j0s7 started at 2022-05-03 08:44:56 +0000 UTC (0+1 container statuses recorded) May 3 08:59:46.160: INFO: Container kube-proxy ready: true, restart count 0 May 3 08:59:46.160: INFO: netserver-2 started at 2022-05-03 08:57:06 +0000 UTC (0+1 container statuses recorded) May 3 08:59:46.160: INFO: Container webserver ready: true, restart count 0 May 3 08:59:46.160: INFO: netserver-2 started at 2022-05-03 08:57:52 +0000 UTC (0+1 container statuses recorded) May 3 08:59:46.160: INFO: Container webserver ready: true, restart count 0 May 3 08:59:46.652: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:46.652: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready May 3 08:59:46.736: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:48.855: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:50.854: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:52.857: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:54.855: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:56.857: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:58.856: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:00.860: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:02.857: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:04.855: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:06.856: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:08.856: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:10.854: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:12.855: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:14.855: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:16.863: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:18.855: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:20.854: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:22.856: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:24.855: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:26.857: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is true, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:28.853: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is true, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure �[1mSTEP�[0m: Destroying namespace "kubectl-7346" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sNetworking\sGranular\sChecks\:\sPods\sshould\sfunction\sfor\snode\-pod\scommunication\:\shttp\s\[LinuxOnly\]\s\[NodeConformance\]\s\[Conformance\]$'
test/e2e/framework/framework.go:652 May 3 09:03:11.752: Error dialing HTTP node to pod failed to find expected endpoints, tries 39 Command curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName retrieved map[] expected map[netserver-1:{}] vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113from junit_19.xml
[BeforeEach] [sig-network] Networking test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Creating a kubernetes client May 3 08:58:06.609: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename pod-network-test �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should function for node-pod communication: http [LinuxOnly] [NodeConformance] [Conformance] test/e2e/framework/framework.go:652 �[1mSTEP�[0m: Performing setup for networking test in namespace pod-network-test-1038 �[1mSTEP�[0m: creating a selector �[1mSTEP�[0m: Creating the service pods in kubernetes May 3 08:58:07.142: INFO: Waiting up to 10m0s for all (but 0) nodes to be schedulable May 3 08:58:07.602: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) May 3 08:58:09.948: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:11.661: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:13.657: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:15.646: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:17.698: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:19.646: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:21.646: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:23.645: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:25.645: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:27.655: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:29.652: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:31.645: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:33.652: INFO: The status of Pod netserver-0 is Running (Ready = true) May 3 08:58:33.736: INFO: The status of Pod netserver-1 is Running (Ready = false) May 3 08:58:35.781: INFO: The status of Pod netserver-1 is Running (Ready = false) May 3 08:58:37.813: INFO: The status of Pod netserver-1 is Running (Ready = false) May 3 08:58:39.780: INFO: The status of Pod netserver-1 is Running (Ready = false) May 3 08:58:41.900: INFO: The status of Pod netserver-1 is Running (Ready = false) May 3 08:58:43.782: INFO: The status of Pod netserver-1 is Running (Ready = true) May 3 08:58:43.868: INFO: The status of Pod netserver-2 is Running (Ready = true) �[1mSTEP�[0m: Creating test pods May 3 09:00:46.449: INFO: Setting MaxTries for pod polling to 39 for networking test based on endpoint count 3 May 3 09:00:46.449: INFO: Going to poll 10.64.2.109 on port 8083 at least 0 times, with a maximum of 39 tries before failing May 3 09:00:46.553: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.2.109:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:00:46.553: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:00:46.554: INFO: ExecWithOptions: Clientset creation May 3 09:00:46.554: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.2.109%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:00:50.954: INFO: Found all 1 expected endpoints: [netserver-0] May 3 09:00:50.954: INFO: Going to poll 10.64.3.93 on port 8083 at least 0 times, with a maximum of 39 tries before failing May 3 09:00:51.026: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:00:51.026: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:00:51.027: INFO: ExecWithOptions: Clientset creation May 3 09:00:51.027: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:00:52.962: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:00:52.963: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:00:55.046: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:00:55.046: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:00:55.047: INFO: ExecWithOptions: Clientset creation May 3 09:00:55.047: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:00:56.953: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:00:56.953: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:00:59.025: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:00:59.025: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:00:59.026: INFO: ExecWithOptions: Clientset creation May 3 09:00:59.026: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:01:00.586: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:01:00.586: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:01:02.792: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:01:02.792: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:01:02.793: INFO: ExecWithOptions: Clientset creation May 3 09:01:02.793: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:01:04.346: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:01:04.347: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:01:06.404: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:01:06.404: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:01:06.405: INFO: ExecWithOptions: Clientset creation May 3 09:01:06.405: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:01:07.947: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:01:07.947: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:01:10.020: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:01:10.020: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:01:10.021: INFO: ExecWithOptions: Clientset creation May 3 09:01:10.021: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:01:11.678: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:01:11.678: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:01:13.751: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:01:13.751: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:01:13.752: INFO: ExecWithOptions: Clientset creation May 3 09:01:13.752: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:01:15.359: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:01:15.359: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:01:17.437: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:01:17.437: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:01:17.438: INFO: ExecWithOptions: Clientset creation May 3 09:01:17.438: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:01:19.190: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:01:19.190: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:01:21.250: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:01:21.250: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:01:21.251: INFO: ExecWithOptions: Clientset creation May 3 09:01:21.251: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:01:22.770: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:01:22.770: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:01:24.830: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:01:24.830: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:01:24.831: INFO: ExecWithOptions: Clientset creation May 3 09:01:24.831: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:01:26.327: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:01:26.327: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:01:28.375: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:01:28.375: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:01:28.376: INFO: ExecWithOptions: Clientset creation May 3 09:01:28.376: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:01:29.992: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:01:29.992: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:01:32.071: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:01:32.071: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:01:32.072: INFO: ExecWithOptions: Clientset creation May 3 09:01:32.072: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:01:33.745: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:01:33.745: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:01:35.822: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:01:35.822: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:01:35.823: INFO: ExecWithOptions: Clientset creation May 3 09:01:35.823: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:01:37.627: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:01:37.627: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:01:39.676: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:01:39.676: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:01:39.677: INFO: ExecWithOptions: Clientset creation May 3 09:01:39.677: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:01:41.094: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:01:41.095: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:01:43.169: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:01:43.169: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:01:43.169: INFO: ExecWithOptions: Clientset creation May 3 09:01:43.170: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:01:44.630: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:01:44.630: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:01:46.703: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:01:46.703: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:01:46.703: INFO: ExecWithOptions: Clientset creation May 3 09:01:46.704: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:01:48.255: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:01:48.255: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:01:50.316: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:01:50.316: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:01:50.317: INFO: ExecWithOptions: Clientset creation May 3 09:01:50.317: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:01:51.746: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:01:51.746: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:01:53.843: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:01:53.843: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:01:53.844: INFO: ExecWithOptions: Clientset creation May 3 09:01:53.844: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:01:55.218: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:01:55.218: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:01:57.260: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:01:57.260: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:01:57.261: INFO: ExecWithOptions: Clientset creation May 3 09:01:57.261: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:01:58.720: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:01:58.720: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:02:00.772: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:02:00.772: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:02:00.773: INFO: ExecWithOptions: Clientset creation May 3 09:02:00.773: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:02:02.345: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:02:02.345: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:02:04.430: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:02:04.430: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:02:04.431: INFO: ExecWithOptions: Clientset creation May 3 09:02:04.431: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:02:06.094: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:02:06.094: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:02:08.222: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:02:08.222: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:02:08.223: INFO: ExecWithOptions: Clientset creation May 3 09:02:08.223: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:02:09.780: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:02:09.780: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:02:11.931: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:02:11.931: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:02:11.932: INFO: ExecWithOptions: Clientset creation May 3 09:02:11.932: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:02:13.539: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:02:13.539: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:02:15.718: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:02:15.718: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:02:15.719: INFO: ExecWithOptions: Clientset creation May 3 09:02:15.719: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:02:17.275: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:02:17.275: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:02:19.317: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:02:19.317: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:02:19.318: INFO: ExecWithOptions: Clientset creation May 3 09:02:19.318: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:02:20.707: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:02:20.707: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:02:22.752: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:02:22.752: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:02:22.753: INFO: ExecWithOptions: Clientset creation May 3 09:02:22.753: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:02:24.142: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:02:24.142: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:02:26.184: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:02:26.184: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:02:26.185: INFO: ExecWithOptions: Clientset creation May 3 09:02:26.185: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:02:27.508: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:02:27.508: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:02:29.555: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:02:29.555: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:02:29.556: INFO: ExecWithOptions: Clientset creation May 3 09:02:29.556: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:02:31.009: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:02:31.009: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:02:33.054: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:02:33.054: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:02:33.055: INFO: ExecWithOptions: Clientset creation May 3 09:02:33.055: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:02:34.563: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:02:34.563: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:02:36.607: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:02:36.607: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:02:36.607: INFO: ExecWithOptions: Clientset creation May 3 09:02:36.607: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:02:38.004: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:02:38.004: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:02:40.046: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:02:40.046: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:02:40.047: INFO: ExecWithOptions: Clientset creation May 3 09:02:40.047: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:02:41.449: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:02:41.449: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:02:43.490: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:02:43.490: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:02:43.492: INFO: ExecWithOptions: Clientset creation May 3 09:02:43.492: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:02:44.870: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:02:44.871: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:02:46.918: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:02:46.918: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:02:46.920: INFO: ExecWithOptions: Clientset creation May 3 09:02:46.920: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:02:48.274: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:02:48.274: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:02:50.317: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:02:50.317: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:02:50.318: INFO: ExecWithOptions: Clientset creation May 3 09:02:50.318: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:02:51.679: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:02:51.679: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:02:53.720: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:02:53.720: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:02:53.722: INFO: ExecWithOptions: Clientset creation May 3 09:02:53.722: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:02:55.058: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:02:55.058: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:02:57.099: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:02:57.099: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:02:57.100: INFO: ExecWithOptions: Clientset creation May 3 09:02:57.100: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:02:58.475: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:02:58.475: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:03:00.516: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:03:00.516: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:03:00.517: INFO: ExecWithOptions: Clientset creation May 3 09:03:00.517: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:03:01.917: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:03:01.917: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:03:03.968: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:03:03.968: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:03:03.969: INFO: ExecWithOptions: Clientset creation May 3 09:03:03.969: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:03:05.425: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:03:05.425: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:03:07.493: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1038 PodName:host-test-container-pod ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 09:03:07.493: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:03:07.494: INFO: ExecWithOptions: Clientset creation May 3 09:03:07.494: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/pod-network-test-1038/pods/host-test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+--max-time+15+--connect-timeout+1+http%3A%2F%2F10.64.3.93%3A8083%2FhostName+%7C+grep+-v+%27%5E%5Cs%2A%24%27&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:03:08.888: INFO: Failed to execute "curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName | grep -v '^\\s*$'": command terminated with exit code 1, stdout: "", stderr: "" May 3 09:03:08.888: INFO: Waiting for [netserver-1] endpoints (expected=[netserver-1], actual=[]) May 3 09:03:10.888: INFO: Output of kubectl describe pod pod-network-test-1038/netserver-0: May 3 09:03:10.888: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.22.140 --kubeconfig=/workspace/.kube/config --namespace=pod-network-test-1038 describe pod netserver-0 --namespace=pod-network-test-1038' May 3 09:03:11.156: INFO: stderr: "" May 3 09:03:11.156: INFO: stdout: "Name: netserver-0\nNamespace: pod-network-test-1038\nPriority: 0\nNode: e2e-c8a0630093-a7d53-minion-group-7bq2/10.40.0.5\nStart Time: Tue, 03 May 2022 08:58:07 +0000\nLabels: selector-b33fe5ea-9c5a-4b44-8a0e-cdae477f4635=true\nAnnotations: <none>\nStatus: Running\nIP: 10.64.2.109\nIPs:\n IP: 10.64.2.109\nContainers:\n webserver:\n Container ID: containerd://e488f04ee766baa55c79277226956d33b6c078c6fedcb17be7c49ec68a51c129\n Image: registry.k8s.io/e2e-test-images/agnhost:2.36\n Image ID: registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8\n Ports: 8083/TCP, 8081/UDP\n Host Ports: 0/TCP, 0/UDP\n Args:\n netexec\n --http-port=8083\n --udp-port=8081\n State: Running\n Started: Tue, 03 May 2022 08:58:08 +0000\n Ready: True\n Restart Count: 0\n Liveness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3\n Readiness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3\n Environment: <none>\n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-72llz (ro)\nConditions:\n Type Status\n Initialized True \n Ready True \n ContainersReady True \n PodScheduled True \nVolumes:\n kube-api-access-72llz:\n Type: Projected (a volume that contains injected data from multiple sources)\n TokenExpirationSeconds: 3607\n ConfigMapName: kube-root-ca.crt\n ConfigMapOptional: <nil>\n DownwardAPI: true\nQoS Class: BestEffort\nNode-Selectors: kubernetes.io/hostname=e2e-c8a0630093-a7d53-minion-group-7bq2\nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 5m4s default-scheduler Successfully assigned pod-network-test-1038/netserver-0 to e2e-c8a0630093-a7d53-minion-group-7bq2\n Normal Pulled 5m3s kubelet Container image \"registry.k8s.io/e2e-test-images/agnhost:2.36\" already present on machine\n Normal Created 5m3s kubelet Created container webserver\n Normal Started 5m3s kubelet Started container webserver\n" May 3 09:03:11.156: INFO: Name: netserver-0 Namespace: pod-network-test-1038 Priority: 0 Node: e2e-c8a0630093-a7d53-minion-group-7bq2/10.40.0.5 Start Time: Tue, 03 May 2022 08:58:07 +0000 Labels: selector-b33fe5ea-9c5a-4b44-8a0e-cdae477f4635=true Annotations: <none> Status: Running IP: 10.64.2.109 IPs: IP: 10.64.2.109 Containers: webserver: Container ID: containerd://e488f04ee766baa55c79277226956d33b6c078c6fedcb17be7c49ec68a51c129 Image: registry.k8s.io/e2e-test-images/agnhost:2.36 Image ID: registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 Ports: 8083/TCP, 8081/UDP Host Ports: 0/TCP, 0/UDP Args: netexec --http-port=8083 --udp-port=8081 State: Running Started: Tue, 03 May 2022 08:58:08 +0000 Ready: True Restart Count: 0 Liveness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3 Readiness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3 Environment: <none> Mounts: /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-72llz (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: kube-api-access-72llz: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: <nil> DownwardAPI: true QoS Class: BestEffort Node-Selectors: kubernetes.io/hostname=e2e-c8a0630093-a7d53-minion-group-7bq2 Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 5m4s default-scheduler Successfully assigned pod-network-test-1038/netserver-0 to e2e-c8a0630093-a7d53-minion-group-7bq2 Normal Pulled 5m3s kubelet Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine Normal Created 5m3s kubelet Created container webserver Normal Started 5m3s kubelet Started container webserver May 3 09:03:11.156: INFO: Output of kubectl describe pod pod-network-test-1038/netserver-1: May 3 09:03:11.156: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.22.140 --kubeconfig=/workspace/.kube/config --namespace=pod-network-test-1038 describe pod netserver-1 --namespace=pod-network-test-1038' May 3 09:03:11.432: INFO: stderr: "" May 3 09:03:11.432: INFO: stdout: "Name: netserver-1\nNamespace: pod-network-test-1038\nPriority: 0\nNode: e2e-c8a0630093-a7d53-minion-group-c5lb/10.40.0.3\nStart Time: Tue, 03 May 2022 08:58:07 +0000\nLabels: selector-b33fe5ea-9c5a-4b44-8a0e-cdae477f4635=true\nAnnotations: <none>\nStatus: Running\nIP: 10.64.3.110\nIPs:\n IP: 10.64.3.110\nContainers:\n webserver:\n Container ID: containerd://eac3f1a4cced5ebca32c6370ac781155d78ec48367ead7647da90316d150ca8f\n Image: registry.k8s.io/e2e-test-images/agnhost:2.36\n Image ID: registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8\n Ports: 8083/TCP, 8081/UDP\n Host Ports: 0/TCP, 0/UDP\n Args:\n netexec\n --http-port=8083\n --udp-port=8081\n State: Running\n Started: Tue, 03 May 2022 09:00:32 +0000\n Last State: Terminated\n Reason: Unknown\n Exit Code: 255\n Started: Tue, 03 May 2022 08:58:09 +0000\n Finished: Tue, 03 May 2022 08:59:17 +0000\n Ready: True\n Restart Count: 1\n Liveness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3\n Readiness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3\n Environment: <none>\n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-b4kzq (ro)\nConditions:\n Type Status\n Initialized True \n Ready True \n ContainersReady True \n PodScheduled True \nVolumes:\n kube-api-access-b4kzq:\n Type: Projected (a volume that contains injected data from multiple sources)\n TokenExpirationSeconds: 3607\n ConfigMapName: kube-root-ca.crt\n ConfigMapOptional: <nil>\n DownwardAPI: true\nQoS Class: BestEffort\nNode-Selectors: kubernetes.io/hostname=e2e-c8a0630093-a7d53-minion-group-c5lb\nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 5m4s default-scheduler Successfully assigned pod-network-test-1038/netserver-1 to e2e-c8a0630093-a7d53-minion-group-c5lb\n Normal Pulled 5m2s kubelet Container image \"registry.k8s.io/e2e-test-images/agnhost:2.36\" already present on machine\n Normal Created 5m2s kubelet Created container webserver\n Normal Started 5m2s kubelet Started container webserver\n Warning NodeNotReady 3m53s node-controller Node is not ready\n Warning FailedMount 2m41s (x2 over 2m42s) kubelet MountVolume.SetUp failed for volume \"kube-api-access-b4kzq\" : failed to sync configmap cache: timed out waiting for the condition\n Normal SandboxChanged 2m40s kubelet Pod sandbox changed, it will be killed and re-created.\n Normal Pulled 2m39s kubelet Container image \"registry.k8s.io/e2e-test-images/agnhost:2.36\" already present on machine\n Normal Created 2m39s kubelet Created container webserver\n Normal Started 2m39s kubelet Started container webserver\n" May 3 09:03:11.432: INFO: Name: netserver-1 Namespace: pod-network-test-1038 Priority: 0 Node: e2e-c8a0630093-a7d53-minion-group-c5lb/10.40.0.3 Start Time: Tue, 03 May 2022 08:58:07 +0000 Labels: selector-b33fe5ea-9c5a-4b44-8a0e-cdae477f4635=true Annotations: <none> Status: Running IP: 10.64.3.110 IPs: IP: 10.64.3.110 Containers: webserver: Container ID: containerd://eac3f1a4cced5ebca32c6370ac781155d78ec48367ead7647da90316d150ca8f Image: registry.k8s.io/e2e-test-images/agnhost:2.36 Image ID: registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 Ports: 8083/TCP, 8081/UDP Host Ports: 0/TCP, 0/UDP Args: netexec --http-port=8083 --udp-port=8081 State: Running Started: Tue, 03 May 2022 09:00:32 +0000 Last State: Terminated Reason: Unknown Exit Code: 255 Started: Tue, 03 May 2022 08:58:09 +0000 Finished: Tue, 03 May 2022 08:59:17 +0000 Ready: True Restart Count: 1 Liveness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3 Readiness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3 Environment: <none> Mounts: /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-b4kzq (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: kube-api-access-b4kzq: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: <nil> DownwardAPI: true QoS Class: BestEffort Node-Selectors: kubernetes.io/hostname=e2e-c8a0630093-a7d53-minion-group-c5lb Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 5m4s default-scheduler Successfully assigned pod-network-test-1038/netserver-1 to e2e-c8a0630093-a7d53-minion-group-c5lb Normal Pulled 5m2s kubelet Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine Normal Created 5m2s kubelet Created container webserver Normal Started 5m2s kubelet Started container webserver Warning NodeNotReady 3m53s node-controller Node is not ready Warning FailedMount 2m41s (x2 over 2m42s) kubelet MountVolume.SetUp failed for volume "kube-api-access-b4kzq" : failed to sync configmap cache: timed out waiting for the condition Normal SandboxChanged 2m40s kubelet Pod sandbox changed, it will be killed and re-created. Normal Pulled 2m39s kubelet Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine Normal Created 2m39s kubelet Created container webserver Normal Started 2m39s kubelet Started container webserver May 3 09:03:11.432: INFO: Output of kubectl describe pod pod-network-test-1038/netserver-2: May 3 09:03:11.432: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.22.140 --kubeconfig=/workspace/.kube/config --namespace=pod-network-test-1038 describe pod netserver-2 --namespace=pod-network-test-1038' May 3 09:03:11.752: INFO: stderr: "" May 3 09:03:11.752: INFO: stdout: "Name: netserver-2\nNamespace: pod-network-test-1038\nPriority: 0\nNode: e2e-c8a0630093-a7d53-minion-group-j0s7/10.40.0.4\nStart Time: Tue, 03 May 2022 08:58:07 +0000\nLabels: selector-b33fe5ea-9c5a-4b44-8a0e-cdae477f4635=true\nAnnotations: <none>\nStatus: Running\nIP: 10.64.1.141\nIPs:\n IP: 10.64.1.141\nContainers:\n webserver:\n Container ID: containerd://831fcb6fa4e1144cf661faaf045c6b1a7efec82c911ff7b36ae48df851830115\n Image: registry.k8s.io/e2e-test-images/agnhost:2.36\n Image ID: registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8\n Ports: 8083/TCP, 8081/UDP\n Host Ports: 0/TCP, 0/UDP\n Args:\n netexec\n --http-port=8083\n --udp-port=8081\n State: Running\n Started: Tue, 03 May 2022 08:58:08 +0000\n Ready: True\n Restart Count: 0\n Liveness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3\n Readiness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3\n Environment: <none>\n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-nhq5n (ro)\nConditions:\n Type Status\n Initialized True \n Ready True \n ContainersReady True \n PodScheduled True \nVolumes:\n kube-api-access-nhq5n:\n Type: Projected (a volume that contains injected data from multiple sources)\n TokenExpirationSeconds: 3607\n ConfigMapName: kube-root-ca.crt\n ConfigMapOptional: <nil>\n DownwardAPI: true\nQoS Class: BestEffort\nNode-Selectors: kubernetes.io/hostname=e2e-c8a0630093-a7d53-minion-group-j0s7\nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 5m4s default-scheduler Successfully assigned pod-network-test-1038/netserver-2 to e2e-c8a0630093-a7d53-minion-group-j0s7\n Normal Pulled 5m3s kubelet Container image \"registry.k8s.io/e2e-test-images/agnhost:2.36\" already present on machine\n Normal Created 5m3s kubelet Created container webserver\n Normal Started 5m3s kubelet Started container webserver\n" May 3 09:03:11.752: INFO: Name: netserver-2 Namespace: pod-network-test-1038 Priority: 0 Node: e2e-c8a0630093-a7d53-minion-group-j0s7/10.40.0.4 Start Time: Tue, 03 May 2022 08:58:07 +0000 Labels: selector-b33fe5ea-9c5a-4b44-8a0e-cdae477f4635=true Annotations: <none> Status: Running IP: 10.64.1.141 IPs: IP: 10.64.1.141 Containers: webserver: Container ID: containerd://831fcb6fa4e1144cf661faaf045c6b1a7efec82c911ff7b36ae48df851830115 Image: registry.k8s.io/e2e-test-images/agnhost:2.36 Image ID: registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 Ports: 8083/TCP, 8081/UDP Host Ports: 0/TCP, 0/UDP Args: netexec --http-port=8083 --udp-port=8081 State: Running Started: Tue, 03 May 2022 08:58:08 +0000 Ready: True Restart Count: 0 Liveness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3 Readiness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3 Environment: <none> Mounts: /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-nhq5n (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: kube-api-access-nhq5n: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: <nil> DownwardAPI: true QoS Class: BestEffort Node-Selectors: kubernetes.io/hostname=e2e-c8a0630093-a7d53-minion-group-j0s7 Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 5m4s default-scheduler Successfully assigned pod-network-test-1038/netserver-2 to e2e-c8a0630093-a7d53-minion-group-j0s7 Normal Pulled 5m3s kubelet Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine Normal Created 5m3s kubelet Created container webserver Normal Started 5m3s kubelet Started container webserver May 3 09:03:11.752: FAIL: Error dialing HTTP node to pod failed to find expected endpoints, tries 39 Command curl -g -q -s --max-time 15 --connect-timeout 1 http://10.64.3.93:8083/hostName retrieved map[] expected map[netserver-1:{}] Full Stack Trace k8s.io/kubernetes/test/e2e.RunE2ETests(0x257e5b7?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x24efd19?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0001f0820, 0x73fa160) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f [AfterEach] [sig-network] Networking test/e2e/framework/framework.go:188 �[1mSTEP�[0m: Collecting events from namespace "pod-network-test-1038". �[1mSTEP�[0m: Found 31 events. May 3 09:03:11.832: INFO: At 2022-05-03 08:58:07 +0000 UTC - event for netserver-0: {default-scheduler } Scheduled: Successfully assigned pod-network-test-1038/netserver-0 to e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 09:03:11.832: INFO: At 2022-05-03 08:58:07 +0000 UTC - event for netserver-1: {default-scheduler } Scheduled: Successfully assigned pod-network-test-1038/netserver-1 to e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:03:11.832: INFO: At 2022-05-03 08:58:07 +0000 UTC - event for netserver-2: {default-scheduler } Scheduled: Successfully assigned pod-network-test-1038/netserver-2 to e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 09:03:11.832: INFO: At 2022-05-03 08:58:08 +0000 UTC - event for netserver-0: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Started: Started container webserver May 3 09:03:11.832: INFO: At 2022-05-03 08:58:08 +0000 UTC - event for netserver-0: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 09:03:11.832: INFO: At 2022-05-03 08:58:08 +0000 UTC - event for netserver-0: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Created: Created container webserver May 3 09:03:11.832: INFO: At 2022-05-03 08:58:08 +0000 UTC - event for netserver-2: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 09:03:11.833: INFO: At 2022-05-03 08:58:08 +0000 UTC - event for netserver-2: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Created: Created container webserver May 3 09:03:11.833: INFO: At 2022-05-03 08:58:08 +0000 UTC - event for netserver-2: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Started: Started container webserver May 3 09:03:11.833: INFO: At 2022-05-03 08:58:09 +0000 UTC - event for netserver-1: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 09:03:11.833: INFO: At 2022-05-03 08:58:09 +0000 UTC - event for netserver-1: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Created: Created container webserver May 3 09:03:11.833: INFO: At 2022-05-03 08:58:09 +0000 UTC - event for netserver-1: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Started: Started container webserver May 3 09:03:11.833: INFO: At 2022-05-03 08:58:43 +0000 UTC - event for host-test-container-pod: {default-scheduler } Scheduled: Successfully assigned pod-network-test-1038/host-test-container-pod to e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:03:11.833: INFO: At 2022-05-03 08:58:43 +0000 UTC - event for test-container-pod: {default-scheduler } Scheduled: Successfully assigned pod-network-test-1038/test-container-pod to e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:03:11.833: INFO: At 2022-05-03 08:59:18 +0000 UTC - event for netserver-1: {node-controller } NodeNotReady: Node is not ready May 3 09:03:11.833: INFO: At 2022-05-03 09:00:28 +0000 UTC - event for host-test-container-pod: {taint-controller } TaintManagerEviction: Cancelling deletion of Pod pod-network-test-1038/host-test-container-pod May 3 09:03:11.833: INFO: At 2022-05-03 09:00:28 +0000 UTC - event for netserver-1: {taint-controller } TaintManagerEviction: Cancelling deletion of Pod pod-network-test-1038/netserver-1 May 3 09:03:11.833: INFO: At 2022-05-03 09:00:28 +0000 UTC - event for test-container-pod: {taint-controller } TaintManagerEviction: Cancelling deletion of Pod pod-network-test-1038/test-container-pod May 3 09:03:11.833: INFO: At 2022-05-03 09:00:29 +0000 UTC - event for netserver-1: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} FailedMount: MountVolume.SetUp failed for volume "kube-api-access-b4kzq" : failed to sync configmap cache: timed out waiting for the condition May 3 09:03:11.833: INFO: At 2022-05-03 09:00:29 +0000 UTC - event for test-container-pod: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} FailedMount: MountVolume.SetUp failed for volume "kube-api-access-sd628" : failed to sync configmap cache: timed out waiting for the condition May 3 09:03:11.833: INFO: At 2022-05-03 09:00:30 +0000 UTC - event for host-test-container-pod: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} FailedMount: MountVolume.SetUp failed for volume "kube-api-access-tbt99" : failed to sync configmap cache: timed out waiting for the condition May 3 09:03:11.833: INFO: At 2022-05-03 09:00:31 +0000 UTC - event for host-test-container-pod: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 09:03:11.833: INFO: At 2022-05-03 09:00:31 +0000 UTC - event for host-test-container-pod: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Started: Started container agnhost-container May 3 09:03:11.833: INFO: At 2022-05-03 09:00:31 +0000 UTC - event for host-test-container-pod: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Created: Created container agnhost-container May 3 09:03:11.833: INFO: At 2022-05-03 09:00:31 +0000 UTC - event for netserver-1: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 3 09:03:11.833: INFO: At 2022-05-03 09:00:31 +0000 UTC - event for test-container-pod: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 09:03:11.833: INFO: At 2022-05-03 09:00:31 +0000 UTC - event for test-container-pod: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Created: Created container webserver May 3 09:03:11.833: INFO: At 2022-05-03 09:00:31 +0000 UTC - event for test-container-pod: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Started: Started container webserver May 3 09:03:11.833: INFO: At 2022-05-03 09:00:32 +0000 UTC - event for netserver-1: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Started: Started container webserver May 3 09:03:11.833: INFO: At 2022-05-03 09:00:32 +0000 UTC - event for netserver-1: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Created: Created container webserver May 3 09:03:11.833: INFO: At 2022-05-03 09:00:32 +0000 UTC - event for netserver-1: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 09:03:11.887: INFO: POD NODE PHASE GRACE CONDITIONS May 3 09:03:11.887: INFO: host-test-container-pod e2e-c8a0630093-a7d53-minion-group-c5lb Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 09:00:27 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 09:00:32 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 09:00:32 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:43 +0000 UTC }] May 3 09:03:11.887: INFO: netserver-0 e2e-c8a0630093-a7d53-minion-group-7bq2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:07 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:27 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:27 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:07 +0000 UTC }] May 3 09:03:11.887: INFO: netserver-1 e2e-c8a0630093-a7d53-minion-group-c5lb Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:07 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 09:00:45 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 09:00:45 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:07 +0000 UTC }] May 3 09:03:11.887: INFO: netserver-2 e2e-c8a0630093-a7d53-minion-group-j0s7 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:07 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:27 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:27 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:07 +0000 UTC }] May 3 09:03:11.887: INFO: test-container-pod e2e-c8a0630093-a7d53-minion-group-c5lb Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 09:00:27 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 09:00:32 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 09:00:32 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:43 +0000 UTC }] May 3 09:03:11.887: INFO: May 3 09:03:12.517: INFO: Logging node info for node e2e-c8a0630093-a7d53-master May 3 09:03:12.666: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-master b19f1e35-3444-417f-aa8a-059f422baac1 28591 0 2022-05-03 08:44:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-05-03 08:44:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 08:45:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3860037632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3597893632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:44:59 +0000 UTC,LastTransitionTime:2022-05-03 08:44:59 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 09:00:59 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 09:00:59 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 09:00:59 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 09:00:59 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.22.140,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bcd3f659cc761bdb6efbff38fefe4e19,SystemUUID:bcd3f659-cc76-1bdb-6efb-ff38fefe4e19,BootID:f91b8838-f530-4990-b2a6-3b369f82164e,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:131049939,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:120695609,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:52333368,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 09:03:12.667: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-master May 3 09:03:12.874: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-master May 3 09:03:13.072: INFO: etcd-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:03:13.072: INFO: Container etcd-container ready: true, restart count 0 May 3 09:03:13.072: INFO: konnectivity-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:03:13.072: INFO: Container konnectivity-server-container ready: true, restart count 0 May 3 09:03:13.072: INFO: kube-apiserver-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:03:13.072: INFO: Container kube-apiserver ready: true, restart count 1 May 3 09:03:13.072: INFO: metadata-proxy-v0.1-blclk started at 2022-05-03 08:45:06 +0000 UTC (0+2 container statuses recorded) May 3 09:03:13.072: INFO: Container metadata-proxy ready: true, restart count 0 May 3 09:03:13.072: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 09:03:13.072: INFO: l7-lb-controller-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:13 +0000 UTC (0+1 container statuses recorded) May 3 09:03:13.072: INFO: Container l7-lb-controller ready: true, restart count 3 May 3 09:03:13.072: INFO: etcd-server-events-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:03:13.072: INFO: Container etcd-container ready: true, restart count 0 May 3 09:03:13.072: INFO: kube-controller-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:03:13.072: INFO: Container kube-controller-manager ready: true, restart count 2 May 3 09:03:13.072: INFO: kube-scheduler-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:03:13.072: INFO: Container kube-scheduler ready: true, restart count 0 May 3 09:03:13.072: INFO: kube-addon-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:12 +0000 UTC (0+1 container statuses recorded) May 3 09:03:13.072: INFO: Container kube-addon-manager ready: true, restart count 0 May 3 09:03:13.574: INFO: Latency metrics for node e2e-c8a0630093-a7d53-master May 3 09:03:13.574: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 09:03:13.735: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-7bq2 bfa6e413-94d8-452c-a687-5f8ae9ea5b7c 32143 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-7bq2 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-7bq2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 09:01:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 09:02:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-7bq2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 09:00:06 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 09:00:06 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 09:00:06 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 09:00:06 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-05-03 09:00:06 +0000 UTC,LastTransitionTime:2022-05-03 09:00:06 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 09:00:06 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 09:02:41 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 09:02:41 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 09:02:41 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 09:02:41 +0000 UTC,LastTransitionTime:2022-05-03 08:45:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:35.197.55.130,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f84a54b770444ef2c7de26e5ab984f78,SystemUUID:f84a54b7-7044-4ef2-c7de-26e5ab984f78,BootID:950b58bb-5fcd-4efa-a61d-cbb738103018,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 09:03:13.735: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 09:03:13.916: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 09:03:14.627: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-vlxs7 started at 2022-05-03 09:03:03 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.627: INFO: Container agnhost-container ready: true, restart count 0 May 3 09:03:14.627: INFO: local-client started at 2022-05-03 09:03:04 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.627: INFO: Container local-client ready: true, restart count 0 May 3 09:03:14.627: INFO: foo-rsfw5 started at 2022-05-03 09:03:05 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.627: INFO: Container c ready: false, restart count 0 May 3 09:03:14.627: INFO: l7-default-backend-bb7fb94cb-jt2kv started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.627: INFO: Container default-http-backend ready: true, restart count 0 May 3 09:03:14.627: INFO: sample-webhook-deployment-69fbcb9788-lnqj5 started at 2022-05-03 09:03:05 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.627: INFO: Container sample-webhook ready: false, restart count 0 May 3 09:03:14.627: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-d4425 started at 2022-05-03 09:02:24 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.627: INFO: Container agnhost-container ready: true, restart count 0 May 3 09:03:14.627: INFO: nfs-client started at 2022-05-03 09:03:01 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.627: INFO: Container nfs-client ready: true, restart count 0 May 3 09:03:14.627: INFO: foo-q49cw started at 2022-05-03 09:03:05 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.627: INFO: Container c ready: false, restart count 0 May 3 09:03:14.627: INFO: external-provisioner-jlwg2 started at 2022-05-03 09:02:26 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.627: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 09:03:14.627: INFO: emptydir-injector started at 2022-05-03 09:02:55 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.627: INFO: Container emptydir-injector ready: true, restart count 0 May 3 09:03:14.627: INFO: external-provisioner-skff4 started at 2022-05-03 08:58:13 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.627: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 09:03:14.627: INFO: inline-volume-68wmp started at 2022-05-03 09:02:23 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.627: INFO: Container volume-tester ready: false, restart count 0 May 3 09:03:14.627: INFO: netserver-0 started at 2022-05-03 08:58:07 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.627: INFO: Container webserver ready: true, restart count 0 May 3 09:03:14.627: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-7bq2 started at 2022-05-03 08:44:57 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.627: INFO: Container kube-proxy ready: true, restart count 0 May 3 09:03:14.627: INFO: netserver-0 started at <nil> (0+0 container statuses recorded) May 3 09:03:14.627: INFO: external-provisioner-55wrx started at 2022-05-03 09:02:25 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.628: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 09:03:14.628: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-jlkcp started at 2022-05-03 09:02:52 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.628: INFO: Container agnhost-container ready: true, restart count 0 May 3 09:03:14.628: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-tb4d6 started at <nil> (0+0 container statuses recorded) May 3 09:03:14.628: INFO: external-provisioner-w2wtr started at <nil> (0+0 container statuses recorded) May 3 09:03:14.628: INFO: deployment-shared-map-item-removal-5979f4dc85-xlndw started at <nil> (0+0 container statuses recorded) May 3 09:03:14.628: INFO: konnectivity-agent-r2m8v started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.628: INFO: Container konnectivity-agent ready: true, restart count 0 May 3 09:03:14.628: INFO: coredns-6b775575b5-w454s started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.628: INFO: Container coredns ready: true, restart count 0 May 3 09:03:14.628: INFO: pod-subpath-test-preprovisionedpv-zbnw started at <nil> (0+0 container statuses recorded) May 3 09:03:14.628: INFO: affinity-clusterip-transition-tv77r started at <nil> (0+0 container statuses recorded) May 3 09:03:14.628: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-cl5ln started at 2022-05-03 09:03:03 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.628: INFO: Container agnhost-container ready: true, restart count 0 May 3 09:03:14.628: INFO: kube-dns-autoscaler-c6c49f5f6-t54xb started at 2022-05-03 08:56:29 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.628: INFO: Container autoscaler ready: true, restart count 0 May 3 09:03:14.628: INFO: npd-v0.8.9-lxnv5 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:03:14.628: INFO: Container node-problem-detector ready: true, restart count 0 May 3 09:03:14.628: INFO: pod-configmaps-80d4039e-229c-406f-a2bb-00434d389b44 started at 2022-05-03 09:02:54 +0000 UTC (0+3 container statuses recorded) May 3 09:03:14.628: INFO: Container createcm-volume-test ready: true, restart count 0 May 3 09:03:14.628: INFO: Container delcm-volume-test ready: true, restart count 0 May 3 09:03:14.628: INFO: Container updcm-volume-test ready: true, restart count 0 May 3 09:03:14.628: INFO: metadata-proxy-v0.1-27ljg started at 2022-05-03 08:44:58 +0000 UTC (0+2 container statuses recorded) May 3 09:03:14.628: INFO: Container metadata-proxy ready: true, restart count 0 May 3 09:03:14.628: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 09:03:15.064: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 09:03:15.064: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:03:15.109: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-c5lb e86bdeb4-972e-4590-a8a1-92d331988301 32588 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-c5lb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-c5lb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-4092":"e2e-c8a0630093-a7d53-minion-group-c5lb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 08:59:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-05-03 09:02:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-05-03 09:02:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{},"f:memory":{}},"f:capacity":{"f:ephemeral-storage":{},"f:memory":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:nodeInfo":{"f:bootID":{}},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-c5lb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817134080 0} {<nil>} 7455Mi BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554990080 0} {<nil>} 7205Mi BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 09:01:32 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 09:01:32 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 09:01:32 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 09:01:32 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 09:01:32 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 09:01:32 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 09:02:50 +0000 UTC,LastTransitionTime:2022-05-03 09:00:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 09:02:50 +0000 UTC,LastTransitionTime:2022-05-03 09:00:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 09:02:50 +0000 UTC,LastTransitionTime:2022-05-03 09:00:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 09:02:50 +0000 UTC,LastTransitionTime:2022-05-03 09:00:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.151.125,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:97eaceafa1dcc38dfa191fea843250cf,SystemUUID:97eaceaf-a1dc-c38d-fa19-1fea843250cf,BootID:07b245ae-f8d1-4df7-99ab-f56ed5c2890d,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/glusterdynamic-provisioner@sha256:7ed3bfb1429e97f721cbd8b2953ffb1f0186e89c1c99ee0e919d563b0caa81d2 registry.k8s.io/e2e-test-images/glusterdynamic-provisioner:v1.3],SizeBytes:151196506,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-4092^b16bbafb-cabf-11ec-81f1-d653a137a25f],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-4092^b16bbafb-cabf-11ec-81f1-d653a137a25f,DevicePath:,},},Config:nil,},} May 3 09:03:15.110: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:03:15.154: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:03:15.287: INFO: csi-mockplugin-attacher-0 started at 2022-05-03 09:01:50 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container csi-attacher ready: true, restart count 0 May 3 09:03:15.287: INFO: inline-volume-tester2-tnnll started at 2022-05-03 09:00:27 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container csi-volume-tester ready: false, restart count 0 May 3 09:03:15.287: INFO: test-container-pod started at 2022-05-03 09:00:27 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container webserver ready: true, restart count 0 May 3 09:03:15.287: INFO: host-test-container-pod started at 2022-05-03 09:00:27 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container agnhost-container ready: true, restart count 0 May 3 09:03:15.287: INFO: netserver-1 started at 2022-05-03 09:02:59 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container webserver ready: false, restart count 0 May 3 09:03:15.287: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-c5lb started at 2022-05-03 08:44:58 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container kube-proxy ready: true, restart count 1 May 3 09:03:15.287: INFO: metadata-proxy-v0.1-96hkj started at 2022-05-03 08:44:58 +0000 UTC (0+2 container statuses recorded) May 3 09:03:15.287: INFO: Container metadata-proxy ready: true, restart count 1 May 3 09:03:15.287: INFO: Container prometheus-to-sd-exporter ready: true, restart count 1 May 3 09:03:15.287: INFO: konnectivity-agent-68zqw started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container konnectivity-agent ready: true, restart count 1 May 3 09:03:15.287: INFO: deployment-shared-map-item-removal-5979f4dc85-kvsb5 started at 2022-05-03 09:03:12 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container nginx ready: false, restart count 0 May 3 09:03:15.287: INFO: netserver-1 started at 2022-05-03 08:58:07 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container webserver ready: true, restart count 1 May 3 09:03:15.287: INFO: proxy-service-5tmvw-2lsvf started at 2022-05-03 08:58:19 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container proxy-service-5tmvw ready: true, restart count 1 May 3 09:03:15.287: INFO: pod-subpath-test-preprovisionedpv-b7v5 started at <nil> (0+0 container statuses recorded) May 3 09:03:15.287: INFO: glusterdynamic-provisioner-zhm5j started at 2022-05-03 08:58:21 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container glusterdynamic-provisioner ready: true, restart count 1 May 3 09:03:15.287: INFO: pod-subpath-test-preprovisionedpv-lhd9 started at 2022-05-03 09:02:57 +0000 UTC (1+1 container statuses recorded) May 3 09:03:15.287: INFO: Init container init-volume-preprovisionedpv-lhd9 ready: true, restart count 0 May 3 09:03:15.287: INFO: Container test-container-subpath-preprovisionedpv-lhd9 ready: true, restart count 0 May 3 09:03:15.287: INFO: external-provisioner-bqptd started at 2022-05-03 09:03:09 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container nfs-provisioner ready: false, restart count 0 May 3 09:03:15.287: INFO: npd-v0.8.9-wzktb started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container node-problem-detector ready: true, restart count 1 May 3 09:03:15.287: INFO: metrics-server-v0.5.2-86b9c987cb-nflsz started at 2022-05-03 08:45:23 +0000 UTC (0+2 container statuses recorded) May 3 09:03:15.287: INFO: Container metrics-server ready: true, restart count 2 May 3 09:03:15.287: INFO: Container metrics-server-nanny ready: true, restart count 1 May 3 09:03:15.287: INFO: coredns-6b775575b5-np5vf started at 2022-05-03 08:45:16 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container coredns ready: true, restart count 1 May 3 09:03:15.287: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-46f7p started at 2022-05-03 09:03:03 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container agnhost-container ready: true, restart count 0 May 3 09:03:15.287: INFO: pvc-volume-tester-kq9zh started at 2022-05-03 09:02:02 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container volume-tester ready: true, restart count 0 May 3 09:03:15.287: INFO: pod-ba8907da-13fb-4b25-ac88-dd32e445f584 started at 2022-05-03 09:03:10 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container test-container ready: false, restart count 0 May 3 09:03:15.287: INFO: csi-mockplugin-0 started at 2022-05-03 09:01:50 +0000 UTC (0+3 container statuses recorded) May 3 09:03:15.287: INFO: Container csi-provisioner ready: true, restart count 0 May 3 09:03:15.287: INFO: Container driver-registrar ready: true, restart count 0 May 3 09:03:15.287: INFO: Container mock ready: true, restart count 0 May 3 09:03:15.287: INFO: affinity-clusterip-transition-jvhnz started at 2022-05-03 09:03:11 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container affinity-clusterip-transition ready: true, restart count 0 May 3 09:03:15.287: INFO: inline-volume-tester-4s44p started at 2022-05-03 08:58:22 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container csi-volume-tester ready: false, restart count 0 May 3 09:03:15.287: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-blpgg started at 2022-05-03 09:02:42 +0000 UTC (0+1 container statuses recorded) May 3 09:03:15.287: INFO: Container agnhost-container ready: true, restart count 0 May 3 09:03:15.827: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:03:15.827: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 09:03:15.885: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-j0s7 13534811-02a2-4928-b008-80e6f39177b8 32707 0 2022-05-03 08:44:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-j0s7 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-j0s7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-9653":"e2e-c8a0630093-a7d53-minion-group-j0s7"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:21 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 09:02:51 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-05-03 09:03:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-j0s7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817138176 0} {<nil>} 7633924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554994176 0} {<nil>} 7377924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 09:00:11 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 09:00:11 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-05-03 09:00:11 +0000 UTC,LastTransitionTime:2022-05-03 09:00:10 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 09:00:11 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 09:00:11 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 09:00:11 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 09:03:11 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 09:03:11 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 09:03:11 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 09:03:11 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.237.94,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:800822b6a794b56fc75d86f7afc2e1a6,SystemUUID:800822b6-a794-b56f-c75d-86f7afc2e1a6,BootID:c95dcb5d-789d-48b1-8b08-198b7583e648,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/build-image/debian-iptables@sha256:3317c4374ea30d88b64b27740b0edfaa600e410901e727b5bab4c4deac1df6f5 registry.k8s.io/build-image/debian-iptables:bullseye-v1.3.0],SizeBytes:27061409,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:00fcc441ea9f72899c25eed61d602272a2a58c5f0014332bdcb5ac24acef08e4 registry.k8s.io/sig-storage/snapshot-controller:v4.0.0],SizeBytes:18952261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-9653^bf73e4e6-cabf-11ec-b784-b67de1967dba,DevicePath:,},},Config:nil,},} May 3 09:03:15.885: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 09:03:15.961: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 09:03:16.097: INFO: konnectivity-agent-98km6 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:03:16.097: INFO: Container konnectivity-agent ready: true, restart count 0 May 3 09:03:16.097: INFO: sample-webhook-deployment-69fbcb9788-kvqns started at <nil> (0+0 container statuses recorded) May 3 09:03:16.097: INFO: pod-ephm-test-projected-shdl started at 2022-05-03 09:02:36 +0000 UTC (0+1 container statuses recorded) May 3 09:03:16.097: INFO: Container test-container-subpath-projected-shdl ready: false, restart count 0 May 3 09:03:16.097: INFO: netserver-2 started at 2022-05-03 08:58:07 +0000 UTC (0+1 container statuses recorded) May 3 09:03:16.097: INFO: Container webserver ready: true, restart count 0 May 3 09:03:16.097: INFO: pod-c9aeb1b3-3c7b-4e0f-8d11-a9280db1ee4b started at 2022-05-03 09:02:34 +0000 UTC (0+1 container statuses recorded) May 3 09:03:16.097: INFO: Container write-pod ready: true, restart count 0 May 3 09:03:16.097: INFO: pod-e2dceb44-d688-4e05-a9e3-1167d08120c1 started at 2022-05-03 09:03:06 +0000 UTC (0+1 container statuses recorded) May 3 09:03:16.097: INFO: Container write-pod ready: true, restart count 0 May 3 09:03:16.097: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-j0s7 started at 2022-05-03 08:44:56 +0000 UTC (0+1 container statuses recorded) May 3 09:03:16.097: INFO: Container kube-proxy ready: true, restart count 0 May 3 09:03:16.097: INFO: netserver-2 started at 2022-05-03 09:02:59 +0000 UTC (0+1 container statuses recorded) May 3 09:03:16.097: INFO: Container webserver ready: false, restart count 0 May 3 09:03:16.097: INFO: affinity-clusterip-transition-8rnbr started at <nil> (0+0 container statuses recorded) May 3 09:03:16.097: INFO: pod-6d841054-3e83-4d93-b0e6-36fc6628ead1 started at 2022-05-03 09:02:51 +0000 UTC (0+1 container statuses recorded) May 3 09:03:16.097: INFO: Container write-pod ready: true, restart count 0 May 3 09:03:16.097: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-j0s7-8xt5d started at 2022-05-03 09:02:30 +0000 UTC (0+1 container statuses recorded) May 3 09:03:16.097: INFO: Container agnhost-container ready: true, restart count 0 May 3 09:03:16.097: INFO: pod-subpath-test-preprovisionedpv-q8d4 started at 2022-05-03 09:03:00 +0000 UTC (1+1 container statuses recorded) May 3 09:03:16.097: INFO: Init container init-volume-preprovisionedpv-q8d4 ready: true, restart count 0 May 3 09:03:16.097: INFO: Container test-container-subpath-preprovisionedpv-q8d4 ready: true, restart count 0 May 3 09:03:16.097: INFO: npd-v0.8.9-dgf5k started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:03:16.097: INFO: Container node-problem-detector ready: true, restart count 0 May 3 09:03:16.097: INFO: volume-snapshot-controller-0 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:03:16.097: INFO: Container volume-snapshot-controller ready: true, restart count 0 May 3 09:03:16.097: INFO: tester started at 2022-05-03 09:02:40 +0000 UTC (0+1 container statuses recorded) May 3 09:03:16.097: INFO: Container tester ready: true, restart count 0 May 3 09:03:16.097: INFO: deployment-shared-map-item-removal-5979f4dc85-vg7fh started at <nil> (0+0 container statuses recorded) May 3 09:03:16.098: INFO: csi-hostpathplugin-0 started at 2022-05-03 09:02:18 +0000 UTC (0+7 container statuses recorded) May 3 09:03:16.098: INFO: Container csi-attacher ready: true, restart count 0 May 3 09:03:16.098: INFO: Container csi-provisioner ready: true, restart count 0 May 3 09:03:16.098: INFO: Container csi-resizer ready: true, restart count 0 May 3 09:03:16.098: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 09:03:16.098: INFO: Container hostpath ready: true, restart count 0 May 3 09:03:16.098: INFO: Container liveness-probe ready: true, restart count 0 May 3 09:03:16.098: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 09:03:16.098: INFO: metadata-proxy-v0.1-86pbj started at 2022-05-03 08:44:57 +0000 UTC (0+2 container statuses recorded) May 3 09:03:16.098: INFO: Container metadata-proxy ready: true, restart count 0 May 3 09:03:16.098: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 09:03:16.401: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 09:03:16.401: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "pod-network-test-1038" for this suite.
Find failed mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sNetworking\sGranular\sChecks\:\sServices\sshould\sfunction\sfor\sservice\sendpoints\susing\shostNetwork$'
test/e2e/network/networking.go:474 May 3 08:59:51.692: failed dialing endpoint, did not find expected responses... Tries 39 Command curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1' retrieved map[] expected map[e2e-c8a0630093-a7d53-minion-group-7bq2:{} e2e-c8a0630093-a7d53-minion-group-c5lb:{} e2e-c8a0630093-a7d53-minion-group-j0s7:{}] vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113from junit_06.xml
[BeforeEach] [sig-network] Networking test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Creating a kubernetes client May 3 08:57:51.931: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename nettest �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should function for service endpoints using hostNetwork test/e2e/network/networking.go:474 �[1mSTEP�[0m: Performing setup for networking test in namespace nettest-9280 �[1mSTEP�[0m: creating a selector �[1mSTEP�[0m: Creating the service pods in kubernetes May 3 08:57:52.269: INFO: Waiting up to 10m0s for all (but 0) nodes to be schedulable May 3 08:57:52.642: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) May 3 08:57:54.684: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) May 3 08:57:56.689: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:57:58.699: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:00.689: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:02.686: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:04.692: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:06.762: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:08.687: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:10.695: INFO: The status of Pod netserver-0 is Running (Ready = false) May 3 08:58:12.771: INFO: The status of Pod netserver-0 is Running (Ready = true) May 3 08:58:12.875: INFO: The status of Pod netserver-1 is Running (Ready = false) May 3 08:58:14.916: INFO: The status of Pod netserver-1 is Running (Ready = false) May 3 08:58:17.060: INFO: The status of Pod netserver-1 is Running (Ready = false) May 3 08:58:18.940: INFO: The status of Pod netserver-1 is Running (Ready = false) May 3 08:58:20.918: INFO: The status of Pod netserver-1 is Running (Ready = true) May 3 08:58:21.005: INFO: The status of Pod netserver-2 is Running (Ready = false) May 3 08:58:23.051: INFO: The status of Pod netserver-2 is Running (Ready = true) �[1mSTEP�[0m: Creating test pods May 3 08:58:39.436: INFO: Setting MaxTries for pod polling to 39 for networking test based on endpoint count 3 �[1mSTEP�[0m: Getting node addresses May 3 08:58:39.436: INFO: Waiting up to 10m0s for all (but 0) nodes to be schedulable �[1mSTEP�[0m: Creating the service on top of the pods in kubernetes May 3 08:58:39.705: INFO: Service node-port-service in namespace nettest-9280 found. May 3 08:58:39.907: INFO: Service session-affinity-service in namespace nettest-9280 found. �[1mSTEP�[0m: Waiting for NodePort service to expose endpoint May 3 08:58:40.961: INFO: Waiting for amount of service:node-port-service endpoints to be 3 �[1mSTEP�[0m: Waiting for Session Affinity service to expose endpoint May 3 08:58:42.008: INFO: Waiting for amount of service:session-affinity-service endpoints to be 3 �[1mSTEP�[0m: pod-Service(hostNetwork): http �[1mSTEP�[0m: dialing(http) test-container-pod --> 10.0.38.220:80 (config.clusterIP) May 3 08:58:42.294: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:58:42.294: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:58:42.295: INFO: ExecWithOptions: Clientset creation May 3 08:58:42.295: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:13.197: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": Timeout occurred, stdout: "", stderr: "" May 3 08:59:13.249: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:13.249: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:13.250: INFO: ExecWithOptions: Clientset creation May 3 08:59:13.250: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:43.378: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial timeout, backstop, stdout: "", stderr: "" May 3 08:59:43.425: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:43.425: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:43.426: INFO: ExecWithOptions: Clientset creation May 3 08:59:43.426: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:43.602: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:43.647: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:43.647: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:43.647: INFO: ExecWithOptions: Clientset creation May 3 08:59:43.647: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:43.828: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:43.873: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:43.873: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:43.874: INFO: ExecWithOptions: Clientset creation May 3 08:59:43.874: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:44.030: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:44.080: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:44.081: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:44.081: INFO: ExecWithOptions: Clientset creation May 3 08:59:44.081: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:44.245: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:44.289: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:44.289: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:44.289: INFO: ExecWithOptions: Clientset creation May 3 08:59:44.289: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:44.423: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:44.464: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:44.464: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:44.465: INFO: ExecWithOptions: Clientset creation May 3 08:59:44.465: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:44.597: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:44.643: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:44.643: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:44.644: INFO: ExecWithOptions: Clientset creation May 3 08:59:44.644: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:44.809: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:44.873: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:44.873: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:44.874: INFO: ExecWithOptions: Clientset creation May 3 08:59:44.874: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:45.032: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:45.095: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:45.096: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:45.096: INFO: ExecWithOptions: Clientset creation May 3 08:59:45.097: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:45.279: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:45.321: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:45.321: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:45.321: INFO: ExecWithOptions: Clientset creation May 3 08:59:45.322: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:45.470: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:45.515: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:45.515: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:45.517: INFO: ExecWithOptions: Clientset creation May 3 08:59:45.517: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:45.692: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:45.738: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:45.738: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:45.739: INFO: ExecWithOptions: Clientset creation May 3 08:59:45.739: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:45.926: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:45.988: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:45.988: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:45.989: INFO: ExecWithOptions: Clientset creation May 3 08:59:45.989: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:46.180: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:46.251: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:46.251: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:46.253: INFO: ExecWithOptions: Clientset creation May 3 08:59:46.253: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:46.505: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:46.573: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:46.573: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:46.574: INFO: ExecWithOptions: Clientset creation May 3 08:59:46.574: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:46.764: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:46.824: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:46.824: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:46.824: INFO: ExecWithOptions: Clientset creation May 3 08:59:46.824: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:46.987: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:47.034: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:47.034: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:47.035: INFO: ExecWithOptions: Clientset creation May 3 08:59:47.035: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:47.188: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:47.236: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:47.236: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:47.237: INFO: ExecWithOptions: Clientset creation May 3 08:59:47.237: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:47.374: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:47.416: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:47.416: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:47.417: INFO: ExecWithOptions: Clientset creation May 3 08:59:47.417: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:47.597: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:47.639: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:47.640: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:47.640: INFO: ExecWithOptions: Clientset creation May 3 08:59:47.641: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:47.779: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:47.824: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:47.824: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:47.825: INFO: ExecWithOptions: Clientset creation May 3 08:59:47.825: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:47.954: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:47.994: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:47.994: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:47.995: INFO: ExecWithOptions: Clientset creation May 3 08:59:47.995: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:48.136: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:48.177: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:48.177: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:48.178: INFO: ExecWithOptions: Clientset creation May 3 08:59:48.178: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:48.306: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:48.347: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:48.347: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:48.348: INFO: ExecWithOptions: Clientset creation May 3 08:59:48.348: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:48.477: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:48.518: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:48.518: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:48.519: INFO: ExecWithOptions: Clientset creation May 3 08:59:48.519: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:48.647: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:48.692: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:48.692: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:48.693: INFO: ExecWithOptions: Clientset creation May 3 08:59:48.693: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:48.822: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:48.871: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:48.871: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:48.872: INFO: ExecWithOptions: Clientset creation May 3 08:59:48.872: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:49.033: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:49.075: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:49.075: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:49.076: INFO: ExecWithOptions: Clientset creation May 3 08:59:49.076: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:49.211: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:49.278: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:49.278: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:49.279: INFO: ExecWithOptions: Clientset creation May 3 08:59:49.279: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:49.433: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:49.480: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:49.480: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:49.481: INFO: ExecWithOptions: Clientset creation May 3 08:59:49.482: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:49.635: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:49.680: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:49.680: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:49.681: INFO: ExecWithOptions: Clientset creation May 3 08:59:49.681: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:49.841: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:49.882: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:49.882: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:49.883: INFO: ExecWithOptions: Clientset creation May 3 08:59:49.883: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:50.029: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:50.071: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:50.071: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:50.072: INFO: ExecWithOptions: Clientset creation May 3 08:59:50.072: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:50.202: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:50.244: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:50.244: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:50.245: INFO: ExecWithOptions: Clientset creation May 3 08:59:50.245: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:50.376: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:50.417: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:50.417: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:50.418: INFO: ExecWithOptions: Clientset creation May 3 08:59:50.418: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:50.547: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:50.589: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:50.589: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:50.590: INFO: ExecWithOptions: Clientset creation May 3 08:59:50.590: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:50.717: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:50.763: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'] Namespace:nettest-9280 PodName:test-container-pod ContainerName:webserver Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:59:50.763: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:50.763: INFO: ExecWithOptions: Clientset creation May 3 08:59:50.764: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/nettest-9280/pods/test-container-pod/exec?command=%2Fbin%2Fsh&command=-c&command=curl+-g+-q+-s+%27http%3A%2F%2F10.64.3.102%3A9080%2Fdial%3Frequest%3Dhostname%26protocol%3Dhttp%26host%3D10.0.38.220%26port%3D80%26tries%3D1%27&container=webserver&container=webserver&stderr=true&stdout=true) May 3 08:59:50.892: INFO: GetResponseFromContainer: failed to execute "curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1'": error dialing backend: dial tcp 10.40.0.3:10250: connect: connection refused, stdout: "", stderr: "" May 3 08:59:50.892: INFO: Output of kubectl describe pod nettest-9280/netserver-0: May 3 08:59:50.892: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.22.140 --kubeconfig=/workspace/.kube/config --namespace=nettest-9280 describe pod netserver-0 --namespace=nettest-9280' May 3 08:59:51.159: INFO: stderr: "" May 3 08:59:51.159: INFO: stdout: "Name: netserver-0\nNamespace: nettest-9280\nPriority: 0\nNode: e2e-c8a0630093-a7d53-minion-group-7bq2/10.40.0.5\nStart Time: Tue, 03 May 2022 08:57:52 +0000\nLabels: selector-f4261fc7-245c-4106-bada-8ed0c65642e5=true\nAnnotations: <none>\nStatus: Running\nIP: 10.40.0.5\nIPs:\n IP: 10.40.0.5\nContainers:\n webserver:\n Container ID: containerd://937980e5d0d99cd99e746028121ab536be6d6fe898634c2993d30b0f85c0ae95\n Image: registry.k8s.io/e2e-test-images/agnhost:2.36\n Image ID: registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8\n Ports: 8083/TCP, 8081/UDP\n Host Ports: 8083/TCP, 8081/UDP\n Args:\n netexec\n --http-port=8083\n --udp-port=8081\n --udp-listen-addresses=$(HOST_IP),$(POD_IPS)\n State: Running\n Started: Tue, 03 May 2022 08:57:53 +0000\n Ready: True\n Restart Count: 0\n Liveness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3\n Readiness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3\n Environment:\n HOST_IP: (v1:status.hostIP)\n POD_IPS: (v1:status.podIPs)\n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-lvkg4 (ro)\nConditions:\n Type Status\n Initialized True \n Ready True \n ContainersReady True \n PodScheduled True \nVolumes:\n kube-api-access-lvkg4:\n Type: Projected (a volume that contains injected data from multiple sources)\n TokenExpirationSeconds: 3607\n ConfigMapName: kube-root-ca.crt\n ConfigMapOptional: <nil>\n DownwardAPI: true\nQoS Class: BestEffort\nNode-Selectors: kubernetes.io/hostname=e2e-c8a0630093-a7d53-minion-group-7bq2\nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 119s default-scheduler Successfully assigned nettest-9280/netserver-0 to e2e-c8a0630093-a7d53-minion-group-7bq2\n Normal Pulled 118s kubelet Container image \"registry.k8s.io/e2e-test-images/agnhost:2.36\" already present on machine\n Normal Created 118s kubelet Created container webserver\n Normal Started 118s kubelet Started container webserver\n" May 3 08:59:51.159: INFO: Name: netserver-0 Namespace: nettest-9280 Priority: 0 Node: e2e-c8a0630093-a7d53-minion-group-7bq2/10.40.0.5 Start Time: Tue, 03 May 2022 08:57:52 +0000 Labels: selector-f4261fc7-245c-4106-bada-8ed0c65642e5=true Annotations: <none> Status: Running IP: 10.40.0.5 IPs: IP: 10.40.0.5 Containers: webserver: Container ID: containerd://937980e5d0d99cd99e746028121ab536be6d6fe898634c2993d30b0f85c0ae95 Image: registry.k8s.io/e2e-test-images/agnhost:2.36 Image ID: registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 Ports: 8083/TCP, 8081/UDP Host Ports: 8083/TCP, 8081/UDP Args: netexec --http-port=8083 --udp-port=8081 --udp-listen-addresses=$(HOST_IP),$(POD_IPS) State: Running Started: Tue, 03 May 2022 08:57:53 +0000 Ready: True Restart Count: 0 Liveness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3 Readiness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3 Environment: HOST_IP: (v1:status.hostIP) POD_IPS: (v1:status.podIPs) Mounts: /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-lvkg4 (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: kube-api-access-lvkg4: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: <nil> DownwardAPI: true QoS Class: BestEffort Node-Selectors: kubernetes.io/hostname=e2e-c8a0630093-a7d53-minion-group-7bq2 Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 119s default-scheduler Successfully assigned nettest-9280/netserver-0 to e2e-c8a0630093-a7d53-minion-group-7bq2 Normal Pulled 118s kubelet Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine Normal Created 118s kubelet Created container webserver Normal Started 118s kubelet Started container webserver May 3 08:59:51.159: INFO: Output of kubectl describe pod nettest-9280/netserver-1: May 3 08:59:51.159: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.22.140 --kubeconfig=/workspace/.kube/config --namespace=nettest-9280 describe pod netserver-1 --namespace=nettest-9280' May 3 08:59:51.421: INFO: stderr: "" May 3 08:59:51.421: INFO: stdout: "Name: netserver-1\nNamespace: nettest-9280\nPriority: 0\nNode: e2e-c8a0630093-a7d53-minion-group-c5lb/10.40.0.3\nStart Time: Tue, 03 May 2022 08:57:52 +0000\nLabels: selector-f4261fc7-245c-4106-bada-8ed0c65642e5=true\nAnnotations: <none>\nStatus: Running\nIP: 10.40.0.3\nIPs:\n IP: 10.40.0.3\nContainers:\n webserver:\n Container ID: containerd://7cfa5e69bd6f32e9f038edf2e0bd6a1cc649dbdb293122701f1719c925635aac\n Image: registry.k8s.io/e2e-test-images/agnhost:2.36\n Image ID: registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8\n Ports: 8083/TCP, 8081/UDP\n Host Ports: 8083/TCP, 8081/UDP\n Args:\n netexec\n --http-port=8083\n --udp-port=8081\n --udp-listen-addresses=$(HOST_IP),$(POD_IPS)\n State: Running\n Started: Tue, 03 May 2022 08:57:53 +0000\n Ready: True\n Restart Count: 0\n Liveness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3\n Readiness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3\n Environment:\n HOST_IP: (v1:status.hostIP)\n POD_IPS: (v1:status.podIPs)\n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-lhkcc (ro)\nConditions:\n Type Status\n Initialized True \n Ready False \n ContainersReady True \n PodScheduled True \nVolumes:\n kube-api-access-lhkcc:\n Type: Projected (a volume that contains injected data from multiple sources)\n TokenExpirationSeconds: 3607\n ConfigMapName: kube-root-ca.crt\n ConfigMapOptional: <nil>\n DownwardAPI: true\nQoS Class: BestEffort\nNode-Selectors: kubernetes.io/hostname=e2e-c8a0630093-a7d53-minion-group-c5lb\nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 119s default-scheduler Successfully assigned nettest-9280/netserver-1 to e2e-c8a0630093-a7d53-minion-group-c5lb\n Normal Pulled 118s kubelet Container image \"registry.k8s.io/e2e-test-images/agnhost:2.36\" already present on machine\n Normal Created 118s kubelet Created container webserver\n Normal Started 118s kubelet Started container webserver\n Warning NodeNotReady 33s node-controller Node is not ready\n" May 3 08:59:51.421: INFO: Name: netserver-1 Namespace: nettest-9280 Priority: 0 Node: e2e-c8a0630093-a7d53-minion-group-c5lb/10.40.0.3 Start Time: Tue, 03 May 2022 08:57:52 +0000 Labels: selector-f4261fc7-245c-4106-bada-8ed0c65642e5=true Annotations: <none> Status: Running IP: 10.40.0.3 IPs: IP: 10.40.0.3 Containers: webserver: Container ID: containerd://7cfa5e69bd6f32e9f038edf2e0bd6a1cc649dbdb293122701f1719c925635aac Image: registry.k8s.io/e2e-test-images/agnhost:2.36 Image ID: registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 Ports: 8083/TCP, 8081/UDP Host Ports: 8083/TCP, 8081/UDP Args: netexec --http-port=8083 --udp-port=8081 --udp-listen-addresses=$(HOST_IP),$(POD_IPS) State: Running Started: Tue, 03 May 2022 08:57:53 +0000 Ready: True Restart Count: 0 Liveness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3 Readiness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3 Environment: HOST_IP: (v1:status.hostIP) POD_IPS: (v1:status.podIPs) Mounts: /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-lhkcc (ro) Conditions: Type Status Initialized True Ready False ContainersReady True PodScheduled True Volumes: kube-api-access-lhkcc: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: <nil> DownwardAPI: true QoS Class: BestEffort Node-Selectors: kubernetes.io/hostname=e2e-c8a0630093-a7d53-minion-group-c5lb Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 119s default-scheduler Successfully assigned nettest-9280/netserver-1 to e2e-c8a0630093-a7d53-minion-group-c5lb Normal Pulled 118s kubelet Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine Normal Created 118s kubelet Created container webserver Normal Started 118s kubelet Started container webserver Warning NodeNotReady 33s node-controller Node is not ready May 3 08:59:51.421: INFO: Output of kubectl describe pod nettest-9280/netserver-2: May 3 08:59:51.421: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.22.140 --kubeconfig=/workspace/.kube/config --namespace=nettest-9280 describe pod netserver-2 --namespace=nettest-9280' May 3 08:59:51.691: INFO: stderr: "" May 3 08:59:51.691: INFO: stdout: "Name: netserver-2\nNamespace: nettest-9280\nPriority: 0\nNode: e2e-c8a0630093-a7d53-minion-group-j0s7/10.40.0.4\nStart Time: Tue, 03 May 2022 08:57:52 +0000\nLabels: selector-f4261fc7-245c-4106-bada-8ed0c65642e5=true\nAnnotations: <none>\nStatus: Running\nIP: 10.40.0.4\nIPs:\n IP: 10.40.0.4\nContainers:\n webserver:\n Container ID: containerd://b90662334c753dc069b9f7ec09c3e3add2d67415f5f136ebab4e93bbf1ab0d09\n Image: registry.k8s.io/e2e-test-images/agnhost:2.36\n Image ID: registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8\n Ports: 8083/TCP, 8081/UDP\n Host Ports: 8083/TCP, 8081/UDP\n Args:\n netexec\n --http-port=8083\n --udp-port=8081\n --udp-listen-addresses=$(HOST_IP),$(POD_IPS)\n State: Running\n Started: Tue, 03 May 2022 08:57:54 +0000\n Ready: True\n Restart Count: 0\n Liveness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3\n Readiness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3\n Environment:\n HOST_IP: (v1:status.hostIP)\n POD_IPS: (v1:status.podIPs)\n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-bjhwh (ro)\nConditions:\n Type Status\n Initialized True \n Ready True \n ContainersReady True \n PodScheduled True \nVolumes:\n kube-api-access-bjhwh:\n Type: Projected (a volume that contains injected data from multiple sources)\n TokenExpirationSeconds: 3607\n ConfigMapName: kube-root-ca.crt\n ConfigMapOptional: <nil>\n DownwardAPI: true\nQoS Class: BestEffort\nNode-Selectors: kubernetes.io/hostname=e2e-c8a0630093-a7d53-minion-group-j0s7\nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 119s default-scheduler Successfully assigned nettest-9280/netserver-2 to e2e-c8a0630093-a7d53-minion-group-j0s7\n Normal Pulled 117s kubelet Container image \"registry.k8s.io/e2e-test-images/agnhost:2.36\" already present on machine\n Normal Created 117s kubelet Created container webserver\n Normal Started 117s kubelet Started container webserver\n" May 3 08:59:51.691: INFO: Name: netserver-2 Namespace: nettest-9280 Priority: 0 Node: e2e-c8a0630093-a7d53-minion-group-j0s7/10.40.0.4 Start Time: Tue, 03 May 2022 08:57:52 +0000 Labels: selector-f4261fc7-245c-4106-bada-8ed0c65642e5=true Annotations: <none> Status: Running IP: 10.40.0.4 IPs: IP: 10.40.0.4 Containers: webserver: Container ID: containerd://b90662334c753dc069b9f7ec09c3e3add2d67415f5f136ebab4e93bbf1ab0d09 Image: registry.k8s.io/e2e-test-images/agnhost:2.36 Image ID: registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 Ports: 8083/TCP, 8081/UDP Host Ports: 8083/TCP, 8081/UDP Args: netexec --http-port=8083 --udp-port=8081 --udp-listen-addresses=$(HOST_IP),$(POD_IPS) State: Running Started: Tue, 03 May 2022 08:57:54 +0000 Ready: True Restart Count: 0 Liveness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3 Readiness: http-get http://:8083/healthz delay=10s timeout=30s period=10s #success=1 #failure=3 Environment: HOST_IP: (v1:status.hostIP) POD_IPS: (v1:status.podIPs) Mounts: /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-bjhwh (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: kube-api-access-bjhwh: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: <nil> DownwardAPI: true QoS Class: BestEffort Node-Selectors: kubernetes.io/hostname=e2e-c8a0630093-a7d53-minion-group-j0s7 Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 119s default-scheduler Successfully assigned nettest-9280/netserver-2 to e2e-c8a0630093-a7d53-minion-group-j0s7 Normal Pulled 117s kubelet Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine Normal Created 117s kubelet Created container webserver Normal Started 117s kubelet Started container webserver May 3 08:59:51.691: INFO: encountered error during dial (did not find expected responses... Tries 39 Command curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1' retrieved map[] expected map[e2e-c8a0630093-a7d53-minion-group-7bq2:{} e2e-c8a0630093-a7d53-minion-group-c5lb:{} e2e-c8a0630093-a7d53-minion-group-j0s7:{}]) May 3 08:59:51.692: FAIL: failed dialing endpoint, did not find expected responses... Tries 39 Command curl -g -q -s 'http://10.64.3.102:9080/dial?request=hostname&protocol=http&host=10.0.38.220&port=80&tries=1' retrieved map[] expected map[e2e-c8a0630093-a7d53-minion-group-7bq2:{} e2e-c8a0630093-a7d53-minion-group-c5lb:{} e2e-c8a0630093-a7d53-minion-group-j0s7:{}] Full Stack Trace k8s.io/kubernetes/test/e2e.RunE2ETests(0x257e5b7?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x24efd01?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000103a00, 0x73fa160) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f [AfterEach] [sig-network] Networking test/e2e/framework/framework.go:188 �[1mSTEP�[0m: Collecting events from namespace "nettest-9280". �[1mSTEP�[0m: Found 23 events. May 3 08:59:51.773: INFO: At 2022-05-03 08:57:52 +0000 UTC - event for netserver-0: {default-scheduler } Scheduled: Successfully assigned nettest-9280/netserver-0 to e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:51.773: INFO: At 2022-05-03 08:57:52 +0000 UTC - event for netserver-1: {default-scheduler } Scheduled: Successfully assigned nettest-9280/netserver-1 to e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:51.773: INFO: At 2022-05-03 08:57:52 +0000 UTC - event for netserver-2: {default-scheduler } Scheduled: Successfully assigned nettest-9280/netserver-2 to e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:51.773: INFO: At 2022-05-03 08:57:53 +0000 UTC - event for netserver-0: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 08:59:51.773: INFO: At 2022-05-03 08:57:53 +0000 UTC - event for netserver-0: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Created: Created container webserver May 3 08:59:51.773: INFO: At 2022-05-03 08:57:53 +0000 UTC - event for netserver-0: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Started: Started container webserver May 3 08:59:51.773: INFO: At 2022-05-03 08:57:53 +0000 UTC - event for netserver-1: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Started: Started container webserver May 3 08:59:51.773: INFO: At 2022-05-03 08:57:53 +0000 UTC - event for netserver-1: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 08:59:51.773: INFO: At 2022-05-03 08:57:53 +0000 UTC - event for netserver-1: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Created: Created container webserver May 3 08:59:51.773: INFO: At 2022-05-03 08:57:54 +0000 UTC - event for netserver-2: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Started: Started container webserver May 3 08:59:51.773: INFO: At 2022-05-03 08:57:54 +0000 UTC - event for netserver-2: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Created: Created container webserver May 3 08:59:51.773: INFO: At 2022-05-03 08:57:54 +0000 UTC - event for netserver-2: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 08:59:51.773: INFO: At 2022-05-03 08:58:23 +0000 UTC - event for host-test-container-pod: {default-scheduler } Scheduled: Successfully assigned nettest-9280/host-test-container-pod to e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:51.773: INFO: At 2022-05-03 08:58:23 +0000 UTC - event for test-container-pod: {default-scheduler } Scheduled: Successfully assigned nettest-9280/test-container-pod to e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:51.773: INFO: At 2022-05-03 08:58:26 +0000 UTC - event for host-test-container-pod: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Started: Started container agnhost-container May 3 08:59:51.773: INFO: At 2022-05-03 08:58:26 +0000 UTC - event for host-test-container-pod: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Created: Created container agnhost-container May 3 08:59:51.773: INFO: At 2022-05-03 08:58:26 +0000 UTC - event for host-test-container-pod: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 08:59:51.773: INFO: At 2022-05-03 08:58:26 +0000 UTC - event for test-container-pod: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 08:59:51.773: INFO: At 2022-05-03 08:58:26 +0000 UTC - event for test-container-pod: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Created: Created container webserver May 3 08:59:51.773: INFO: At 2022-05-03 08:58:26 +0000 UTC - event for test-container-pod: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Started: Started container webserver May 3 08:59:51.773: INFO: At 2022-05-03 08:59:18 +0000 UTC - event for host-test-container-pod: {node-controller } NodeNotReady: Node is not ready May 3 08:59:51.773: INFO: At 2022-05-03 08:59:18 +0000 UTC - event for netserver-1: {node-controller } NodeNotReady: Node is not ready May 3 08:59:51.773: INFO: At 2022-05-03 08:59:18 +0000 UTC - event for test-container-pod: {node-controller } NodeNotReady: Node is not ready May 3 08:59:51.817: INFO: POD NODE PHASE GRACE CONDITIONS May 3 08:59:51.817: INFO: host-test-container-pod e2e-c8a0630093-a7d53-minion-group-c5lb Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:23 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:59:18 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:27 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:23 +0000 UTC }] May 3 08:59:51.817: INFO: netserver-0 e2e-c8a0630093-a7d53-minion-group-7bq2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:57:52 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:12 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:12 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:57:52 +0000 UTC }] May 3 08:59:51.817: INFO: netserver-1 e2e-c8a0630093-a7d53-minion-group-c5lb Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:57:52 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:59:18 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:12 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:57:52 +0000 UTC }] May 3 08:59:51.817: INFO: netserver-2 e2e-c8a0630093-a7d53-minion-group-j0s7 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:57:52 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:12 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:12 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:57:52 +0000 UTC }] May 3 08:59:51.817: INFO: test-container-pod e2e-c8a0630093-a7d53-minion-group-c5lb Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:23 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:59:18 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:27 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:23 +0000 UTC }] May 3 08:59:51.817: INFO: May 3 08:59:51.863: INFO: Unable to fetch nettest-9280/host-test-container-pod/agnhost-container logs: an error on the server ("unknown") has prevented the request from succeeding (get pods host-test-container-pod) May 3 08:59:51.955: INFO: Unable to fetch nettest-9280/netserver-1/webserver logs: an error on the server ("unknown") has prevented the request from succeeding (get pods netserver-1) May 3 08:59:52.046: INFO: Unable to fetch nettest-9280/test-container-pod/webserver logs: an error on the server ("unknown") has prevented the request from succeeding (get pods test-container-pod) May 3 08:59:52.125: INFO: Logging node info for node e2e-c8a0630093-a7d53-master May 3 08:59:52.170: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-master b19f1e35-3444-417f-aa8a-059f422baac1 21446 0 2022-05-03 08:44:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-05-03 08:44:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 08:45:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3860037632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3597893632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:44:59 +0000 UTC,LastTransitionTime:2022-05-03 08:44:59 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.22.140,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bcd3f659cc761bdb6efbff38fefe4e19,SystemUUID:bcd3f659-cc76-1bdb-6efb-ff38fefe4e19,BootID:f91b8838-f530-4990-b2a6-3b369f82164e,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:131049939,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:120695609,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:52333368,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 08:59:52.170: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-master May 3 08:59:52.213: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-master May 3 08:59:52.271: INFO: etcd-server-events-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.271: INFO: Container etcd-container ready: true, restart count 0 May 3 08:59:52.271: INFO: kube-controller-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.271: INFO: Container kube-controller-manager ready: true, restart count 2 May 3 08:59:52.271: INFO: kube-scheduler-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.271: INFO: Container kube-scheduler ready: true, restart count 0 May 3 08:59:52.271: INFO: kube-addon-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.271: INFO: Container kube-addon-manager ready: true, restart count 0 May 3 08:59:52.271: INFO: l7-lb-controller-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:13 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.271: INFO: Container l7-lb-controller ready: true, restart count 3 May 3 08:59:52.271: INFO: etcd-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.271: INFO: Container etcd-container ready: true, restart count 0 May 3 08:59:52.271: INFO: konnectivity-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.271: INFO: Container konnectivity-server-container ready: true, restart count 0 May 3 08:59:52.271: INFO: kube-apiserver-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.271: INFO: Container kube-apiserver ready: true, restart count 1 May 3 08:59:52.271: INFO: metadata-proxy-v0.1-blclk started at 2022-05-03 08:45:06 +0000 UTC (0+2 container statuses recorded) May 3 08:59:52.271: INFO: Container metadata-proxy ready: true, restart count 0 May 3 08:59:52.271: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 08:59:52.476: INFO: Latency metrics for node e2e-c8a0630093-a7d53-master May 3 08:59:52.476: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:52.519: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-7bq2 bfa6e413-94d8-452c-a687-5f8ae9ea5b7c 27885 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-7bq2 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-7bq2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-6774":"e2e-c8a0630093-a7d53-minion-group-7bq2","csi-mock-csi-mock-volumes-4868":"e2e-c8a0630093-a7d53-minion-group-7bq2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 08:56:35 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 08:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-7bq2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:45:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:35.197.55.130,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f84a54b770444ef2c7de26e5ab984f78,SystemUUID:f84a54b7-7044-4ef2-c7de-26e5ab984f78,BootID:950b58bb-5fcd-4efa-a61d-cbb738103018,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 08:59:52.519: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:52.566: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:52.660: INFO: external-provisioner-dwb56 started at 2022-05-03 08:56:28 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.660: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 08:59:52.660: INFO: external-provisioner-skff4 started at 2022-05-03 08:58:13 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.660: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 08:59:52.660: INFO: csi-mockplugin-resizer-0 started at 2022-05-03 08:56:55 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.660: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:52.660: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-7bq2 started at 2022-05-03 08:44:57 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.660: INFO: Container kube-proxy ready: true, restart count 0 May 3 08:59:52.660: INFO: netserver-0 started at 2022-05-03 08:58:07 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.660: INFO: Container webserver ready: true, restart count 0 May 3 08:59:52.660: INFO: csi-mockplugin-0 started at 2022-05-03 08:56:55 +0000 UTC (0+3 container statuses recorded) May 3 08:59:52.660: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:52.660: INFO: Container driver-registrar ready: true, restart count 0 May 3 08:59:52.660: INFO: Container mock ready: true, restart count 0 May 3 08:59:52.660: INFO: netserver-0 started at 2022-05-03 08:57:29 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.660: INFO: Container webserver ready: true, restart count 0 May 3 08:59:52.660: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:58:01 +0000 UTC (0+7 container statuses recorded) May 3 08:59:52.660: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:52.660: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:52.660: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:52.660: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:52.660: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:52.660: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:52.660: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:52.660: INFO: coredns-6b775575b5-w454s started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.660: INFO: Container coredns ready: true, restart count 0 May 3 08:59:52.660: INFO: konnectivity-agent-r2m8v started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.660: INFO: Container konnectivity-agent ready: true, restart count 0 May 3 08:59:52.660: INFO: npd-v0.8.9-lxnv5 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.660: INFO: Container node-problem-detector ready: true, restart count 0 May 3 08:59:52.660: INFO: kube-dns-autoscaler-c6c49f5f6-t54xb started at 2022-05-03 08:56:29 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.660: INFO: Container autoscaler ready: true, restart count 0 May 3 08:59:52.660: INFO: netserver-0 started at 2022-05-03 08:57:52 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.660: INFO: Container webserver ready: true, restart count 0 May 3 08:59:52.660: INFO: metadata-proxy-v0.1-27ljg started at 2022-05-03 08:44:58 +0000 UTC (0+2 container statuses recorded) May 3 08:59:52.660: INFO: Container metadata-proxy ready: true, restart count 0 May 3 08:59:52.660: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 08:59:52.660: INFO: csi-mockplugin-attacher-0 started at 2022-05-03 08:56:55 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.660: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:52.660: INFO: l7-default-backend-bb7fb94cb-jt2kv started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.660: INFO: Container default-http-backend ready: true, restart count 0 May 3 08:59:52.660: INFO: ss2-2 started at 2022-05-03 08:58:11 +0000 UTC (0+1 container statuses recorded) May 3 08:59:52.660: INFO: Container webserver ready: true, restart count 0 May 3 08:59:52.919: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:52.919: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:52.961: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-c5lb e86bdeb4-972e-4590-a8a1-92d331988301 27865 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-c5lb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-c5lb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-05-03 08:57:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2022-05-03 08:59:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-05-03 08:59:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"Ready\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-c5lb,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoSchedule,TimeAdded:2022-05-03 08:59:18 +0000 UTC,},Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoExecute,TimeAdded:2022-05-03 08:59:23 +0000 UTC,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:DiskPressure,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:PIDPressure,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:Ready,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.151.125,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:97eaceafa1dcc38dfa191fea843250cf,SystemUUID:97eaceaf-a1dc-c38d-fa19-1fea843250cf,BootID:eddb2e60-9b10-4c23-9e89-f2539bba18c7,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 08:59:52.961: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:53.004: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:53.049: INFO: Unable to retrieve kubelet pods for node e2e-c8a0630093-a7d53-minion-group-c5lb: error trying to reach service: dial tcp 10.40.0.3:10250: connect: connection refused May 3 08:59:53.049: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:53.091: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-j0s7 13534811-02a2-4928-b008-80e6f39177b8 27875 0 2022-05-03 08:44:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-j0s7 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-j0s7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-132":"e2e-c8a0630093-a7d53-minion-group-j0s7","csi-hostpath-ephemeral-928":"e2e-c8a0630093-a7d53-minion-group-j0s7","csi-hostpath-provisioning-1259":"e2e-c8a0630093-a7d53-minion-group-j0s7"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:21 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 08:59:21 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-05-03 08:59:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-j0s7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817138176 0} {<nil>} 7633924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554994176 0} {<nil>} 7377924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.237.94,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:800822b6a794b56fc75d86f7afc2e1a6,SystemUUID:800822b6-a794-b56f-c75d-86f7afc2e1a6,BootID:c95dcb5d-789d-48b1-8b08-198b7583e648,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/build-image/debian-iptables@sha256:3317c4374ea30d88b64b27740b0edfaa600e410901e727b5bab4c4deac1df6f5 registry.k8s.io/build-image/debian-iptables:bullseye-v1.3.0],SizeBytes:27061409,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:00fcc441ea9f72899c25eed61d602272a2a58c5f0014332bdcb5ac24acef08e4 registry.k8s.io/sig-storage/snapshot-controller:v4.0.0],SizeBytes:18952261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-928^50cccb5b-cabf-11ec-85c1-1e399d5f0c6b],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-928^50cccb5b-cabf-11ec-85c1-1e399d5f0c6b,DevicePath:,},},Config:nil,},} May 3 08:59:53.092: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:53.135: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:53.192: INFO: konnectivity-agent-98km6 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:53.192: INFO: Container konnectivity-agent ready: true, restart count 0 May 3 08:59:53.192: INFO: test-container-pod started at 2022-05-03 08:57:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:53.192: INFO: Container webserver ready: true, restart count 0 May 3 08:59:53.192: INFO: netserver-2 started at 2022-05-03 08:58:07 +0000 UTC (0+1 container statuses recorded) May 3 08:59:53.192: INFO: Container webserver ready: true, restart count 0 May 3 08:59:53.192: INFO: netserver-2 started at 2022-05-03 08:57:29 +0000 UTC (0+1 container statuses recorded) May 3 08:59:53.192: INFO: Container webserver ready: true, restart count 0 May 3 08:59:53.192: INFO: external-provisioner-mh5tk started at 2022-05-03 08:57:54 +0000 UTC (0+1 container statuses recorded) May 3 08:59:53.192: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 08:59:53.192: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-j0s7 started at 2022-05-03 08:44:56 +0000 UTC (0+1 container statuses recorded) May 3 08:59:53.192: INFO: Container kube-proxy ready: true, restart count 0 May 3 08:59:53.192: INFO: netserver-2 started at 2022-05-03 08:57:06 +0000 UTC (0+1 container statuses recorded) May 3 08:59:53.192: INFO: Container webserver ready: true, restart count 0 May 3 08:59:53.192: INFO: netserver-2 started at 2022-05-03 08:57:52 +0000 UTC (0+1 container statuses recorded) May 3 08:59:53.192: INFO: Container webserver ready: true, restart count 0 May 3 08:59:53.192: INFO: npd-v0.8.9-dgf5k started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:53.192: INFO: Container node-problem-detector ready: true, restart count 0 May 3 08:59:53.192: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:58:08 +0000 UTC (0+7 container statuses recorded) May 3 08:59:53.192: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:53.192: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:53.192: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:53.192: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:53.192: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:53.192: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:53.192: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:53.192: INFO: volume-snapshot-controller-0 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:53.192: INFO: Container volume-snapshot-controller ready: true, restart count 0 May 3 08:59:53.192: INFO: rand-non-local-7rpz7 started at 2022-05-03 08:58:44 +0000 UTC (0+1 container statuses recorded) May 3 08:59:53.192: INFO: Container c ready: false, restart count 0 May 3 08:59:53.192: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:59:16 +0000 UTC (0+7 container statuses recorded) May 3 08:59:53.192: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:53.192: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:53.192: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:53.192: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:53.192: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:53.192: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:53.192: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:53.192: INFO: metadata-proxy-v0.1-86pbj started at 2022-05-03 08:44:57 +0000 UTC (0+2 container statuses recorded) May 3 08:59:53.192: INFO: Container metadata-proxy ready: true, restart count 0 May 3 08:59:53.192: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 08:59:53.192: INFO: inline-volume-tester-8x7vv started at 2022-05-03 08:59:20 +0000 UTC (0+1 container statuses recorded) May 3 08:59:53.192: INFO: Container csi-volume-tester ready: true, restart count 0 May 3 08:59:53.192: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:56:40 +0000 UTC (0+7 container statuses recorded) May 3 08:59:53.192: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:53.192: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:53.192: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:53.193: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:53.193: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:53.193: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:53.193: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:53.193: INFO: ss2-0 started at 2022-05-03 08:57:52 +0000 UTC (0+1 container statuses recorded) May 3 08:59:53.193: INFO: Container webserver ready: true, restart count 0 May 3 08:59:53.490: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:53.490: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready May 3 08:59:53.535: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:55.618: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:57.681: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:59.672: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:01.654: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:03.654: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:05.654: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:07.668: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:09.655: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:11.655: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:13.654: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:15.654: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:17.656: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:19.657: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:21.656: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:23.654: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:25.654: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:27.656: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is true, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure �[1mSTEP�[0m: Destroying namespace "nettest-9280" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sProxy\sversion\sv1\sshould\sproxy\sthrough\sa\sservice\sand\sa\spod\s\s\[Conformance\]$'
test/e2e/framework/framework.go:652 May 3 09:14:27.350: 14 (503; 5.204219062s): path /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 5.209345419s): path /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 5.210709679s): path /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 30.136613973s): path /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 44.90799072s): path /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 44.909640767s): path /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 44.915415373s): path /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 44.916752493s): path /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 54.341339075s): path /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 59.506313412s): path /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 59.507168827s): path /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 15m38.582744935s): path /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 15m41.531830898s): path /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 15m43.579109552s): path /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 15m43.588027095s): path /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 15m43.589425531s): path /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113from junit_30.xml
[BeforeEach] version v1 test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Creating a kubernetes client May 3 08:58:18.873: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename proxy �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should proxy through a service and a pod [Conformance] test/e2e/framework/framework.go:652 �[1mSTEP�[0m: starting an echo server on multiple ports �[1mSTEP�[0m: creating replication controller proxy-service-5tmvw in namespace proxy-7039 I0503 08:58:19.366290 80490 runners.go:193] Created replication controller with name: proxy-service-5tmvw, namespace: proxy-7039, replica count: 1 I0503 08:58:20.467869 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:21.468057 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:22.468249 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:23.469403 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:24.469610 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:25.469779 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:26.469950 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:27.470374 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:28.470815 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:29.471216 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:30.471377 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:31.472476 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:32.472659 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:33.472784 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:34.473122 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:35.473277 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:36.473443 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:37.473617 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:38.474225 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0503 08:58:39.474444 80490 runners.go:193] proxy-service-5tmvw Pods: 1 out of 1 created, 1 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady May 3 08:58:39.516: INFO: setup took 20.26627371s, starting test cases �[1mSTEP�[0m: running 16 cases, 20 attempts per case, 320 total attempts May 3 08:58:39.754: INFO: (0) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 237.223531ms) May 3 08:58:39.754: INFO: (0) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 237.305005ms) May 3 08:58:39.755: INFO: (0) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 238.719202ms) May 3 08:58:39.755: INFO: (0) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 238.699467ms) May 3 08:58:39.764: INFO: (0) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 247.342942ms) May 3 08:58:39.765: INFO: (0) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 248.727663ms) May 3 08:58:39.765: INFO: (0) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 248.670069ms) May 3 08:58:39.765: INFO: (0) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 248.770436ms) May 3 08:58:39.815: INFO: (0) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 298.633774ms) May 3 08:58:39.815: INFO: (0) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 298.6702ms) May 3 08:58:39.815: INFO: (0) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 298.684561ms) May 3 08:58:39.815: INFO: (0) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 298.714958ms) May 3 08:58:39.815: INFO: (0) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 298.940239ms) May 3 08:58:39.853: INFO: (0) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 336.272591ms) May 3 08:58:39.878: INFO: (0) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 361.986931ms) May 3 08:58:39.879: INFO: (0) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 362.327391ms) May 3 08:58:40.086: INFO: (1) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 207.278529ms) May 3 08:58:40.087: INFO: (1) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 207.527988ms) May 3 08:58:40.087: INFO: (1) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 207.528345ms) May 3 08:58:40.087: INFO: (1) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 207.588023ms) May 3 08:58:40.088: INFO: (1) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 209.123645ms) May 3 08:58:40.138: INFO: (1) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 259.190105ms) May 3 08:58:40.138: INFO: (1) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 259.367221ms) May 3 08:58:40.138: INFO: (1) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 259.246077ms) May 3 08:58:40.138: INFO: (1) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 259.207422ms) May 3 08:58:40.138: INFO: (1) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 259.514949ms) May 3 08:58:40.139: INFO: (1) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 259.434369ms) May 3 08:58:40.139: INFO: (1) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 259.507753ms) May 3 08:58:40.186: INFO: (1) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 306.665249ms) May 3 08:58:40.186: INFO: (1) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 306.640468ms) May 3 08:58:40.188: INFO: (1) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 309.024913ms) May 3 08:58:40.196: INFO: (1) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 316.929884ms) May 3 08:58:40.281: INFO: (2) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 85.247001ms) May 3 08:58:40.281: INFO: (2) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 85.244679ms) May 3 08:58:40.288: INFO: (2) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 91.379343ms) May 3 08:58:40.288: INFO: (2) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 91.418763ms) May 3 08:58:40.288: INFO: (2) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 91.931963ms) May 3 08:58:40.288: INFO: (2) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 91.991707ms) May 3 08:58:40.288: INFO: (2) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 92.240892ms) May 3 08:58:40.304: INFO: (2) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 107.618482ms) May 3 08:58:40.304: INFO: (2) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 107.712977ms) May 3 08:58:40.359: INFO: (2) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 162.446281ms) May 3 08:58:40.370: INFO: (2) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 173.554678ms) May 3 08:58:40.370: INFO: (2) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 173.657709ms) May 3 08:58:40.371: INFO: (2) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 175.076666ms) May 3 08:58:40.371: INFO: (2) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 175.124327ms) May 3 08:58:40.371: INFO: (2) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 175.090683ms) May 3 08:58:40.459: INFO: (2) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 262.420271ms) May 3 08:58:40.524: INFO: (3) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 64.770049ms) May 3 08:58:40.555: INFO: (3) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 96.36809ms) May 3 08:58:40.555: INFO: (3) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 96.361087ms) May 3 08:58:40.555: INFO: (3) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 96.327226ms) May 3 08:58:40.556: INFO: (3) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 96.717276ms) May 3 08:58:40.556: INFO: (3) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 96.789766ms) May 3 08:58:40.557: INFO: (3) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 97.578669ms) May 3 08:58:40.557: INFO: (3) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 97.696768ms) May 3 08:58:40.557: INFO: (3) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 97.60921ms) May 3 08:58:40.558: INFO: (3) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 98.979452ms) May 3 08:58:40.593: INFO: (3) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 134.141675ms) May 3 08:58:40.593: INFO: (3) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 134.295056ms) May 3 08:58:40.593: INFO: (3) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 134.312969ms) May 3 08:58:40.620: INFO: (3) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 161.629794ms) May 3 08:58:40.627: INFO: (3) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 168.226965ms) May 3 08:58:40.639: INFO: (3) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 179.724204ms) May 3 08:58:40.744: INFO: (4) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 105.441809ms) May 3 08:58:40.752: INFO: (4) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 113.656864ms) May 3 08:58:40.753: INFO: (4) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 113.939813ms) May 3 08:58:40.753: INFO: (4) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 114.307218ms) May 3 08:58:40.753: INFO: (4) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 114.333167ms) May 3 08:58:40.754: INFO: (4) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 115.061967ms) May 3 08:58:40.754: INFO: (4) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 115.086438ms) May 3 08:58:40.754: INFO: (4) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 115.167196ms) May 3 08:58:40.754: INFO: (4) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 115.203606ms) May 3 08:58:40.755: INFO: (4) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 116.621513ms) May 3 08:58:40.798: INFO: (4) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 159.52688ms) May 3 08:58:40.816: INFO: (4) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 177.737142ms) May 3 08:58:40.821: INFO: (4) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 181.696128ms) May 3 08:58:40.821: INFO: (4) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 181.846875ms) May 3 08:58:40.821: INFO: (4) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 182.06637ms) May 3 08:58:40.822: INFO: (4) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 183.517458ms) May 3 08:58:40.934: INFO: (5) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 111.467834ms) May 3 08:58:40.940: INFO: (5) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 117.270044ms) May 3 08:58:40.943: INFO: (5) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 120.049468ms) May 3 08:58:40.948: INFO: (5) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 125.786376ms) May 3 08:58:40.948: INFO: (5) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 125.591283ms) May 3 08:58:40.959: INFO: (5) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 136.238606ms) May 3 08:58:40.959: INFO: (5) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 136.319359ms) May 3 08:58:40.959: INFO: (5) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 136.346199ms) May 3 08:58:40.960: INFO: (5) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 137.239857ms) May 3 08:58:40.960: INFO: (5) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 137.280792ms) May 3 08:58:40.960: INFO: (5) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 137.489314ms) May 3 08:58:40.960: INFO: (5) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 137.692113ms) May 3 08:58:40.960: INFO: (5) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 137.633612ms) May 3 08:58:40.996: INFO: (5) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 173.203737ms) May 3 08:58:40.996: INFO: (5) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 173.241029ms) May 3 08:58:40.997: INFO: (5) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 174.313083ms) May 3 08:58:41.059: INFO: (6) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 61.850391ms) May 3 08:58:41.059: INFO: (6) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 62.159936ms) May 3 08:58:41.059: INFO: (6) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 62.094562ms) May 3 08:58:41.060: INFO: (6) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 63.395794ms) May 3 08:58:41.061: INFO: (6) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 63.976136ms) May 3 08:58:41.066: INFO: (6) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 69.080306ms) May 3 08:58:41.066: INFO: (6) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 69.071194ms) May 3 08:58:41.066: INFO: (6) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 69.06902ms) May 3 08:58:41.066: INFO: (6) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 69.203996ms) May 3 08:58:41.068: INFO: (6) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 70.644934ms) May 3 08:58:41.116: INFO: (6) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 118.872482ms) May 3 08:58:41.116: INFO: (6) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 119.384841ms) May 3 08:58:41.116: INFO: (6) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 119.372127ms) May 3 08:58:41.116: INFO: (6) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 119.330403ms) May 3 08:58:41.130: INFO: (6) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 133.524244ms) May 3 08:58:41.135: INFO: (6) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 138.117269ms) May 3 08:58:41.203: INFO: (7) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 67.569458ms) May 3 08:58:41.213: INFO: (7) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 77.839848ms) May 3 08:58:41.263: INFO: (7) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 128.175964ms) May 3 08:58:41.263: INFO: (7) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 128.14008ms) May 3 08:58:41.264: INFO: (7) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 128.37198ms) May 3 08:58:41.264: INFO: (7) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 128.370429ms) May 3 08:58:41.264: INFO: (7) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 128.405358ms) May 3 08:58:41.266: INFO: (7) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 130.329642ms) May 3 08:58:41.267: INFO: (7) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 131.325103ms) May 3 08:58:41.267: INFO: (7) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 131.40765ms) May 3 08:58:41.294: INFO: (7) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 158.857551ms) May 3 08:58:41.294: INFO: (7) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 159.07363ms) May 3 08:58:41.315: INFO: (7) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 179.360394ms) May 3 08:58:41.315: INFO: (7) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 179.680436ms) May 3 08:58:41.315: INFO: (7) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 179.595574ms) May 3 08:58:41.315: INFO: (7) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 179.57527ms) May 3 08:58:41.405: INFO: (8) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 89.493946ms) May 3 08:58:41.461: INFO: (8) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 146.302863ms) May 3 08:58:41.462: INFO: (8) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 146.586105ms) May 3 08:58:41.462: INFO: (8) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 146.643347ms) May 3 08:58:41.462: INFO: (8) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 146.689682ms) May 3 08:58:41.463: INFO: (8) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 147.506976ms) May 3 08:58:41.463: INFO: (8) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 147.426933ms) May 3 08:58:41.463: INFO: (8) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 147.453126ms) May 3 08:58:41.463: INFO: (8) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 147.417101ms) May 3 08:58:41.463: INFO: (8) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 147.430635ms) May 3 08:58:41.463: INFO: (8) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 147.955368ms) May 3 08:58:41.474: INFO: (8) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 159.158743ms) May 3 08:58:41.474: INFO: (8) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 159.120436ms) May 3 08:58:41.474: INFO: (8) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 159.081653ms) May 3 08:58:41.474: INFO: (8) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 159.235048ms) May 3 08:58:41.521: INFO: (8) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 205.394613ms) May 3 08:58:41.633: INFO: (9) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 112.204266ms) May 3 08:58:41.633: INFO: (9) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 112.401337ms) May 3 08:58:41.634: INFO: (9) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 112.903813ms) May 3 08:58:41.670: INFO: (9) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 149.236897ms) May 3 08:58:41.670: INFO: (9) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 149.39589ms) May 3 08:58:41.670: INFO: (9) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 149.550048ms) May 3 08:58:41.670: INFO: (9) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 149.449426ms) May 3 08:58:41.671: INFO: (9) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 150.536064ms) May 3 08:58:41.671: INFO: (9) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 150.479478ms) May 3 08:58:41.672: INFO: (9) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 151.043505ms) May 3 08:58:41.672: INFO: (9) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 151.08787ms) May 3 08:58:41.674: INFO: (9) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 153.236353ms) May 3 08:58:41.689: INFO: (9) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 168.686068ms) May 3 08:58:41.730: INFO: (9) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 209.10864ms) May 3 08:58:41.730: INFO: (9) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 209.253507ms) May 3 08:58:41.730: INFO: (9) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 209.269067ms) May 3 08:58:41.934: INFO: (10) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 203.883598ms) May 3 08:58:41.935: INFO: (10) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 204.788231ms) May 3 08:58:41.935: INFO: (10) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 204.706927ms) May 3 08:58:41.935: INFO: (10) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 204.657021ms) May 3 08:58:41.935: INFO: (10) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 204.655125ms) May 3 08:58:41.935: INFO: (10) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 204.776696ms) May 3 08:58:41.935: INFO: (10) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 205.198636ms) May 3 08:58:41.938: INFO: (10) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 208.052214ms) May 3 08:58:41.938: INFO: (10) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 208.102217ms) May 3 08:58:41.939: INFO: (10) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 208.263247ms) May 3 08:58:41.997: INFO: (10) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 266.500529ms) May 3 08:58:41.997: INFO: (10) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 266.514221ms) May 3 08:58:41.997: INFO: (10) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 266.492071ms) May 3 08:58:41.997: INFO: (10) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 266.563647ms) May 3 08:58:41.997: INFO: (10) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 267.114149ms) May 3 08:58:41.997: INFO: (10) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 267.18512ms) May 3 08:58:42.247: INFO: (11) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 249.304391ms) May 3 08:58:42.272: INFO: (11) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 273.94511ms) May 3 08:58:42.272: INFO: (11) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 273.997199ms) May 3 08:58:42.272: INFO: (11) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 274.068258ms) May 3 08:58:42.287: INFO: (11) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 289.300459ms) May 3 08:58:42.287: INFO: (11) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 289.384454ms) May 3 08:58:42.291: INFO: (11) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 293.095042ms) May 3 08:58:42.295: INFO: (11) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 297.445868ms) May 3 08:58:42.295: INFO: (11) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 297.585865ms) May 3 08:58:42.295: INFO: (11) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 297.728157ms) May 3 08:58:42.339: INFO: (11) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 341.726695ms) May 3 08:58:42.339: INFO: (11) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 341.790362ms) May 3 08:58:42.375: INFO: (11) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 377.078837ms) May 3 08:58:42.375: INFO: (11) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 376.987ms) May 3 08:58:42.375: INFO: (11) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 377.10504ms) May 3 08:58:42.375: INFO: (11) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 377.037494ms) May 3 08:58:42.800: INFO: (12) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 424.741821ms) May 3 08:58:42.800: INFO: (12) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 424.773752ms) May 3 08:58:42.801: INFO: (12) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 426.284722ms) May 3 08:58:42.801: INFO: (12) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 426.418312ms) May 3 08:58:42.801: INFO: (12) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 426.286325ms) May 3 08:58:42.801: INFO: (12) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 426.417259ms) May 3 08:58:42.820: INFO: (12) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 445.556753ms) May 3 08:58:42.820: INFO: (12) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 445.645318ms) May 3 08:58:42.820: INFO: (12) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 445.668962ms) May 3 08:58:42.820: INFO: (12) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 445.675843ms) May 3 08:58:42.916: INFO: (12) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 541.195842ms) May 3 08:58:42.916: INFO: (12) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 541.148579ms) May 3 08:58:42.942: INFO: (12) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 566.700786ms) May 3 08:58:42.942: INFO: (12) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 567.047443ms) May 3 08:58:42.942: INFO: (12) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 567.245924ms) May 3 08:58:42.942: INFO: (12) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 567.112085ms) May 3 08:58:43.149: INFO: (13) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 207.216526ms) May 3 08:58:43.161: INFO: (13) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 219.238835ms) May 3 08:58:43.164: INFO: (13) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 221.631532ms) May 3 08:58:43.164: INFO: (13) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 221.692222ms) May 3 08:58:43.164: INFO: (13) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 221.740489ms) May 3 08:58:43.223: INFO: (13) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 280.914898ms) May 3 08:58:43.223: INFO: (13) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 280.820368ms) May 3 08:58:43.224: INFO: (13) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 281.418181ms) May 3 08:58:43.225: INFO: (13) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 283.024049ms) May 3 08:58:43.225: INFO: (13) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 283.053518ms) May 3 08:58:43.225: INFO: (13) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 283.125114ms) May 3 08:58:43.225: INFO: (13) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 283.114369ms) May 3 08:58:43.237: INFO: (13) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 294.374887ms) May 3 08:58:43.237: INFO: (13) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 294.552039ms) May 3 08:58:43.237: INFO: (13) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 294.440623ms) May 3 08:58:43.313: INFO: (13) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 371.003938ms) May 3 08:58:48.518: INFO: (14) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: k8s� � �v1��Status�m � �������Failure�Cerror trying to reach service: dial tcp 10.64.3.98:162: i/... (503; 5.204219062s) May 3 08:58:48.523: INFO: (14) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: k8s� � �v1��Status�m � �������Failure�Cerror trying to reach service: dial tcp 10.64.3.98:162: i/... (503; 5.209345419s) May 3 08:58:48.524: INFO: (14) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: k8s� � �v1��Status�m � �������Failure�Cerror trying to reach service: dial tcp 10.64.3.98:160: i/... (503; 5.210709679s) May 3 08:59:13.450: INFO: (14) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: k8s� � �v1��Status�_ � �������Failure�5error trying to reach service: dial timeout, backstop"�Ser... (503; 30.136613973s) May 3 08:59:28.221: INFO: (14) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: k8s� � �v1��Status�f � �������Failure�<error trying to reach service: http2: client connection lo... (503; 44.90799072s) May 3 08:59:28.223: INFO: (14) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: k8s� � �v1��Status�f � �������Failure�<error trying to reach service: http2: client connection lo... (503; 44.909640767s) May 3 08:59:28.229: INFO: (14) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: k8s� � �v1��Status�f � �������Failure�<error trying to reach service: http2: client connection lo... (503; 44.915415373s) May 3 08:59:28.230: INFO: (14) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: k8s� � �v1��Status�f � �������Failure�<error trying to reach service: http2: client connection lo... (503; 44.916752493s) May 3 08:59:37.655: INFO: (14) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: k8s� � �v1��Status�f � �������Failure�<error trying to reach service: http2: client connection lo... (503; 54.341339075s) May 3 08:59:42.820: INFO: (14) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: k8s� � �v1��Status�l � �������Failure�Berror trying to reach service: dial tcp 10.64.3.98:80: i/o... (503; 59.506313412s) May 3 08:59:42.821: INFO: (14) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: k8s� � �v1��Status�m � �������Failure�Cerror trying to reach service: dial tcp 10.64.3.98:160: i/... (503; 59.507168827s) May 3 09:14:21.896: INFO: (14) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: k8s� � �v1��Status�| � �������Failure�Rerror trying to reach service: dial tcp 10.64.3.98:1080: c... (503; 15m38.582744935s) May 3 09:14:24.845: INFO: (14) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: k8s� � �v1��Status�m � �������Failure�Cerror trying to reach service: dial tcp 10.64.3.98:160: i/... (503; 15m41.531830898s) May 3 09:14:26.892: INFO: (14) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: k8s� � �v1��Status�n � �������Failure�Derror trying to reach service: dial tcp 10.64.3.98:1080: i... (503; 15m43.579109552s) May 3 09:14:26.901: INFO: (14) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: k8s� � �v1��Status�m � �������Failure�Cerror trying to reach service: dial tcp 10.64.3.98:162: i/... (503; 15m43.588027095s) May 3 09:14:26.903: INFO: (14) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: k8s� � �v1��Status�m � �������Failure�Cerror trying to reach service: dial tcp 10.64.3.98:162: i/... (503; 15m43.589425531s) May 3 09:14:26.964: INFO: (15) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 60.727806ms) May 3 09:14:26.965: INFO: (15) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 62.01906ms) May 3 09:14:26.965: INFO: (15) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 62.086397ms) May 3 09:14:26.965: INFO: (15) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 62.462729ms) May 3 09:14:26.975: INFO: (15) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 71.877678ms) May 3 09:14:26.975: INFO: (15) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 72.390829ms) May 3 09:14:27.002: INFO: (15) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 99.313024ms) May 3 09:14:27.002: INFO: (15) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 99.301154ms) May 3 09:14:27.002: INFO: (15) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 99.303585ms) May 3 09:14:27.002: INFO: (15) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 99.397678ms) May 3 09:14:27.002: INFO: (15) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 99.536423ms) May 3 09:14:27.002: INFO: (15) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 99.496898ms) May 3 09:14:27.002: INFO: (15) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 99.3204ms) May 3 09:14:27.002: INFO: (15) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 99.350166ms) May 3 09:14:27.002: INFO: (15) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 99.306199ms) May 3 09:14:27.002: INFO: (15) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 99.359593ms) May 3 09:14:27.064: INFO: (16) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 61.062585ms) May 3 09:14:27.065: INFO: (16) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 62.563501ms) May 3 09:14:27.069: INFO: (16) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 66.335998ms) May 3 09:14:27.069: INFO: (16) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 66.305314ms) May 3 09:14:27.069: INFO: (16) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 66.448882ms) May 3 09:14:27.069: INFO: (16) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 66.47169ms) May 3 09:14:27.069: INFO: (16) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 66.548474ms) May 3 09:14:27.070: INFO: (16) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 67.598878ms) May 3 09:14:27.070: INFO: (16) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 67.542352ms) May 3 09:14:27.071: INFO: (16) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 67.9077ms) May 3 09:14:27.071: INFO: (16) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 67.983696ms) May 3 09:14:27.071: INFO: (16) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 67.992776ms) May 3 09:14:27.072: INFO: (16) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 68.956486ms) May 3 09:14:27.074: INFO: (16) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 71.151644ms) May 3 09:14:27.074: INFO: (16) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 71.132976ms) May 3 09:14:27.075: INFO: (16) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 72.078892ms) May 3 09:14:27.140: INFO: (17) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 65.612332ms) May 3 09:14:27.144: INFO: (17) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 69.118903ms) May 3 09:14:27.145: INFO: (17) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 69.625989ms) May 3 09:14:27.145: INFO: (17) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 69.629824ms) May 3 09:14:27.145: INFO: (17) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 70.291196ms) May 3 09:14:27.145: INFO: (17) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 70.290309ms) May 3 09:14:27.145: INFO: (17) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 70.163722ms) May 3 09:14:27.146: INFO: (17) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 70.748915ms) May 3 09:14:27.146: INFO: (17) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 70.858789ms) May 3 09:14:27.146: INFO: (17) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 70.806514ms) May 3 09:14:27.146: INFO: (17) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 70.774102ms) May 3 09:14:27.147: INFO: (17) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 71.856907ms) May 3 09:14:27.147: INFO: (17) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 72.547859ms) May 3 09:14:27.149: INFO: (17) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 73.65337ms) May 3 09:14:27.150: INFO: (17) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 74.615929ms) May 3 09:14:27.150: INFO: (17) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 74.583837ms) May 3 09:14:27.208: INFO: (18) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 58.703416ms) May 3 09:14:27.217: INFO: (18) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 67.741926ms) May 3 09:14:27.218: INFO: (18) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 67.982031ms) May 3 09:14:27.219: INFO: (18) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 69.087541ms) May 3 09:14:27.219: INFO: (18) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 69.039918ms) May 3 09:14:27.222: INFO: (18) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 72.113233ms) May 3 09:14:27.222: INFO: (18) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 72.437103ms) May 3 09:14:27.223: INFO: (18) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 73.018583ms) May 3 09:14:27.223: INFO: (18) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 73.501667ms) May 3 09:14:27.224: INFO: (18) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 74.525786ms) May 3 09:14:27.224: INFO: (18) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 74.49635ms) May 3 09:14:27.224: INFO: (18) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 74.623141ms) May 3 09:14:27.224: INFO: (18) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 74.6024ms) May 3 09:14:27.225: INFO: (18) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 75.227426ms) May 3 09:14:27.225: INFO: (18) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 75.16126ms) May 3 09:14:27.228: INFO: (18) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 78.504228ms) May 3 09:14:27.290: INFO: (19) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/rewriteme">test</a> (200; 61.842155ms) May 3 09:14:27.293: INFO: (19) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">test<... (200; 64.427748ms) May 3 09:14:27.293: INFO: (19) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 64.469229ms) May 3 09:14:27.294: INFO: (19) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 66.048536ms) May 3 09:14:27.294: INFO: (19) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/: bar (200; 65.936883ms) May 3 09:14:27.294: INFO: (19) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/tlsrewritem... (200; 66.102073ms) May 3 09:14:27.295: INFO: (19) /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/: foo (200; 67.091106ms) May 3 09:14:27.296: INFO: (19) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/: tls qux (200; 67.584318ms) May 3 09:14:27.296: INFO: (19) /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/: <a href="/api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/rewriteme">... (200; 67.578615ms) May 3 09:14:27.296: INFO: (19) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/: tls baz (200; 67.741237ms) May 3 09:14:27.296: INFO: (19) /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/: tls baz (200; 67.644274ms) May 3 09:14:27.296: INFO: (19) /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/: tls qux (200; 67.592842ms) May 3 09:14:27.298: INFO: (19) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/: bar (200; 69.811764ms) May 3 09:14:27.299: INFO: (19) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/: foo (200; 71.059392ms) May 3 09:14:27.299: INFO: (19) /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/: bar (200; 71.080406ms) May 3 09:14:27.300: INFO: (19) /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/: foo (200; 71.695605ms) May 3 09:14:27.350: INFO: Pod proxy-service-5tmvw-2lsvf has the following error logs: I0503 09:14:26.960614 1 log.go:195] http: TLS handshake error from 10.64.2.4:46020: EOF May 3 09:14:27.350: FAIL: 14 (503; 5.204219062s): path /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:162/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 5.209345419s): path /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname2/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 5.210709679s): path /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:160/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 30.136613973s): path /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname1/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 44.90799072s): path /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:460/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 44.909640767s): path /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname1/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 44.915415373s): path /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:462/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 44.916752493s): path /api/v1/namespaces/proxy-7039/services/https:proxy-service-5tmvw:tlsportname2/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 54.341339075s): path /api/v1/namespaces/proxy-7039/pods/https:proxy-service-5tmvw-2lsvf:443/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 59.506313412s): path /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 59.507168827s): path /api/v1/namespaces/proxy-7039/services/http:proxy-service-5tmvw:portname1/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 15m38.582744935s): path /api/v1/namespaces/proxy-7039/pods/proxy-service-5tmvw-2lsvf:1080/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 15m41.531830898s): path /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:160/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 15m43.579109552s): path /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:1080/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 15m43.588027095s): path /api/v1/namespaces/proxy-7039/services/proxy-service-5tmvw:portname2/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} 14 (503; 15m43.589425531s): path /api/v1/namespaces/proxy-7039/pods/http:proxy-service-5tmvw-2lsvf:162/proxy/ gave status error: {TypeMeta:{Kind: APIVersion:} ListMeta:{SelfLink: ResourceVersion: Continue: RemainingItemCount:<nil>} Status:Failure Message:the server is currently unable to handle the request Reason:ServiceUnavailable Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:UnexpectedServerResponse,Message:unknown,Field:,},},RetryAfterSeconds:0,UID:,} Code:503} Full Stack Trace k8s.io/kubernetes/test/e2e.RunE2ETests(0x257e5b7?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x0?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000517520, 0x73fa160) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: deleting ReplicationController proxy-service-5tmvw in namespace proxy-7039, will wait for the garbage collector to delete the pods May 3 09:14:27.488: INFO: Deleting ReplicationController proxy-service-5tmvw took: 44.297072ms May 3 09:14:27.589: INFO: Terminating ReplicationController proxy-service-5tmvw pods took: 101.132344ms [AfterEach] version v1 test/e2e/framework/framework.go:188 �[1mSTEP�[0m: Collecting events from namespace "proxy-7039". �[1mSTEP�[0m: Found 12 events. May 3 09:14:28.236: INFO: At 2022-05-03 08:58:19 +0000 UTC - event for proxy-service-5tmvw: {replication-controller } SuccessfulCreate: Created pod: proxy-service-5tmvw-2lsvf May 3 09:14:28.236: INFO: At 2022-05-03 08:58:19 +0000 UTC - event for proxy-service-5tmvw-2lsvf: {default-scheduler } Scheduled: Successfully assigned proxy-7039/proxy-service-5tmvw-2lsvf to e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:14:28.236: INFO: At 2022-05-03 08:58:20 +0000 UTC - event for proxy-service-5tmvw-2lsvf: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 09:14:28.236: INFO: At 2022-05-03 08:58:20 +0000 UTC - event for proxy-service-5tmvw-2lsvf: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Created: Created container proxy-service-5tmvw May 3 09:14:28.236: INFO: At 2022-05-03 08:58:20 +0000 UTC - event for proxy-service-5tmvw-2lsvf: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Started: Started container proxy-service-5tmvw May 3 09:14:28.236: INFO: At 2022-05-03 08:59:18 +0000 UTC - event for proxy-service-5tmvw-2lsvf: {node-controller } NodeNotReady: Node is not ready May 3 09:14:28.236: INFO: At 2022-05-03 09:00:28 +0000 UTC - event for proxy-service-5tmvw-2lsvf: {taint-controller } TaintManagerEviction: Cancelling deletion of Pod proxy-7039/proxy-service-5tmvw-2lsvf May 3 09:14:28.236: INFO: At 2022-05-03 09:00:30 +0000 UTC - event for proxy-service-5tmvw-2lsvf: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 3 09:14:28.236: INFO: At 2022-05-03 09:00:31 +0000 UTC - event for proxy-service-5tmvw-2lsvf: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 09:14:28.236: INFO: At 2022-05-03 09:00:31 +0000 UTC - event for proxy-service-5tmvw-2lsvf: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Created: Created container proxy-service-5tmvw May 3 09:14:28.236: INFO: At 2022-05-03 09:00:31 +0000 UTC - event for proxy-service-5tmvw-2lsvf: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Started: Started container proxy-service-5tmvw May 3 09:14:28.236: INFO: At 2022-05-03 09:14:27 +0000 UTC - event for proxy-service-5tmvw-2lsvf: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Killing: Stopping container proxy-service-5tmvw May 3 09:14:28.277: INFO: POD NODE PHASE GRACE CONDITIONS May 3 09:14:28.277: INFO: May 3 09:14:28.360: INFO: Logging node info for node e2e-c8a0630093-a7d53-master May 3 09:14:28.404: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-master b19f1e35-3444-417f-aa8a-059f422baac1 41767 0 2022-05-03 08:44:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-05-03 08:44:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 08:45:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3860037632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3597893632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:44:59 +0000 UTC,LastTransitionTime:2022-05-03 08:44:59 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 09:11:13 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 09:11:13 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 09:11:13 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 09:11:13 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.22.140,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bcd3f659cc761bdb6efbff38fefe4e19,SystemUUID:bcd3f659-cc76-1bdb-6efb-ff38fefe4e19,BootID:f91b8838-f530-4990-b2a6-3b369f82164e,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:131049939,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:120695609,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:52333368,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 09:14:28.404: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-master May 3 09:14:28.451: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-master May 3 09:14:28.526: INFO: etcd-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:14:28.526: INFO: Container etcd-container ready: true, restart count 0 May 3 09:14:28.526: INFO: konnectivity-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:14:28.526: INFO: Container konnectivity-server-container ready: true, restart count 0 May 3 09:14:28.526: INFO: kube-apiserver-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:14:28.526: INFO: Container kube-apiserver ready: true, restart count 1 May 3 09:14:28.526: INFO: metadata-proxy-v0.1-blclk started at 2022-05-03 08:45:06 +0000 UTC (0+2 container statuses recorded) May 3 09:14:28.526: INFO: Container metadata-proxy ready: true, restart count 0 May 3 09:14:28.526: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 09:14:28.526: INFO: etcd-server-events-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:14:28.526: INFO: Container etcd-container ready: true, restart count 0 May 3 09:14:28.526: INFO: kube-controller-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:14:28.526: INFO: Container kube-controller-manager ready: true, restart count 2 May 3 09:14:28.526: INFO: kube-scheduler-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:14:28.526: INFO: Container kube-scheduler ready: true, restart count 0 May 3 09:14:28.526: INFO: kube-addon-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:12 +0000 UTC (0+1 container statuses recorded) May 3 09:14:28.526: INFO: Container kube-addon-manager ready: true, restart count 0 May 3 09:14:28.526: INFO: l7-lb-controller-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:13 +0000 UTC (0+1 container statuses recorded) May 3 09:14:28.526: INFO: Container l7-lb-controller ready: true, restart count 3 May 3 09:14:28.760: INFO: Latency metrics for node e2e-c8a0630093-a7d53-master May 3 09:14:28.760: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 09:14:28.804: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-7bq2 bfa6e413-94d8-452c-a687-5f8ae9ea5b7c 41706 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-7bq2 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-7bq2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-05-03 09:05:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2022-05-03 09:05:30 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-7bq2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 09:10:07 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 09:10:07 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 09:10:07 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 09:10:07 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-05-03 09:10:07 +0000 UTC,LastTransitionTime:2022-05-03 09:00:06 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 09:10:07 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 09:10:42 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 09:10:42 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 09:10:42 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 09:10:42 +0000 UTC,LastTransitionTime:2022-05-03 08:45:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:35.197.55.130,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f84a54b770444ef2c7de26e5ab984f78,SystemUUID:f84a54b7-7044-4ef2-c7de-26e5ab984f78,BootID:950b58bb-5fcd-4efa-a61d-cbb738103018,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 09:14:28.804: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 09:14:28.849: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 09:14:28.903: INFO: coredns-6b775575b5-w454s started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:14:28.903: INFO: Container coredns ready: true, restart count 0 May 3 09:14:28.903: INFO: konnectivity-agent-r2m8v started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:14:28.903: INFO: Container konnectivity-agent ready: true, restart count 0 May 3 09:14:28.903: INFO: npd-v0.8.9-lxnv5 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:14:28.903: INFO: Container node-problem-detector ready: true, restart count 0 May 3 09:14:28.903: INFO: kube-dns-autoscaler-c6c49f5f6-t54xb started at 2022-05-03 08:56:29 +0000 UTC (0+1 container statuses recorded) May 3 09:14:28.903: INFO: Container autoscaler ready: true, restart count 0 May 3 09:14:28.903: INFO: metadata-proxy-v0.1-27ljg started at 2022-05-03 08:44:58 +0000 UTC (0+2 container statuses recorded) May 3 09:14:28.903: INFO: Container metadata-proxy ready: true, restart count 0 May 3 09:14:28.903: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 09:14:28.903: INFO: l7-default-backend-bb7fb94cb-jt2kv started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:14:28.903: INFO: Container default-http-backend ready: true, restart count 0 May 3 09:14:28.903: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-7bq2 started at 2022-05-03 08:44:57 +0000 UTC (0+1 container statuses recorded) May 3 09:14:28.903: INFO: Container kube-proxy ready: true, restart count 0 May 3 09:14:29.132: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 09:14:29.132: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:14:29.174: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-c5lb e86bdeb4-972e-4590-a8a1-92d331988301 41849 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-c5lb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-c5lb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 08:59:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-05-03 09:06:03 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 09:06:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{},"f:memory":{}},"f:capacity":{"f:ephemeral-storage":{},"f:memory":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:nodeInfo":{"f:bootID":{}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-c5lb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817134080 0} {<nil>} 7455Mi BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554990080 0} {<nil>} 7205Mi BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 09:11:33 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 09:11:33 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 09:11:33 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 09:11:33 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 09:11:33 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 09:11:33 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 09:11:52 +0000 UTC,LastTransitionTime:2022-05-03 09:00:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 09:11:52 +0000 UTC,LastTransitionTime:2022-05-03 09:00:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 09:11:52 +0000 UTC,LastTransitionTime:2022-05-03 09:00:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 09:11:52 +0000 UTC,LastTransitionTime:2022-05-03 09:00:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.151.125,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:97eaceafa1dcc38dfa191fea843250cf,SystemUUID:97eaceaf-a1dc-c38d-fa19-1fea843250cf,BootID:07b245ae-f8d1-4df7-99ab-f56ed5c2890d,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/glusterdynamic-provisioner@sha256:7ed3bfb1429e97f721cbd8b2953ffb1f0186e89c1c99ee0e919d563b0caa81d2 registry.k8s.io/e2e-test-images/glusterdynamic-provisioner:v1.3],SizeBytes:151196506,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 09:14:29.175: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:14:29.219: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:14:29.289: INFO: metrics-server-v0.5.2-86b9c987cb-nflsz started at 2022-05-03 08:45:23 +0000 UTC (0+2 container statuses recorded) May 3 09:14:29.289: INFO: Container metrics-server ready: true, restart count 2 May 3 09:14:29.289: INFO: Container metrics-server-nanny ready: true, restart count 1 May 3 09:14:29.289: INFO: coredns-6b775575b5-np5vf started at 2022-05-03 08:45:16 +0000 UTC (0+1 container statuses recorded) May 3 09:14:29.289: INFO: Container coredns ready: true, restart count 1 May 3 09:14:29.289: INFO: metadata-proxy-v0.1-96hkj started at 2022-05-03 08:44:58 +0000 UTC (0+2 container statuses recorded) May 3 09:14:29.289: INFO: Container metadata-proxy ready: true, restart count 1 May 3 09:14:29.289: INFO: Container prometheus-to-sd-exporter ready: true, restart count 1 May 3 09:14:29.289: INFO: konnectivity-agent-68zqw started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:14:29.289: INFO: Container konnectivity-agent ready: true, restart count 1 May 3 09:14:29.289: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-c5lb started at 2022-05-03 08:44:58 +0000 UTC (0+1 container statuses recorded) May 3 09:14:29.289: INFO: Container kube-proxy ready: true, restart count 1 May 3 09:14:29.289: INFO: npd-v0.8.9-wzktb started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:14:29.289: INFO: Container node-problem-detector ready: true, restart count 1 May 3 09:14:29.289: INFO: inline-volume-tester2-tnnll started at 2022-05-03 09:00:27 +0000 UTC (0+1 container statuses recorded) May 3 09:14:29.289: INFO: Container csi-volume-tester ready: false, restart count 0 May 3 09:14:29.493: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:14:29.493: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 09:14:29.535: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-j0s7 13534811-02a2-4928-b008-80e6f39177b8 41804 0 2022-05-03 08:44:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-j0s7 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-j0s7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:21 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 09:05:48 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 09:06:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-j0s7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817138176 0} {<nil>} 7633924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554994176 0} {<nil>} 7377924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 09:10:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 09:10:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 09:10:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 09:10:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-05-03 09:10:12 +0000 UTC,LastTransitionTime:2022-05-03 09:00:10 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 09:10:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 09:11:31 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 09:11:31 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 09:11:31 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 09:11:31 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.237.94,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:800822b6a794b56fc75d86f7afc2e1a6,SystemUUID:800822b6-a794-b56f-c75d-86f7afc2e1a6,BootID:c95dcb5d-789d-48b1-8b08-198b7583e648,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/build-image/debian-iptables@sha256:3317c4374ea30d88b64b27740b0edfaa600e410901e727b5bab4c4deac1df6f5 registry.k8s.io/build-image/debian-iptables:bullseye-v1.3.0],SizeBytes:27061409,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:00fcc441ea9f72899c25eed61d602272a2a58c5f0014332bdcb5ac24acef08e4 registry.k8s.io/sig-storage/snapshot-controller:v4.0.0],SizeBytes:18952261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 09:14:29.535: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 09:14:29.582: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 09:14:29.630: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-j0s7 started at 2022-05-03 08:44:56 +0000 UTC (0+1 container statuses recorded) May 3 09:14:29.631: INFO: Container kube-proxy ready: true, restart count 0 May 3 09:14:29.631: INFO: npd-v0.8.9-dgf5k started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:14:29.631: INFO: Container node-problem-detector ready: true, restart count 0 May 3 09:14:29.631: INFO: volume-snapshot-controller-0 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:14:29.631: INFO: Container volume-snapshot-controller ready: true, restart count 0 May 3 09:14:29.631: INFO: metadata-proxy-v0.1-86pbj started at 2022-05-03 08:44:57 +0000 UTC (0+2 container statuses recorded) May 3 09:14:29.631: INFO: Container metadata-proxy ready: true, restart count 0 May 3 09:14:29.631: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 09:14:29.631: INFO: konnectivity-agent-98km6 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:14:29.631: INFO: Container konnectivity-agent ready: true, restart count 0 May 3 09:14:29.872: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 09:14:29.872: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "proxy-7039" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-node\]\sNodeLease\sNodeLease\sthe\skubelet\sshould\sreport\snode\sstatus\sinfrequently$'
test/e2e/common/node/node_lease.go:114 May 3 08:59:18.653: Expected <v1.ConditionStatus>: Unknown to equal <v1.ConditionStatus>: True test/e2e/common/node/node_lease.go:193from junit_14.xml
[BeforeEach] [sig-node] NodeLease test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Creating a kubernetes client May 3 08:58:25.064: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename node-lease-test �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [BeforeEach] [sig-node] NodeLease test/e2e/common/node/node_lease.go:45 [It] the kubelet should report node status infrequently test/e2e/common/node/node_lease.go:114 �[1mSTEP�[0m: wait until node is ready May 3 08:58:25.418: INFO: Waiting up to 5m0s for node e2e-c8a0630093-a7d53-minion-group-c5lb condition Ready to be true �[1mSTEP�[0m: wait until there is node lease �[1mSTEP�[0m: verify NodeStatus report period is longer than lease duration May 3 08:58:26.588: INFO: node status heartbeat is unchanged for 1.043161522s, waiting for 1m20s May 3 08:58:27.588: INFO: node status heartbeat is unchanged for 2.043025107s, waiting for 1m20s May 3 08:58:28.588: INFO: node status heartbeat is unchanged for 3.043004152s, waiting for 1m20s May 3 08:58:29.595: INFO: node status heartbeat is unchanged for 4.049926507s, waiting for 1m20s May 3 08:58:30.591: INFO: node status heartbeat is unchanged for 5.045680652s, waiting for 1m20s May 3 08:58:31.588: INFO: node status heartbeat is unchanged for 6.04299231s, waiting for 1m20s May 3 08:58:32.598: INFO: node status heartbeat is unchanged for 7.053430361s, waiting for 1m20s May 3 08:58:33.588: INFO: node status heartbeat is unchanged for 8.043312886s, waiting for 1m20s May 3 08:58:34.586: INFO: node status heartbeat is unchanged for 9.041249891s, waiting for 1m20s May 3 08:58:35.589: INFO: node status heartbeat is unchanged for 10.043727775s, waiting for 1m20s May 3 08:58:36.588: INFO: node status heartbeat is unchanged for 11.042627591s, waiting for 1m20s May 3 08:58:37.699: INFO: node status heartbeat is unchanged for 12.153683941s, waiting for 1m20s May 3 08:58:38.588: INFO: node status heartbeat is unchanged for 13.042666443s, waiting for 1m20s May 3 08:58:39.588: INFO: node status heartbeat is unchanged for 14.043081111s, waiting for 1m20s May 3 08:58:40.591: INFO: node status heartbeat is unchanged for 15.046013897s, waiting for 1m20s May 3 08:58:41.597: INFO: node status heartbeat is unchanged for 16.051883918s, waiting for 1m20s May 3 08:58:42.904: INFO: node status heartbeat is unchanged for 17.359321793s, waiting for 1m20s May 3 08:58:43.594: INFO: node status heartbeat is unchanged for 18.048530101s, waiting for 1m20s May 3 08:58:44.589: INFO: node status heartbeat is unchanged for 19.043833682s, waiting for 1m20s May 3 08:58:45.587: INFO: node status heartbeat is unchanged for 20.041971243s, waiting for 1m20s May 3 08:58:46.588: INFO: node status heartbeat is unchanged for 21.043296003s, waiting for 1m20s May 3 08:58:47.589: INFO: node status heartbeat is unchanged for 22.043538519s, waiting for 1m20s May 3 08:58:48.588: INFO: node status heartbeat is unchanged for 23.042749056s, waiting for 1m20s May 3 08:58:49.593: INFO: node status heartbeat is unchanged for 24.047522519s, waiting for 1m20s May 3 08:58:50.679: INFO: node status heartbeat is unchanged for 25.134446371s, waiting for 1m20s May 3 08:58:51.644: INFO: node status heartbeat is unchanged for 26.099312624s, waiting for 1m20s May 3 08:58:52.590: INFO: node status heartbeat is unchanged for 27.044696907s, waiting for 1m20s May 3 08:58:53.588: INFO: node status heartbeat is unchanged for 28.042768524s, waiting for 1m20s May 3 08:58:54.588: INFO: node status heartbeat is unchanged for 29.043136485s, waiting for 1m20s May 3 08:58:55.595: INFO: node status heartbeat is unchanged for 30.050254937s, waiting for 1m20s May 3 08:58:56.587: INFO: node status heartbeat is unchanged for 31.041904109s, waiting for 1m20s May 3 08:58:57.587: INFO: node status heartbeat is unchanged for 32.042480622s, waiting for 1m20s May 3 08:58:58.588: INFO: node status heartbeat is unchanged for 33.042616945s, waiting for 1m20s May 3 08:58:59.588: INFO: node status heartbeat is unchanged for 34.04316s, waiting for 1m20s May 3 08:59:00.588: INFO: node status heartbeat is unchanged for 35.042587512s, waiting for 1m20s May 3 08:59:01.588: INFO: node status heartbeat is unchanged for 36.042550789s, waiting for 1m20s May 3 08:59:02.694: INFO: node status heartbeat is unchanged for 37.149026541s, waiting for 1m20s May 3 08:59:03.614: INFO: node status heartbeat is unchanged for 38.069093879s, waiting for 1m20s May 3 08:59:04.593: INFO: node status heartbeat is unchanged for 39.048113184s, waiting for 1m20s May 3 08:59:05.588: INFO: node status heartbeat is unchanged for 40.042839983s, waiting for 1m20s May 3 08:59:06.591: INFO: node status heartbeat is unchanged for 41.046446399s, waiting for 1m20s May 3 08:59:07.589: INFO: node status heartbeat is unchanged for 42.043726983s, waiting for 1m20s May 3 08:59:08.588: INFO: node status heartbeat is unchanged for 43.042738741s, waiting for 1m20s May 3 08:59:09.588: INFO: node status heartbeat is unchanged for 44.042702174s, waiting for 1m20s May 3 08:59:10.588: INFO: node status heartbeat is unchanged for 45.042549125s, waiting for 1m20s May 3 08:59:11.588: INFO: node status heartbeat is unchanged for 46.042903681s, waiting for 1m20s May 3 08:59:12.593: INFO: node status heartbeat is unchanged for 47.047651697s, waiting for 1m20s May 3 08:59:13.589: INFO: node status heartbeat is unchanged for 48.043906577s, waiting for 1m20s May 3 08:59:14.588: INFO: node status heartbeat is unchanged for 49.042969254s, waiting for 1m20s May 3 08:59:15.589: INFO: node status heartbeat is unchanged for 50.043927479s, waiting for 1m20s May 3 08:59:16.588: INFO: node status heartbeat is unchanged for 51.042966558s, waiting for 1m20s May 3 08:59:17.617: INFO: node status heartbeat is unchanged for 52.072375144s, waiting for 1m20s May 3 08:59:18.653: FAIL: Expected <v1.ConditionStatus>: Unknown to equal <v1.ConditionStatus>: True Full Stack Trace k8s.io/kubernetes/test/e2e/common/node.getHeartbeatTimeAndStatus({_, _}, {_, _}) test/e2e/common/node/node_lease.go:193 +0x1ba k8s.io/kubernetes/test/e2e/common/node.glob..func13.2.3.2() test/e2e/common/node/node_lease.go:140 +0xa7 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x2609951, 0x0}) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:220 +0x1b k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7a3dc68?, 0xc000144000?}, 0x24f71e5?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:233 +0x57 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7a3dc68, 0xc000144000}, 0xc0015bc078, 0x2d973aa?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 +0x116 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7a3dc68, 0xc000144000}, 0xd8?, 0x2d95f45?, 0x38?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:594 +0x9a k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollWithContext({0x7a3dc68, 0xc000144000}, 0x26?, 0xc000a2ae28?, 0x24f7547?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:458 +0x47 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.Poll(0xc003367710?, 0xc003367740?, 0x0?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:443 +0x50 k8s.io/kubernetes/test/e2e/common/node.glob..func13.2.3() test/e2e/common/node/node_lease.go:139 +0x53c k8s.io/kubernetes/test/e2e.RunE2ETests(0x257e5b7?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc0009edc00?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000102b60, 0x73fa160) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f E0503 08:59:18.654300 80654 runtime.go:79] Observed a panic: ginkgowrapper.FailurePanic{Message:"May 3 08:59:18.653: Expected\n <v1.ConditionStatus>: Unknown\nto equal\n <v1.ConditionStatus>: True", Filename:"test/e2e/common/node/node_lease.go", Line:193, FullStackTrace:"k8s.io/kubernetes/test/e2e/common/node.getHeartbeatTimeAndStatus({_, _}, {_, _})\n\ttest/e2e/common/node/node_lease.go:193 +0x1ba\nk8s.io/kubernetes/test/e2e/common/node.glob..func13.2.3.2()\n\ttest/e2e/common/node/node_lease.go:140 +0xa7\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x2609951, 0x0})\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:220 +0x1b\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7a3dc68?, 0xc000144000?}, 0x24f71e5?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:233 +0x57\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7a3dc68, 0xc000144000}, 0xc0015bc078, 0x2d973aa?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 +0x116\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7a3dc68, 0xc000144000}, 0xd8?, 0x2d95f45?, 0x38?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:594 +0x9a\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollWithContext({0x7a3dc68, 0xc000144000}, 0x26?, 0xc000a2ae28?, 0x24f7547?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:458 +0x47\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.Poll(0xc003367710?, 0xc003367740?, 0x0?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:443 +0x50\nk8s.io/kubernetes/test/e2e/common/node.glob..func13.2.3()\n\ttest/e2e/common/node/node_lease.go:139 +0x53c\nk8s.io/kubernetes/test/e2e.RunE2ETests(0x257e5b7?)\n\ttest/e2e/e2e.go:130 +0x686\nk8s.io/kubernetes/test/e2e.TestE2E(0xc0009edc00?)\n\ttest/e2e/e2e_test.go:136 +0x19\ntesting.tRunner(0xc000102b60, 0x73fa160)\n\t/usr/local/go/src/testing/testing.go:1439 +0x102\ncreated by testing.(*T).Run\n\t/usr/local/go/src/testing/testing.go:1486 +0x35f"} ( Your test failed. Ginkgo panics to prevent subsequent assertions from running. Normally Ginkgo rescues this panic so you shouldn't see it. But, if you make an assertion in a goroutine, Ginkgo can't capture the panic. To circumvent this, you should call defer GinkgoRecover() at the top of the goroutine that caused this panic. ) goroutine 44 [running]: k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime.logPanic({0x6ca5500?, 0xc0017e7040}) vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:75 +0x99 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xc0017e7040?}) vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:49 +0x75 panic({0x6ca5500, 0xc0017e7040}) /usr/local/go/src/runtime/panic.go:838 +0x207 k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1() test/e2e/framework/ginkgowrapper/wrapper.go:63 +0x7d panic({0x632c000, 0x7a050b0}) /usr/local/go/src/runtime/panic.go:838 +0x207 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo.Fail({0xc003ec7b90, 0x67}, {0xc000a2a2f0?, 0xc000a2a300?, 0x0?}) vendor/github.com/onsi/ginkgo/ginkgo_dsl.go:260 +0xdd k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail({0xc003ec7b90, 0x67}, {0xc000a2a3d0?, 0x714b92b?, 0xc000a2a3f0?}) test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x197 k8s.io/kubernetes/test/e2e/framework.Fail({0xc000117b60, 0x52}, {0xc002fdcc30?, 0xc000117b60?, 0x23?}) test/e2e/framework/log.go:63 +0x145 k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc000a2a540, {0x7a29648, 0xc001db0880}, 0x1, {0x0, 0x0, 0x0}) vendor/github.com/onsi/gomega/internal/assertion/assertion.go:79 +0x1bd k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).To(0xc000a2a540, {0x7a29648, 0xc001db0880}, {0x0, 0x0, 0x0}) vendor/github.com/onsi/gomega/internal/assertion/assertion.go:38 +0x95 k8s.io/kubernetes/test/e2e/framework.ExpectEqual({0x6327f40?, 0xc001db0870?}, {0x6327f40?, 0x79ff710}, {0x0, 0x0, 0x0}) test/e2e/framework/expect.go:25 +0x125 k8s.io/kubernetes/test/e2e/common/node.getHeartbeatTimeAndStatus({_, _}, {_, _}) test/e2e/common/node/node_lease.go:193 +0x1ba k8s.io/kubernetes/test/e2e/common/node.glob..func13.2.3.2() test/e2e/common/node/node_lease.go:140 +0xa7 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x2609951, 0x0}) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:220 +0x1b k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7a3dc68?, 0xc000144000?}, 0x24f71e5?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:233 +0x57 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7a3dc68, 0xc000144000}, 0xc0015bc078, 0x2d973aa?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 +0x116 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7a3dc68, 0xc000144000}, 0xd8?, 0x2d95f45?, 0x38?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:594 +0x9a k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollWithContext({0x7a3dc68, 0xc000144000}, 0x26?, 0xc000a2ae28?, 0x24f7547?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:458 +0x47 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.Poll(0xc003367710?, 0xc003367740?, 0x0?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:443 +0x50 k8s.io/kubernetes/test/e2e/common/node.glob..func13.2.3() test/e2e/common/node/node_lease.go:139 +0x53c k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).runSync(0x300000002?) vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113 +0xb1 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).run(0xc000a2b5b8?) vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:64 +0x125 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*ItNode).Run(0x0?) vendor/github.com/onsi/ginkgo/internal/leafnodes/it_node.go:26 +0x7b k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/spec.(*Spec).runSample(0xc003e922d0, 0xc000a2b980?, {0x7a0c660, 0xc000160840}) vendor/github.com/onsi/ginkgo/internal/spec/spec.go:215 +0x28a k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/spec.(*Spec).Run(0xc003e922d0, {0x7a0c660, 0xc000160840}) vendor/github.com/onsi/ginkgo/internal/spec/spec.go:138 +0xe7 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpec(0xc000a1e140, 0xc003e922d0) vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:200 +0xe8 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpecs(0xc000a1e140) vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:170 +0x1a5 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).Run(0xc000a1e140) vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:66 +0xc5 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/suite.(*Suite).Run(0xc000238070, {0x7f51f5295210, 0xc000102b60}, {0x718c46b, 0x14}, {0xc000d38e40, 0x3, 0x3}, {0x7a42028, 0xc000160840}, ...) vendor/github.com/onsi/ginkgo/internal/suite/suite.go:79 +0x4d2 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo.RunSpecsWithCustomReporters({0x7a130c0?, 0xc000102b60}, {0x718c46b, 0x14}, {0xc000d27ac0, 0x3, 0x1?}) vendor/github.com/onsi/ginkgo/ginkgo_dsl.go:219 +0x189 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo.RunSpecsWithDefaultAndCustomReporters({0x7a130c0, 0xc000102b60}, {0x718c46b, 0x14}, {0xc000cf7440, 0x2, 0x2}) vendor/github.com/onsi/ginkgo/ginkgo_dsl.go:207 +0xf9 k8s.io/kubernetes/test/e2e.RunE2ETests(0x257e5b7?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc0009edc00?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000102b60, 0x73fa160) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f [AfterEach] [sig-node] NodeLease test/e2e/framework/framework.go:188 �[1mSTEP�[0m: Collecting events from namespace "node-lease-test-4960". �[1mSTEP�[0m: Found 0 events. May 3 08:59:18.811: INFO: POD NODE PHASE GRACE CONDITIONS May 3 08:59:18.811: INFO: May 3 08:59:18.923: INFO: Logging node info for node e2e-c8a0630093-a7d53-master May 3 08:59:18.987: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-master b19f1e35-3444-417f-aa8a-059f422baac1 21446 0 2022-05-03 08:44:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-05-03 08:44:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 08:45:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3860037632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3597893632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:44:59 +0000 UTC,LastTransitionTime:2022-05-03 08:44:59 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.22.140,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bcd3f659cc761bdb6efbff38fefe4e19,SystemUUID:bcd3f659-cc76-1bdb-6efb-ff38fefe4e19,BootID:f91b8838-f530-4990-b2a6-3b369f82164e,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:131049939,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:120695609,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:52333368,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 08:59:18.987: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-master May 3 08:59:19.052: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-master May 3 08:59:38.025: INFO: l7-lb-controller-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:13 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.025: INFO: Container l7-lb-controller ready: true, restart count 3 May 3 08:59:38.025: INFO: etcd-server-events-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.025: INFO: Container etcd-container ready: true, restart count 0 May 3 08:59:38.025: INFO: kube-controller-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.025: INFO: Container kube-controller-manager ready: true, restart count 2 May 3 08:59:38.025: INFO: kube-scheduler-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.025: INFO: Container kube-scheduler ready: true, restart count 0 May 3 08:59:38.025: INFO: kube-addon-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.025: INFO: Container kube-addon-manager ready: true, restart count 0 May 3 08:59:38.025: INFO: etcd-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.025: INFO: Container etcd-container ready: true, restart count 0 May 3 08:59:38.025: INFO: konnectivity-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.025: INFO: Container konnectivity-server-container ready: true, restart count 0 May 3 08:59:38.025: INFO: kube-apiserver-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.025: INFO: Container kube-apiserver ready: true, restart count 1 May 3 08:59:38.025: INFO: metadata-proxy-v0.1-blclk started at 2022-05-03 08:45:06 +0000 UTC (0+2 container statuses recorded) May 3 08:59:38.025: INFO: Container metadata-proxy ready: true, restart count 0 May 3 08:59:38.025: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 08:59:38.318: INFO: Latency metrics for node e2e-c8a0630093-a7d53-master May 3 08:59:38.318: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:38.407: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-7bq2 bfa6e413-94d8-452c-a687-5f8ae9ea5b7c 27885 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-7bq2 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-7bq2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-6774":"e2e-c8a0630093-a7d53-minion-group-7bq2","csi-mock-csi-mock-volumes-4868":"e2e-c8a0630093-a7d53-minion-group-7bq2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 08:56:35 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 08:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-7bq2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:45:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:35.197.55.130,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f84a54b770444ef2c7de26e5ab984f78,SystemUUID:f84a54b7-7044-4ef2-c7de-26e5ab984f78,BootID:950b58bb-5fcd-4efa-a61d-cbb738103018,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 08:59:38.407: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:38.533: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:38.678: INFO: kube-dns-autoscaler-c6c49f5f6-t54xb started at 2022-05-03 08:56:29 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.678: INFO: Container autoscaler ready: true, restart count 0 May 3 08:59:38.678: INFO: netserver-0 started at 2022-05-03 08:57:52 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.678: INFO: Container webserver ready: true, restart count 0 May 3 08:59:38.678: INFO: npd-v0.8.9-lxnv5 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.678: INFO: Container node-problem-detector ready: true, restart count 0 May 3 08:59:38.678: INFO: csi-mockplugin-attacher-0 started at 2022-05-03 08:56:55 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.678: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:38.678: INFO: metadata-proxy-v0.1-27ljg started at 2022-05-03 08:44:58 +0000 UTC (0+2 container statuses recorded) May 3 08:59:38.678: INFO: Container metadata-proxy ready: true, restart count 0 May 3 08:59:38.678: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 08:59:38.678: INFO: httpd started at 2022-05-03 08:59:03 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.678: INFO: Container httpd ready: true, restart count 0 May 3 08:59:38.678: INFO: l7-default-backend-bb7fb94cb-jt2kv started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.678: INFO: Container default-http-backend ready: true, restart count 0 May 3 08:59:38.678: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-zxhh5 started at 2022-05-03 08:58:18 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.678: INFO: Container agnhost-container ready: true, restart count 0 May 3 08:59:38.678: INFO: ss2-2 started at 2022-05-03 08:58:11 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.678: INFO: Container webserver ready: true, restart count 0 May 3 08:59:38.678: INFO: external-provisioner-dwb56 started at 2022-05-03 08:56:28 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.678: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 08:59:38.678: INFO: external-provisioner-skff4 started at 2022-05-03 08:58:13 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.678: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 08:59:38.678: INFO: csi-mockplugin-resizer-0 started at 2022-05-03 08:56:55 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.678: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:38.678: INFO: netserver-0 started at 2022-05-03 08:58:07 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.678: INFO: Container webserver ready: true, restart count 0 May 3 08:59:38.678: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-7bq2 started at 2022-05-03 08:44:57 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.678: INFO: Container kube-proxy ready: true, restart count 0 May 3 08:59:38.678: INFO: netserver-0 started at 2022-05-03 08:57:29 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.678: INFO: Container webserver ready: true, restart count 0 May 3 08:59:38.678: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:58:01 +0000 UTC (0+7 container statuses recorded) May 3 08:59:38.678: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:38.678: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:38.678: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:38.678: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:38.678: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:38.678: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:38.678: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:38.678: INFO: csi-mockplugin-0 started at 2022-05-03 08:56:55 +0000 UTC (0+3 container statuses recorded) May 3 08:59:38.678: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:38.678: INFO: Container driver-registrar ready: true, restart count 0 May 3 08:59:38.678: INFO: Container mock ready: true, restart count 0 May 3 08:59:38.678: INFO: konnectivity-agent-r2m8v started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.678: INFO: Container konnectivity-agent ready: true, restart count 0 May 3 08:59:38.678: INFO: coredns-6b775575b5-w454s started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.678: INFO: Container coredns ready: true, restart count 0 May 3 08:59:39.323: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:39.323: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:39.390: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-c5lb e86bdeb4-972e-4590-a8a1-92d331988301 27865 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-c5lb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-c5lb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-05-03 08:57:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2022-05-03 08:59:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-05-03 08:59:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"Ready\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-c5lb,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoSchedule,TimeAdded:2022-05-03 08:59:18 +0000 UTC,},Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoExecute,TimeAdded:2022-05-03 08:59:23 +0000 UTC,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:DiskPressure,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:PIDPressure,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:Ready,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.151.125,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:97eaceafa1dcc38dfa191fea843250cf,SystemUUID:97eaceaf-a1dc-c38d-fa19-1fea843250cf,BootID:eddb2e60-9b10-4c23-9e89-f2539bba18c7,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 08:59:39.391: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:39.454: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:39.539: INFO: Unable to retrieve kubelet pods for node e2e-c8a0630093-a7d53-minion-group-c5lb: error trying to reach service: dial tcp 10.40.0.3:10250: connect: connection refused May 3 08:59:39.539: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:39.599: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-j0s7 13534811-02a2-4928-b008-80e6f39177b8 27875 0 2022-05-03 08:44:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-j0s7 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-j0s7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-132":"e2e-c8a0630093-a7d53-minion-group-j0s7","csi-hostpath-ephemeral-928":"e2e-c8a0630093-a7d53-minion-group-j0s7","csi-hostpath-provisioning-1259":"e2e-c8a0630093-a7d53-minion-group-j0s7"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:21 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 08:59:21 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-05-03 08:59:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-j0s7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817138176 0} {<nil>} 7633924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554994176 0} {<nil>} 7377924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.237.94,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:800822b6a794b56fc75d86f7afc2e1a6,SystemUUID:800822b6-a794-b56f-c75d-86f7afc2e1a6,BootID:c95dcb5d-789d-48b1-8b08-198b7583e648,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/build-image/debian-iptables@sha256:3317c4374ea30d88b64b27740b0edfaa600e410901e727b5bab4c4deac1df6f5 registry.k8s.io/build-image/debian-iptables:bullseye-v1.3.0],SizeBytes:27061409,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:00fcc441ea9f72899c25eed61d602272a2a58c5f0014332bdcb5ac24acef08e4 registry.k8s.io/sig-storage/snapshot-controller:v4.0.0],SizeBytes:18952261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-928^50cccb5b-cabf-11ec-85c1-1e399d5f0c6b],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-928^50cccb5b-cabf-11ec-85c1-1e399d5f0c6b,DevicePath:,},},Config:nil,},} May 3 08:59:39.600: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:39.657: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:39.839: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:56:40 +0000 UTC (0+7 container statuses recorded) May 3 08:59:39.839: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:39.839: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:39.839: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:39.839: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:39.839: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:39.839: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:39.839: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:39.839: INFO: ss2-0 started at 2022-05-03 08:57:52 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.839: INFO: Container webserver ready: true, restart count 0 May 3 08:59:39.839: INFO: konnectivity-agent-98km6 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.839: INFO: Container konnectivity-agent ready: true, restart count 0 May 3 08:59:39.839: INFO: test-container-pod started at 2022-05-03 08:57:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.839: INFO: Container webserver ready: true, restart count 0 May 3 08:59:39.839: INFO: netserver-2 started at 2022-05-03 08:58:07 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.839: INFO: Container webserver ready: true, restart count 0 May 3 08:59:39.839: INFO: netserver-2 started at 2022-05-03 08:57:29 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.839: INFO: Container webserver ready: true, restart count 0 May 3 08:59:39.839: INFO: external-provisioner-mh5tk started at 2022-05-03 08:57:54 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.839: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 08:59:39.839: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-j0s7 started at 2022-05-03 08:44:56 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.839: INFO: Container kube-proxy ready: true, restart count 0 May 3 08:59:39.839: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-j0s7-rck49 started at 2022-05-03 08:58:36 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.839: INFO: Container agnhost-container ready: true, restart count 0 May 3 08:59:39.839: INFO: netserver-2 started at 2022-05-03 08:57:06 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.839: INFO: Container webserver ready: true, restart count 0 May 3 08:59:39.839: INFO: netserver-2 started at 2022-05-03 08:57:52 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.839: INFO: Container webserver ready: true, restart count 0 May 3 08:59:39.839: INFO: npd-v0.8.9-dgf5k started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.839: INFO: Container node-problem-detector ready: true, restart count 0 May 3 08:59:39.839: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:58:08 +0000 UTC (0+7 container statuses recorded) May 3 08:59:39.839: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:39.839: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:39.839: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:39.839: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:39.839: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:39.839: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:39.839: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:39.839: INFO: volume-snapshot-controller-0 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.839: INFO: Container volume-snapshot-controller ready: true, restart count 0 May 3 08:59:39.839: INFO: rand-non-local-7rpz7 started at 2022-05-03 08:58:44 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.839: INFO: Container c ready: false, restart count 0 May 3 08:59:39.839: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:59:16 +0000 UTC (0+7 container statuses recorded) May 3 08:59:39.839: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:39.839: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:39.839: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:39.839: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:39.839: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:39.839: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:39.839: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:39.839: INFO: metadata-proxy-v0.1-86pbj started at 2022-05-03 08:44:57 +0000 UTC (0+2 container statuses recorded) May 3 08:59:39.839: INFO: Container metadata-proxy ready: true, restart count 0 May 3 08:59:39.839: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 08:59:39.839: INFO: inline-volume-tester-8x7vv started at 2022-05-03 08:59:20 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.839: INFO: Container csi-volume-tester ready: true, restart count 0 May 3 08:59:40.396: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:40.396: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready May 3 08:59:40.470: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:42.652: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:44.590: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:46.639: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:48.554: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:50.553: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:52.556: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:54.589: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:56.590: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:58.593: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:00.594: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:02.592: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:04.590: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:06.602: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:08.594: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:10.589: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:12.589: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:14.592: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:16.590: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:18.592: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:20.591: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:22.590: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:24.590: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:26.599: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC} {node.kubernetes.io/not-ready NoSchedule 2022-05-03 09:00:26 +0000 UTC}]. Failure May 3 09:00:28.591: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is true, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure �[1mSTEP�[0m: Destroying namespace "node-lease-test-4960" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\sVolumes\s\[Driver\:\scsi\-hostpath\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\svolumes\sshould\sstore\sdata$'
test/e2e/storage/testsuites/volumes.go:161 May 3 08:59:25.135: "test -b /opt/0" should fail with exit code 1, but failed with error message "error dialing backend: dial timeout, backstop" stdout: stderr: Unexpected error: <*errors.StatusError | 0xc002bd32c0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "error dialing backend: dial timeout, backstop", Reason: "", Details: nil, Code: 500, }, } error dialing backend: dial timeout, backstop occurred test/e2e/framework/volume/fixtures.go:750from junit_20.xml
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Creating a kubernetes client May 3 08:57:58.357: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename volume �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should store data test/e2e/storage/testsuites/volumes.go:161 �[1mSTEP�[0m: Building a driver namespace object, basename volume-6774 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: deploying csi-hostpath driver May 3 08:57:59.168: INFO: creating *v1.ServiceAccount: volume-6774-543/csi-attacher May 3 08:57:59.214: INFO: creating *v1.ClusterRole: external-attacher-runner-volume-6774 May 3 08:57:59.214: INFO: Define cluster role external-attacher-runner-volume-6774 May 3 08:57:59.319: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-volume-6774 May 3 08:57:59.471: INFO: creating *v1.Role: volume-6774-543/external-attacher-cfg-volume-6774 May 3 08:57:59.597: INFO: creating *v1.RoleBinding: volume-6774-543/csi-attacher-role-cfg May 3 08:57:59.665: INFO: creating *v1.ServiceAccount: volume-6774-543/csi-provisioner May 3 08:57:59.710: INFO: creating *v1.ClusterRole: external-provisioner-runner-volume-6774 May 3 08:57:59.710: INFO: Define cluster role external-provisioner-runner-volume-6774 May 3 08:57:59.757: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-volume-6774 May 3 08:57:59.811: INFO: creating *v1.Role: volume-6774-543/external-provisioner-cfg-volume-6774 May 3 08:57:59.860: INFO: creating *v1.RoleBinding: volume-6774-543/csi-provisioner-role-cfg May 3 08:57:59.906: INFO: creating *v1.ServiceAccount: volume-6774-543/csi-snapshotter May 3 08:57:59.951: INFO: creating *v1.ClusterRole: external-snapshotter-runner-volume-6774 May 3 08:57:59.951: INFO: Define cluster role external-snapshotter-runner-volume-6774 May 3 08:57:59.998: INFO: creating *v1.ClusterRoleBinding: csi-snapshotter-role-volume-6774 May 3 08:58:00.044: INFO: creating *v1.Role: volume-6774-543/external-snapshotter-leaderelection-volume-6774 May 3 08:58:00.086: INFO: creating *v1.RoleBinding: volume-6774-543/external-snapshotter-leaderelection May 3 08:58:00.129: INFO: creating *v1.ServiceAccount: volume-6774-543/csi-external-health-monitor-controller May 3 08:58:00.176: INFO: creating *v1.ClusterRole: external-health-monitor-controller-runner-volume-6774 May 3 08:58:00.176: INFO: Define cluster role external-health-monitor-controller-runner-volume-6774 May 3 08:58:00.221: INFO: creating *v1.ClusterRoleBinding: csi-external-health-monitor-controller-role-volume-6774 May 3 08:58:00.264: INFO: creating *v1.Role: volume-6774-543/external-health-monitor-controller-cfg-volume-6774 May 3 08:58:00.307: INFO: creating *v1.RoleBinding: volume-6774-543/csi-external-health-monitor-controller-role-cfg May 3 08:58:00.349: INFO: creating *v1.ServiceAccount: volume-6774-543/csi-resizer May 3 08:58:00.392: INFO: creating *v1.ClusterRole: external-resizer-runner-volume-6774 May 3 08:58:00.392: INFO: Define cluster role external-resizer-runner-volume-6774 May 3 08:58:00.435: INFO: creating *v1.ClusterRoleBinding: csi-resizer-role-volume-6774 May 3 08:58:00.477: INFO: creating *v1.Role: volume-6774-543/external-resizer-cfg-volume-6774 May 3 08:58:00.518: INFO: creating *v1.RoleBinding: volume-6774-543/csi-resizer-role-cfg May 3 08:58:00.560: INFO: creating *v1.CSIDriver: csi-hostpath-volume-6774 May 3 08:58:00.602: INFO: creating *v1.ServiceAccount: volume-6774-543/csi-hostpathplugin-sa May 3 08:58:00.643: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-attacher-cluster-role-volume-6774 May 3 08:58:00.688: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-health-monitor-controller-cluster-role-volume-6774 May 3 08:58:00.732: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-provisioner-cluster-role-volume-6774 May 3 08:58:00.781: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-resizer-cluster-role-volume-6774 May 3 08:58:00.826: INFO: creating *v1.ClusterRoleBinding: csi-hostpathplugin-snapshotter-cluster-role-volume-6774 May 3 08:58:00.876: INFO: creating *v1.RoleBinding: volume-6774-543/csi-hostpathplugin-attacher-role May 3 08:58:00.921: INFO: creating *v1.RoleBinding: volume-6774-543/csi-hostpathplugin-health-monitor-controller-role May 3 08:58:00.964: INFO: creating *v1.RoleBinding: volume-6774-543/csi-hostpathplugin-provisioner-role May 3 08:58:01.007: INFO: creating *v1.RoleBinding: volume-6774-543/csi-hostpathplugin-resizer-role May 3 08:58:01.050: INFO: creating *v1.RoleBinding: volume-6774-543/csi-hostpathplugin-snapshotter-role May 3 08:58:01.093: INFO: creating *v1.StatefulSet: volume-6774-543/csi-hostpathplugin May 3 08:58:01.140: INFO: creating *v1.ClusterRoleBinding: psp-csi-hostpath-role-volume-6774 May 3 08:58:01.222: INFO: Creating resource for dynamic PV May 3 08:58:01.222: INFO: Using claimSize:1Mi, test suite supported size:{ 1Mi}, driver(csi-hostpath) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass volume-6774z27fj �[1mSTEP�[0m: creating a claim May 3 08:58:01.312: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil May 3 08:58:01.381: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [csi-hostpathxcpx4] to have phase Bound May 3 08:58:01.432: INFO: PersistentVolumeClaim csi-hostpathxcpx4 found but phase is Pending instead of Bound. May 3 08:58:03.521: INFO: PersistentVolumeClaim csi-hostpathxcpx4 found but phase is Pending instead of Bound. May 3 08:58:05.562: INFO: PersistentVolumeClaim csi-hostpathxcpx4 found and phase=Bound (4.180359383s) �[1mSTEP�[0m: starting hostpath-injector �[1mSTEP�[0m: Writing text file contents in the container. May 3 08:58:31.811: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.22.140 --kubeconfig=/workspace/.kube/config --namespace=volume-6774 exec hostpath-injector --namespace=volume-6774 -- /bin/sh -c echo 'Hello from csi-hostpath from namespace volume-6774' > /opt/0/index.html' May 3 08:58:32.318: INFO: stderr: "" May 3 08:58:32.318: INFO: stdout: "" �[1mSTEP�[0m: Checking that text file contents are perfect. May 3 08:58:32.318: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.22.140 --kubeconfig=/workspace/.kube/config --namespace=volume-6774 exec hostpath-injector --namespace=volume-6774 -- cat /opt/0/index.html' May 3 08:58:33.149: INFO: stderr: "" May 3 08:58:33.149: INFO: stdout: "Hello from csi-hostpath from namespace volume-6774\n" May 3 08:58:33.149: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /opt/0] Namespace:volume-6774 PodName:hostpath-injector ContainerName:hostpath-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:58:33.149: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:58:33.150: INFO: ExecWithOptions: Clientset creation May 3 08:58:33.150: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/volume-6774/pods/hostpath-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fopt%2F0&container=hostpath-injector&container=hostpath-injector&stderr=true&stdout=true) May 3 08:58:33.544: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /opt/0] Namespace:volume-6774 PodName:hostpath-injector ContainerName:hostpath-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:58:33.544: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:58:33.544: INFO: ExecWithOptions: Clientset creation May 3 08:58:33.545: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/volume-6774/pods/hostpath-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-b+%2Fopt%2F0&container=hostpath-injector&container=hostpath-injector&stderr=true&stdout=true) �[1mSTEP�[0m: Deleting pod hostpath-injector in namespace volume-6774 May 3 08:58:33.931: INFO: Waiting for pod hostpath-injector to disappear May 3 08:58:33.972: INFO: Pod hostpath-injector still exists May 3 08:58:35.973: INFO: Waiting for pod hostpath-injector to disappear May 3 08:58:36.023: INFO: Pod hostpath-injector no longer exists �[1mSTEP�[0m: starting hostpath-client �[1mSTEP�[0m: Checking that text file contents are perfect. May 3 08:58:54.189: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.22.140 --kubeconfig=/workspace/.kube/config --namespace=volume-6774 exec hostpath-client --namespace=volume-6774 -- cat /opt/0/index.html' May 3 08:58:54.684: INFO: stderr: "" May 3 08:58:54.684: INFO: stdout: "Hello from csi-hostpath from namespace volume-6774\n" May 3 08:58:54.684: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /opt/0] Namespace:volume-6774 PodName:hostpath-client ContainerName:hostpath-client Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:58:54.684: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:58:54.684: INFO: ExecWithOptions: Clientset creation May 3 08:58:54.685: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/volume-6774/pods/hostpath-client/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fopt%2F0&container=hostpath-client&container=hostpath-client&stderr=true&stdout=true) May 3 08:58:54.999: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /opt/0] Namespace:volume-6774 PodName:hostpath-client ContainerName:hostpath-client Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} May 3 08:58:54.999: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:58:55.000: INFO: ExecWithOptions: Clientset creation May 3 08:58:55.000: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/volume-6774/pods/hostpath-client/exec?command=%2Fbin%2Fsh&command=-c&command=test+-b+%2Fopt%2F0&container=hostpath-client&container=hostpath-client&stderr=true&stdout=true) May 3 08:59:25.135: FAIL: "test -b /opt/0" should fail with exit code 1, but failed with error message "error dialing backend: dial timeout, backstop" stdout: stderr: Unexpected error: <*errors.StatusError | 0xc002bd32c0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "error dialing backend: dial timeout, backstop", Reason: "", Details: nil, Code: 500, }, } error dialing backend: dial timeout, backstop occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework/volume.VerifyExecInPodFail(0x715e103?, 0xa?, {0xc000b48580, 0xe}, 0x1?) test/e2e/framework/volume/fixtures.go:750 +0x35c k8s.io/kubernetes/test/e2e/framework/volume.CheckVolumeModeOfPath(0xc001c06c00?, 0x0?, {0x0?, 0xc00285e870?}, {0xc001c06c00, 0x6}) test/e2e/framework/volume/fixtures.go:707 +0x1ce k8s.io/kubernetes/test/e2e/framework/volume.testVolumeContent(0x8?, 0xc002f09400, {0x0, 0x0}, 0x0, {0x0, 0x0}, {0xc00285f098, 0x1, 0x1}) test/e2e/framework/volume/fixtures.go:551 +0x577 k8s.io/kubernetes/test/e2e/framework/volume.testVolumeClient(0xc000bd9500, {{0xc000ef7250, 0xb}, {0x7156d71, 0x8}, {0x0, 0x0}, {0x0, 0x0, 0x0}, ...}, ...) test/e2e/framework/volume/fixtures.go:603 +0x1fe k8s.io/kubernetes/test/e2e/framework/volume.TestVolumeClient(...) test/e2e/framework/volume/fixtures.go:580 k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func3() test/e2e/storage/testsuites/volumes.go:190 +0x525 k8s.io/kubernetes/test/e2e.RunE2ETests(0x257e5b7?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x24efd19?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0001f0820, 0x73fa160) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: Deleting pod hostpath-client in namespace volume-6774 May 3 08:59:25.188: INFO: Waiting for pod hostpath-client to disappear May 3 08:59:25.294: INFO: Pod hostpath-client still exists May 3 08:59:27.295: INFO: Waiting for pod hostpath-client to disappear May 3 08:59:27.379: INFO: Pod hostpath-client no longer exists �[1mSTEP�[0m: cleaning the environment after hostpath �[1mSTEP�[0m: Deleting pvc May 3 08:59:27.379: INFO: Deleting PersistentVolumeClaim "csi-hostpathxcpx4" May 3 08:59:27.449: INFO: Waiting up to 5m0s for PersistentVolume pvc-0afbed78-8218-4ad9-a17e-67bd1f33ddad to get deleted May 3 08:59:27.508: INFO: PersistentVolume pvc-0afbed78-8218-4ad9-a17e-67bd1f33ddad found and phase=Bound (59.468355ms) May 3 08:59:32.595: INFO: PersistentVolume pvc-0afbed78-8218-4ad9-a17e-67bd1f33ddad was removed �[1mSTEP�[0m: Deleting sc �[1mSTEP�[0m: deleting the test namespace: volume-6774 �[1mSTEP�[0m: Waiting for namespaces [volume-6774] to vanish �[1mSTEP�[0m: uninstalling csi csi-hostpath driver May 3 09:02:15.003: INFO: deleting *v1.ServiceAccount: volume-6774-543/csi-attacher May 3 09:02:15.186: INFO: deleting *v1.ClusterRole: external-attacher-runner-volume-6774 May 3 09:02:15.369: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-volume-6774 May 3 09:02:15.598: INFO: deleting *v1.Role: volume-6774-543/external-attacher-cfg-volume-6774 May 3 09:02:15.845: INFO: deleting *v1.RoleBinding: volume-6774-543/csi-attacher-role-cfg May 3 09:02:16.011: INFO: deleting *v1.ServiceAccount: volume-6774-543/csi-provisioner May 3 09:02:16.061: INFO: deleting *v1.ClusterRole: external-provisioner-runner-volume-6774 May 3 09:02:16.117: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-volume-6774 May 3 09:02:16.161: INFO: deleting *v1.Role: volume-6774-543/external-provisioner-cfg-volume-6774 May 3 09:02:16.205: INFO: deleting *v1.RoleBinding: volume-6774-543/csi-provisioner-role-cfg May 3 09:02:16.282: INFO: deleting *v1.ServiceAccount: volume-6774-543/csi-snapshotter May 3 09:02:16.337: INFO: deleting *v1.ClusterRole: external-snapshotter-runner-volume-6774 May 3 09:02:16.397: INFO: deleting *v1.ClusterRoleBinding: csi-snapshotter-role-volume-6774 May 3 09:02:16.446: INFO: deleting *v1.Role: volume-6774-543/external-snapshotter-leaderelection-volume-6774 May 3 09:02:16.492: INFO: deleting *v1.RoleBinding: volume-6774-543/external-snapshotter-leaderelection May 3 09:02:16.539: INFO: deleting *v1.ServiceAccount: volume-6774-543/csi-external-health-monitor-controller May 3 09:02:16.582: INFO: deleting *v1.ClusterRole: external-health-monitor-controller-runner-volume-6774 May 3 09:02:16.626: INFO: deleting *v1.ClusterRoleBinding: csi-external-health-monitor-controller-role-volume-6774 May 3 09:02:16.681: INFO: deleting *v1.Role: volume-6774-543/external-health-monitor-controller-cfg-volume-6774 May 3 09:02:16.730: INFO: deleting *v1.RoleBinding: volume-6774-543/csi-external-health-monitor-controller-role-cfg May 3 09:02:16.773: INFO: deleting *v1.ServiceAccount: volume-6774-543/csi-resizer May 3 09:02:16.818: INFO: deleting *v1.ClusterRole: external-resizer-runner-volume-6774 May 3 09:02:16.862: INFO: deleting *v1.ClusterRoleBinding: csi-resizer-role-volume-6774 May 3 09:02:16.907: INFO: deleting *v1.Role: volume-6774-543/external-resizer-cfg-volume-6774 May 3 09:02:16.965: INFO: deleting *v1.RoleBinding: volume-6774-543/csi-resizer-role-cfg May 3 09:02:17.013: INFO: deleting *v1.CSIDriver: csi-hostpath-volume-6774 May 3 09:02:17.056: INFO: deleting *v1.ServiceAccount: volume-6774-543/csi-hostpathplugin-sa May 3 09:02:17.099: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-attacher-cluster-role-volume-6774 May 3 09:02:17.146: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-health-monitor-controller-cluster-role-volume-6774 May 3 09:02:17.191: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-provisioner-cluster-role-volume-6774 May 3 09:02:17.283: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-resizer-cluster-role-volume-6774 May 3 09:02:17.377: INFO: deleting *v1.ClusterRoleBinding: csi-hostpathplugin-snapshotter-cluster-role-volume-6774 May 3 09:02:17.421: INFO: deleting *v1.RoleBinding: volume-6774-543/csi-hostpathplugin-attacher-role May 3 09:02:17.468: INFO: deleting *v1.RoleBinding: volume-6774-543/csi-hostpathplugin-health-monitor-controller-role May 3 09:02:17.511: INFO: deleting *v1.RoleBinding: volume-6774-543/csi-hostpathplugin-provisioner-role May 3 09:02:17.597: INFO: deleting *v1.RoleBinding: volume-6774-543/csi-hostpathplugin-resizer-role May 3 09:02:17.663: INFO: deleting *v1.RoleBinding: volume-6774-543/csi-hostpathplugin-snapshotter-role May 3 09:02:17.728: INFO: deleting *v1.StatefulSet: volume-6774-543/csi-hostpathplugin May 3 09:02:17.783: INFO: deleting *v1.ClusterRoleBinding: psp-csi-hostpath-role-volume-6774 �[1mSTEP�[0m: deleting the driver namespace: volume-6774-543 �[1mSTEP�[0m: Waiting for namespaces [volume-6774-543] to vanish [AfterEach] [Testpattern: Dynamic PV (default fs)] volumes test/e2e/framework/framework.go:188 May 3 09:02:23.999: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sDynamic\sProvisioning\sGlusterDynamicProvisioner\sshould\screate\sand\sdelete\spersistent\svolumes\s\[fast\]$'
test/e2e/storage/volume_provisioning.go:712 May 3 09:05:55.290: Unexpected error: <*errors.errorString | 0xc0026cdc20>: { s: "PersistentVolumeClaims [pvc-7kc97] not all in phase Bound within 5m0s", } PersistentVolumeClaims [pvc-7kc97] not all in phase Bound within 5m0s occurred test/e2e/storage/testsuites/provisioning.go:669from junit_27.xml
[BeforeEach] [sig-storage] Dynamic Provisioning test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Creating a kubernetes client May 3 08:58:20.968: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename volume-provisioning �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [BeforeEach] [sig-storage] Dynamic Provisioning test/e2e/storage/volume_provisioning.go:146 [It] should create and delete persistent volumes [fast] test/e2e/storage/volume_provisioning.go:712 �[1mSTEP�[0m: creating a Gluster DP server Pod �[1mSTEP�[0m: locating the provisioner pod �[1mSTEP�[0m: creating a StorageClass �[1mSTEP�[0m: Creating a StorageClass �[1mSTEP�[0m: creating a claim object with a suffix for gluster dynamic provisioner May 3 09:00:53.734: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP�[0m: creating claim=&PersistentVolumeClaim{ObjectMeta:{ pvc- volume-provisioning-8010 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{2147483648 0} {<nil>} 2Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*volume-provisioning-8010-glusterdptestp6vqx,VolumeMode:nil,DataSource:nil,DataSourceRef:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},AllocatedResources:ResourceList{},ResizeStatus:nil,},} May 3 09:00:53.925: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-7kc97] to have phase Bound May 3 09:00:54.128: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:00:56.210: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:00:58.392: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:00.468: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:02.696: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:04.792: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:06.872: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:08.935: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:11.004: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:13.110: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:15.172: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:17.243: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:19.306: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:21.379: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:23.457: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:25.541: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:27.653: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:29.717: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:31.777: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:33.833: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:35.886: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:37.945: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:39.986: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:42.055: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:44.108: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:46.150: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:48.192: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:50.242: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:52.284: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:54.326: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:56.390: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:01:58.443: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:00.526: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:02.608: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:04.697: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:06.812: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:08.875: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:10.950: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:13.013: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:15.125: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:17.176: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:19.216: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:21.261: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:23.308: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:25.358: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:27.400: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:29.447: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:31.489: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:33.537: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:35.579: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:37.626: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:39.672: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:41.714: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:43.756: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:45.797: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:47.845: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:49.886: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:51.931: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:53.972: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:56.014: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:02:58.066: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:00.117: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:02.159: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:04.203: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:06.247: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:08.363: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:10.413: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:12.466: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:14.618: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:16.668: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:18.757: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:20.799: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:22.939: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:24.981: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:27.093: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:29.178: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:31.219: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:33.268: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:35.313: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:37.357: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:39.438: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:41.495: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:43.541: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:45.585: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:47.631: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:49.677: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:51.727: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:53.771: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:55.813: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:57.924: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:03:59.965: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:02.016: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:04.061: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:06.103: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:08.150: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:10.196: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:12.242: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:14.288: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:16.333: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:18.383: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:20.430: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:22.473: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:24.514: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:26.559: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:28.601: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:30.643: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:32.703: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:34.749: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:36.790: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:38.842: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:40.891: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:42.934: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:44.976: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:47.019: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:49.060: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:51.102: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:53.236: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:55.291: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:57.490: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:04:59.538: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:01.581: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:03.654: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:05.697: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:07.880: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:09.946: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:12.000: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:14.206: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:16.251: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:18.306: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:20.347: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:22.485: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:24.534: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:26.587: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:28.636: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:30.717: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:32.784: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:34.828: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:36.872: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:38.916: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:40.960: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:43.008: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:45.049: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:47.090: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:49.132: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:51.204: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:53.289: INFO: PersistentVolumeClaim pvc-7kc97 found but phase is Pending instead of Bound. May 3 09:05:55.290: FAIL: Unexpected error: <*errors.errorString | 0xc0026cdc20>: { s: "PersistentVolumeClaims [pvc-7kc97] not all in phase Bound within 5m0s", } PersistentVolumeClaims [pvc-7kc97] not all in phase Bound within 5m0s occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.StorageClassTest.checkProvisioning({{0x7a6bff8, 0xc002385b00}, 0xc002575600, 0xc0000003c0, 0x0, 0xc001246a80, {0x71e0189, 0x20}, {0x0, 0x0, ...}, ...}, ...) test/e2e/storage/testsuites/provisioning.go:669 +0x131 k8s.io/kubernetes/test/e2e/storage/testsuites.StorageClassTest.TestDynamicProvisioning({{0x7a6bff8, 0xc002385b00}, 0xc002575600, 0xc0000003c0, 0x0, 0xc001246a80, {0x71e0189, 0x20}, {0x0, 0x0, ...}, ...}) test/e2e/storage/testsuites/provisioning.go:633 +0x8b3 k8s.io/kubernetes/test/e2e/storage.glob..func32.5.1() test/e2e/storage/volume_provisioning.go:738 +0x499 k8s.io/kubernetes/test/e2e.RunE2ETests(0x257e5b7?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc000839880?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000df31e0, 0x73fa160) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f May 3 09:05:55.290: INFO: deleting claim "volume-provisioning-8010"/"pvc-7kc97" May 3 09:05:55.365: INFO: deleting storage class volume-provisioning-8010-glusterdptestp6vqx [AfterEach] [sig-storage] Dynamic Provisioning test/e2e/framework/framework.go:188 �[1mSTEP�[0m: Collecting events from namespace "volume-provisioning-8010". �[1mSTEP�[0m: Found 12 events. May 3 09:05:55.485: INFO: At 2022-05-03 08:58:21 +0000 UTC - event for glusterdynamic-provisioner-zhm5j: {default-scheduler } Scheduled: Successfully assigned volume-provisioning-8010/glusterdynamic-provisioner-zhm5j to e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:05:55.485: INFO: At 2022-05-03 08:58:22 +0000 UTC - event for glusterdynamic-provisioner-zhm5j: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Pulling: Pulling image "registry.k8s.io/e2e-test-images/glusterdynamic-provisioner:v1.3" May 3 09:05:55.485: INFO: At 2022-05-03 08:58:38 +0000 UTC - event for glusterdynamic-provisioner-zhm5j: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/glusterdynamic-provisioner:v1.3" in 16.226670474s May 3 09:05:55.485: INFO: At 2022-05-03 08:58:38 +0000 UTC - event for glusterdynamic-provisioner-zhm5j: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Created: Created container glusterdynamic-provisioner May 3 09:05:55.485: INFO: At 2022-05-03 08:58:39 +0000 UTC - event for glusterdynamic-provisioner-zhm5j: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Started: Started container glusterdynamic-provisioner May 3 09:05:55.485: INFO: At 2022-05-03 09:00:28 +0000 UTC - event for glusterdynamic-provisioner-zhm5j: {taint-controller } TaintManagerEviction: Cancelling deletion of Pod volume-provisioning-8010/glusterdynamic-provisioner-zhm5j May 3 09:05:55.485: INFO: At 2022-05-03 09:00:32 +0000 UTC - event for glusterdynamic-provisioner-zhm5j: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} FailedMount: MountVolume.SetUp failed for volume "kube-api-access-cfx96" : failed to sync configmap cache: timed out waiting for the condition May 3 09:05:55.485: INFO: At 2022-05-03 09:00:36 +0000 UTC - event for glusterdynamic-provisioner-zhm5j: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 3 09:05:55.485: INFO: At 2022-05-03 09:00:38 +0000 UTC - event for glusterdynamic-provisioner-zhm5j: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Pulled: Container image "registry.k8s.io/e2e-test-images/glusterdynamic-provisioner:v1.3" already present on machine May 3 09:05:55.485: INFO: At 2022-05-03 09:00:39 +0000 UTC - event for glusterdynamic-provisioner-zhm5j: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Created: Created container glusterdynamic-provisioner May 3 09:05:55.485: INFO: At 2022-05-03 09:00:40 +0000 UTC - event for glusterdynamic-provisioner-zhm5j: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Started: Started container glusterdynamic-provisioner May 3 09:05:55.485: INFO: At 2022-05-03 09:00:54 +0000 UTC - event for pvc-7kc97: {persistentvolume-controller } ProvisioningFailed: Failed to provision volume with StorageClass "volume-provisioning-8010-glusterdptestp6vqx": failed to create volume: failed to create volume: see kube-controller-manager.log for details May 3 09:05:55.539: INFO: POD NODE PHASE GRACE CONDITIONS May 3 09:05:55.539: INFO: glusterdynamic-provisioner-zhm5j e2e-c8a0630093-a7d53-minion-group-c5lb Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:21 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 09:00:40 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 09:00:40 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-05-03 08:58:21 +0000 UTC }] May 3 09:05:55.539: INFO: May 3 09:05:55.699: INFO: Logging node info for node e2e-c8a0630093-a7d53-master May 3 09:05:55.747: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-master b19f1e35-3444-417f-aa8a-059f422baac1 28591 0 2022-05-03 08:44:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-05-03 08:44:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 08:45:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3860037632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3597893632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:44:59 +0000 UTC,LastTransitionTime:2022-05-03 08:44:59 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 09:00:59 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 09:00:59 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 09:00:59 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 09:00:59 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.22.140,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bcd3f659cc761bdb6efbff38fefe4e19,SystemUUID:bcd3f659-cc76-1bdb-6efb-ff38fefe4e19,BootID:f91b8838-f530-4990-b2a6-3b369f82164e,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:131049939,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:120695609,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:52333368,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 09:05:55.748: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-master May 3 09:05:55.791: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-master May 3 09:05:55.845: INFO: etcd-server-events-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:05:55.845: INFO: Container etcd-container ready: true, restart count 0 May 3 09:05:55.845: INFO: kube-controller-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:05:55.845: INFO: Container kube-controller-manager ready: true, restart count 2 May 3 09:05:55.845: INFO: kube-scheduler-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:05:55.845: INFO: Container kube-scheduler ready: true, restart count 0 May 3 09:05:55.845: INFO: kube-addon-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:12 +0000 UTC (0+1 container statuses recorded) May 3 09:05:55.845: INFO: Container kube-addon-manager ready: true, restart count 0 May 3 09:05:55.845: INFO: l7-lb-controller-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:13 +0000 UTC (0+1 container statuses recorded) May 3 09:05:55.845: INFO: Container l7-lb-controller ready: true, restart count 3 May 3 09:05:55.845: INFO: etcd-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:05:55.845: INFO: Container etcd-container ready: true, restart count 0 May 3 09:05:55.845: INFO: konnectivity-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:05:55.845: INFO: Container konnectivity-server-container ready: true, restart count 0 May 3 09:05:55.845: INFO: kube-apiserver-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:05:55.845: INFO: Container kube-apiserver ready: true, restart count 1 May 3 09:05:55.845: INFO: metadata-proxy-v0.1-blclk started at 2022-05-03 08:45:06 +0000 UTC (0+2 container statuses recorded) May 3 09:05:55.845: INFO: Container metadata-proxy ready: true, restart count 0 May 3 09:05:55.845: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 09:05:56.137: INFO: Latency metrics for node e2e-c8a0630093-a7d53-master May 3 09:05:56.137: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 09:05:56.180: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-7bq2 bfa6e413-94d8-452c-a687-5f8ae9ea5b7c 38229 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-7bq2 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-7bq2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2020":"e2e-c8a0630093-a7d53-minion-group-7bq2","csi-hostpath-volumemode-6151":"e2e-c8a0630093-a7d53-minion-group-7bq2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-05-03 09:05:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2022-05-03 09:05:30 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-7bq2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 09:05:06 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-05-03 09:05:06 +0000 UTC,LastTransitionTime:2022-05-03 09:00:06 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 09:05:06 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 09:05:06 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 09:05:06 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 09:05:06 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 09:05:35 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 09:05:35 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 09:05:35 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 09:05:35 +0000 UTC,LastTransitionTime:2022-05-03 08:45:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:35.197.55.130,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f84a54b770444ef2c7de26e5ab984f78,SystemUUID:f84a54b7-7044-4ef2-c7de-26e5ab984f78,BootID:950b58bb-5fcd-4efa-a61d-cbb738103018,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 09:05:56.180: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 09:05:56.228: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 09:05:56.350: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-7bq2 started at 2022-05-03 08:44:57 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container kube-proxy ready: true, restart count 0 May 3 09:05:56.350: INFO: pod1 started at 2022-05-03 09:05:13 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container container1 ready: true, restart count 0 May 3 09:05:56.350: INFO: pod-d4d210a6-3c52-4a82-9851-a7924ff0c7a1 started at 2022-05-03 09:05:50 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container write-pod ready: false, restart count 0 May 3 09:05:56.350: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-rdhgf started at 2022-05-03 09:05:52 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container agnhost-container ready: false, restart count 0 May 3 09:05:56.350: INFO: netserver-0 started at 2022-05-03 09:05:20 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container webserver ready: true, restart count 0 May 3 09:05:56.350: INFO: coredns-6b775575b5-w454s started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container coredns ready: true, restart count 0 May 3 09:05:56.350: INFO: konnectivity-agent-r2m8v started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container konnectivity-agent ready: true, restart count 0 May 3 09:05:56.350: INFO: deployment-5979f4dc85-p4l8r started at 2022-05-03 09:05:24 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container nginx ready: false, restart count 0 May 3 09:05:56.350: INFO: affinity-nodeport-transition-lr6fp started at 2022-05-03 09:03:35 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container affinity-nodeport-transition ready: true, restart count 0 May 3 09:05:56.350: INFO: csi-hostpathplugin-0 started at 2022-05-03 09:05:25 +0000 UTC (0+7 container statuses recorded) May 3 09:05:56.350: INFO: Container csi-attacher ready: true, restart count 0 May 3 09:05:56.350: INFO: Container csi-provisioner ready: true, restart count 0 May 3 09:05:56.350: INFO: Container csi-resizer ready: true, restart count 0 May 3 09:05:56.350: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 09:05:56.350: INFO: Container hostpath ready: true, restart count 0 May 3 09:05:56.350: INFO: Container liveness-probe ready: true, restart count 0 May 3 09:05:56.350: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 09:05:56.350: INFO: indexed-job-0-7cdh9 started at 2022-05-03 09:05:44 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container c ready: false, restart count 0 May 3 09:05:56.350: INFO: npd-v0.8.9-lxnv5 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container node-problem-detector ready: true, restart count 0 May 3 09:05:56.350: INFO: external-provisioner-mjsdf started at 2022-05-03 09:05:12 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 09:05:56.350: INFO: kube-dns-autoscaler-c6c49f5f6-t54xb started at 2022-05-03 08:56:29 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container autoscaler ready: true, restart count 0 May 3 09:05:56.350: INFO: metadata-proxy-v0.1-27ljg started at 2022-05-03 08:44:58 +0000 UTC (0+2 container statuses recorded) May 3 09:05:56.350: INFO: Container metadata-proxy ready: true, restart count 0 May 3 09:05:56.350: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 09:05:56.350: INFO: pod-handle-http-request started at 2022-05-03 09:05:43 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container agnhost-container ready: true, restart count 0 May 3 09:05:56.350: INFO: indexed-job-2-624mb started at 2022-05-03 09:05:48 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container c ready: false, restart count 0 May 3 09:05:56.350: INFO: execpod-noendpointsdchb6 started at <nil> (0+0 container statuses recorded) May 3 09:05:56.350: INFO: concurrent-27526145-d2jpl started at 2022-05-03 09:05:00 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container c ready: false, restart count 0 May 3 09:05:56.350: INFO: webhook-to-be-mutated started at 2022-05-03 09:05:01 +0000 UTC (1+1 container statuses recorded) May 3 09:05:56.350: INFO: Init container webhook-added-init-container ready: false, restart count 0 May 3 09:05:56.350: INFO: Container example ready: false, restart count 0 May 3 09:05:56.350: INFO: csi-hostpathplugin-0 started at <nil> (0+0 container statuses recorded) May 3 09:05:56.350: INFO: l7-default-backend-bb7fb94cb-jt2kv started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container default-http-backend ready: true, restart count 0 May 3 09:05:56.350: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-xkwwc started at 2022-05-03 09:05:45 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container agnhost-container ready: true, restart count 0 May 3 09:05:56.350: INFO: pod-2 started at 2022-05-03 09:05:39 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container donothing ready: true, restart count 0 May 3 09:05:56.350: INFO: external-provisioner-skff4 started at 2022-05-03 08:58:13 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 09:05:56.350: INFO: inline-volume-tester-xt45b started at 2022-05-03 09:05:19 +0000 UTC (0+1 container statuses recorded) May 3 09:05:56.350: INFO: Container csi-volume-tester ready: true, restart count 0 May 3 09:05:56.350: INFO: csi-hostpathplugin-0 started at 2022-05-03 09:05:19 +0000 UTC (0+7 container statuses recorded) May 3 09:05:56.350: INFO: Container csi-attacher ready: true, restart count 0 May 3 09:05:56.351: INFO: Container csi-provisioner ready: true, restart count 0 May 3 09:05:56.351: INFO: Container csi-resizer ready: true, restart count 0 May 3 09:05:56.351: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 09:05:56.351: INFO: Container hostpath ready: true, restart count 0 May 3 09:05:56.351: INFO: Container liveness-probe ready: true, restart count 0 May 3 09:05:56.351: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 09:05:57.412: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 09:05:57.412: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:05:57.478: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-c5lb e86bdeb4-972e-4590-a8a1-92d331988301 38975 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-c5lb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-c5lb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 08:59:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-05-03 09:02:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 09:05:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{},"f:memory":{}},"f:capacity":{"f:ephemeral-storage":{},"f:memory":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:nodeInfo":{"f:bootID":{}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-c5lb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817134080 0} {<nil>} 7455Mi BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554990080 0} {<nil>} 7205Mi BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 09:01:32 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 09:01:32 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 09:01:32 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 09:01:32 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 09:01:32 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 09:01:32 +0000 UTC,LastTransitionTime:2022-05-03 09:01:31 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 09:04:42 +0000 UTC,LastTransitionTime:2022-05-03 09:00:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 09:04:42 +0000 UTC,LastTransitionTime:2022-05-03 09:00:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 09:04:42 +0000 UTC,LastTransitionTime:2022-05-03 09:00:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 09:04:42 +0000 UTC,LastTransitionTime:2022-05-03 09:00:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.151.125,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:97eaceafa1dcc38dfa191fea843250cf,SystemUUID:97eaceaf-a1dc-c38d-fa19-1fea843250cf,BootID:07b245ae-f8d1-4df7-99ab-f56ed5c2890d,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/glusterdynamic-provisioner@sha256:7ed3bfb1429e97f721cbd8b2953ffb1f0186e89c1c99ee0e919d563b0caa81d2 registry.k8s.io/e2e-test-images/glusterdynamic-provisioner:v1.3],SizeBytes:151196506,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 09:05:57.478: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:05:57.544: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:05:57.732: INFO: agnhost-replica-58c8495b-sczjf started at 2022-05-03 09:05:22 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container replica ready: true, restart count 0 May 3 09:05:57.732: INFO: npd-v0.8.9-wzktb started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container node-problem-detector ready: true, restart count 1 May 3 09:05:57.732: INFO: pod-subpath-test-configmap-b4tr started at 2022-05-03 09:05:52 +0000 UTC (1+2 container statuses recorded) May 3 09:05:57.732: INFO: Init container init-volume-configmap-b4tr ready: false, restart count 0 May 3 09:05:57.732: INFO: Container test-container-subpath-configmap-b4tr ready: false, restart count 0 May 3 09:05:57.732: INFO: Container test-container-volume-configmap-b4tr ready: false, restart count 0 May 3 09:05:57.732: INFO: gluster-server started at 2022-05-03 09:05:30 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container gluster-server ready: true, restart count 0 May 3 09:05:57.732: INFO: netserver-1 started at 2022-05-03 09:05:19 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container webserver ready: true, restart count 0 May 3 09:05:57.732: INFO: inline-volume-tester-lc5vw started at 2022-05-03 09:05:19 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container csi-volume-tester ready: true, restart count 0 May 3 09:05:57.732: INFO: inline-volume-tester2-tnnll started at 2022-05-03 09:00:27 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container csi-volume-tester ready: false, restart count 0 May 3 09:05:57.732: INFO: affinity-nodeport-transition-xwbpl started at 2022-05-03 09:03:35 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container affinity-nodeport-transition ready: true, restart count 0 May 3 09:05:57.732: INFO: proxy-service-5tmvw-2lsvf started at 2022-05-03 08:58:19 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container proxy-service-5tmvw ready: true, restart count 1 May 3 09:05:57.732: INFO: test-container-pod started at 2022-05-03 09:05:48 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container webserver ready: true, restart count 0 May 3 09:05:57.732: INFO: glusterdynamic-provisioner-zhm5j started at 2022-05-03 08:58:21 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container glusterdynamic-provisioner ready: true, restart count 1 May 3 09:05:57.732: INFO: deployment-5979f4dc85-xbj86 started at 2022-05-03 09:05:23 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container nginx ready: false, restart count 0 May 3 09:05:57.732: INFO: metrics-server-v0.5.2-86b9c987cb-nflsz started at 2022-05-03 08:45:23 +0000 UTC (0+2 container statuses recorded) May 3 09:05:57.732: INFO: Container metrics-server ready: true, restart count 2 May 3 09:05:57.732: INFO: Container metrics-server-nanny ready: true, restart count 1 May 3 09:05:57.732: INFO: deployment-5979f4dc85-9kxft started at 2022-05-03 09:05:23 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container nginx ready: false, restart count 0 May 3 09:05:57.732: INFO: pod2 started at 2022-05-03 09:05:12 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container container1 ready: true, restart count 0 May 3 09:05:57.732: INFO: coredns-6b775575b5-np5vf started at 2022-05-03 08:45:16 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container coredns ready: true, restart count 1 May 3 09:05:57.732: INFO: csi-hostpathplugin-0 started at <nil> (0+0 container statuses recorded) May 3 09:05:57.732: INFO: inline-volume-tester-4s44p started at 2022-05-03 08:58:22 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container csi-volume-tester ready: false, restart count 0 May 3 09:05:57.732: INFO: csi-hostpathplugin-0 started at 2022-05-03 09:05:38 +0000 UTC (0+7 container statuses recorded) May 3 09:05:57.732: INFO: Container csi-attacher ready: true, restart count 0 May 3 09:05:57.732: INFO: Container csi-provisioner ready: true, restart count 0 May 3 09:05:57.732: INFO: Container csi-resizer ready: true, restart count 0 May 3 09:05:57.732: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 09:05:57.732: INFO: Container hostpath ready: true, restart count 0 May 3 09:05:57.732: INFO: Container liveness-probe ready: true, restart count 0 May 3 09:05:57.732: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 09:05:57.732: INFO: run-test started at 2022-05-03 09:05:33 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container run-test ready: false, restart count 0 May 3 09:05:57.732: INFO: httpd started at 2022-05-03 09:05:17 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container httpd ready: true, restart count 0 May 3 09:05:57.732: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-c5lb started at 2022-05-03 08:44:58 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container kube-proxy ready: true, restart count 1 May 3 09:05:57.732: INFO: metadata-proxy-v0.1-96hkj started at 2022-05-03 08:44:58 +0000 UTC (0+2 container statuses recorded) May 3 09:05:57.732: INFO: Container metadata-proxy ready: true, restart count 1 May 3 09:05:57.732: INFO: Container prometheus-to-sd-exporter ready: true, restart count 1 May 3 09:05:57.732: INFO: konnectivity-agent-68zqw started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:05:57.732: INFO: Container konnectivity-agent ready: true, restart count 1 May 3 09:05:58.339: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:05:58.339: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 09:05:58.429: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-j0s7 13534811-02a2-4928-b008-80e6f39177b8 39018 0 2022-05-03 08:44:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-j0s7 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-j0s7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-291":"e2e-c8a0630093-a7d53-minion-group-j0s7"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:21 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 09:05:48 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-05-03 09:05:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-j0s7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817138176 0} {<nil>} 7633924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554994176 0} {<nil>} 7377924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 09:05:11 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 09:05:11 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-05-03 09:05:11 +0000 UTC,LastTransitionTime:2022-05-03 09:00:10 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 09:05:11 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 09:05:11 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 09:05:11 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 09:05:54 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 09:05:54 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 09:05:54 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 09:05:54 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.237.94,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:800822b6a794b56fc75d86f7afc2e1a6,SystemUUID:800822b6-a794-b56f-c75d-86f7afc2e1a6,BootID:c95dcb5d-789d-48b1-8b08-198b7583e648,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/build-image/debian-iptables@sha256:3317c4374ea30d88b64b27740b0edfaa600e410901e727b5bab4c4deac1df6f5 registry.k8s.io/build-image/debian-iptables:bullseye-v1.3.0],SizeBytes:27061409,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:00fcc441ea9f72899c25eed61d602272a2a58c5f0014332bdcb5ac24acef08e4 registry.k8s.io/sig-storage/snapshot-controller:v4.0.0],SizeBytes:18952261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-291^26914d82-cac0-11ec-b1be-b2a8620f7085],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-291^26914d82-cac0-11ec-b1be-b2a8620f7085,DevicePath:,},},Config:nil,},} May 3 09:05:58.430: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 09:05:58.523: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 09:05:58.640: INFO: nfs-server started at 2022-05-03 09:05:30 +0000 UTC (0+1 container statuses recorded) May 3 09:05:58.640: INFO: Container nfs-server ready: true, restart count 0 May 3 09:05:58.640: INFO: deployment-5979f4dc85-5cl2l started at 2022-05-03 09:05:24 +0000 UTC (0+1 container statuses recorded) May 3 09:05:58.640: INFO: Container nginx ready: false, restart count 0 May 3 09:05:58.640: INFO: metadata-proxy-v0.1-86pbj started at 2022-05-03 08:44:57 +0000 UTC (0+2 container statuses recorded) May 3 09:05:58.640: INFO: Container metadata-proxy ready: true, restart count 0 May 3 09:05:58.640: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 09:05:58.640: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-j0s7-hr26j started at <nil> (0+0 container statuses recorded) May 3 09:05:58.640: INFO: external-provisioner-zlpxj started at 2022-05-03 09:03:46 +0000 UTC (0+1 container statuses recorded) May 3 09:05:58.640: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 09:05:58.640: INFO: deployment-5979f4dc85-hsz89 started at 2022-05-03 09:05:24 +0000 UTC (0+1 container statuses recorded) May 3 09:05:58.640: INFO: Container nginx ready: false, restart count 0 May 3 09:05:58.640: INFO: frontend-7f66dbdbfb-gpr2v started at 2022-05-03 09:05:22 +0000 UTC (0+1 container statuses recorded) May 3 09:05:58.640: INFO: Container guestbook-frontend ready: true, restart count 0 May 3 09:05:58.640: INFO: konnectivity-agent-98km6 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:05:58.640: INFO: Container konnectivity-agent ready: true, restart count 0 May 3 09:05:58.640: INFO: indexed-job-3-jflwm started at <nil> (0+0 container statuses recorded) May 3 09:05:58.640: INFO: agnhost-replica-58c8495b-l4l95 started at 2022-05-03 09:05:23 +0000 UTC (0+1 container statuses recorded) May 3 09:05:58.640: INFO: Container replica ready: true, restart count 1 May 3 09:05:58.640: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-j0s7 started at 2022-05-03 08:44:56 +0000 UTC (0+1 container statuses recorded) May 3 09:05:58.640: INFO: Container kube-proxy ready: true, restart count 0 May 3 09:05:58.640: INFO: csi-hostpathplugin-0 started at 2022-05-03 09:05:11 +0000 UTC (0+7 container statuses recorded) May 3 09:05:58.640: INFO: Container csi-attacher ready: true, restart count 0 May 3 09:05:58.640: INFO: Container csi-provisioner ready: true, restart count 0 May 3 09:05:58.640: INFO: Container csi-resizer ready: true, restart count 0 May 3 09:05:58.640: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 09:05:58.640: INFO: Container hostpath ready: true, restart count 0 May 3 09:05:58.640: INFO: Container liveness-probe ready: true, restart count 0 May 3 09:05:58.640: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 09:05:58.640: INFO: netserver-2 started at 2022-05-03 09:05:20 +0000 UTC (0+1 container statuses recorded) May 3 09:05:58.640: INFO: Container webserver ready: true, restart count 0 May 3 09:05:58.640: INFO: pod-subpath-test-preprovisionedpv-sb5t started at 2022-05-03 09:05:43 +0000 UTC (2+1 container statuses recorded) May 3 09:05:58.640: INFO: Init container init-volume-preprovisionedpv-sb5t ready: true, restart count 0 May 3 09:05:58.640: INFO: Init container test-init-subpath-preprovisionedpv-sb5t ready: true, restart count 0 May 3 09:05:58.640: INFO: Container test-container-subpath-preprovisionedpv-sb5t ready: false, restart count 0 May 3 09:05:58.640: INFO: indexed-job-1-fhwtz started at 2022-05-03 09:05:44 +0000 UTC (0+1 container statuses recorded) May 3 09:05:58.640: INFO: Container c ready: false, restart count 0 May 3 09:05:58.640: INFO: busybox-fed66511-79e4-4147-8ba1-010fbaa846ef started at 2022-05-03 09:03:34 +0000 UTC (0+1 container statuses recorded) May 3 09:05:58.640: INFO: Container busybox ready: true, restart count 0 May 3 09:05:58.640: INFO: npd-v0.8.9-dgf5k started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:05:58.640: INFO: Container node-problem-detector ready: true, restart count 0 May 3 09:05:58.640: INFO: pod-1 started at 2022-05-03 09:05:39 +0000 UTC (0+1 container statuses recorded) May 3 09:05:58.640: INFO: Container donothing ready: true, restart count 0 May 3 09:05:58.640: INFO: hostpath-client started at 2022-05-03 09:05:48 +0000 UTC (0+1 container statuses recorded) May 3 09:05:58.640: INFO: Container hostpath-client ready: false, restart count 0 May 3 09:05:58.640: INFO: volume-snapshot-controller-0 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:05:58.640: INFO: Container volume-snapshot-controller ready: true, restart count 0 May 3 09:05:58.640: INFO: test-webserver-6b22b5b7-dc47-4503-bf64-579ea69a2edb started at 2022-05-03 09:03:23 +0000 UTC (0+1 container statuses recorded) May 3 09:05:58.640: INFO: Container test-webserver ready: true, restart count 0 May 3 09:05:59.199: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 09:05:59.199: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "volume-provisioning-8010" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sIn\-tree\sVolumes\s\[Driver\:\slocal\]\[LocalVolumeType\:\sdir\-bindmounted\]\s\[Testpattern\:\sPre\-provisioned\sPV\s\(default\sfs\)\]\ssubPath\sshould\sbe\sable\sto\sunmount\safter\sthe\ssubpath\sdirectory\sis\sdeleted\s\[LinuxOnly\]$'
test/e2e/storage/testsuites/subpath.go:447 May 3 08:59:27.490: Unexpected error: <*errors.StatusError | 0xc003957360>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "error dialing backend: dial timeout, backstop", Reason: "", Details: nil, Code: 500, }, } error dialing backend: dial timeout, backstop occurred test/e2e/storage/utils/local.go:251from junit_13.xml
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Creating a kubernetes client May 3 08:58:20.253: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename provisioning �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should be able to unmount after the subpath directory is deleted [LinuxOnly] test/e2e/storage/testsuites/subpath.go:447 May 3 08:58:20.604: INFO: In-tree plugin kubernetes.io/local-volume is not migrated, not validating any metrics May 3 08:58:32.807: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir /tmp/local-driver-808f4acd-7b72-4f6d-a68c-6b56d0a7d5cd && mount --bind /tmp/local-driver-808f4acd-7b72-4f6d-a68c-6b56d0a7d5cd /tmp/local-driver-808f4acd-7b72-4f6d-a68c-6b56d0a7d5cd] Namespace:provisioning-1938 PodName:hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-r8h2l ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} May 3 08:58:32.807: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:58:32.808: INFO: ExecWithOptions: Clientset creation May 3 08:58:32.808: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/provisioning-1938/pods/hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-r8h2l/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+%2Ftmp%2Flocal-driver-808f4acd-7b72-4f6d-a68c-6b56d0a7d5cd+%26%26+mount+--bind+%2Ftmp%2Flocal-driver-808f4acd-7b72-4f6d-a68c-6b56d0a7d5cd+%2Ftmp%2Flocal-driver-808f4acd-7b72-4f6d-a68c-6b56d0a7d5cd&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 08:58:33.466: INFO: Creating resource for pre-provisioned PV May 3 08:58:33.466: INFO: Creating PVC and PV �[1mSTEP�[0m: Creating a PVC followed by a PV May 3 08:58:33.563: INFO: Waiting for PV local-nm7hd to bind to PVC pvc-tzhd7 May 3 08:58:33.563: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-tzhd7] to have phase Bound May 3 08:58:33.608: INFO: PersistentVolumeClaim pvc-tzhd7 found but phase is Pending instead of Bound. May 3 08:58:35.671: INFO: PersistentVolumeClaim pvc-tzhd7 found but phase is Pending instead of Bound. May 3 08:58:37.749: INFO: PersistentVolumeClaim pvc-tzhd7 found but phase is Pending instead of Bound. May 3 08:58:39.814: INFO: PersistentVolumeClaim pvc-tzhd7 found but phase is Pending instead of Bound. May 3 08:58:41.954: INFO: PersistentVolumeClaim pvc-tzhd7 found but phase is Pending instead of Bound. May 3 08:58:43.995: INFO: PersistentVolumeClaim pvc-tzhd7 found and phase=Bound (10.431721303s) May 3 08:58:43.995: INFO: Waiting up to 3m0s for PersistentVolume local-nm7hd to have phase Bound May 3 08:58:44.036: INFO: PersistentVolume local-nm7hd found and phase=Bound (41.217451ms) �[1mSTEP�[0m: Creating pod pod-subpath-test-preprovisionedpv-pz69 May 3 08:58:50.256: INFO: Running '/go/src/k8s.io/kubernetes/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.22.140 --kubeconfig=/workspace/.kube/config --namespace=provisioning-1938 exec pod-subpath-test-preprovisionedpv-pz69 --container test-container-volume-preprovisionedpv-pz69 -- /bin/sh -c rm -r /test-volume/provisioning-1938' May 3 08:58:50.978: INFO: stderr: "" May 3 08:58:50.978: INFO: stdout: "" �[1mSTEP�[0m: Deleting pod pod-subpath-test-preprovisionedpv-pz69 May 3 08:58:50.978: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-pz69" in namespace "provisioning-1938" May 3 08:58:51.023: INFO: Wait up to 5m0s for pod "pod-subpath-test-preprovisionedpv-pz69" to be fully deleted �[1mSTEP�[0m: Deleting pod May 3 08:58:57.194: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-pz69" in namespace "provisioning-1938" �[1mSTEP�[0m: Deleting pv and pvc May 3 08:58:57.244: INFO: Deleting PersistentVolumeClaim "pvc-tzhd7" May 3 08:58:57.294: INFO: Deleting PersistentVolume "local-nm7hd" �[1mSTEP�[0m: Removing the test directory May 3 08:58:57.357: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c umount /tmp/local-driver-808f4acd-7b72-4f6d-a68c-6b56d0a7d5cd && rm -r /tmp/local-driver-808f4acd-7b72-4f6d-a68c-6b56d0a7d5cd] Namespace:provisioning-1938 PodName:hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-r8h2l ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} May 3 08:58:57.357: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:58:57.357: INFO: ExecWithOptions: Clientset creation May 3 08:58:57.358: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/provisioning-1938/pods/hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-r8h2l/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=umount+%2Ftmp%2Flocal-driver-808f4acd-7b72-4f6d-a68c-6b56d0a7d5cd+%26%26+rm+-r+%2Ftmp%2Flocal-driver-808f4acd-7b72-4f6d-a68c-6b56d0a7d5cd&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 08:59:27.490: INFO: exec e2e-c8a0630093-a7d53-minion-group-7bq2: command: umount /tmp/local-driver-808f4acd-7b72-4f6d-a68c-6b56d0a7d5cd && rm -r /tmp/local-driver-808f4acd-7b72-4f6d-a68c-6b56d0a7d5cd May 3 08:59:27.490: INFO: exec e2e-c8a0630093-a7d53-minion-group-7bq2: stdout: "" May 3 08:59:27.490: INFO: exec e2e-c8a0630093-a7d53-minion-group-7bq2: stderr: "" May 3 08:59:27.490: INFO: exec e2e-c8a0630093-a7d53-minion-group-7bq2: exit code: 0 May 3 08:59:27.490: FAIL: Unexpected error: <*errors.StatusError | 0xc003957360>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "error dialing backend: dial timeout, backstop", Reason: "", Details: nil, Code: 500, }, } error dialing backend: dial timeout, backstop occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).cleanupLocalVolumeDirectoryBindMounted(0xc0031c5b00, 0xc003632500) test/e2e/storage/utils/local.go:251 +0xf2 k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).Remove(0x22?, 0xc00276c000?) test/e2e/storage/utils/local.go:345 +0x128 k8s.io/kubernetes/test/e2e/storage/drivers.(*localVolume).DeleteVolume(0xc0015b0e10?) test/e2e/storage/drivers/in_tree.go:1950 +0x28 k8s.io/kubernetes/test/e2e/storage/utils.TryFunc(0x7a6bff8?) test/e2e/storage/utils/utils.go:769 +0x6d k8s.io/kubernetes/test/e2e/storage/framework.(*VolumeResource).CleanupResource(0xc00255ce40) test/e2e/storage/framework/volume_resource.go:228 +0xc6d k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func2() test/e2e/storage/testsuites/subpath.go:179 +0x12d k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func20() test/e2e/storage/testsuites/subpath.go:475 +0x4c9 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000e87fb0?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x1?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000f04340, 0x73fa160) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: Deleting pod hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-r8h2l in namespace provisioning-1938 [AfterEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/framework/framework.go:188 �[1mSTEP�[0m: Collecting events from namespace "provisioning-1938". �[1mSTEP�[0m: Found 14 events. May 3 08:59:27.841: INFO: At 2022-05-03 08:58:20 +0000 UTC - event for hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-r8h2l: {default-scheduler } Scheduled: Successfully assigned provisioning-1938/hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-r8h2l to e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:27.841: INFO: At 2022-05-03 08:58:22 +0000 UTC - event for hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-r8h2l: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 08:59:27.841: INFO: At 2022-05-03 08:58:22 +0000 UTC - event for hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-r8h2l: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Created: Created container agnhost-container May 3 08:59:27.841: INFO: At 2022-05-03 08:58:22 +0000 UTC - event for hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-r8h2l: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Started: Started container agnhost-container May 3 08:59:27.841: INFO: At 2022-05-03 08:58:33 +0000 UTC - event for pvc-tzhd7: {persistentvolume-controller } ProvisioningFailed: storageclass.storage.k8s.io "provisioning-1938" not found May 3 08:59:27.841: INFO: At 2022-05-03 08:58:44 +0000 UTC - event for pod-subpath-test-preprovisionedpv-pz69: {default-scheduler } Scheduled: Successfully assigned provisioning-1938/pod-subpath-test-preprovisionedpv-pz69 to e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:27.841: INFO: At 2022-05-03 08:58:44 +0000 UTC - event for pod-subpath-test-preprovisionedpv-pz69: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 08:59:27.841: INFO: At 2022-05-03 08:58:44 +0000 UTC - event for pod-subpath-test-preprovisionedpv-pz69: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Created: Created container test-container-subpath-preprovisionedpv-pz69 May 3 08:59:27.841: INFO: At 2022-05-03 08:58:44 +0000 UTC - event for pod-subpath-test-preprovisionedpv-pz69: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Started: Started container test-container-subpath-preprovisionedpv-pz69 May 3 08:59:27.841: INFO: At 2022-05-03 08:58:45 +0000 UTC - event for pod-subpath-test-preprovisionedpv-pz69: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine May 3 08:59:27.841: INFO: At 2022-05-03 08:58:45 +0000 UTC - event for pod-subpath-test-preprovisionedpv-pz69: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Created: Created container test-container-volume-preprovisionedpv-pz69 May 3 08:59:27.841: INFO: At 2022-05-03 08:58:45 +0000 UTC - event for pod-subpath-test-preprovisionedpv-pz69: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Started: Started container test-container-volume-preprovisionedpv-pz69 May 3 08:59:27.841: INFO: At 2022-05-03 08:58:51 +0000 UTC - event for pod-subpath-test-preprovisionedpv-pz69: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Killing: Stopping container test-container-volume-preprovisionedpv-pz69 May 3 08:59:27.841: INFO: At 2022-05-03 08:59:27 +0000 UTC - event for hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-r8h2l: {kubelet e2e-c8a0630093-a7d53-minion-group-7bq2} Killing: Stopping container agnhost-container May 3 08:59:27.905: INFO: POD NODE PHASE GRACE CONDITIONS May 3 08:59:27.905: INFO: May 3 08:59:28.010: INFO: Logging node info for node e2e-c8a0630093-a7d53-master May 3 08:59:28.105: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-master b19f1e35-3444-417f-aa8a-059f422baac1 21446 0 2022-05-03 08:44:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-05-03 08:44:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 08:45:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3860037632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3597893632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:44:59 +0000 UTC,LastTransitionTime:2022-05-03 08:44:59 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.22.140,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bcd3f659cc761bdb6efbff38fefe4e19,SystemUUID:bcd3f659-cc76-1bdb-6efb-ff38fefe4e19,BootID:f91b8838-f530-4990-b2a6-3b369f82164e,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:131049939,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:120695609,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:52333368,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 08:59:28.105: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-master May 3 08:59:28.196: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-master May 3 08:59:38.057: INFO: etcd-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.057: INFO: Container etcd-container ready: true, restart count 0 May 3 08:59:38.057: INFO: konnectivity-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.057: INFO: Container konnectivity-server-container ready: true, restart count 0 May 3 08:59:38.057: INFO: kube-apiserver-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.057: INFO: Container kube-apiserver ready: true, restart count 1 May 3 08:59:38.057: INFO: metadata-proxy-v0.1-blclk started at 2022-05-03 08:45:06 +0000 UTC (0+2 container statuses recorded) May 3 08:59:38.057: INFO: Container metadata-proxy ready: true, restart count 0 May 3 08:59:38.057: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 08:59:38.057: INFO: etcd-server-events-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.057: INFO: Container etcd-container ready: true, restart count 0 May 3 08:59:38.057: INFO: kube-controller-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.057: INFO: Container kube-controller-manager ready: true, restart count 2 May 3 08:59:38.057: INFO: kube-scheduler-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.057: INFO: Container kube-scheduler ready: true, restart count 0 May 3 08:59:38.057: INFO: kube-addon-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.057: INFO: Container kube-addon-manager ready: true, restart count 0 May 3 08:59:38.057: INFO: l7-lb-controller-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:13 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.057: INFO: Container l7-lb-controller ready: true, restart count 3 May 3 08:59:38.418: INFO: Latency metrics for node e2e-c8a0630093-a7d53-master May 3 08:59:38.418: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:38.533: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-7bq2 bfa6e413-94d8-452c-a687-5f8ae9ea5b7c 27885 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-7bq2 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-7bq2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-6774":"e2e-c8a0630093-a7d53-minion-group-7bq2","csi-mock-csi-mock-volumes-4868":"e2e-c8a0630093-a7d53-minion-group-7bq2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 08:56:35 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 08:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-7bq2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:45:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:35.197.55.130,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f84a54b770444ef2c7de26e5ab984f78,SystemUUID:f84a54b7-7044-4ef2-c7de-26e5ab984f78,BootID:950b58bb-5fcd-4efa-a61d-cbb738103018,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 08:59:38.533: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:38.601: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:38.763: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-zxhh5 started at 2022-05-03 08:58:18 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.763: INFO: Container agnhost-container ready: true, restart count 0 May 3 08:59:38.763: INFO: ss2-2 started at 2022-05-03 08:58:11 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.763: INFO: Container webserver ready: true, restart count 0 May 3 08:59:38.763: INFO: external-provisioner-dwb56 started at 2022-05-03 08:56:28 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.763: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 08:59:38.763: INFO: external-provisioner-skff4 started at 2022-05-03 08:58:13 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.763: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 08:59:38.763: INFO: csi-mockplugin-resizer-0 started at 2022-05-03 08:56:55 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.763: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:38.763: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-7bq2 started at 2022-05-03 08:44:57 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.763: INFO: Container kube-proxy ready: true, restart count 0 May 3 08:59:38.763: INFO: netserver-0 started at 2022-05-03 08:58:07 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.763: INFO: Container webserver ready: true, restart count 0 May 3 08:59:38.763: INFO: csi-mockplugin-0 started at 2022-05-03 08:56:55 +0000 UTC (0+3 container statuses recorded) May 3 08:59:38.763: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:38.763: INFO: Container driver-registrar ready: true, restart count 0 May 3 08:59:38.763: INFO: Container mock ready: true, restart count 0 May 3 08:59:38.763: INFO: netserver-0 started at 2022-05-03 08:57:29 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.763: INFO: Container webserver ready: true, restart count 0 May 3 08:59:38.763: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:58:01 +0000 UTC (0+7 container statuses recorded) May 3 08:59:38.763: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:38.763: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:38.763: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:38.763: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:38.763: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:38.763: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:38.763: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:38.763: INFO: coredns-6b775575b5-w454s started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.763: INFO: Container coredns ready: true, restart count 0 May 3 08:59:38.763: INFO: konnectivity-agent-r2m8v started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.763: INFO: Container konnectivity-agent ready: true, restart count 0 May 3 08:59:38.763: INFO: kube-dns-autoscaler-c6c49f5f6-t54xb started at 2022-05-03 08:56:29 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.763: INFO: Container autoscaler ready: true, restart count 0 May 3 08:59:38.763: INFO: netserver-0 started at 2022-05-03 08:57:52 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.763: INFO: Container webserver ready: true, restart count 0 May 3 08:59:38.763: INFO: npd-v0.8.9-lxnv5 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.763: INFO: Container node-problem-detector ready: true, restart count 0 May 3 08:59:38.763: INFO: metadata-proxy-v0.1-27ljg started at 2022-05-03 08:44:58 +0000 UTC (0+2 container statuses recorded) May 3 08:59:38.763: INFO: Container metadata-proxy ready: true, restart count 0 May 3 08:59:38.763: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 08:59:38.763: INFO: csi-mockplugin-attacher-0 started at 2022-05-03 08:56:55 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.763: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:38.763: INFO: l7-default-backend-bb7fb94cb-jt2kv started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.763: INFO: Container default-http-backend ready: true, restart count 0 May 3 08:59:38.763: INFO: httpd started at 2022-05-03 08:59:03 +0000 UTC (0+1 container statuses recorded) May 3 08:59:38.763: INFO: Container httpd ready: true, restart count 0 May 3 08:59:39.418: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:39.418: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:39.474: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-c5lb e86bdeb4-972e-4590-a8a1-92d331988301 27865 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-c5lb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-c5lb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-05-03 08:57:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2022-05-03 08:59:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-05-03 08:59:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"Ready\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-c5lb,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoSchedule,TimeAdded:2022-05-03 08:59:18 +0000 UTC,},Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoExecute,TimeAdded:2022-05-03 08:59:23 +0000 UTC,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:DiskPressure,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:PIDPressure,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:Ready,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.151.125,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:97eaceafa1dcc38dfa191fea843250cf,SystemUUID:97eaceaf-a1dc-c38d-fa19-1fea843250cf,BootID:eddb2e60-9b10-4c23-9e89-f2539bba18c7,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 08:59:39.474: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:39.533: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:39.633: INFO: Unable to retrieve kubelet pods for node e2e-c8a0630093-a7d53-minion-group-c5lb: error trying to reach service: dial tcp 10.40.0.3:10250: connect: connection refused May 3 08:59:39.633: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:39.713: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-j0s7 13534811-02a2-4928-b008-80e6f39177b8 27875 0 2022-05-03 08:44:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-j0s7 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-j0s7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-132":"e2e-c8a0630093-a7d53-minion-group-j0s7","csi-hostpath-ephemeral-928":"e2e-c8a0630093-a7d53-minion-group-j0s7","csi-hostpath-provisioning-1259":"e2e-c8a0630093-a7d53-minion-group-j0s7"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:21 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 08:59:21 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-05-03 08:59:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-j0s7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817138176 0} {<nil>} 7633924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554994176 0} {<nil>} 7377924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.237.94,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:800822b6a794b56fc75d86f7afc2e1a6,SystemUUID:800822b6-a794-b56f-c75d-86f7afc2e1a6,BootID:c95dcb5d-789d-48b1-8b08-198b7583e648,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/build-image/debian-iptables@sha256:3317c4374ea30d88b64b27740b0edfaa600e410901e727b5bab4c4deac1df6f5 registry.k8s.io/build-image/debian-iptables:bullseye-v1.3.0],SizeBytes:27061409,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:00fcc441ea9f72899c25eed61d602272a2a58c5f0014332bdcb5ac24acef08e4 registry.k8s.io/sig-storage/snapshot-controller:v4.0.0],SizeBytes:18952261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-928^50cccb5b-cabf-11ec-85c1-1e399d5f0c6b],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-928^50cccb5b-cabf-11ec-85c1-1e399d5f0c6b,DevicePath:,},},Config:nil,},} May 3 08:59:39.713: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:39.776: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:39.966: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-j0s7 started at 2022-05-03 08:44:56 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.966: INFO: Container kube-proxy ready: true, restart count 0 May 3 08:59:39.966: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-j0s7-rck49 started at 2022-05-03 08:58:36 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.966: INFO: Container agnhost-container ready: true, restart count 0 May 3 08:59:39.966: INFO: netserver-2 started at 2022-05-03 08:57:06 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.966: INFO: Container webserver ready: true, restart count 0 May 3 08:59:39.966: INFO: netserver-2 started at 2022-05-03 08:57:52 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.966: INFO: Container webserver ready: true, restart count 0 May 3 08:59:39.966: INFO: npd-v0.8.9-dgf5k started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.966: INFO: Container node-problem-detector ready: true, restart count 0 May 3 08:59:39.966: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:58:08 +0000 UTC (0+7 container statuses recorded) May 3 08:59:39.966: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:39.966: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:39.966: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:39.966: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:39.966: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:39.966: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:39.966: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:39.966: INFO: volume-snapshot-controller-0 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.966: INFO: Container volume-snapshot-controller ready: true, restart count 0 May 3 08:59:39.966: INFO: rand-non-local-7rpz7 started at 2022-05-03 08:58:44 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.966: INFO: Container c ready: false, restart count 0 May 3 08:59:39.966: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:59:16 +0000 UTC (0+7 container statuses recorded) May 3 08:59:39.966: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:39.966: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:39.966: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:39.966: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:39.966: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:39.966: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:39.966: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:39.966: INFO: metadata-proxy-v0.1-86pbj started at 2022-05-03 08:44:57 +0000 UTC (0+2 container statuses recorded) May 3 08:59:39.966: INFO: Container metadata-proxy ready: true, restart count 0 May 3 08:59:39.966: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 08:59:39.966: INFO: inline-volume-tester-8x7vv started at 2022-05-03 08:59:20 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.966: INFO: Container csi-volume-tester ready: true, restart count 0 May 3 08:59:39.966: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:56:40 +0000 UTC (0+7 container statuses recorded) May 3 08:59:39.966: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:39.966: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:39.966: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:39.966: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:39.966: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:39.966: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:39.966: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:39.966: INFO: ss2-0 started at 2022-05-03 08:57:52 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.966: INFO: Container webserver ready: true, restart count 0 May 3 08:59:39.966: INFO: netserver-2 started at 2022-05-03 08:58:07 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.966: INFO: Container webserver ready: true, restart count 0 May 3 08:59:39.966: INFO: konnectivity-agent-98km6 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.966: INFO: Container konnectivity-agent ready: true, restart count 0 May 3 08:59:39.966: INFO: test-container-pod started at 2022-05-03 08:57:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.966: INFO: Container webserver ready: true, restart count 0 May 3 08:59:39.966: INFO: external-provisioner-mh5tk started at 2022-05-03 08:57:54 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.966: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 08:59:39.966: INFO: netserver-2 started at 2022-05-03 08:57:29 +0000 UTC (0+1 container statuses recorded) May 3 08:59:39.966: INFO: Container webserver ready: true, restart count 0 May 3 08:59:40.534: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:40.534: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready May 3 08:59:40.598: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:42.769: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:44.719: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:46.730: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:48.717: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:50.716: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:52.717: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:54.717: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:56.718: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:58.717: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:00.723: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:02.722: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:04.718: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:06.718: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:08.718: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:10.716: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:12.719: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:14.722: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:16.740: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:18.724: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:20.717: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:22.725: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:24.717: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:26.734: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is true, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:28.717: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is true, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure �[1mSTEP�[0m: Destroying namespace "provisioning-1938" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sIn\-tree\sVolumes\s\[Driver\:\slocal\]\[LocalVolumeType\:\sdir\]\s\[Testpattern\:\sPre\-provisioned\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\sexisting\sdirectories\swhen\sreadOnly\sspecified\sin\sthe\svolumeSource$'
test/e2e/storage/testsuites/subpath.go:397 May 3 08:59:41.465: Unexpected error: <*errors.StatusError | 0xc003b0f680>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "error dialing backend: dial timeout, backstop", Reason: "", Details: nil, Code: 500, }, } error dialing backend: dial timeout, backstop occurred test/e2e/storage/utils/local.go:211from junit_17.xml
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Creating a kubernetes client May 3 08:58:36.144: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename provisioning �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should support existing directories when readOnly specified in the volumeSource test/e2e/storage/testsuites/subpath.go:397 May 3 08:58:36.487: INFO: In-tree plugin kubernetes.io/local-volume is not migrated, not validating any metrics May 3 08:58:42.917: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-driver-17e1a646-1ebe-445f-b8a1-bf544c78580e] Namespace:provisioning-9012 PodName:hostexec-e2e-c8a0630093-a7d53-minion-group-j0s7-rck49 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} May 3 08:58:42.917: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:58:42.918: INFO: ExecWithOptions: Clientset creation May 3 08:58:42.918: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/provisioning-9012/pods/hostexec-e2e-c8a0630093-a7d53-minion-group-j0s7-rck49/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-driver-17e1a646-1ebe-445f-b8a1-bf544c78580e&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 08:58:43.711: INFO: Creating resource for pre-provisioned PV May 3 08:58:43.711: INFO: Creating PVC and PV �[1mSTEP�[0m: Creating a PVC followed by a PV May 3 08:58:43.798: INFO: Waiting for PV local-8sd98 to bind to PVC pvc-7kfq9 May 3 08:58:43.798: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-7kfq9] to have phase Bound May 3 08:58:43.839: INFO: PersistentVolumeClaim pvc-7kfq9 found but phase is Pending instead of Bound. May 3 08:58:45.886: INFO: PersistentVolumeClaim pvc-7kfq9 found but phase is Pending instead of Bound. May 3 08:58:47.928: INFO: PersistentVolumeClaim pvc-7kfq9 found but phase is Pending instead of Bound. May 3 08:58:49.970: INFO: PersistentVolumeClaim pvc-7kfq9 found but phase is Pending instead of Bound. May 3 08:58:52.014: INFO: PersistentVolumeClaim pvc-7kfq9 found but phase is Pending instead of Bound. May 3 08:58:54.059: INFO: PersistentVolumeClaim pvc-7kfq9 found but phase is Pending instead of Bound. May 3 08:58:56.101: INFO: PersistentVolumeClaim pvc-7kfq9 found but phase is Pending instead of Bound. May 3 08:58:58.144: INFO: PersistentVolumeClaim pvc-7kfq9 found and phase=Bound (14.346126428s) May 3 08:58:58.144: INFO: Waiting up to 3m0s for PersistentVolume local-8sd98 to have phase Bound May 3 08:58:58.186: INFO: PersistentVolume local-8sd98 found and phase=Bound (41.402103ms) �[1mSTEP�[0m: Creating pod pod-subpath-test-preprovisionedpv-jnkw �[1mSTEP�[0m: Creating a pod to test subpath May 3 08:58:58.335: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-jnkw" in namespace "provisioning-9012" to be "Succeeded or Failed" May 3 08:58:58.376: INFO: Pod "pod-subpath-test-preprovisionedpv-jnkw": Phase="Pending", Reason="", readiness=false. Elapsed: 41.400715ms May 3 08:59:00.419: INFO: Pod "pod-subpath-test-preprovisionedpv-jnkw": Phase="Pending", Reason="", readiness=false. Elapsed: 2.084094071s May 3 08:59:02.462: INFO: Pod "pod-subpath-test-preprovisionedpv-jnkw": Phase="Pending", Reason="", readiness=false. Elapsed: 4.127683292s May 3 08:59:04.516: INFO: Pod "pod-subpath-test-preprovisionedpv-jnkw": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.181043695s �[1mSTEP�[0m: Saw pod success May 3 08:59:04.516: INFO: Pod "pod-subpath-test-preprovisionedpv-jnkw" satisfied condition "Succeeded or Failed" May 3 08:59:04.560: INFO: Trying to get logs from node e2e-c8a0630093-a7d53-minion-group-j0s7 pod pod-subpath-test-preprovisionedpv-jnkw container test-container-subpath-preprovisionedpv-jnkw: <nil> �[1mSTEP�[0m: delete the pod May 3 08:59:04.677: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-jnkw to disappear May 3 08:59:04.724: INFO: Pod pod-subpath-test-preprovisionedpv-jnkw no longer exists �[1mSTEP�[0m: Deleting pod pod-subpath-test-preprovisionedpv-jnkw May 3 08:59:04.724: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-jnkw" in namespace "provisioning-9012" �[1mSTEP�[0m: Creating pod pod-subpath-test-preprovisionedpv-jnkw �[1mSTEP�[0m: Creating a pod to test subpath May 3 08:59:04.809: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-jnkw" in namespace "provisioning-9012" to be "Succeeded or Failed" May 3 08:59:04.852: INFO: Pod "pod-subpath-test-preprovisionedpv-jnkw": Phase="Pending", Reason="", readiness=false. Elapsed: 42.767226ms May 3 08:59:06.895: INFO: Pod "pod-subpath-test-preprovisionedpv-jnkw": Phase="Pending", Reason="", readiness=false. Elapsed: 2.08576956s May 3 08:59:08.939: INFO: Pod "pod-subpath-test-preprovisionedpv-jnkw": Phase="Pending", Reason="", readiness=false. Elapsed: 4.129534512s May 3 08:59:10.982: INFO: Pod "pod-subpath-test-preprovisionedpv-jnkw": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.173034415s �[1mSTEP�[0m: Saw pod success May 3 08:59:10.983: INFO: Pod "pod-subpath-test-preprovisionedpv-jnkw" satisfied condition "Succeeded or Failed" May 3 08:59:11.025: INFO: Trying to get logs from node e2e-c8a0630093-a7d53-minion-group-j0s7 pod pod-subpath-test-preprovisionedpv-jnkw container test-container-subpath-preprovisionedpv-jnkw: <nil> �[1mSTEP�[0m: delete the pod May 3 08:59:11.121: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-jnkw to disappear May 3 08:59:11.163: INFO: Pod pod-subpath-test-preprovisionedpv-jnkw no longer exists �[1mSTEP�[0m: Deleting pod pod-subpath-test-preprovisionedpv-jnkw May 3 08:59:11.163: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-jnkw" in namespace "provisioning-9012" �[1mSTEP�[0m: Deleting pod May 3 08:59:11.203: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-jnkw" in namespace "provisioning-9012" �[1mSTEP�[0m: Deleting pv and pvc May 3 08:59:11.244: INFO: Deleting PersistentVolumeClaim "pvc-7kfq9" May 3 08:59:11.287: INFO: Deleting PersistentVolume "local-8sd98" �[1mSTEP�[0m: Removing the test directory May 3 08:59:11.330: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-driver-17e1a646-1ebe-445f-b8a1-bf544c78580e] Namespace:provisioning-9012 PodName:hostexec-e2e-c8a0630093-a7d53-minion-group-j0s7-rck49 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} May 3 08:59:11.330: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:59:11.331: INFO: ExecWithOptions: Clientset creation May 3 08:59:11.331: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/provisioning-9012/pods/hostexec-e2e-c8a0630093-a7d53-minion-group-j0s7-rck49/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-driver-17e1a646-1ebe-445f-b8a1-bf544c78580e&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 08:59:41.464: INFO: exec e2e-c8a0630093-a7d53-minion-group-j0s7: command: rm -r /tmp/local-driver-17e1a646-1ebe-445f-b8a1-bf544c78580e May 3 08:59:41.464: INFO: exec e2e-c8a0630093-a7d53-minion-group-j0s7: stdout: "" May 3 08:59:41.464: INFO: exec e2e-c8a0630093-a7d53-minion-group-j0s7: stderr: "" May 3 08:59:41.464: INFO: exec e2e-c8a0630093-a7d53-minion-group-j0s7: exit code: 0 May 3 08:59:41.465: FAIL: Unexpected error: <*errors.StatusError | 0xc003b0f680>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "error dialing backend: dial timeout, backstop", Reason: "", Details: nil, Code: 500, }, } error dialing backend: dial timeout, backstop occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).cleanupLocalVolumeDirectory(0xc002bff650, 0xc002ed0380) test/e2e/storage/utils/local.go:211 +0xc5 k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).Remove(0x22?, 0xc0026b60d0?) test/e2e/storage/utils/local.go:341 +0x4b k8s.io/kubernetes/test/e2e/storage/drivers.(*localVolume).DeleteVolume(0xc002ea2e50?) test/e2e/storage/drivers/in_tree.go:1950 +0x28 k8s.io/kubernetes/test/e2e/storage/utils.TryFunc(0x7a6bff8?) test/e2e/storage/utils/utils.go:769 +0x6d k8s.io/kubernetes/test/e2e/storage/framework.(*VolumeResource).CleanupResource(0xc00232aa80) test/e2e/storage/framework/volume_resource.go:228 +0xc6d k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func2() test/e2e/storage/testsuites/subpath.go:179 +0x12d k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func18() test/e2e/storage/testsuites/subpath.go:423 +0x31d k8s.io/kubernetes/test/e2e.RunE2ETests(0x257e5b7?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0x0?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000a6c820, 0x73fa160) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: Deleting pod hostexec-e2e-c8a0630093-a7d53-minion-group-j0s7-rck49 in namespace provisioning-9012 [AfterEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/framework/framework.go:188 �[1mSTEP�[0m: Collecting events from namespace "provisioning-9012". �[1mSTEP�[0m: Found 22 events. May 3 08:59:41.611: INFO: At 2022-05-03 08:58:36 +0000 UTC - event for hostexec-e2e-c8a0630093-a7d53-minion-group-j0s7-rck49: {default-scheduler } Scheduled: Successfully assigned provisioning-9012/hostexec-e2e-c8a0630093-a7d53-minion-group-j0s7-rck49 to e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:41.611: INFO: At 2022-05-03 08:58:37 +0000 UTC - event for hostexec-e2e-c8a0630093-a7d53-minion-group-j0s7-rck49: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 08:59:41.611: INFO: At 2022-05-03 08:58:37 +0000 UTC - event for hostexec-e2e-c8a0630093-a7d53-minion-group-j0s7-rck49: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Created: Created container agnhost-container May 3 08:59:41.611: INFO: At 2022-05-03 08:58:38 +0000 UTC - event for hostexec-e2e-c8a0630093-a7d53-minion-group-j0s7-rck49: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Started: Started container agnhost-container May 3 08:59:41.611: INFO: At 2022-05-03 08:58:43 +0000 UTC - event for pvc-7kfq9: {persistentvolume-controller } ProvisioningFailed: storageclass.storage.k8s.io "provisioning-9012" not found May 3 08:59:41.611: INFO: At 2022-05-03 08:58:58 +0000 UTC - event for pod-subpath-test-preprovisionedpv-jnkw: {default-scheduler } Scheduled: Successfully assigned provisioning-9012/pod-subpath-test-preprovisionedpv-jnkw to e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:41.611: INFO: At 2022-05-03 08:58:58 +0000 UTC - event for pod-subpath-test-preprovisionedpv-jnkw: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine May 3 08:59:41.611: INFO: At 2022-05-03 08:58:58 +0000 UTC - event for pod-subpath-test-preprovisionedpv-jnkw: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Created: Created container init-volume-preprovisionedpv-jnkw May 3 08:59:41.611: INFO: At 2022-05-03 08:58:58 +0000 UTC - event for pod-subpath-test-preprovisionedpv-jnkw: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Started: Started container init-volume-preprovisionedpv-jnkw May 3 08:59:41.611: INFO: At 2022-05-03 08:58:59 +0000 UTC - event for pod-subpath-test-preprovisionedpv-jnkw: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 08:59:41.611: INFO: At 2022-05-03 08:58:59 +0000 UTC - event for pod-subpath-test-preprovisionedpv-jnkw: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Created: Created container test-init-subpath-preprovisionedpv-jnkw May 3 08:59:41.611: INFO: At 2022-05-03 08:58:59 +0000 UTC - event for pod-subpath-test-preprovisionedpv-jnkw: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Started: Started container test-init-subpath-preprovisionedpv-jnkw May 3 08:59:41.611: INFO: At 2022-05-03 08:59:00 +0000 UTC - event for pod-subpath-test-preprovisionedpv-jnkw: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 08:59:41.611: INFO: At 2022-05-03 08:59:00 +0000 UTC - event for pod-subpath-test-preprovisionedpv-jnkw: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Created: Created container test-container-subpath-preprovisionedpv-jnkw May 3 08:59:41.611: INFO: At 2022-05-03 08:59:00 +0000 UTC - event for pod-subpath-test-preprovisionedpv-jnkw: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Started: Started container test-container-subpath-preprovisionedpv-jnkw May 3 08:59:41.611: INFO: At 2022-05-03 08:59:04 +0000 UTC - event for pod-subpath-test-preprovisionedpv-jnkw: {default-scheduler } Scheduled: Successfully assigned provisioning-9012/pod-subpath-test-preprovisionedpv-jnkw to e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:41.611: INFO: At 2022-05-03 08:59:05 +0000 UTC - event for pod-subpath-test-preprovisionedpv-jnkw: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} FileSystemResizeFailed: MountVolume.NodeExpandVolume failed for volume "local-8sd98" requested read-only file system May 3 08:59:41.611: INFO: At 2022-05-03 08:59:05 +0000 UTC - event for pvc-7kfq9: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} FileSystemResizeFailed: MountVolume.NodeExpandVolume failed for volume "local-8sd98" requested read-only file system May 3 08:59:41.611: INFO: At 2022-05-03 08:59:06 +0000 UTC - event for pod-subpath-test-preprovisionedpv-jnkw: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 08:59:41.611: INFO: At 2022-05-03 08:59:06 +0000 UTC - event for pod-subpath-test-preprovisionedpv-jnkw: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Created: Created container test-container-subpath-preprovisionedpv-jnkw May 3 08:59:41.611: INFO: At 2022-05-03 08:59:06 +0000 UTC - event for pod-subpath-test-preprovisionedpv-jnkw: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Started: Started container test-container-subpath-preprovisionedpv-jnkw May 3 08:59:41.611: INFO: At 2022-05-03 08:59:41 +0000 UTC - event for hostexec-e2e-c8a0630093-a7d53-minion-group-j0s7-rck49: {kubelet e2e-c8a0630093-a7d53-minion-group-j0s7} Killing: Stopping container agnhost-container May 3 08:59:41.655: INFO: POD NODE PHASE GRACE CONDITIONS May 3 08:59:41.655: INFO: May 3 08:59:41.735: INFO: Logging node info for node e2e-c8a0630093-a7d53-master May 3 08:59:41.778: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-master b19f1e35-3444-417f-aa8a-059f422baac1 21446 0 2022-05-03 08:44:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-05-03 08:44:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 08:45:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3860037632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3597893632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:44:59 +0000 UTC,LastTransitionTime:2022-05-03 08:44:59 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.22.140,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bcd3f659cc761bdb6efbff38fefe4e19,SystemUUID:bcd3f659-cc76-1bdb-6efb-ff38fefe4e19,BootID:f91b8838-f530-4990-b2a6-3b369f82164e,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:131049939,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:120695609,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:52333368,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 08:59:41.779: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-master May 3 08:59:41.824: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-master May 3 08:59:41.897: INFO: metadata-proxy-v0.1-blclk started at 2022-05-03 08:45:06 +0000 UTC (0+2 container statuses recorded) May 3 08:59:41.897: INFO: Container metadata-proxy ready: true, restart count 0 May 3 08:59:41.897: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 08:59:41.897: INFO: etcd-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:41.897: INFO: Container etcd-container ready: true, restart count 0 May 3 08:59:41.897: INFO: konnectivity-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:41.897: INFO: Container konnectivity-server-container ready: true, restart count 0 May 3 08:59:41.897: INFO: kube-apiserver-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:41.897: INFO: Container kube-apiserver ready: true, restart count 1 May 3 08:59:41.897: INFO: kube-addon-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:41.897: INFO: Container kube-addon-manager ready: true, restart count 0 May 3 08:59:41.897: INFO: l7-lb-controller-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:13 +0000 UTC (0+1 container statuses recorded) May 3 08:59:41.897: INFO: Container l7-lb-controller ready: true, restart count 3 May 3 08:59:41.897: INFO: etcd-server-events-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:41.897: INFO: Container etcd-container ready: true, restart count 0 May 3 08:59:41.897: INFO: kube-controller-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:41.897: INFO: Container kube-controller-manager ready: true, restart count 2 May 3 08:59:41.897: INFO: kube-scheduler-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:41.897: INFO: Container kube-scheduler ready: true, restart count 0 May 3 08:59:42.105: INFO: Latency metrics for node e2e-c8a0630093-a7d53-master May 3 08:59:42.105: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:42.149: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-7bq2 bfa6e413-94d8-452c-a687-5f8ae9ea5b7c 27885 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-7bq2 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-7bq2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-6774":"e2e-c8a0630093-a7d53-minion-group-7bq2","csi-mock-csi-mock-volumes-4868":"e2e-c8a0630093-a7d53-minion-group-7bq2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 08:56:35 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 08:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-7bq2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 08:55:19 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:45:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:35.197.55.130,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f84a54b770444ef2c7de26e5ab984f78,SystemUUID:f84a54b7-7044-4ef2-c7de-26e5ab984f78,BootID:950b58bb-5fcd-4efa-a61d-cbb738103018,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 08:59:42.149: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:42.193: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:42.309: INFO: kube-dns-autoscaler-c6c49f5f6-t54xb started at 2022-05-03 08:56:29 +0000 UTC (0+1 container statuses recorded) May 3 08:59:42.309: INFO: Container autoscaler ready: true, restart count 0 May 3 08:59:42.309: INFO: netserver-0 started at 2022-05-03 08:57:52 +0000 UTC (0+1 container statuses recorded) May 3 08:59:42.309: INFO: Container webserver ready: true, restart count 0 May 3 08:59:42.309: INFO: npd-v0.8.9-lxnv5 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:42.309: INFO: Container node-problem-detector ready: true, restart count 0 May 3 08:59:42.309: INFO: csi-mockplugin-attacher-0 started at 2022-05-03 08:56:55 +0000 UTC (0+1 container statuses recorded) May 3 08:59:42.309: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:42.309: INFO: metadata-proxy-v0.1-27ljg started at 2022-05-03 08:44:58 +0000 UTC (0+2 container statuses recorded) May 3 08:59:42.309: INFO: Container metadata-proxy ready: true, restart count 0 May 3 08:59:42.309: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 08:59:42.309: INFO: l7-default-backend-bb7fb94cb-jt2kv started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:42.309: INFO: Container default-http-backend ready: true, restart count 0 May 3 08:59:42.309: INFO: httpd started at 2022-05-03 08:59:03 +0000 UTC (0+1 container statuses recorded) May 3 08:59:42.309: INFO: Container httpd ready: true, restart count 0 May 3 08:59:42.309: INFO: ss2-2 started at 2022-05-03 08:58:11 +0000 UTC (0+1 container statuses recorded) May 3 08:59:42.309: INFO: Container webserver ready: true, restart count 0 May 3 08:59:42.309: INFO: external-provisioner-dwb56 started at 2022-05-03 08:56:28 +0000 UTC (0+1 container statuses recorded) May 3 08:59:42.309: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 08:59:42.309: INFO: external-provisioner-skff4 started at 2022-05-03 08:58:13 +0000 UTC (0+1 container statuses recorded) May 3 08:59:42.309: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 08:59:42.309: INFO: csi-mockplugin-resizer-0 started at 2022-05-03 08:56:55 +0000 UTC (0+1 container statuses recorded) May 3 08:59:42.309: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:42.309: INFO: netserver-0 started at 2022-05-03 08:58:07 +0000 UTC (0+1 container statuses recorded) May 3 08:59:42.309: INFO: Container webserver ready: true, restart count 0 May 3 08:59:42.309: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-7bq2 started at 2022-05-03 08:44:57 +0000 UTC (0+1 container statuses recorded) May 3 08:59:42.309: INFO: Container kube-proxy ready: true, restart count 0 May 3 08:59:42.309: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:58:01 +0000 UTC (0+7 container statuses recorded) May 3 08:59:42.309: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:42.309: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:42.309: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:42.309: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:42.309: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:42.309: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:42.309: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:42.309: INFO: csi-mockplugin-0 started at 2022-05-03 08:56:55 +0000 UTC (0+3 container statuses recorded) May 3 08:59:42.309: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:42.309: INFO: Container driver-registrar ready: true, restart count 0 May 3 08:59:42.309: INFO: Container mock ready: true, restart count 0 May 3 08:59:42.309: INFO: netserver-0 started at 2022-05-03 08:57:29 +0000 UTC (0+1 container statuses recorded) May 3 08:59:42.309: INFO: Container webserver ready: true, restart count 0 May 3 08:59:42.309: INFO: coredns-6b775575b5-w454s started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:42.309: INFO: Container coredns ready: true, restart count 0 May 3 08:59:42.309: INFO: konnectivity-agent-r2m8v started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:42.309: INFO: Container konnectivity-agent ready: true, restart count 0 May 3 08:59:42.602: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 08:59:42.602: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:42.738: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-c5lb e86bdeb4-972e-4590-a8a1-92d331988301 27865 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-c5lb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-c5lb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-05-03 08:57:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2022-05-03 08:59:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-05-03 08:59:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"Ready\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-c5lb,Unschedulable:false,Taints:[]Taint{Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoSchedule,TimeAdded:2022-05-03 08:59:18 +0000 UTC,},Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoExecute,TimeAdded:2022-05-03 08:59:23 +0000 UTC,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:DiskPressure,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:PIDPressure,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:Ready,Status:Unknown,LastHeartbeatTime:2022-05-03 08:57:35 +0000 UTC,LastTransitionTime:2022-05-03 08:59:17 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.151.125,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:97eaceafa1dcc38dfa191fea843250cf,SystemUUID:97eaceaf-a1dc-c38d-fa19-1fea843250cf,BootID:eddb2e60-9b10-4c23-9e89-f2539bba18c7,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 08:59:42.739: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:42.802: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 08:59:42.889: INFO: Unable to retrieve kubelet pods for node e2e-c8a0630093-a7d53-minion-group-c5lb: error trying to reach service: dial tcp 10.40.0.3:10250: connect: connection refused May 3 08:59:42.889: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:42.961: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-j0s7 13534811-02a2-4928-b008-80e6f39177b8 27875 0 2022-05-03 08:44:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-j0s7 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-j0s7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-132":"e2e-c8a0630093-a7d53-minion-group-j0s7","csi-hostpath-ephemeral-928":"e2e-c8a0630093-a7d53-minion-group-j0s7","csi-hostpath-provisioning-1259":"e2e-c8a0630093-a7d53-minion-group-j0s7"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:21 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 08:59:21 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-05-03 08:59:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-j0s7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817138176 0} {<nil>} 7633924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554994176 0} {<nil>} 7377924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:22 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 08:59:26 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.237.94,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:800822b6a794b56fc75d86f7afc2e1a6,SystemUUID:800822b6-a794-b56f-c75d-86f7afc2e1a6,BootID:c95dcb5d-789d-48b1-8b08-198b7583e648,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/build-image/debian-iptables@sha256:3317c4374ea30d88b64b27740b0edfaa600e410901e727b5bab4c4deac1df6f5 registry.k8s.io/build-image/debian-iptables:bullseye-v1.3.0],SizeBytes:27061409,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:00fcc441ea9f72899c25eed61d602272a2a58c5f0014332bdcb5ac24acef08e4 registry.k8s.io/sig-storage/snapshot-controller:v4.0.0],SizeBytes:18952261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-928^50cccb5b-cabf-11ec-85c1-1e399d5f0c6b],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-928^50cccb5b-cabf-11ec-85c1-1e399d5f0c6b,DevicePath:,},},Config:nil,},} May 3 08:59:42.962: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:43.012: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:43.095: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:56:40 +0000 UTC (0+7 container statuses recorded) May 3 08:59:43.095: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:43.095: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:43.095: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:43.095: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:43.095: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:43.095: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:43.095: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:43.095: INFO: ss2-0 started at 2022-05-03 08:57:52 +0000 UTC (0+1 container statuses recorded) May 3 08:59:43.095: INFO: Container webserver ready: true, restart count 0 May 3 08:59:43.095: INFO: konnectivity-agent-98km6 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:43.095: INFO: Container konnectivity-agent ready: true, restart count 0 May 3 08:59:43.095: INFO: test-container-pod started at 2022-05-03 08:57:35 +0000 UTC (0+1 container statuses recorded) May 3 08:59:43.095: INFO: Container webserver ready: true, restart count 0 May 3 08:59:43.095: INFO: netserver-2 started at 2022-05-03 08:58:07 +0000 UTC (0+1 container statuses recorded) May 3 08:59:43.095: INFO: Container webserver ready: true, restart count 0 May 3 08:59:43.095: INFO: netserver-2 started at 2022-05-03 08:57:29 +0000 UTC (0+1 container statuses recorded) May 3 08:59:43.095: INFO: Container webserver ready: true, restart count 0 May 3 08:59:43.095: INFO: external-provisioner-mh5tk started at 2022-05-03 08:57:54 +0000 UTC (0+1 container statuses recorded) May 3 08:59:43.095: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 08:59:43.095: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-j0s7 started at 2022-05-03 08:44:56 +0000 UTC (0+1 container statuses recorded) May 3 08:59:43.095: INFO: Container kube-proxy ready: true, restart count 0 May 3 08:59:43.095: INFO: netserver-2 started at 2022-05-03 08:57:06 +0000 UTC (0+1 container statuses recorded) May 3 08:59:43.095: INFO: Container webserver ready: true, restart count 0 May 3 08:59:43.095: INFO: netserver-2 started at 2022-05-03 08:57:52 +0000 UTC (0+1 container statuses recorded) May 3 08:59:43.095: INFO: Container webserver ready: true, restart count 0 May 3 08:59:43.095: INFO: npd-v0.8.9-dgf5k started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:43.095: INFO: Container node-problem-detector ready: true, restart count 0 May 3 08:59:43.095: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:58:08 +0000 UTC (0+7 container statuses recorded) May 3 08:59:43.095: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:43.095: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:43.095: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:43.095: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:43.095: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:43.095: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:43.095: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:43.095: INFO: volume-snapshot-controller-0 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 08:59:43.095: INFO: Container volume-snapshot-controller ready: true, restart count 0 May 3 08:59:43.095: INFO: rand-non-local-7rpz7 started at 2022-05-03 08:58:44 +0000 UTC (0+1 container statuses recorded) May 3 08:59:43.095: INFO: Container c ready: false, restart count 0 May 3 08:59:43.095: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:59:16 +0000 UTC (0+7 container statuses recorded) May 3 08:59:43.095: INFO: Container csi-attacher ready: true, restart count 0 May 3 08:59:43.095: INFO: Container csi-provisioner ready: true, restart count 0 May 3 08:59:43.095: INFO: Container csi-resizer ready: true, restart count 0 May 3 08:59:43.095: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 08:59:43.095: INFO: Container hostpath ready: true, restart count 0 May 3 08:59:43.095: INFO: Container liveness-probe ready: true, restart count 0 May 3 08:59:43.095: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 08:59:43.095: INFO: metadata-proxy-v0.1-86pbj started at 2022-05-03 08:44:57 +0000 UTC (0+2 container statuses recorded) May 3 08:59:43.095: INFO: Container metadata-proxy ready: true, restart count 0 May 3 08:59:43.095: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 08:59:43.095: INFO: inline-volume-tester-8x7vv started at 2022-05-03 08:59:20 +0000 UTC (0+1 container statuses recorded) May 3 08:59:43.095: INFO: Container csi-volume-tester ready: true, restart count 0 May 3 08:59:43.516: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 08:59:43.516: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready May 3 08:59:43.577: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:45.690: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:47.697: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:49.704: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:51.697: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:53.698: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:55.695: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:57.840: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 08:59:59.697: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:01.696: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:03.698: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:05.696: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:07.699: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:09.701: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:11.706: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:13.697: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:15.696: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:17.697: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:19.702: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:21.699: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:23.697: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:25.696: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2022-05-03 08:59:18 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure May 3 09:00:27.700: INFO: Condition Ready of node e2e-c8a0630093-a7d53-minion-group-c5lb is true, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2022-05-03 08:59:23 +0000 UTC}]. Failure �[1mSTEP�[0m: Destroying namespace "provisioning-9012" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sIn\-tree\sVolumes\s\[Driver\:\slocal\]\[LocalVolumeType\:\sdir\]\s\[Testpattern\:\sPre\-provisioned\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\sreadOnly\sdirectory\sspecified\sin\sthe\svolumeMount$'
test/e2e/storage/testsuites/subpath.go:367 May 3 09:00:56.814: Unexpected error: <exec.CodeExitError>: { Err: { s: "command terminated with exit code 1", }, Code: 1, } command terminated with exit code 1 occurred test/e2e/storage/utils/local.go:211
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Creating a kubernetes client May 3 08:58:13.911: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename provisioning �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should support readOnly directory specified in the volumeMount test/e2e/storage/testsuites/subpath.go:367 May 3 08:58:14.299: INFO: In-tree plugin kubernetes.io/local-volume is not migrated, not validating any metrics May 3 08:58:22.437: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-driver-7b4cc607-4caf-47d0-84d9-26e952a044f2] Namespace:provisioning-5195 PodName:hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-xj556 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} May 3 08:58:22.437: INFO: >>> kubeConfig: /workspace/.kube/config May 3 08:58:22.438: INFO: ExecWithOptions: Clientset creation May 3 08:58:22.438: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/provisioning-5195/pods/hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-xj556/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-driver-7b4cc607-4caf-47d0-84d9-26e952a044f2&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 08:58:22.888: INFO: Creating resource for pre-provisioned PV May 3 08:58:22.888: INFO: Creating PVC and PV �[1mSTEP�[0m: Creating a PVC followed by a PV May 3 08:58:22.974: INFO: Waiting for PV local-rrnpf to bind to PVC pvc-tp96c May 3 08:58:22.974: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-tp96c] to have phase Bound May 3 08:58:23.020: INFO: PersistentVolumeClaim pvc-tp96c found but phase is Pending instead of Bound. May 3 08:58:25.062: INFO: PersistentVolumeClaim pvc-tp96c found but phase is Pending instead of Bound. May 3 08:58:27.103: INFO: PersistentVolumeClaim pvc-tp96c found but phase is Pending instead of Bound. May 3 08:58:29.148: INFO: PersistentVolumeClaim pvc-tp96c found and phase=Bound (6.173302227s) May 3 08:58:29.148: INFO: Waiting up to 3m0s for PersistentVolume local-rrnpf to have phase Bound May 3 08:58:29.192: INFO: PersistentVolume local-rrnpf found and phase=Bound (44.665363ms) �[1mSTEP�[0m: Creating pod pod-subpath-test-preprovisionedpv-n7jj �[1mSTEP�[0m: Creating a pod to test subpath May 3 08:58:29.385: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-n7jj" in namespace "provisioning-5195" to be "Succeeded or Failed" May 3 08:58:29.466: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 81.289375ms May 3 08:58:31.510: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.125536013s May 3 08:58:33.555: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.169826184s May 3 08:58:35.597: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.21244528s May 3 08:58:37.702: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.317157702s May 3 08:58:39.746: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 10.361147274s May 3 08:58:41.900: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 12.514928145s May 3 08:58:43.942: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 14.556738406s May 3 08:58:45.985: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 16.600375572s May 3 08:58:48.037: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 18.652592709s May 3 08:58:50.080: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 20.69558916s May 3 08:58:52.123: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 22.738647686s May 3 08:58:54.168: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 24.782737944s May 3 08:58:56.211: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 26.825914671s May 3 08:58:58.258: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 28.872868718s May 3 08:59:00.307: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 30.921988951s May 3 08:59:02.349: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 32.964111214s May 3 08:59:04.393: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 35.00796842s May 3 08:59:06.439: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 37.05405778s May 3 08:59:08.493: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 39.108437356s May 3 08:59:10.537: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 41.151858734s May 3 08:59:12.584: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 43.199543894s May 3 08:59:14.627: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 45.242418039s May 3 08:59:16.672: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 47.286886588s May 3 08:59:18.775: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 49.389902817s May 3 08:59:20.828: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 51.443422454s May 3 08:59:22.901: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 53.51668276s May 3 08:59:24.973: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 55.588264657s May 3 08:59:27.029: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 57.643962685s May 3 08:59:29.084: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 59.69891029s May 3 08:59:31.192: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.807279277s May 3 08:59:33.277: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.892238016s May 3 08:59:35.334: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.948953826s May 3 08:59:37.380: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.994810642s May 3 08:59:39.431: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.046613377s May 3 08:59:41.484: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.099475661s May 3 08:59:43.535: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.150686919s May 3 08:59:45.579: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.19390485s May 3 08:59:47.624: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.238702154s May 3 08:59:49.669: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.284468167s May 3 08:59:51.712: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.327348355s May 3 08:59:53.756: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.370909535s May 3 08:59:55.799: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.414004641s May 3 08:59:57.855: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.470003106s May 3 08:59:59.899: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.51405013s May 3 09:00:01.942: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.55755296s May 3 09:00:03.985: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.599873638s May 3 09:00:06.029: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.64409546s May 3 09:00:08.075: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.690587533s May 3 09:00:10.119: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.734156251s May 3 09:00:12.162: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.777383708s May 3 09:00:14.206: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.821652518s May 3 09:00:16.250: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.864982478s May 3 09:00:18.293: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.908477199s May 3 09:00:20.337: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.952195226s May 3 09:00:22.380: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.995143976s May 3 09:00:24.423: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m55.038558756s May 3 09:00:26.477: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m57.092109935s May 3 09:00:28.519: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 1m59.134170015s May 3 09:00:30.564: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m1.178730161s May 3 09:00:32.611: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m3.225883497s May 3 09:00:34.657: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m5.271951407s May 3 09:00:36.729: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m7.344392918s May 3 09:00:38.795: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m9.409877599s May 3 09:00:40.859: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m11.474211434s May 3 09:00:42.950: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m13.564902454s May 3 09:00:45.031: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m15.64620685s May 3 09:00:47.092: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m17.706974468s May 3 09:00:49.169: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m19.784156798s May 3 09:00:51.235: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m21.850542623s May 3 09:00:53.353: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Pending", Reason="", readiness=false. Elapsed: 2m23.968529564s May 3 09:00:55.412: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2m26.02710406s �[1mSTEP�[0m: Saw pod success May 3 09:00:55.412: INFO: Pod "pod-subpath-test-preprovisionedpv-n7jj" satisfied condition "Succeeded or Failed" May 3 09:00:55.478: INFO: Trying to get logs from node e2e-c8a0630093-a7d53-minion-group-c5lb pod pod-subpath-test-preprovisionedpv-n7jj container test-container-subpath-preprovisionedpv-n7jj: <nil> �[1mSTEP�[0m: delete the pod May 3 09:00:55.797: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-n7jj to disappear May 3 09:00:55.885: INFO: Pod pod-subpath-test-preprovisionedpv-n7jj no longer exists �[1mSTEP�[0m: Deleting pod pod-subpath-test-preprovisionedpv-n7jj May 3 09:00:55.885: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-n7jj" in namespace "provisioning-5195" �[1mSTEP�[0m: Deleting pod May 3 09:00:55.996: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-n7jj" in namespace "provisioning-5195" �[1mSTEP�[0m: Deleting pv and pvc May 3 09:00:56.091: INFO: Deleting PersistentVolumeClaim "pvc-tp96c" May 3 09:00:56.210: INFO: Deleting PersistentVolume "local-rrnpf" �[1mSTEP�[0m: Removing the test directory May 3 09:00:56.295: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-driver-7b4cc607-4caf-47d0-84d9-26e952a044f2] Namespace:provisioning-5195 PodName:hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-xj556 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} May 3 09:00:56.295: INFO: >>> kubeConfig: /workspace/.kube/config May 3 09:00:56.296: INFO: ExecWithOptions: Clientset creation May 3 09:00:56.296: INFO: ExecWithOptions: execute(POST https://34.82.22.140/api/v1/namespaces/provisioning-5195/pods/hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-xj556/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-driver-7b4cc607-4caf-47d0-84d9-26e952a044f2&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) May 3 09:00:56.813: INFO: exec e2e-c8a0630093-a7d53-minion-group-c5lb: command: rm -r /tmp/local-driver-7b4cc607-4caf-47d0-84d9-26e952a044f2 May 3 09:00:56.813: INFO: exec e2e-c8a0630093-a7d53-minion-group-c5lb: stdout: "" May 3 09:00:56.813: INFO: exec e2e-c8a0630093-a7d53-minion-group-c5lb: stderr: "rm: cannot remove '/tmp/local-driver-7b4cc607-4caf-47d0-84d9-26e952a044f2': No such file or directory\n" May 3 09:00:56.813: INFO: exec e2e-c8a0630093-a7d53-minion-group-c5lb: exit code: 0 May 3 09:00:56.814: FAIL: Unexpected error: <exec.CodeExitError>: { Err: { s: "command terminated with exit code 1", }, Code: 1, } command terminated with exit code 1 occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).cleanupLocalVolumeDirectory(0xc0026e24e0, 0xc003746e00) test/e2e/storage/utils/local.go:211 +0xc5 k8s.io/kubernetes/test/e2e/storage/utils.(*ltrMgr).Remove(0x22?, 0xc001ad6750?) test/e2e/storage/utils/local.go:341 +0x4b k8s.io/kubernetes/test/e2e/storage/drivers.(*localVolume).DeleteVolume(0xc000758ea0?) test/e2e/storage/drivers/in_tree.go:1950 +0x28 k8s.io/kubernetes/test/e2e/storage/utils.TryFunc(0x7a6bff8?) test/e2e/storage/utils/utils.go:769 +0x6d k8s.io/kubernetes/test/e2e/storage/framework.(*VolumeResource).CleanupResource(0xc0029bb140) test/e2e/storage/framework/volume_resource.go:228 +0xc6d k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func2() test/e2e/storage/testsuites/subpath.go:179 +0x12d k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func16() test/e2e/storage/testsuites/subpath.go:380 +0x1fa k8s.io/kubernetes/test/e2e.RunE2ETests(0x257e5b7?) test/e2e/e2e.go:130 +0x686 k8s.io/kubernetes/test/e2e.TestE2E(0xc00057e000?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000d96340, 0x73fa160) /usr/local/go/src/testing/testing.go:1439 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1486 +0x35f �[1mSTEP�[0m: Deleting pod hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-xj556 in namespace provisioning-5195 [AfterEach] [Testpattern: Pre-provisioned PV (default fs)] subPath test/e2e/framework/framework.go:188 �[1mSTEP�[0m: Collecting events from namespace "provisioning-5195". �[1mSTEP�[0m: Found 19 events. May 3 09:00:57.078: INFO: At 2022-05-03 08:58:14 +0000 UTC - event for hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-xj556: {default-scheduler } Scheduled: Successfully assigned provisioning-5195/hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-xj556 to e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:00:57.078: INFO: At 2022-05-03 08:58:15 +0000 UTC - event for hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-xj556: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 09:00:57.078: INFO: At 2022-05-03 08:58:15 +0000 UTC - event for hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-xj556: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Created: Created container agnhost-container May 3 09:00:57.078: INFO: At 2022-05-03 08:58:15 +0000 UTC - event for hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-xj556: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Started: Started container agnhost-container May 3 09:00:57.078: INFO: At 2022-05-03 08:58:22 +0000 UTC - event for pvc-tp96c: {persistentvolume-controller } ProvisioningFailed: storageclass.storage.k8s.io "provisioning-5195" not found May 3 09:00:57.078: INFO: At 2022-05-03 08:58:29 +0000 UTC - event for pod-subpath-test-preprovisionedpv-n7jj: {default-scheduler } Scheduled: Successfully assigned provisioning-5195/pod-subpath-test-preprovisionedpv-n7jj to e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:00:57.078: INFO: At 2022-05-03 08:58:32 +0000 UTC - event for pod-subpath-test-preprovisionedpv-n7jj: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Created: Created container init-volume-preprovisionedpv-n7jj May 3 09:00:57.078: INFO: At 2022-05-03 08:58:32 +0000 UTC - event for pod-subpath-test-preprovisionedpv-n7jj: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-2" already present on machine May 3 09:00:57.078: INFO: At 2022-05-03 08:58:33 +0000 UTC - event for pod-subpath-test-preprovisionedpv-n7jj: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Started: Started container init-volume-preprovisionedpv-n7jj May 3 09:00:57.078: INFO: At 2022-05-03 08:58:34 +0000 UTC - event for pod-subpath-test-preprovisionedpv-n7jj: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 09:00:57.078: INFO: At 2022-05-03 08:58:34 +0000 UTC - event for pod-subpath-test-preprovisionedpv-n7jj: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Created: Created container test-init-volume-preprovisionedpv-n7jj May 3 09:00:57.078: INFO: At 2022-05-03 08:58:35 +0000 UTC - event for pod-subpath-test-preprovisionedpv-n7jj: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Started: Started container test-init-volume-preprovisionedpv-n7jj May 3 09:00:57.078: INFO: At 2022-05-03 08:58:35 +0000 UTC - event for pod-subpath-test-preprovisionedpv-n7jj: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.36" already present on machine May 3 09:00:57.078: INFO: At 2022-05-03 08:58:35 +0000 UTC - event for pod-subpath-test-preprovisionedpv-n7jj: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Created: Created container test-container-subpath-preprovisionedpv-n7jj May 3 09:00:57.078: INFO: At 2022-05-03 08:58:36 +0000 UTC - event for pod-subpath-test-preprovisionedpv-n7jj: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} Started: Started container test-container-subpath-preprovisionedpv-n7jj May 3 09:00:57.078: INFO: At 2022-05-03 08:59:18 +0000 UTC - event for hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-xj556: {node-controller } NodeNotReady: Node is not ready May 3 09:00:57.078: INFO: At 2022-05-03 09:00:28 +0000 UTC - event for hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-xj556: {taint-controller } TaintManagerEviction: Cancelling deletion of Pod provisioning-5195/hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-xj556 May 3 09:00:57.078: INFO: At 2022-05-03 09:00:28 +0000 UTC - event for pod-subpath-test-preprovisionedpv-n7jj: {taint-controller } TaintManagerEviction: Cancelling deletion of Pod provisioning-5195/pod-subpath-test-preprovisionedpv-n7jj May 3 09:00:57.078: INFO: At 2022-05-03 09:00:39 +0000 UTC - event for hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-xj556: {kubelet e2e-c8a0630093-a7d53-minion-group-c5lb} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 3 09:00:57.127: INFO: POD NODE PHASE GRACE CONDITIONS May 3 09:00:57.127: INFO: May 3 09:00:57.219: INFO: Logging node info for node e2e-c8a0630093-a7d53-master May 3 09:00:57.292: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-master b19f1e35-3444-417f-aa8a-059f422baac1 21446 0 2022-05-03 08:44:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-05-03 08:44:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-05-03 08:44:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 08:45:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3860037632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3597893632 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:44:59 +0000 UTC,LastTransitionTime:2022-05-03 08:44:59 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:44:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 08:55:52 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.22.140,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-master.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bcd3f659cc761bdb6efbff38fefe4e19,SystemUUID:bcd3f659-cc76-1bdb-6efb-ff38fefe4e19,BootID:f91b8838-f530-4990-b2a6-3b369f82164e,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:131049939,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:120695609,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:52333368,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:be60ef505fc80879eeb5d8bf3ad8bb1146b395afc2394584645e99431806c26c gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.12.0],SizeBytes:32705362,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:d59ff043b173896cedeb897225ecfd2cdfc48591a04df035b439c04431421fc2 registry.k8s.io/kas-network-proxy/proxy-server:v0.0.30],SizeBytes:17920446,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 09:00:57.292: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-master May 3 09:00:57.401: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-master May 3 09:00:57.503: INFO: konnectivity-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:00:57.503: INFO: Container konnectivity-server-container ready: true, restart count 0 May 3 09:00:57.503: INFO: kube-apiserver-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:00:57.503: INFO: Container kube-apiserver ready: true, restart count 1 May 3 09:00:57.503: INFO: metadata-proxy-v0.1-blclk started at 2022-05-03 08:45:06 +0000 UTC (0+2 container statuses recorded) May 3 09:00:57.503: INFO: Container metadata-proxy ready: true, restart count 0 May 3 09:00:57.503: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 09:00:57.503: INFO: etcd-server-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:00:57.503: INFO: Container etcd-container ready: true, restart count 0 May 3 09:00:57.503: INFO: kube-controller-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:00:57.503: INFO: Container kube-controller-manager ready: true, restart count 2 May 3 09:00:57.503: INFO: kube-scheduler-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:00:57.503: INFO: Container kube-scheduler ready: true, restart count 0 May 3 09:00:57.503: INFO: kube-addon-manager-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:12 +0000 UTC (0+1 container statuses recorded) May 3 09:00:57.503: INFO: Container kube-addon-manager ready: true, restart count 0 May 3 09:00:57.503: INFO: l7-lb-controller-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:44:13 +0000 UTC (0+1 container statuses recorded) May 3 09:00:57.503: INFO: Container l7-lb-controller ready: true, restart count 3 May 3 09:00:57.503: INFO: etcd-server-events-e2e-c8a0630093-a7d53-master started at 2022-05-03 08:43:35 +0000 UTC (0+1 container statuses recorded) May 3 09:00:57.504: INFO: Container etcd-container ready: true, restart count 0 May 3 09:00:58.068: INFO: Latency metrics for node e2e-c8a0630093-a7d53-master May 3 09:00:58.068: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 09:00:58.155: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-7bq2 bfa6e413-94d8-452c-a687-5f8ae9ea5b7c 27993 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-7bq2 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-7bq2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-6774":"e2e-c8a0630093-a7d53-minion-group-7bq2","csi-mock-csi-mock-volumes-4868":"e2e-c8a0630093-a7d53-minion-group-7bq2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 08:56:35 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 08:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-7bq2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817146368 0} {<nil>} 7633932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7555002368 0} {<nil>} 7377932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 09:00:06 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 09:00:06 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 09:00:06 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 09:00:06 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-05-03 09:00:06 +0000 UTC,LastTransitionTime:2022-05-03 09:00:06 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 09:00:06 +0000 UTC,LastTransitionTime:2022-05-03 08:45:17 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:44:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 08:59:27 +0000 UTC,LastTransitionTime:2022-05-03 08:45:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:35.197.55.130,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-7bq2.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f84a54b770444ef2c7de26e5ab984f78,SystemUUID:f84a54b7-7044-4ef2-c7de-26e5ab984f78,BootID:950b58bb-5fcd-4efa-a61d-cbb738103018,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 09:00:58.155: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 09:00:58.242: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 09:00:58.535: INFO: l7-default-backend-bb7fb94cb-jt2kv started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:00:58.535: INFO: Container default-http-backend ready: true, restart count 0 May 3 09:00:58.535: INFO: httpd started at 2022-05-03 09:00:30 +0000 UTC (0+1 container statuses recorded) May 3 09:00:58.535: INFO: Container httpd ready: true, restart count 0 May 3 09:00:58.535: INFO: ss2-2 started at 2022-05-03 08:58:11 +0000 UTC (0+1 container statuses recorded) May 3 09:00:58.535: INFO: Container webserver ready: true, restart count 0 May 3 09:00:58.535: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-7bq2-8brdm started at 2022-05-03 09:00:29 +0000 UTC (0+1 container statuses recorded) May 3 09:00:58.535: INFO: Container agnhost-container ready: true, restart count 0 May 3 09:00:58.535: INFO: sample-webhook-deployment-69fbcb9788-8vf24 started at <nil> (0+0 container statuses recorded) May 3 09:00:58.535: INFO: external-provisioner-skff4 started at 2022-05-03 08:58:13 +0000 UTC (0+1 container statuses recorded) May 3 09:00:58.535: INFO: Container nfs-provisioner ready: true, restart count 0 May 3 09:00:58.535: INFO: netserver-0 started at <nil> (0+0 container statuses recorded) May 3 09:00:58.535: INFO: csi-mockplugin-resizer-0 started at 2022-05-03 08:56:55 +0000 UTC (0+1 container statuses recorded) May 3 09:00:58.535: INFO: Container csi-resizer ready: true, restart count 0 May 3 09:00:58.535: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-7bq2 started at 2022-05-03 08:44:57 +0000 UTC (0+1 container statuses recorded) May 3 09:00:58.535: INFO: Container kube-proxy ready: true, restart count 0 May 3 09:00:58.535: INFO: pod-0576e4bd-c185-4b0e-bcf2-d7b16b094c1f started at 2022-05-03 09:00:44 +0000 UTC (0+1 container statuses recorded) May 3 09:00:58.535: INFO: Container write-pod ready: true, restart count 0 May 3 09:00:58.535: INFO: netserver-0 started at <nil> (0+0 container statuses recorded) May 3 09:00:58.535: INFO: netserver-0 started at 2022-05-03 08:58:07 +0000 UTC (0+1 container statuses recorded) May 3 09:00:58.535: INFO: Container webserver ready: true, restart count 0 May 3 09:00:58.535: INFO: csi-mockplugin-0 started at 2022-05-03 08:56:55 +0000 UTC (0+3 container statuses recorded) May 3 09:00:58.535: INFO: Container csi-provisioner ready: true, restart count 0 May 3 09:00:58.535: INFO: Container driver-registrar ready: true, restart count 0 May 3 09:00:58.535: INFO: Container mock ready: true, restart count 0 May 3 09:00:58.535: INFO: netserver-0 started at 2022-05-03 08:57:29 +0000 UTC (0+1 container statuses recorded) May 3 09:00:58.535: INFO: Container webserver ready: true, restart count 0 May 3 09:00:58.535: INFO: csi-hostpathplugin-0 started at 2022-05-03 08:58:01 +0000 UTC (0+7 container statuses recorded) May 3 09:00:58.535: INFO: Container csi-attacher ready: true, restart count 0 May 3 09:00:58.535: INFO: Container csi-provisioner ready: true, restart count 0 May 3 09:00:58.535: INFO: Container csi-resizer ready: true, restart count 0 May 3 09:00:58.535: INFO: Container csi-snapshotter ready: true, restart count 0 May 3 09:00:58.535: INFO: Container hostpath ready: true, restart count 0 May 3 09:00:58.535: INFO: Container liveness-probe ready: true, restart count 0 May 3 09:00:58.535: INFO: Container node-driver-registrar ready: true, restart count 0 May 3 09:00:58.535: INFO: coredns-6b775575b5-w454s started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:00:58.535: INFO: Container coredns ready: true, restart count 0 May 3 09:00:58.535: INFO: konnectivity-agent-r2m8v started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:00:58.535: INFO: Container konnectivity-agent ready: true, restart count 0 May 3 09:00:58.535: INFO: pod-client started at 2022-05-03 09:00:38 +0000 UTC (0+1 container statuses recorded) May 3 09:00:58.535: INFO: Container pod-client ready: true, restart count 0 May 3 09:00:58.536: INFO: npd-v0.8.9-lxnv5 started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:00:58.536: INFO: Container node-problem-detector ready: true, restart count 0 May 3 09:00:58.536: INFO: kube-dns-autoscaler-c6c49f5f6-t54xb started at 2022-05-03 08:56:29 +0000 UTC (0+1 container statuses recorded) May 3 09:00:58.536: INFO: Container autoscaler ready: true, restart count 0 May 3 09:00:58.536: INFO: metadata-proxy-v0.1-27ljg started at 2022-05-03 08:44:58 +0000 UTC (0+2 container statuses recorded) May 3 09:00:58.536: INFO: Container metadata-proxy ready: true, restart count 0 May 3 09:00:58.536: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 May 3 09:00:58.536: INFO: httpd-deployment-7f8cc8868-9scr8 started at 2022-05-03 09:00:46 +0000 UTC (0+1 container statuses recorded) May 3 09:00:58.536: INFO: Container httpd ready: false, restart count 0 May 3 09:00:58.536: INFO: csi-mockplugin-attacher-0 started at 2022-05-03 08:56:55 +0000 UTC (0+1 container statuses recorded) May 3 09:00:58.536: INFO: Container csi-attacher ready: true, restart count 0 May 3 09:00:59.012: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-7bq2 May 3 09:00:59.012: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:00:59.085: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-c5lb e86bdeb4-972e-4590-a8a1-92d331988301 28057 0 2022-05-03 08:44:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-c5lb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-c5lb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-05-03 08:44:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 08:59:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-05-03 08:59:18 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 09:00:26 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{},"f:memory":{}},"f:capacity":{"f:ephemeral-storage":{},"f:memory":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:nodeInfo":{"f:bootID":{}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-c5lb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817134080 0} {<nil>} 7455Mi BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554990080 0} {<nil>} 7205Mi BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 08:55:18 +0000 UTC,LastTransitionTime:2022-05-03 08:45:16 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 09:00:27 +0000 UTC,LastTransitionTime:2022-05-03 09:00:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 09:00:27 +0000 UTC,LastTransitionTime:2022-05-03 09:00:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 09:00:27 +0000 UTC,LastTransitionTime:2022-05-03 09:00:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 09:00:27 +0000 UTC,LastTransitionTime:2022-05-03 09:00:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.151.125,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-c5lb.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:97eaceafa1dcc38dfa191fea843250cf,SystemUUID:97eaceaf-a1dc-c38d-fa19-1fea843250cf,BootID:07b245ae-f8d1-4df7-99ab-f56ed5c2890d,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/glusterdynamic-provisioner@sha256:7ed3bfb1429e97f721cbd8b2953ffb1f0186e89c1c99ee0e919d563b0caa81d2 registry.k8s.io/e2e-test-images/glusterdynamic-provisioner:v1.3],SizeBytes:151196506,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e registry.k8s.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b registry.k8s.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:a9fbc49846c679f3d0f6fb2606ad3346fca0d915d7de3ee177f09551a1b1ec1b registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.30],SizeBytes:7711912,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 registry.k8s.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7 registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 3 09:00:59.086: INFO: Logging kubelet events for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:00:59.172: INFO: Logging pods the kubelet thinks is on node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:00:59.389: INFO: kube-proxy-e2e-c8a0630093-a7d53-minion-group-c5lb started at 2022-05-03 08:44:58 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container kube-proxy ready: true, restart count 1 May 3 09:00:59.389: INFO: metadata-proxy-v0.1-96hkj started at 2022-05-03 08:44:58 +0000 UTC (0+2 container statuses recorded) May 3 09:00:59.389: INFO: Container metadata-proxy ready: true, restart count 1 May 3 09:00:59.389: INFO: Container prometheus-to-sd-exporter ready: true, restart count 1 May 3 09:00:59.389: INFO: konnectivity-agent-68zqw started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container konnectivity-agent ready: true, restart count 1 May 3 09:00:59.389: INFO: netserver-1 started at 2022-05-03 08:57:52 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container webserver ready: false, restart count 0 May 3 09:00:59.389: INFO: netserver-1 started at 2022-05-03 08:58:07 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container webserver ready: false, restart count 1 May 3 09:00:59.389: INFO: proxy-service-5tmvw-2lsvf started at 2022-05-03 08:58:19 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container proxy-service-5tmvw ready: true, restart count 1 May 3 09:00:59.389: INFO: pod-14331bd4-ae62-46a1-80f1-1d3a4f82e2ac started at <nil> (0+0 container statuses recorded) May 3 09:00:59.389: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-25htm started at 2022-05-03 09:00:31 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container agnhost-container ready: false, restart count 0 May 3 09:00:59.389: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-cjj8q started at 2022-05-03 08:58:02 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container agnhost-container ready: true, restart count 1 May 3 09:00:59.389: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-8gdh7 started at <nil> (0+0 container statuses recorded) May 3 09:00:59.389: INFO: glusterdynamic-provisioner-zhm5j started at 2022-05-03 08:58:21 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container glusterdynamic-provisioner ready: false, restart count 0 May 3 09:00:59.389: INFO: netserver-1 started at 2022-05-03 08:57:06 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container webserver ready: false, restart count 0 May 3 09:00:59.389: INFO: ss2-1 started at 2022-05-03 08:58:04 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container webserver ready: false, restart count 0 May 3 09:00:59.389: INFO: busybox-privileged-true-161a4847-63d5-4990-8440-b997e42fbab3 started at 2022-05-03 09:00:27 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container busybox-privileged-true-161a4847-63d5-4990-8440-b997e42fbab3 ready: false, restart count 0 May 3 09:00:59.389: INFO: hostexec-e2e-c8a0630093-a7d53-minion-group-c5lb-kv9p4 started at 2022-05-03 09:00:27 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container agnhost-container ready: false, restart count 0 May 3 09:00:59.389: INFO: httpd-deployment-67d89878b7-xtxxn started at <nil> (0+0 container statuses recorded) May 3 09:00:59.389: INFO: npd-v0.8.9-wzktb started at 2022-05-03 08:45:12 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container node-problem-detector ready: false, restart count 0 May 3 09:00:59.389: INFO: metrics-server-v0.5.2-86b9c987cb-nflsz started at 2022-05-03 08:45:23 +0000 UTC (0+2 container statuses recorded) May 3 09:00:59.389: INFO: Container metrics-server ready: false, restart count 1 May 3 09:00:59.389: INFO: Container metrics-server-nanny ready: false, restart count 0 May 3 09:00:59.389: INFO: pod-secrets-3d1bbdc0-8c07-499a-83b8-703c99c304dd started at 2022-05-03 09:00:27 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container secret-volume-test ready: false, restart count 0 May 3 09:00:59.389: INFO: coredns-6b775575b5-np5vf started at 2022-05-03 08:45:16 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container coredns ready: false, restart count 0 May 3 09:00:59.389: INFO: netserver-1 started at <nil> (0+0 container statuses recorded) May 3 09:00:59.389: INFO: pod-dae2b55c-48a5-4aeb-8086-afefb582973d started at 2022-05-03 08:58:12 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container write-pod ready: false, restart count 0 May 3 09:00:59.389: INFO: pod-740f09e0-1c05-4e24-8ac8-ab02c252c46e started at 2022-05-03 09:00:27 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container write-pod ready: false, restart count 0 May 3 09:00:59.389: INFO: netserver-1 started at 2022-05-03 08:57:29 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container webserver ready: false, restart count 0 May 3 09:00:59.389: INFO: inline-volume-tester-4s44p started at 2022-05-03 08:58:22 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container csi-volume-tester ready: false, restart count 0 May 3 09:00:59.389: INFO: host-test-container-pod started at 2022-05-03 08:58:14 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container agnhost-container ready: false, restart count 0 May 3 09:00:59.389: INFO: test-container-pod started at 2022-05-03 08:58:14 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container webserver ready: false, restart count 0 May 3 09:00:59.389: INFO: inline-volume-tester2-tnnll started at 2022-05-03 09:00:27 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container csi-volume-tester ready: false, restart count 0 May 3 09:00:59.389: INFO: rand-non-local-7mtjr started at 2022-05-03 09:00:27 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container c ready: false, restart count 0 May 3 09:00:59.389: INFO: pod-server-1 started at <nil> (0+0 container statuses recorded) May 3 09:00:59.389: INFO: test-container-pod started at 2022-05-03 08:58:23 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container webserver ready: false, restart count 0 May 3 09:00:59.389: INFO: test-container-pod started at 2022-05-03 09:00:27 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container webserver ready: true, restart count 0 May 3 09:00:59.389: INFO: host-test-container-pod started at 2022-05-03 09:00:27 +0000 UTC (0+1 container statuses recorded) May 3 09:00:59.389: INFO: Container agnhost-container ready: true, restart count 0 May 3 09:00:59.389: INFO: netserver-1 started at <nil> (0+0 container statuses recorded) May 3 09:00:59.910: INFO: Latency metrics for node e2e-c8a0630093-a7d53-minion-group-c5lb May 3 09:00:59.910: INFO: Logging node info for node e2e-c8a0630093-a7d53-minion-group-j0s7 May 3 09:01:00.000: INFO: Node Info: &Node{ObjectMeta:{e2e-c8a0630093-a7d53-minion-group-j0s7 13534811-02a2-4928-b008-80e6f39177b8 28009 0 2022-05-03 08:44:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-c8a0630093-a7d53-minion-group-j0s7 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-c8a0630093-a7d53-minion-group-j0s7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-132":"e2e-c8a0630093-a7d53-minion-group-j0s7","csi-hostpath-ephemeral-928":"e2e-c8a0630093-a7d53-minion-group-j0s7","csi-hostpath-provisioning-1259":"e2e-c8a0630093-a7d53-minion-group-j0s7"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-05-03 08:44:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-05-03 08:45:21 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-05-03 08:59:21 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-05-03 09:00:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-049/us-west1-b/e2e-c8a0630093-a7d53-minion-group-j0s7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7817138176 0} {<nil>} 7633924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7554994176 0} {<nil>} 7377924Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-05-03 09:00:11 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-05-03 09:00:11 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-05-03 09:00:11 +0000 UTC,LastTransitionTime:2022-05-03 09:00:10 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-05-03 09:00:11 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-05-03 09:00:11 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-05-03 09:00:11 +0000 UTC,LastTransitionTime:2022-05-03 08:45:20 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-05-03 08:45:12 +0000 UTC,LastTransitionTime:2022-05-03 08:45:12 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-05-03 09:00:07 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-05-03 09:00:07 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-05-03 09:00:07 +0000 UTC,LastTransitionTime:2022-05-03 08:44:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-05-03 09:00:07 +0000 UTC,LastTransitionTime:2022-05-03 08:45:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.237.94,},NodeAddress{Type:InternalDNS,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},NodeAddress{Type:Hostname,Address:e2e-c8a0630093-a7d53-minion-group-j0s7.c.k8s-infra-e2e-boskos-049.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:800822b6a794b56fc75d86f7afc2e1a6,SystemUUID:800822b6-a794-b56f-c75d-86f7afc2e1a6,BootID:c95dcb5d-789d-48b1-8b08-198b7583e648,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.6.0,KubeletVersion:v1.25.0-alpha.0.22+20b712cdede0d5,KubeProxyVersion:v1.25.0-alpha.0.22+20b712cdede0d5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5 registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.0.22_20b712cdede0d5],SizeBytes:111851575,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:c4a75e50c3ee30daa78b7149de781f66236885850b1ea7b0c1a062af5019e019 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.9],SizeBytes:56740357,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:f5241226198f5a54d22540acf2b3933ea0f49458f90c51fc75833d0c428687b8 registry.k8s.io/e2e-test-images/agnhost:2.36],SizeBytes:50655495,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/build-image/debian-iptables@sha256:3317c4374ea30d88b64b27740b0edfaa600e410901e727b5bab4c4deac1df6f5 registry.k8s.io/build-image/debian-iptables:bullseye-v1.3.0],SizeBytes:27061409,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 registry.k8s.io/sig