Result | FAILURE |
Tests | 34 failed / 732 succeeded |
Started | |
Elapsed | 59m26s |
Revision | |
Builder | gke-prow-ssd-pool-1a225945-5wt3 |
links | {u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/57eea0b3-8513-4a81-9a1f-51d6c037eadf/targets/test'}} |
pod | a50fc772-1577-11ea-a60b-92e661a0ef68 |
resultstore | https://source.cloud.google.com/results/invocations/57eea0b3-8513-4a81-9a1f-51d6c037eadf/targets/test |
infra-commit | 0d1804185 |
job-version | v1.18.0-alpha.0.1350+57b6b287d4ffa4 |
master_os_image | cos-77-12371-89-0 |
node_os_image | cos-77-12371-89-0 |
pod | a50fc772-1577-11ea-a60b-92e661a0ef68 |
revision | v1.18.0-alpha.0.1350+57b6b287d4ffa4 |
error during ./cluster/log-dump/log-dump.sh /workspace/_artifacts (interrupted): signal: interrupt
from junit_runner.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sProbing\scontainer\swith\sreadiness\sprobe\sshould\snot\sbe\sready\sbefore\sinitial\sdelay\sand\snever\srestart\s\[NodeConformance\]\s\[Conformance\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:721 Dec 3 03:15:03.868: Unexpected error: <*errors.errorString | 0xc001ba6330>: { s: "want pod 'test-webserver-10e80124-1f4b-415c-b0d5-b7ae23929fc2' on 'bootstrap-e2e-minion-group-3k6d' to be 'Running' but was 'Pending'", } want pod 'test-webserver-10e80124-1f4b-415c-b0d5-b7ae23929fc2' on 'bootstrap-e2e-minion-group-3k6d' to be 'Running' but was 'Pending' occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:68from junit_03.xml
[BeforeEach] [k8s.io] Probing container /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Creating a kubernetes client Dec 3 03:10:02.924: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename container-probe �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in container-probe-2038 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:51 [It] with readiness probe should not be ready before initial delay and never restart [NodeConformance] [Conformance] /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:721 Dec 3 03:15:03.868: FAIL: Unexpected error: <*errors.errorString | 0xc001ba6330>: { s: "want pod 'test-webserver-10e80124-1f4b-415c-b0d5-b7ae23929fc2' on 'bootstrap-e2e-minion-group-3k6d' to be 'Running' but was 'Pending'", } want pod 'test-webserver-10e80124-1f4b-415c-b0d5-b7ae23929fc2' on 'bootstrap-e2e-minion-group-3k6d' to be 'Running' but was 'Pending' occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func3.2() /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:68 +0x1fc k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0027e8100) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:110 +0x30a k8s.io/kubernetes/test/e2e.TestE2E(0xc0027e8100) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:112 +0x2b testing.tRunner(0xc0027e8100, 0x4c381c8) /usr/local/go/src/testing/testing.go:909 +0xc9 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:960 +0x350 [AfterEach] [k8s.io] Probing container /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:152 �[1mSTEP�[0m: Collecting events from namespace "container-probe-2038". �[1mSTEP�[0m: Found 1 events. Dec 3 03:15:03.910: INFO: At 2019-12-03 03:10:03 +0000 UTC - event for test-webserver-10e80124-1f4b-415c-b0d5-b7ae23929fc2: {default-scheduler } Scheduled: Successfully assigned container-probe-2038/test-webserver-10e80124-1f4b-415c-b0d5-b7ae23929fc2 to bootstrap-e2e-minion-group-3k6d Dec 3 03:15:03.949: INFO: POD NODE PHASE GRACE CONDITIONS Dec 3 03:15:03.949: INFO: test-webserver-10e80124-1f4b-415c-b0d5-b7ae23929fc2 bootstrap-e2e-minion-group-3k6d Pending [{PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:03 +0000 UTC }] Dec 3 03:15:03.949: INFO: Dec 3 03:15:03.990: INFO: Logging node info for node bootstrap-e2e-master Dec 3 03:15:04.030: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master /api/v1/nodes/bootstrap-e2e-master 64f6954b-0039-46a9-bde3-dcd825532c16 34871 0 2019-12-03 02:56:38 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3876802560 0} {<nil>} 3785940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3614658560 0} {<nil>} 3529940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.39.205,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5736e6f149167618f71cd530dafef4cc,SystemUUID:5736e6f1-4916-7618-f71c-d530dafef4cc,BootID:113c1994-21fb-4e64-a041-99c12a1d120b,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3-0],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:212299081,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:200712199,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:110449186,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:3e315022a842d782a28e729720f21091dde21f1efea28868d65ec595ad871616 k8s.gcr.io/kube-addon-manager:v9.0.2],SizeBytes:83076028,},ContainerImage{Names:[k8s.gcr.io/etcd-empty-dir-cleanup@sha256:484662e55e0705caed26c6fb8632097457f43ce685756531da7a76319a7dcee1 k8s.gcr.io/etcd-empty-dir-cleanup:3.4.3.0],SizeBytes:77408900,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:76121176,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:04.031: INFO: Logging kubelet events for node bootstrap-e2e-master Dec 3 03:15:04.086: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Dec 3 03:15:04.153: INFO: kube-controller-manager-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.153: INFO: Container kube-controller-manager ready: true, restart count 0 Dec 3 03:15:04.153: INFO: kube-addon-manager-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.153: INFO: Container kube-addon-manager ready: true, restart count 0 Dec 3 03:15:04.153: INFO: etcd-empty-dir-cleanup-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.153: INFO: Container etcd-empty-dir-cleanup ready: true, restart count 0 Dec 3 03:15:04.153: INFO: etcd-server-events-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.153: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:15:04.153: INFO: etcd-server-bootstrap-e2e-master started at 2019-12-03 02:57:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.153: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:15:04.153: INFO: kube-apiserver-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.153: INFO: Container kube-apiserver ready: true, restart count 0 Dec 3 03:15:04.153: INFO: kube-scheduler-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.153: INFO: Container kube-scheduler ready: true, restart count 0 Dec 3 03:15:04.153: INFO: l7-lb-controller-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.153: INFO: Container l7-lb-controller ready: true, restart count 2 Dec 3 03:15:04.153: INFO: fluentd-gcp-v3.2.0-r5wvv started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:04.153: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:04.153: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:04.153: INFO: metadata-proxy-v0.1-b2xdn started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:04.153: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:04.153: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:04.317: INFO: Latency metrics for node bootstrap-e2e-master Dec 3 03:15:04.317: INFO: Logging node info for node bootstrap-e2e-minion-group-3k6d Dec 3 03:15:04.359: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3k6d /api/v1/nodes/bootstrap-e2e-minion-group-3k6d 27be8cb7-3aa4-4522-ac85-20da26bd0631 37099 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3k6d kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3k6d topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-6015":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-9792":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-8555":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-9542":"bootstrap-e2e-minion-group-3k6d","csi-mock-csi-mock-volumes-3632":"csi-mock-csi-mock-volumes-3632","csi-mock-csi-mock-volumes-8963":"csi-mock-csi-mock-volumes-8963","csi-mock-csi-mock-volumes-9932":"csi-mock-csi-mock-volumes-9932"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-3k6d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.230.19.255,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:323aa9707db5a0349fc3829baed3d8ee,SystemUUID:323aa970-7db5-a034-9fc3-829baed3d8ee,BootID:35d11602-3a27-4158-8abd-6152101be7c6,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/fluentd-gcp-scaler@sha256:4f28f10fb89506768910b858f7a18ffb996824a16d70d5ac895e49687df9ff58 k8s.gcr.io/fluentd-gcp-scaler:0.5.2],SizeBytes:90498960,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:13513083,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[busybox@sha256:679b1c1058c1f2dc59a3ee70eed986a88811c0205c8ceea57cec5f22d2c3fbb1 busybox:latest],SizeBytes:1219790,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:04.359: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3k6d Dec 3 03:15:04.411: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3k6d Dec 3 03:15:04.449: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3k6d: the server is currently unable to handle the request (get nodes bootstrap-e2e-minion-group-3k6d:10250) Dec 3 03:15:04.449: INFO: Logging node info for node bootstrap-e2e-minion-group-4kfl Dec 3 03:15:04.489: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-4kfl /api/v1/nodes/bootstrap-e2e-minion-group-4kfl dd9963b5-5d66-49cc-af35-0cb8c13d5de7 37998 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-4kfl kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-4kfl topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1470":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-ephemeral-9740":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-2571":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-7815":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-volume-398":"bootstrap-e2e-minion-group-4kfl","csi-mock-csi-mock-volumes-2306":"csi-mock-csi-mock-volumes-2306","csi-mock-csi-mock-volumes-2465":"csi-mock-csi-mock-volumes-2465","csi-mock-csi-mock-volumes-5287":"csi-mock-csi-mock-volumes-5287","csi-mock-csi-mock-volumes-9659":"csi-mock-csi-mock-volumes-9659"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-4kfl,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:56 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:56 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:56 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:56 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.13.80,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:30b63c524b868d3087050fb30234d2f7,SystemUUID:30b63c52-4b86-8d30-8705-0fb30234d2f7,BootID:03f4e451-9446-49a9-9e0b-32e618ab9497,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 gluster/glusterdynamic-provisioner:v1.0],SizeBytes:373281573,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/heapster-amd64@sha256:9fae0af136ce0cf4f88393b3670f7139ffc464692060c374d2ae748e13144521 k8s.gcr.io/heapster-amd64:v1.6.0-beta.1],SizeBytes:76016169,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/snapshot-controller@sha256:b3c1c484ffe4f0bbf000bda93fb745e1b3899b08d605a08581426a1963dd3e8a quay.io/k8scsi/snapshot-controller:v2.0.0-rc2],SizeBytes:47222712,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/metadata-concealment@sha256:e38f92502f6f6a175fb15b5ce2d02229d465b419d4a643f5999a0f88ee170dcc gcr.io/kubernetes-e2e-test-images/metadata-concealment:1.2],SizeBytes:5124686,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/gce-pd/bootstrap-e2e-dynamic-pvc-28b24f22-305c-4e9b-9b83-4a958ed99598],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/gce-pd/bootstrap-e2e-dynamic-pvc-28b24f22-305c-4e9b-9b83-4a958ed99598,DevicePath:/dev/disk/by-id/google-bootstrap-e2e-dynamic-pvc-28b24f22-305c-4e9b-9b83-4a958ed99598,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:04.490: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-4kfl Dec 3 03:15:04.548: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-4kfl Dec 3 03:15:04.600: INFO: test-webserver-c6a57e65-6bd0-49ca-91ec-4de611743d50 started at 2019-12-03 03:14:55 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.600: INFO: Container test-webserver ready: true, restart count 0 Dec 3 03:15:04.600: INFO: metadata-proxy-v0.1-8x5ch started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:04.600: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:04.600: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:04.600: INFO: netserver-1 started at 2019-12-03 03:10:00 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.600: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:04.600: INFO: kube-proxy-bootstrap-e2e-minion-group-4kfl started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.600: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:15:04.600: INFO: netserver-1 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.600: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:04.600: INFO: netserver-1 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.600: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:04.600: INFO: heapster-v1.6.0-beta.1-56cb44959-szz2b started at 2019-12-03 02:57:02 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:04.600: INFO: Container heapster ready: true, restart count 0 Dec 3 03:15:04.600: INFO: Container heapster-nanny ready: true, restart count 0 Dec 3 03:15:04.600: INFO: volume-snapshot-controller-0 started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.600: INFO: Container volume-snapshot-controller ready: true, restart count 0 Dec 3 03:15:04.600: INFO: netserver-1 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.600: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:04.600: INFO: fluentd-gcp-v3.2.0-8n4lg started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:04.600: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:04.600: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:04.600: INFO: netserver-1 started at 2019-12-03 03:10:01 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.600: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:04.600: INFO: netserver-1 started at 2019-12-03 03:10:32 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.601: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:04.771: INFO: Latency metrics for node bootstrap-e2e-minion-group-4kfl Dec 3 03:15:04.771: INFO: Logging node info for node bootstrap-e2e-minion-group-5z63 Dec 3 03:15:04.820: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-5z63 /api/v1/nodes/bootstrap-e2e-minion-group-5z63 80c242ff-92d9-4147-9224-53017c8034c4 37958 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-5z63 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-5z63 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7831":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3055":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3427":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-6545":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-755":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-9008":"bootstrap-e2e-minion-group-5z63","csi-hostpath-volume-expand-9229":"bootstrap-e2e-minion-group-5z63","csi-mock-csi-mock-volumes-2016":"csi-mock-csi-mock-volumes-2016","csi-mock-csi-mock-volumes-6472":"csi-mock-csi-mock-volumes-6472"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-5z63,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.135.120,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9bc851f45efbabdf9b8ebd2b559e5c3e,SystemUUID:9bc851f4-5efb-abdf-9b8e-bd2b559e5c3e,BootID:8e50611c-7834-4dbe-bffa-e61943723514,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[k8s.gcr.io/event-exporter@sha256:ab71028f7cbc851d273bb00449e30ab743d4e3be21ed2093299f718b42df0748 k8s.gcr.io/event-exporter:v0.3.1],SizeBytes:51445475,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:1d49fb3b108e6b42542e4a9b056dee308f06f88824326cde1636eea0472b799d k8s.gcr.io/prometheus-to-sd:v0.7.2],SizeBytes:42314030,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-3427^6d4b52bf-157a-11ea-8520-72234df9033e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-3427^6d4b52bf-157a-11ea-8520-72234df9033e,DevicePath:,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:04.821: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-5z63 Dec 3 03:15:04.882: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-5z63 Dec 3 03:15:04.931: INFO: csi-hostpath-attacher-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.931: INFO: Container csi-attacher ready: true, restart count 0 Dec 3 03:15:04.931: INFO: event-exporter-v0.3.1-747b47fcd-v9x29 started at 2019-12-03 02:56:59 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:04.931: INFO: Container event-exporter ready: true, restart count 0 Dec 3 03:15:04.931: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:04.931: INFO: netserver-2 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.931: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:04.931: INFO: netserver-2 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.931: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:04.931: INFO: ss2-1 started at 2019-12-03 03:09:36 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.931: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:04.931: INFO: csi-hostpath-resizer-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.931: INFO: Container csi-resizer ready: true, restart count 0 Dec 3 03:15:04.931: INFO: kube-dns-autoscaler-65bc6d4889-kjnhr started at 2019-12-03 03:03:02 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.931: INFO: Container autoscaler ready: true, restart count 0 Dec 3 03:15:04.931: INFO: csi-snapshotter-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.931: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 3 03:15:04.931: INFO: metadata-proxy-v0.1-gvbgq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:04.931: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:04.931: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:04.931: INFO: kube-proxy-bootstrap-e2e-minion-group-5z63 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.931: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:15:04.931: INFO: fluentd-gcp-v3.2.0-mzjbq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:04.931: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:04.931: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:04.931: INFO: inline-volume-tester-zmz7g started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.931: INFO: Container csi-volume-tester ready: true, restart count 0 Dec 3 03:15:04.931: INFO: netserver-2 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.931: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:04.931: INFO: netserver-2 started at 2019-12-03 03:10:00 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.931: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:04.931: INFO: csi-hostpathplugin-0 started at 2019-12-03 03:14:41 +0000 UTC (0+3 container statuses recorded) Dec 3 03:15:04.931: INFO: Container hostpath ready: true, restart count 0 Dec 3 03:15:04.931: INFO: Container liveness-probe ready: true, restart count 0 Dec 3 03:15:04.931: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 3 03:15:04.931: INFO: netserver-2 started at 2019-12-03 03:10:32 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.931: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:04.931: INFO: csi-hostpath-provisioner-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.931: INFO: Container csi-provisioner ready: true, restart count 0 Dec 3 03:15:04.931: INFO: netserver-2 started at 2019-12-03 03:10:01 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.931: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:05.159: INFO: Latency metrics for node bootstrap-e2e-minion-group-5z63 Dec 3 03:15:05.159: INFO: Logging node info for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:05.196: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-f8g7 /api/v1/nodes/bootstrap-e2e-minion-group-f8g7 0ae3612d-6f1b-43b7-ac42-d209b2c53997 38042 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-f8g7 kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-5136 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-f8g7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2646":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-provisioning-6116":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volume-expand-7110":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-1617":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-5822":"bootstrap-e2e-minion-group-f8g7","csi-mock-csi-mock-volumes-447":"csi-mock-csi-mock-volumes-447","csi-mock-csi-mock-volumes-4534":"csi-mock-csi-mock-volumes-4534","csi-mock-csi-mock-volumes-5485":"csi-mock-csi-mock-volumes-5485","csi-mock-csi-mock-volumes-6096":"csi-mock-csi-mock-volumes-6096","csi-mock-csi-mock-volumes-8158":"csi-mock-csi-mock-volumes-8158"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-f8g7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:00 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:00 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:00 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:15:00 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.230.75.62,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:343d3fec9626aaffa54d1b2394118877,SystemUUID:343d3fec-9626-aaff-a54d-1b2394118877,BootID:266805a2-3169-4ee5-8194-05b64e8d9864,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1],SizeBytes:121711221,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10],SizeBytes:61365829,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:39944451,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-447^4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-447^4,DevicePath:,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:05.197: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:05.239: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:05.469: INFO: netserver-3 started at 2019-12-03 03:10:01 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:05.469: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:05.469: INFO: pvc-volume-tester-57cch started at 2019-12-03 03:14:55 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:05.469: INFO: Container volume-tester ready: true, restart count 0 Dec 3 03:15:05.469: INFO: csi-mockplugin-attacher-0 started at 2019-12-03 03:14:48 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:05.469: INFO: Container csi-attacher ready: true, restart count 0 Dec 3 03:15:05.469: INFO: netserver-3 started at 2019-12-03 03:10:00 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:05.469: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:05.469: INFO: metrics-server-v0.3.6-7d96444597-lmbw7 started at 2019-12-03 02:57:03 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:05.469: INFO: Container metrics-server ready: true, restart count 0 Dec 3 03:15:05.469: INFO: Container metrics-server-nanny ready: true, restart count 0 Dec 3 03:15:05.469: INFO: netserver-3 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:05.469: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:05.469: INFO: pod-secrets-d5a30c98-13bb-4c17-aac0-d4d74fe60b60 started at 2019-12-03 03:14:15 +0000 UTC (0+3 container statuses recorded) Dec 3 03:15:05.469: INFO: Container creates-volume-test ready: true, restart count 0 Dec 3 03:15:05.469: INFO: Container dels-volume-test ready: true, restart count 0 Dec 3 03:15:05.469: INFO: Container upds-volume-test ready: true, restart count 0 Dec 3 03:15:05.469: INFO: netserver-3 started at 2019-12-03 03:10:32 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:05.469: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:05.469: INFO: coredns-65567c7b57-8thvw started at 2019-12-03 02:57:10 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:05.469: INFO: Container coredns ready: true, restart count 0 Dec 3 03:15:05.469: INFO: ss2-2 started at 2019-12-03 03:09:16 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:05.469: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:05.469: INFO: netserver-3 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:05.469: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:05.469: INFO: fluentd-gcp-v3.2.0-wv2h4 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:05.469: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:05.469: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:05.469: INFO: kubernetes-dashboard-7778f8b456-lrmfl started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:05.469: INFO: Container kubernetes-dashboard ready: true, restart count 0 Dec 3 03:15:05.469: INFO: netserver-3 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:05.469: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:05.469: INFO: csi-mockplugin-0 started at 2019-12-03 03:14:48 +0000 UTC (0+3 container statuses recorded) Dec 3 03:15:05.469: INFO: Container csi-provisioner ready: true, restart count 0 Dec 3 03:15:05.469: INFO: Container driver-registrar ready: true, restart count 0 Dec 3 03:15:05.469: INFO: Container mock ready: true, restart count 0 Dec 3 03:15:05.469: INFO: kube-proxy-bootstrap-e2e-minion-group-f8g7 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:05.469: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:15:05.469: INFO: metadata-proxy-v0.1-dmvr8 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:05.469: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:05.469: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:05.842: INFO: Latency metrics for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:05.842: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "container-probe-2038" for this suite.
Find test-webserver-10e80124-1f4b-415c-b0d5-b7ae23929fc2 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sStatefulSet\s\[k8s\.io\]\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sshould\sperform\scanary\supdates\sand\sphased\srolling\supdates\sof\stemplate\smodifications\s\[Conformance\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:721 Dec 3 03:19:42.363: Failed waiting for state update: timed out waiting for the condition /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:129from junit_12.xml
[BeforeEach] [sig-apps] StatefulSet /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Creating a kubernetes client Dec 3 03:08:18.024: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename statefulset �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in statefulset-3942 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:64 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:79 �[1mSTEP�[0m: Creating service test in namespace statefulset-3942 [It] should perform canary updates and phased rolling updates of template modifications [Conformance] /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:721 �[1mSTEP�[0m: Creating a new StatefulSet Dec 3 03:08:18.579: INFO: Found 1 stateful pods, waiting for 3 Dec 3 03:08:28.942: INFO: Found 1 stateful pods, waiting for 3 Dec 3 03:08:38.856: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true Dec 3 03:08:38.856: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true Dec 3 03:08:38.856: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false Dec 3 03:08:48.755: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true Dec 3 03:08:48.755: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true Dec 3 03:08:48.755: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Running - Ready=true �[1mSTEP�[0m: Updating stateful set template: update image from docker.io/library/httpd:2.4.38-alpine to docker.io/library/httpd:2.4.39-alpine Dec 3 03:08:49.479: INFO: Updating stateful set ss2 �[1mSTEP�[0m: Creating a new revision �[1mSTEP�[0m: Not applying an update when the partition is greater than the number of replicas �[1mSTEP�[0m: Performing a canary update Dec 3 03:08:59.860: INFO: Updating stateful set ss2 Dec 3 03:08:59.943: INFO: Waiting for Pod statefulset-3942/ss2-2 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 �[1mSTEP�[0m: Restoring Pods to the correct revision when they are deleted Dec 3 03:09:10.207: INFO: Found 2 stateful pods, waiting for 3 Dec 3 03:09:20.251: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true Dec 3 03:09:20.251: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true Dec 3 03:09:20.251: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false Dec 3 03:09:30.397: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true Dec 3 03:09:30.397: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true Dec 3 03:09:30.397: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Running - Ready=true �[1mSTEP�[0m: Performing a phased rolling update Dec 3 03:09:31.008: INFO: Updating stateful set ss2 Dec 3 03:09:31.239: INFO: Waiting for Pod statefulset-3942/ss2-1 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:09:41.773: INFO: Updating stateful set ss2 Dec 3 03:09:42.214: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:09:42.214: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:09:52.394: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:09:52.394: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:10:02.411: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:10:02.411: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:10:12.286: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:10:12.286: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:10:22.296: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:10:22.296: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:10:32.318: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:10:32.318: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:10:42.294: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:10:42.294: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:10:52.286: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:10:52.286: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:11:02.321: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:11:02.321: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:11:12.287: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:11:12.287: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:11:22.355: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:11:22.355: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:11:32.471: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:11:32.471: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:11:42.292: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:11:42.292: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:11:52.296: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:11:52.296: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:12:02.291: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:12:02.291: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:12:12.286: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:12:12.286: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:12:22.291: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:12:22.291: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:12:32.291: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:12:32.291: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:12:42.294: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:12:42.295: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:12:52.287: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:12:52.287: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:13:02.311: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:13:02.311: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:13:12.285: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:13:12.285: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:13:22.291: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:13:22.291: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:13:32.299: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:13:32.299: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:13:42.286: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:13:42.286: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:13:52.306: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:13:52.306: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:14:02.285: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:14:02.285: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:14:12.287: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:14:12.287: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:14:22.289: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:14:22.290: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:14:32.292: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:14:32.292: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:14:42.288: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:14:42.288: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:14:52.290: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:14:52.290: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:15:02.287: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:15:02.287: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:15:12.289: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:15:12.289: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:15:23.674: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:15:23.674: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:15:32.342: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:15:32.342: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:15:42.291: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:15:42.292: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:15:52.302: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:15:52.302: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:16:02.288: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:16:02.288: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:16:12.289: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:16:12.289: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:16:22.288: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:16:22.288: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:16:32.286: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:16:32.286: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:16:42.288: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:16:42.288: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:16:52.287: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:16:52.287: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:17:02.289: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:17:02.289: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:17:12.291: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:17:12.291: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:17:22.287: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:17:22.287: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:17:32.284: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:17:32.284: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:17:42.296: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:17:42.296: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:17:52.287: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:17:52.287: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:18:02.286: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:18:02.287: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:18:12.293: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:18:12.293: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:18:22.285: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:18:22.286: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:18:32.286: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:18:32.286: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:18:42.285: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:18:42.286: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:18:52.287: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:18:52.287: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:19:02.287: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:19:02.287: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:19:12.291: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:19:12.291: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:19:22.287: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:19:22.287: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:19:32.299: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:19:32.299: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:19:42.287: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:19:42.288: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:19:42.362: INFO: Waiting for StatefulSet statefulset-3942/ss2 to complete update Dec 3 03:19:42.362: INFO: Waiting for Pod statefulset-3942/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Dec 3 03:19:42.363: FAIL: Failed waiting for state update: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForState(0x542cb00, 0xc0014ad760, 0xc000a26a00, 0xc0029c7068) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:129 +0x105 k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForPartitionedRollingUpdate(0x542cb00, 0xc0014ad760, 0xc000738a00, 0x0, 0x0) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:48 +0x1f5 k8s.io/kubernetes/test/e2e/apps.glob..func10.2.8() /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:438 +0x4208 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00030e700) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:110 +0x30a k8s.io/kubernetes/test/e2e.TestE2E(0xc00030e700) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:112 +0x2b testing.tRunner(0xc00030e700, 0x4c381c8) /usr/local/go/src/testing/testing.go:909 +0xc9 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:960 +0x350 [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:90 Dec 3 03:19:42.400: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.39.205 --kubeconfig=/workspace/.kube/config describe po ss2-0 --namespace=statefulset-3942' Dec 3 03:19:42.678: INFO: stderr: "" Dec 3 03:19:42.678: INFO: stdout: "Name: ss2-0\nNamespace: statefulset-3942\nPriority: 0\nNode: bootstrap-e2e-minion-group-3k6d/10.138.0.3\nStart Time: Tue, 03 Dec 2019 03:09:10 +0000\nLabels: baz=blah\n controller-revision-hash=ss2-65c7964b94\n foo=bar\n statefulset.kubernetes.io/pod-name=ss2-0\nAnnotations: kubernetes.io/psp: e2e-test-privileged-psp\nStatus: Terminating (lasts 9m24s)\nTermination Grace Period: 30s\nIP: \nIPs: <none>\nControlled By: StatefulSet/ss2\nContainers:\n webserver:\n Container ID: docker://d3a9b441ff6a1bbc468ef2d189f3f5b8c24e9e05866d5bf98a11ec2bfc4dd902\n Image: docker.io/library/httpd:2.4.38-alpine\n Image ID: docker-pullable://httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4\n Port: <none>\n Host Port: <none>\n State: Terminated\n Exit Code: 0\n Started: Mon, 01 Jan 0001 00:00:00 +0000\n Finished: Mon, 01 Jan 0001 00:00:00 +0000\n Ready: False\n Restart Count: 0\n Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n Environment: <none>\n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from default-token-zdc7p (ro)\nConditions:\n Type Status\n Initialized True \n Ready False \n ContainersReady False \n PodScheduled True \nVolumes:\n default-token-zdc7p:\n Type: Secret (a volume populated by a Secret)\n SecretName: default-token-zdc7p\n Optional: false\nQoS Class: BestEffort\nNode-Selectors: <none>\nTolerations: node.kubernetes.io/not-ready:NoExecute for 300s\n node.kubernetes.io/unreachable:NoExecute for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 10m default-scheduler Successfully assigned statefulset-3942/ss2-0 to bootstrap-e2e-minion-group-3k6d\n Normal Pulled 10m kubelet, bootstrap-e2e-minion-group-3k6d Container image \"docker.io/library/httpd:2.4.38-alpine\" already present on machine\n Normal Created 10m kubelet, bootstrap-e2e-minion-group-3k6d Created container webserver\n Normal Started 10m kubelet, bootstrap-e2e-minion-group-3k6d Started container webserver\n Normal Killing 9m54s kubelet, bootstrap-e2e-minion-group-3k6d Stopping container webserver\n Warning Unhealthy 9m54s kubelet, bootstrap-e2e-minion-group-3k6d Readiness probe failed: Get http://10.64.1.242:80/index.html: dial tcp 10.64.1.242:80: connect: connection refused\n" Dec 3 03:19:42.678: INFO: Output of kubectl describe ss2-0: Name: ss2-0 Namespace: statefulset-3942 Priority: 0 Node: bootstrap-e2e-minion-group-3k6d/10.138.0.3 Start Time: Tue, 03 Dec 2019 03:09:10 +0000 Labels: baz=blah controller-revision-hash=ss2-65c7964b94 foo=bar statefulset.kubernetes.io/pod-name=ss2-0 Annotations: kubernetes.io/psp: e2e-test-privileged-psp Status: Terminating (lasts 9m24s) Termination Grace Period: 30s IP: IPs: <none> Controlled By: StatefulSet/ss2 Containers: webserver: Container ID: docker://d3a9b441ff6a1bbc468ef2d189f3f5b8c24e9e05866d5bf98a11ec2bfc4dd902 Image: docker.io/library/httpd:2.4.38-alpine Image ID: docker-pullable://httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 Port: <none> Host Port: <none> State: Terminated Exit Code: 0 Started: Mon, 01 Jan 0001 00:00:00 +0000 Finished: Mon, 01 Jan 0001 00:00:00 +0000 Ready: False Restart Count: 0 Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1 Environment: <none> Mounts: /var/run/secrets/kubernetes.io/serviceaccount from default-token-zdc7p (ro) Conditions: Type Status Initialized True Ready False ContainersReady False PodScheduled True Volumes: default-token-zdc7p: Type: Secret (a volume populated by a Secret) SecretName: default-token-zdc7p Optional: false QoS Class: BestEffort Node-Selectors: <none> Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s node.kubernetes.io/unreachable:NoExecute for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 10m default-scheduler Successfully assigned statefulset-3942/ss2-0 to bootstrap-e2e-minion-group-3k6d Normal Pulled 10m kubelet, bootstrap-e2e-minion-group-3k6d Container image "docker.io/library/httpd:2.4.38-alpine" already present on machine Normal Created 10m kubelet, bootstrap-e2e-minion-group-3k6d Created container webserver Normal Started 10m kubelet, bootstrap-e2e-minion-group-3k6d Started container webserver Normal Killing 9m54s kubelet, bootstrap-e2e-minion-group-3k6d Stopping container webserver Warning Unhealthy 9m54s kubelet, bootstrap-e2e-minion-group-3k6d Readiness probe failed: Get http://10.64.1.242:80/index.html: dial tcp 10.64.1.242:80: connect: connection refused Dec 3 03:19:42.678: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.39.205 --kubeconfig=/workspace/.kube/config logs ss2-0 --namespace=statefulset-3942 --tail=100' Dec 3 03:19:42.932: INFO: rc: 1 Dec 3 03:19:42.932: INFO: Last 100 log lines of ss2-0: Dec 3 03:19:42.932: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.39.205 --kubeconfig=/workspace/.kube/config describe po ss2-1 --namespace=statefulset-3942' Dec 3 03:19:43.223: INFO: stderr: "" Dec 3 03:19:43.223: INFO: stdout: "Name: ss2-1\nNamespace: statefulset-3942\nPriority: 0\nNode: bootstrap-e2e-minion-group-5z63/10.138.0.4\nStart Time: Tue, 03 Dec 2019 03:09:36 +0000\nLabels: baz=blah\n controller-revision-hash=ss2-84f9d6bf57\n foo=bar\n statefulset.kubernetes.io/pod-name=ss2-1\nAnnotations: kubernetes.io/psp: e2e-test-privileged-psp\nStatus: Running\nIP: 10.64.2.22\nIPs:\n IP: 10.64.2.22\nControlled By: StatefulSet/ss2\nContainers:\n webserver:\n Container ID: docker://4f867e91e88be16d470c4247a5d948b70e7e30684741ba34ea94dfd85f011b76\n Image: docker.io/library/httpd:2.4.39-alpine\n Image ID: docker-pullable://httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71\n Port: <none>\n Host Port: <none>\n State: Running\n Started: Tue, 03 Dec 2019 03:09:37 +0000\n Ready: True\n Restart Count: 0\n Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n Environment: <none>\n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from default-token-zdc7p (ro)\nConditions:\n Type Status\n Initialized True \n Ready True \n ContainersReady True \n PodScheduled True \nVolumes:\n default-token-zdc7p:\n Type: Secret (a volume populated by a Secret)\n SecretName: default-token-zdc7p\n Optional: false\nQoS Class: BestEffort\nNode-Selectors: <none>\nTolerations: node.kubernetes.io/not-ready:NoExecute for 300s\n node.kubernetes.io/unreachable:NoExecute for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 10m default-scheduler Successfully assigned statefulset-3942/ss2-1 to bootstrap-e2e-minion-group-5z63\n Normal Pulled 10m kubelet, bootstrap-e2e-minion-group-5z63 Container image \"docker.io/library/httpd:2.4.39-alpine\" already present on machine\n Normal Created 10m kubelet, bootstrap-e2e-minion-group-5z63 Created container webserver\n Normal Started 10m kubelet, bootstrap-e2e-minion-group-5z63 Started container webserver\n" Dec 3 03:19:43.223: INFO: Output of kubectl describe ss2-1: Name: ss2-1 Namespace: statefulset-3942 Priority: 0 Node: bootstrap-e2e-minion-group-5z63/10.138.0.4 Start Time: Tue, 03 Dec 2019 03:09:36 +0000 Labels: baz=blah controller-revision-hash=ss2-84f9d6bf57 foo=bar statefulset.kubernetes.io/pod-name=ss2-1 Annotations: kubernetes.io/psp: e2e-test-privileged-psp Status: Running IP: 10.64.2.22 IPs: IP: 10.64.2.22 Controlled By: StatefulSet/ss2 Containers: webserver: Container ID: docker://4f867e91e88be16d470c4247a5d948b70e7e30684741ba34ea94dfd85f011b76 Image: docker.io/library/httpd:2.4.39-alpine Image ID: docker-pullable://httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 Port: <none> Host Port: <none> State: Running Started: Tue, 03 Dec 2019 03:09:37 +0000 Ready: True Restart Count: 0 Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1 Environment: <none> Mounts: /var/run/secrets/kubernetes.io/serviceaccount from default-token-zdc7p (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: default-token-zdc7p: Type: Secret (a volume populated by a Secret) SecretName: default-token-zdc7p Optional: false QoS Class: BestEffort Node-Selectors: <none> Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s node.kubernetes.io/unreachable:NoExecute for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 10m default-scheduler Successfully assigned statefulset-3942/ss2-1 to bootstrap-e2e-minion-group-5z63 Normal Pulled 10m kubelet, bootstrap-e2e-minion-group-5z63 Container image "docker.io/library/httpd:2.4.39-alpine" already present on machine Normal Created 10m kubelet, bootstrap-e2e-minion-group-5z63 Created container webserver Normal Started 10m kubelet, bootstrap-e2e-minion-group-5z63 Started container webserver Dec 3 03:19:43.223: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.39.205 --kubeconfig=/workspace/.kube/config logs ss2-1 --namespace=statefulset-3942 --tail=100' Dec 3 03:19:43.462: INFO: stderr: "" Dec 3 03:19:43.462: INFO: stdout: "10.64.2.1 - - [03/Dec/2019:03:18:03 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:04 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:05 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:06 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:07 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:08 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:09 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:10 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:11 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:12 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:13 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:14 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:15 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:16 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:17 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:18 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:19 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:20 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:21 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:22 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:23 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:24 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:25 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:26 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:27 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:28 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:29 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:30 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:31 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:32 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:33 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:34 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:35 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:36 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:37 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:38 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:39 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:40 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:41 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:42 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:43 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:44 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:45 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:46 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:47 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:48 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:49 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:50 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:51 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:52 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:53 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:54 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:55 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:56 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:57 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:58 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:18:59 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:00 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:01 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:02 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:03 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:04 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:05 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:06 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:07 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:08 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:09 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:10 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:11 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:12 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:13 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:14 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:15 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:16 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:17 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:18 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:19 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:20 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:21 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:22 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:23 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:24 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:25 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:26 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:27 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:28 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:29 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:30 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:31 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:32 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:33 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:34 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:35 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:36 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:37 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:38 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:39 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:40 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:41 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.2.1 - - [03/Dec/2019:03:19:42 +0000] \"GET /index.html HTTP/1.1\" 200 45\n" Dec 3 03:19:43.463: INFO: Last 100 log lines of ss2-1: 10.64.2.1 - - [03/Dec/2019:03:18:03 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:04 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:05 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:06 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:07 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:08 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:09 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:10 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:11 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:12 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:13 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:14 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:15 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:16 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:17 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:18 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:19 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:20 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:21 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:22 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:23 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:24 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:25 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:26 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:27 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:28 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:29 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:30 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:31 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:32 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:33 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:34 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:35 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:36 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:37 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:38 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:39 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:40 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:41 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:42 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:43 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:44 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:45 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:46 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:47 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:48 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:49 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:50 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:51 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:52 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:53 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:54 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:55 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:56 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:57 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:58 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:18:59 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:00 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:01 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:02 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:03 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:04 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:05 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:06 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:07 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:08 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:09 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:10 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:11 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:12 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:13 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:14 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:15 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:16 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:17 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:18 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:19 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:20 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:21 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:22 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:23 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:24 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:25 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:26 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:27 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:28 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:29 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:30 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:31 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:32 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:33 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:34 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:35 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:36 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:37 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:38 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:39 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:40 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:41 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.2.1 - - [03/Dec/2019:03:19:42 +0000] "GET /index.html HTTP/1.1" 200 45 Dec 3 03:19:43.463: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.39.205 --kubeconfig=/workspace/.kube/config describe po ss2-2 --namespace=statefulset-3942' Dec 3 03:19:43.772: INFO: stderr: "" Dec 3 03:19:43.772: INFO: stdout: "Name: ss2-2\nNamespace: statefulset-3942\nPriority: 0\nNode: bootstrap-e2e-minion-group-f8g7/10.138.0.6\nStart Time: Tue, 03 Dec 2019 03:09:16 +0000\nLabels: baz=blah\n controller-revision-hash=ss2-84f9d6bf57\n foo=bar\n statefulset.kubernetes.io/pod-name=ss2-2\nAnnotations: kubernetes.io/psp: e2e-test-privileged-psp\nStatus: Running\nIP: 10.64.3.29\nIPs:\n IP: 10.64.3.29\nControlled By: StatefulSet/ss2\nContainers:\n webserver:\n Container ID: docker://7a662f2bafcd860a4a3e2cc30574e57443267126305632bc09e7504d3dd97546\n Image: docker.io/library/httpd:2.4.39-alpine\n Image ID: docker-pullable://httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71\n Port: <none>\n Host Port: <none>\n State: Running\n Started: Tue, 03 Dec 2019 03:09:21 +0000\n Ready: True\n Restart Count: 0\n Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n Environment: <none>\n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from default-token-zdc7p (ro)\nConditions:\n Type Status\n Initialized True \n Ready True \n ContainersReady True \n PodScheduled True \nVolumes:\n default-token-zdc7p:\n Type: Secret (a volume populated by a Secret)\n SecretName: default-token-zdc7p\n Optional: false\nQoS Class: BestEffort\nNode-Selectors: <none>\nTolerations: node.kubernetes.io/not-ready:NoExecute for 300s\n node.kubernetes.io/unreachable:NoExecute for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 10m default-scheduler Successfully assigned statefulset-3942/ss2-2 to bootstrap-e2e-minion-group-f8g7\n Normal Pulled 10m kubelet, bootstrap-e2e-minion-group-f8g7 Container image \"docker.io/library/httpd:2.4.39-alpine\" already present on machine\n Normal Created 10m kubelet, bootstrap-e2e-minion-group-f8g7 Created container webserver\n Normal Started 10m kubelet, bootstrap-e2e-minion-group-f8g7 Started container webserver\n" Dec 3 03:19:43.772: INFO: Output of kubectl describe ss2-2: Name: ss2-2 Namespace: statefulset-3942 Priority: 0 Node: bootstrap-e2e-minion-group-f8g7/10.138.0.6 Start Time: Tue, 03 Dec 2019 03:09:16 +0000 Labels: baz=blah controller-revision-hash=ss2-84f9d6bf57 foo=bar statefulset.kubernetes.io/pod-name=ss2-2 Annotations: kubernetes.io/psp: e2e-test-privileged-psp Status: Running IP: 10.64.3.29 IPs: IP: 10.64.3.29 Controlled By: StatefulSet/ss2 Containers: webserver: Container ID: docker://7a662f2bafcd860a4a3e2cc30574e57443267126305632bc09e7504d3dd97546 Image: docker.io/library/httpd:2.4.39-alpine Image ID: docker-pullable://httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 Port: <none> Host Port: <none> State: Running Started: Tue, 03 Dec 2019 03:09:21 +0000 Ready: True Restart Count: 0 Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1 Environment: <none> Mounts: /var/run/secrets/kubernetes.io/serviceaccount from default-token-zdc7p (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: default-token-zdc7p: Type: Secret (a volume populated by a Secret) SecretName: default-token-zdc7p Optional: false QoS Class: BestEffort Node-Selectors: <none> Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s node.kubernetes.io/unreachable:NoExecute for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 10m default-scheduler Successfully assigned statefulset-3942/ss2-2 to bootstrap-e2e-minion-group-f8g7 Normal Pulled 10m kubelet, bootstrap-e2e-minion-group-f8g7 Container image "docker.io/library/httpd:2.4.39-alpine" already present on machine Normal Created 10m kubelet, bootstrap-e2e-minion-group-f8g7 Created container webserver Normal Started 10m kubelet, bootstrap-e2e-minion-group-f8g7 Started container webserver Dec 3 03:19:43.772: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://34.82.39.205 --kubeconfig=/workspace/.kube/config logs ss2-2 --namespace=statefulset-3942 --tail=100' Dec 3 03:19:44.019: INFO: stderr: "" Dec 3 03:19:44.019: INFO: stdout: "10.64.3.1 - - [03/Dec/2019:03:18:04 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:05 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:06 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:07 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:08 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:09 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:10 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:11 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:12 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:13 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:14 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:15 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:16 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:17 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:18 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:19 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:20 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:21 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:22 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:23 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:24 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:25 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:26 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:27 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:28 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:29 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:30 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:31 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:32 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:33 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:34 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:35 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:36 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:37 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:38 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:39 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:40 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:41 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:42 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:43 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:44 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:45 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:46 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:47 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:48 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:49 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:50 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:51 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:52 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:53 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:54 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:55 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:56 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:57 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:58 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:18:59 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:00 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:01 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:02 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:03 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:04 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:05 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:06 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:07 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:08 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:09 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:10 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:11 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:12 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:13 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:14 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:15 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:16 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:17 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:18 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:19 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:20 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:21 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:22 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:23 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:24 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:25 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:26 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:27 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:28 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:29 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:30 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:31 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:32 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:33 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:34 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:35 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:36 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:37 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:38 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:39 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:40 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:41 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:42 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.64.3.1 - - [03/Dec/2019:03:19:43 +0000] \"GET /index.html HTTP/1.1\" 200 45\n" Dec 3 03:19:44.019: INFO: Last 100 log lines of ss2-2: 10.64.3.1 - - [03/Dec/2019:03:18:04 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:05 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:06 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:07 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:08 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:09 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:10 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:11 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:12 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:13 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:14 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:15 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:16 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:17 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:18 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:19 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:20 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:21 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:22 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:23 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:24 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:25 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:26 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:27 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:28 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:29 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:30 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:31 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:32 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:33 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:34 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:35 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:36 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:37 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:38 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:39 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:40 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:41 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:42 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:43 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:44 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:45 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:46 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:47 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:48 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:49 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:50 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:51 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:52 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:53 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:54 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:55 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:56 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:57 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:58 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:18:59 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:00 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:01 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:02 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:03 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:04 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:05 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:06 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:07 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:08 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:09 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:10 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:11 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:12 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:13 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:14 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:15 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:16 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:17 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:18 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:19 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:20 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:21 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:22 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:23 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:24 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:25 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:26 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:27 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:28 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:29 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:30 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:31 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:32 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:33 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:34 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:35 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:36 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:37 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:38 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:39 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:40 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:41 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:42 +0000] "GET /index.html HTTP/1.1" 200 45 10.64.3.1 - - [03/Dec/2019:03:19:43 +0000] "GET /index.html HTTP/1.1" 200 45 Dec 3 03:19:44.019: INFO: Deleting all statefulset in ns statefulset-3942 Dec 3 03:19:44.056: INFO: Scaling statefulset ss2 to 0 Dec 3 03:29:44.289: INFO: Waiting for statefulset status.replicas updated to 0 Dec 3 03:29:44.326: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:29:54.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:30:04.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:30:14.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:30:24.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:30:34.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:30:44.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:30:54.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:31:04.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:31:14.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:31:24.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:31:34.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:31:44.376: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:31:54.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:32:04.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:32:14.368: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:32:24.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:32:34.426: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:32:44.366: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:32:54.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:33:04.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:33:14.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:33:24.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:33:34.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:33:44.371: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:33:54.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:34:04.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:34:14.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:34:24.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:34:34.388: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:34:44.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:34:54.362: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:35:04.366: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:35:14.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:35:24.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:35:34.366: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:35:44.366: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:35:54.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:36:04.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:36:14.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:36:24.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:36:34.370: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:36:44.381: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:36:54.366: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:37:04.366: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:37:14.371: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:37:24.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:37:34.389: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:37:44.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:37:54.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:38:04.365: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:38:14.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:38:24.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:38:34.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:38:44.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:38:54.370: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:39:04.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:39:14.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:39:24.363: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:39:34.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:39:44.364: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:39:44.399: INFO: Waiting for stateful set status.replicas to become 0, currently 1 Dec 3 03:39:44.399: FAIL: Failed waiting for stateful set status.replicas updated to 0: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForStatusReplicas(0x542cb00, 0xc0014ad760, 0xc000abd400, 0x0) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:272 +0x22e k8s.io/kubernetes/test/e2e/framework/statefulset.DeleteAllStatefulSets(0x542cb00, 0xc0014ad760, 0xc00304c8f0, 0x10) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/rest.go:94 +0x385 k8s.io/kubernetes/test/e2e/apps.glob..func10.2.2() /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:95 +0x135 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00030e700) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:110 +0x30a k8s.io/kubernetes/test/e2e.TestE2E(0xc00030e700) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:112 +0x2b testing.tRunner(0xc00030e700, 0x4c381c8) /usr/local/go/src/testing/testing.go:909 +0xc9 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:960 +0x350 [AfterEach] [sig-apps] StatefulSet /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:152 �[1mSTEP�[0m: Collecting events from namespace "statefulset-3942". �[1mSTEP�[0m: Found 46 events. Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:18 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulCreate: create Pod ss2-0 in StatefulSet ss2 successful Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:18 +0000 UTC - event for ss2-0: {default-scheduler } Scheduled: Successfully assigned statefulset-3942/ss2-0 to bootstrap-e2e-minion-group-5z63 Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:24 +0000 UTC - event for ss2-0: {kubelet bootstrap-e2e-minion-group-5z63} Pulled: Container image "docker.io/library/httpd:2.4.38-alpine" already present on machine Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:24 +0000 UTC - event for ss2-0: {kubelet bootstrap-e2e-minion-group-5z63} Created: Created container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:25 +0000 UTC - event for ss2-0: {kubelet bootstrap-e2e-minion-group-5z63} Started: Started container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:29 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulCreate: create Pod ss2-1 in StatefulSet ss2 successful Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:29 +0000 UTC - event for ss2-1: {default-scheduler } Scheduled: Successfully assigned statefulset-3942/ss2-1 to bootstrap-e2e-minion-group-4kfl Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:31 +0000 UTC - event for ss2-1: {kubelet bootstrap-e2e-minion-group-4kfl} Started: Started container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:31 +0000 UTC - event for ss2-1: {kubelet bootstrap-e2e-minion-group-4kfl} Created: Created container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:31 +0000 UTC - event for ss2-1: {kubelet bootstrap-e2e-minion-group-4kfl} Pulled: Container image "docker.io/library/httpd:2.4.38-alpine" already present on machine Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:33 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulCreate: create Pod ss2-2 in StatefulSet ss2 successful Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:34 +0000 UTC - event for ss2-2: {default-scheduler } Scheduled: Successfully assigned statefulset-3942/ss2-2 to bootstrap-e2e-minion-group-f8g7 Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:34 +0000 UTC - event for test: {endpoint-controller } FailedToUpdateEndpoint: Failed to update endpoint statefulset-3942/test: Operation cannot be fulfilled on endpoints "test": the object has been modified; please apply your changes to the latest version and try again Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:36 +0000 UTC - event for ss2-2: {kubelet bootstrap-e2e-minion-group-f8g7} Created: Created container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:36 +0000 UTC - event for ss2-2: {kubelet bootstrap-e2e-minion-group-f8g7} Pulled: Container image "docker.io/library/httpd:2.4.38-alpine" already present on machine Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:37 +0000 UTC - event for ss2-2: {kubelet bootstrap-e2e-minion-group-f8g7} Started: Started container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:59 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulDelete: delete Pod ss2-2 in StatefulSet ss2 successful Dec 3 03:39:44.444: INFO: At 2019-12-03 03:08:59 +0000 UTC - event for ss2-2: {kubelet bootstrap-e2e-minion-group-f8g7} Killing: Stopping container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:00 +0000 UTC - event for ss2-2: {kubelet bootstrap-e2e-minion-group-f8g7} Unhealthy: Readiness probe failed: Get http://10.64.3.8:80/index.html: dial tcp 10.64.3.8:80: connect: connection refused Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:06 +0000 UTC - event for ss2-2: {default-scheduler } Scheduled: Successfully assigned statefulset-3942/ss2-2 to bootstrap-e2e-minion-group-f8g7 Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:07 +0000 UTC - event for ss2-2: {kubelet bootstrap-e2e-minion-group-f8g7} Created: Created container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:07 +0000 UTC - event for ss2-2: {kubelet bootstrap-e2e-minion-group-f8g7} Started: Started container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:07 +0000 UTC - event for ss2-2: {kubelet bootstrap-e2e-minion-group-f8g7} Pulled: Container image "docker.io/library/httpd:2.4.39-alpine" already present on machine Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:10 +0000 UTC - event for ss2-0: {kubelet bootstrap-e2e-minion-group-5z63} Killing: Stopping container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:10 +0000 UTC - event for ss2-0: {default-scheduler } Scheduled: Successfully assigned statefulset-3942/ss2-0 to bootstrap-e2e-minion-group-3k6d Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:10 +0000 UTC - event for ss2-2: {kubelet bootstrap-e2e-minion-group-f8g7} Killing: Stopping container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:12 +0000 UTC - event for ss2-0: {kubelet bootstrap-e2e-minion-group-3k6d} Pulled: Container image "docker.io/library/httpd:2.4.38-alpine" already present on machine Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:12 +0000 UTC - event for ss2-0: {kubelet bootstrap-e2e-minion-group-3k6d} Created: Created container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:13 +0000 UTC - event for ss2-0: {kubelet bootstrap-e2e-minion-group-3k6d} Started: Started container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:16 +0000 UTC - event for ss2-2: {default-scheduler } Scheduled: Successfully assigned statefulset-3942/ss2-2 to bootstrap-e2e-minion-group-f8g7 Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:20 +0000 UTC - event for ss2-2: {kubelet bootstrap-e2e-minion-group-f8g7} Pulled: Container image "docker.io/library/httpd:2.4.39-alpine" already present on machine Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:20 +0000 UTC - event for ss2-2: {kubelet bootstrap-e2e-minion-group-f8g7} Created: Created container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:21 +0000 UTC - event for ss2-2: {kubelet bootstrap-e2e-minion-group-f8g7} Started: Started container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:31 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulDelete: delete Pod ss2-1 in StatefulSet ss2 successful Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:31 +0000 UTC - event for ss2-1: {kubelet bootstrap-e2e-minion-group-4kfl} Killing: Stopping container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:36 +0000 UTC - event for ss2-1: {default-scheduler } Scheduled: Successfully assigned statefulset-3942/ss2-1 to bootstrap-e2e-minion-group-5z63 Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:37 +0000 UTC - event for ss2-1: {kubelet bootstrap-e2e-minion-group-5z63} Created: Created container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:37 +0000 UTC - event for ss2-1: {kubelet bootstrap-e2e-minion-group-5z63} Started: Started container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:37 +0000 UTC - event for ss2-1: {kubelet bootstrap-e2e-minion-group-5z63} Pulled: Container image "docker.io/library/httpd:2.4.39-alpine" already present on machine Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:48 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulDelete: delete Pod ss2-0 in StatefulSet ss2 successful Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:48 +0000 UTC - event for ss2-0: {kubelet bootstrap-e2e-minion-group-3k6d} Killing: Stopping container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:09:48 +0000 UTC - event for ss2-0: {kubelet bootstrap-e2e-minion-group-3k6d} Unhealthy: Readiness probe failed: Get http://10.64.1.242:80/index.html: dial tcp 10.64.1.242:80: connect: connection refused Dec 3 03:39:44.444: INFO: At 2019-12-03 03:11:20 +0000 UTC - event for ss2-2: {kubelet bootstrap-e2e-minion-group-f8g7} FailedMount: Unable to attach or mount volumes: unmounted volumes=[default-token-zdc7p], unattached volumes=[default-token-zdc7p]: timed out waiting for the condition Dec 3 03:39:44.444: INFO: At 2019-12-03 03:19:44 +0000 UTC - event for ss2-2: {kubelet bootstrap-e2e-minion-group-f8g7} Unhealthy: Readiness probe failed: Get http://10.64.3.29:80/index.html: dial tcp 10.64.3.29:80: connect: connection refused Dec 3 03:39:44.444: INFO: At 2019-12-03 03:19:44 +0000 UTC - event for ss2-2: {kubelet bootstrap-e2e-minion-group-f8g7} Killing: Stopping container webserver Dec 3 03:39:44.444: INFO: At 2019-12-03 03:19:53 +0000 UTC - event for ss2-1: {kubelet bootstrap-e2e-minion-group-5z63} Killing: Stopping container webserver Dec 3 03:39:44.480: INFO: POD NODE PHASE GRACE CONDITIONS Dec 3 03:39:44.480: INFO: ss2-0 bootstrap-e2e-minion-group-3k6d Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:09:10 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:09:48 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:09:48 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:09:10 +0000 UTC }] Dec 3 03:39:44.480: INFO: Dec 3 03:39:44.523: INFO: Logging node info for node bootstrap-e2e-master Dec 3 03:39:44.559: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master /api/v1/nodes/bootstrap-e2e-master 64f6954b-0039-46a9-bde3-dcd825532c16 43477 0 2019-12-03 02:56:38 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3876802560 0} {<nil>} 3785940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3614658560 0} {<nil>} 3529940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:37:35 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:37:35 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:37:35 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:37:35 +0000 UTC,LastTransitionTime:2019-12-03 02:56:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.39.205,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5736e6f149167618f71cd530dafef4cc,SystemUUID:5736e6f1-4916-7618-f71c-d530dafef4cc,BootID:113c1994-21fb-4e64-a041-99c12a1d120b,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3-0],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:212299081,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:200712199,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:110449186,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:3e315022a842d782a28e729720f21091dde21f1efea28868d65ec595ad871616 k8s.gcr.io/kube-addon-manager:v9.0.2],SizeBytes:83076028,},ContainerImage{Names:[k8s.gcr.io/etcd-empty-dir-cleanup@sha256:484662e55e0705caed26c6fb8632097457f43ce685756531da7a76319a7dcee1 k8s.gcr.io/etcd-empty-dir-cleanup:3.4.3.0],SizeBytes:77408900,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:76121176,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:39:44.560: INFO: Logging kubelet events for node bootstrap-e2e-master Dec 3 03:39:44.600: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Dec 3 03:39:44.663: INFO: etcd-empty-dir-cleanup-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.663: INFO: Container etcd-empty-dir-cleanup ready: true, restart count 0 Dec 3 03:39:44.663: INFO: etcd-server-events-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.663: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:39:44.663: INFO: etcd-server-bootstrap-e2e-master started at 2019-12-03 02:57:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.663: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:39:44.663: INFO: kube-apiserver-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.663: INFO: Container kube-apiserver ready: true, restart count 0 Dec 3 03:39:44.663: INFO: kube-scheduler-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.663: INFO: Container kube-scheduler ready: true, restart count 0 Dec 3 03:39:44.663: INFO: l7-lb-controller-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.663: INFO: Container l7-lb-controller ready: true, restart count 2 Dec 3 03:39:44.663: INFO: fluentd-gcp-v3.2.0-r5wvv started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:39:44.663: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:39:44.663: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:39:44.663: INFO: metadata-proxy-v0.1-b2xdn started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:39:44.663: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:39:44.663: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:39:44.663: INFO: kube-controller-manager-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.663: INFO: Container kube-controller-manager ready: true, restart count 0 Dec 3 03:39:44.663: INFO: kube-addon-manager-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.663: INFO: Container kube-addon-manager ready: true, restart count 0 Dec 3 03:39:44.793: INFO: Latency metrics for node bootstrap-e2e-master Dec 3 03:39:44.793: INFO: Logging node info for node bootstrap-e2e-minion-group-3k6d Dec 3 03:39:44.829: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3k6d /api/v1/nodes/bootstrap-e2e-minion-group-3k6d 27be8cb7-3aa4-4522-ac85-20da26bd0631 43260 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3k6d kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3k6d topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-6015":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-9792":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-8555":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-9542":"bootstrap-e2e-minion-group-3k6d","csi-mock-csi-mock-volumes-3632":"csi-mock-csi-mock-volumes-3632","csi-mock-csi-mock-volumes-8963":"csi-mock-csi-mock-volumes-8963","csi-mock-csi-mock-volumes-9932":"csi-mock-csi-mock-volumes-9932"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-3k6d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:35:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:35:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:35:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:35:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:35:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:35:26 +0000 UTC,LastTransitionTime:2019-12-03 03:15:24 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:35:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:36:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:36:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:36:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:36:27 +0000 UTC,LastTransitionTime:2019-12-03 03:36:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.230.19.255,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:323aa9707db5a0349fc3829baed3d8ee,SystemUUID:323aa970-7db5-a034-9fc3-829baed3d8ee,BootID:35d11602-3a27-4158-8abd-6152101be7c6,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/fluentd-gcp-scaler@sha256:4f28f10fb89506768910b858f7a18ffb996824a16d70d5ac895e49687df9ff58 k8s.gcr.io/fluentd-gcp-scaler:0.5.2],SizeBytes:90498960,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:13513083,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[busybox@sha256:679b1c1058c1f2dc59a3ee70eed986a88811c0205c8ceea57cec5f22d2c3fbb1 busybox:latest],SizeBytes:1219790,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:39:44.830: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3k6d Dec 3 03:39:44.869: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3k6d Dec 3 03:39:44.932: INFO: coredns-65567c7b57-zlk2x started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.932: INFO: Container coredns ready: true, restart count 0 Dec 3 03:39:44.932: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.932: INFO: Container webserver ready: false, restart count 0 Dec 3 03:39:44.932: INFO: pod-ephm-test-projected-8z62 started at 2019-12-03 03:09:17 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.932: INFO: Container test-container-subpath-projected-8z62 ready: false, restart count 0 Dec 3 03:39:44.932: INFO: local-client started at 2019-12-03 03:09:34 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.932: INFO: Container local-client ready: false, restart count 0 Dec 3 03:39:44.932: INFO: netserver-0 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.932: INFO: Container webserver ready: false, restart count 0 Dec 3 03:39:44.932: INFO: pod-subpath-test-hostpath-8sl4 started at 2019-12-03 03:15:08 +0000 UTC (0+2 container statuses recorded) Dec 3 03:39:44.932: INFO: Container test-container-subpath-hostpath-8sl4 ready: false, restart count 0 Dec 3 03:39:44.932: INFO: Container test-container-volume-hostpath-8sl4 ready: false, restart count 0 Dec 3 03:39:44.932: INFO: l7-default-backend-678889f899-kfz7v started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.932: INFO: Container default-http-backend ready: true, restart count 0 Dec 3 03:39:44.932: INFO: ss2-0 started at 2019-12-03 03:09:10 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.932: INFO: Container webserver ready: false, restart count 0 Dec 3 03:39:44.932: INFO: metadata-proxy-v0.1-8w2f8 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:39:44.932: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:39:44.932: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:39:44.932: INFO: csi-mockplugin-0 started at 2019-12-03 03:08:07 +0000 UTC (0+3 container statuses recorded) Dec 3 03:39:44.932: INFO: Container csi-provisioner ready: false, restart count 0 Dec 3 03:39:44.932: INFO: Container driver-registrar ready: false, restart count 0 Dec 3 03:39:44.932: INFO: Container mock ready: false, restart count 0 Dec 3 03:39:44.932: INFO: pvc-volume-tester-fnspg started at 2019-12-03 03:08:16 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.932: INFO: Container volume-tester ready: false, restart count 0 Dec 3 03:39:44.932: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.932: INFO: Container webserver ready: false, restart count 0 Dec 3 03:39:44.932: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.932: INFO: Container webserver ready: false, restart count 0 Dec 3 03:39:44.932: INFO: fluentd-gcp-scaler-76d9c77b4d-lfhqr started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.932: INFO: Container fluentd-gcp-scaler ready: true, restart count 0 Dec 3 03:39:44.932: INFO: fluentd-gcp-v3.2.0-lf9js started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:39:44.932: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:39:44.932: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:39:44.932: INFO: netserver-0 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.932: INFO: Container webserver ready: false, restart count 0 Dec 3 03:39:44.932: INFO: test-webserver-10e80124-1f4b-415c-b0d5-b7ae23929fc2 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.932: INFO: Container test-webserver ready: false, restart count 0 Dec 3 03:39:44.932: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.932: INFO: Container webserver ready: false, restart count 0 Dec 3 03:39:44.932: INFO: hostpath-symlink-prep-provisioning-6108 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.932: INFO: Container init-volume-provisioning-6108 ready: false, restart count 0 Dec 3 03:39:44.932: INFO: kube-proxy-bootstrap-e2e-minion-group-3k6d started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.932: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:39:44.932: INFO: csi-mockplugin-resizer-0 started at 2019-12-03 03:08:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:44.932: INFO: Container csi-resizer ready: false, restart count 0 Dec 3 03:39:45.083: INFO: Latency metrics for node bootstrap-e2e-minion-group-3k6d Dec 3 03:39:45.083: INFO: Logging node info for node bootstrap-e2e-minion-group-4kfl Dec 3 03:39:45.120: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-4kfl /api/v1/nodes/bootstrap-e2e-minion-group-4kfl dd9963b5-5d66-49cc-af35-0cb8c13d5de7 43211 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-4kfl kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-4kfl topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1470":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-ephemeral-9740":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-2571":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-7815":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-volume-398":"bootstrap-e2e-minion-group-4kfl","csi-mock-csi-mock-volumes-2306":"csi-mock-csi-mock-volumes-2306","csi-mock-csi-mock-volumes-2465":"csi-mock-csi-mock-volumes-2465","csi-mock-csi-mock-volumes-5287":"csi-mock-csi-mock-volumes-5287","csi-mock-csi-mock-volumes-9659":"csi-mock-csi-mock-volumes-9659"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-4kfl,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:35:29 +0000 UTC,LastTransitionTime:2019-12-03 03:15:26 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:35:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:35:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:35:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:35:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:35:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:35:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:36:12 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:36:12 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:36:12 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:36:12 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.13.80,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:30b63c524b868d3087050fb30234d2f7,SystemUUID:30b63c52-4b86-8d30-8705-0fb30234d2f7,BootID:03f4e451-9446-49a9-9e0b-32e618ab9497,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 gluster/glusterdynamic-provisioner:v1.0],SizeBytes:373281573,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/heapster-amd64@sha256:9fae0af136ce0cf4f88393b3670f7139ffc464692060c374d2ae748e13144521 k8s.gcr.io/heapster-amd64:v1.6.0-beta.1],SizeBytes:76016169,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/snapshot-controller@sha256:b3c1c484ffe4f0bbf000bda93fb745e1b3899b08d605a08581426a1963dd3e8a quay.io/k8scsi/snapshot-controller:v2.0.0-rc2],SizeBytes:47222712,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/metadata-concealment@sha256:e38f92502f6f6a175fb15b5ce2d02229d465b419d4a643f5999a0f88ee170dcc gcr.io/kubernetes-e2e-test-images/metadata-concealment:1.2],SizeBytes:5124686,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:39:45.121: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-4kfl Dec 3 03:39:45.161: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-4kfl Dec 3 03:39:45.217: INFO: heapster-v1.6.0-beta.1-56cb44959-szz2b started at 2019-12-03 02:57:02 +0000 UTC (0+2 container statuses recorded) Dec 3 03:39:45.217: INFO: Container heapster ready: true, restart count 0 Dec 3 03:39:45.217: INFO: Container heapster-nanny ready: true, restart count 0 Dec 3 03:39:45.217: INFO: volume-snapshot-controller-0 started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:45.217: INFO: Container volume-snapshot-controller ready: true, restart count 0 Dec 3 03:39:45.217: INFO: fluentd-gcp-v3.2.0-8n4lg started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:39:45.217: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:39:45.217: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:39:45.217: INFO: metadata-proxy-v0.1-8x5ch started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:39:45.217: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:39:45.217: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:39:45.217: INFO: kube-proxy-bootstrap-e2e-minion-group-4kfl started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:45.217: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:39:45.368: INFO: Latency metrics for node bootstrap-e2e-minion-group-4kfl Dec 3 03:39:45.368: INFO: Logging node info for node bootstrap-e2e-minion-group-5z63 Dec 3 03:39:45.405: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-5z63 /api/v1/nodes/bootstrap-e2e-minion-group-5z63 80c242ff-92d9-4147-9224-53017c8034c4 43082 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-5z63 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-5z63 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7831":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3055":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3427":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-6545":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-755":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-9008":"bootstrap-e2e-minion-group-5z63","csi-hostpath-volume-expand-7531":"bootstrap-e2e-minion-group-5z63","csi-hostpath-volume-expand-9229":"bootstrap-e2e-minion-group-5z63","csi-mock-csi-mock-volumes-2016":"csi-mock-csi-mock-volumes-2016","csi-mock-csi-mock-volumes-6472":"csi-mock-csi-mock-volumes-6472"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-5z63,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:35:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:35:31 +0000 UTC,LastTransitionTime:2019-12-03 03:15:28 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:35:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:35:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:35:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:35:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:35:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:35:00 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:35:00 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:35:00 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:35:00 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.135.120,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9bc851f45efbabdf9b8ebd2b559e5c3e,SystemUUID:9bc851f4-5efb-abdf-9b8e-bd2b559e5c3e,BootID:8e50611c-7834-4dbe-bffa-e61943723514,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[k8s.gcr.io/event-exporter@sha256:ab71028f7cbc851d273bb00449e30ab743d4e3be21ed2093299f718b42df0748 k8s.gcr.io/event-exporter:v0.3.1],SizeBytes:51445475,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:1d49fb3b108e6b42542e4a9b056dee308f06f88824326cde1636eea0472b799d k8s.gcr.io/prometheus-to-sd:v0.7.2],SizeBytes:42314030,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-3427^6d4b52bf-157a-11ea-8520-72234df9033e],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:39:45.406: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-5z63 Dec 3 03:39:45.449: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-5z63 Dec 3 03:39:45.503: INFO: metadata-proxy-v0.1-gvbgq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:39:45.503: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:39:45.503: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:39:45.503: INFO: kube-proxy-bootstrap-e2e-minion-group-5z63 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:45.503: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:39:45.503: INFO: fluentd-gcp-v3.2.0-mzjbq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:39:45.503: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:39:45.503: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:39:45.503: INFO: event-exporter-v0.3.1-747b47fcd-v9x29 started at 2019-12-03 02:56:59 +0000 UTC (0+2 container statuses recorded) Dec 3 03:39:45.503: INFO: Container event-exporter ready: true, restart count 0 Dec 3 03:39:45.503: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:39:45.503: INFO: kube-dns-autoscaler-65bc6d4889-kjnhr started at 2019-12-03 03:03:02 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:45.503: INFO: Container autoscaler ready: true, restart count 0 Dec 3 03:39:45.662: INFO: Latency metrics for node bootstrap-e2e-minion-group-5z63 Dec 3 03:39:45.662: INFO: Logging node info for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:39:45.698: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-f8g7 /api/v1/nodes/bootstrap-e2e-minion-group-f8g7 0ae3612d-6f1b-43b7-ac42-d209b2c53997 43291 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-f8g7 kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-5136 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-f8g7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2646":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-provisioning-6116":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volume-expand-7110":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-1617":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-5822":"bootstrap-e2e-minion-group-f8g7","csi-mock-csi-mock-volumes-447":"csi-mock-csi-mock-volumes-447","csi-mock-csi-mock-volumes-4534":"csi-mock-csi-mock-volumes-4534","csi-mock-csi-mock-volumes-5485":"csi-mock-csi-mock-volumes-5485","csi-mock-csi-mock-volumes-6096":"csi-mock-csi-mock-volumes-6096","csi-mock-csi-mock-volumes-8158":"csi-mock-csi-mock-volumes-8158"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-f8g7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:35:33 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:35:33 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:35:33 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:35:33 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:35:33 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:35:33 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:35:33 +0000 UTC,LastTransitionTime:2019-12-03 03:15:31 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:36:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:36:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:36:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:36:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.230.75.62,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:343d3fec9626aaffa54d1b2394118877,SystemUUID:343d3fec-9626-aaff-a54d-1b2394118877,BootID:266805a2-3169-4ee5-8194-05b64e8d9864,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1],SizeBytes:121711221,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10],SizeBytes:61365829,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:39944451,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:39:45.700: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:39:45.740: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-f8g7 Dec 3 03:39:45.792: INFO: fluentd-gcp-v3.2.0-wv2h4 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:39:45.792: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:39:45.792: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:39:45.792: INFO: coredns-65567c7b57-8thvw started at 2019-12-03 02:57:10 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:45.793: INFO: Container coredns ready: true, restart count 0 Dec 3 03:39:45.793: INFO: kubernetes-dashboard-7778f8b456-lrmfl started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:45.793: INFO: Container kubernetes-dashboard ready: true, restart count 0 Dec 3 03:39:45.793: INFO: kube-proxy-bootstrap-e2e-minion-group-f8g7 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:39:45.793: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:39:45.793: INFO: metadata-proxy-v0.1-dmvr8 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:39:45.793: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:39:45.793: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:39:45.793: INFO: metrics-server-v0.3.6-7d96444597-lmbw7 started at 2019-12-03 02:57:03 +0000 UTC (0+2 container statuses recorded) Dec 3 03:39:45.793: INFO: Container metrics-server ready: true, restart count 0 Dec 3 03:39:45.793: INFO: Container metrics-server-nanny ready: true, restart count 0 Dec 3 03:39:45.945: INFO: Latency metrics for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:39:45.945: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "statefulset-3942" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sNetworking\sGranular\sChecks\:\sPods\sshould\sfunction\sfor\sintra\-pod\scommunication\:\shttp\s\[LinuxOnly\]\s\[NodeConformance\]\s\[Conformance\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:721 Dec 3 03:15:01.023: Unexpected error: <*errors.errorString | 0xc0001d6000>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:664from junit_10.xml
[BeforeEach] [sig-network] Networking /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Creating a kubernetes client Dec 3 03:09:58.392: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename pod-network-test �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in pod-network-test-9772 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should function for intra-pod communication: http [LinuxOnly] [NodeConformance] [Conformance] /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:721 �[1mSTEP�[0m: Performing setup for networking test in namespace pod-network-test-9772 �[1mSTEP�[0m: creating a selector �[1mSTEP�[0m: Creating the service pods in kubernetes Dec 3 03:09:59.899: INFO: Waiting up to 10m0s for all (but 0) nodes to be schedulable Dec 3 03:15:01.023: FAIL: Unexpected error: <*errors.errorString | 0xc0001d6000>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).createNetProxyPods(0xc000e112b0, 0x4a5ba8b, 0x9, 0xc00384f5f0, 0x0, 0xc00384f5f0, 0xc0019a81e0) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:664 +0x4d0 k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).setupCore(0xc000e112b0, 0xc00384f5f0) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:599 +0x78 k8s.io/kubernetes/test/e2e/framework/network.NewCoreNetworkingTestConfig(0xc000864500, 0x7b22501, 0x65) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:96 +0x134 k8s.io/kubernetes/test/e2e/common.glob..func16.1.1() /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/networking.go:42 +0x41 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0001d8400) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:110 +0x30a k8s.io/kubernetes/test/e2e.TestE2E(0xc0001d8400) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:112 +0x2b testing.tRunner(0xc0001d8400, 0x4c381c8) /usr/local/go/src/testing/testing.go:909 +0xc9 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:960 +0x350 [AfterEach] [sig-network] Networking /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:152 �[1mSTEP�[0m: Collecting events from namespace "pod-network-test-9772". �[1mSTEP�[0m: Found 13 events. Dec 3 03:15:01.067: INFO: At 2019-12-03 03:10:00 +0000 UTC - event for netserver-0: {default-scheduler } Scheduled: Successfully assigned pod-network-test-9772/netserver-0 to bootstrap-e2e-minion-group-3k6d Dec 3 03:15:01.067: INFO: At 2019-12-03 03:10:00 +0000 UTC - event for netserver-1: {default-scheduler } Scheduled: Successfully assigned pod-network-test-9772/netserver-1 to bootstrap-e2e-minion-group-4kfl Dec 3 03:15:01.067: INFO: At 2019-12-03 03:10:00 +0000 UTC - event for netserver-2: {default-scheduler } Scheduled: Successfully assigned pod-network-test-9772/netserver-2 to bootstrap-e2e-minion-group-5z63 Dec 3 03:15:01.067: INFO: At 2019-12-03 03:10:00 +0000 UTC - event for netserver-3: {default-scheduler } Scheduled: Successfully assigned pod-network-test-9772/netserver-3 to bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:01.067: INFO: At 2019-12-03 03:10:02 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:15:01.067: INFO: At 2019-12-03 03:10:02 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Created: Created container webserver Dec 3 03:15:01.067: INFO: At 2019-12-03 03:10:02 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Started: Started container webserver Dec 3 03:15:01.067: INFO: At 2019-12-03 03:10:03 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:15:01.067: INFO: At 2019-12-03 03:10:03 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Started: Started container webserver Dec 3 03:15:01.067: INFO: At 2019-12-03 03:10:03 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Created: Created container webserver Dec 3 03:15:01.067: INFO: At 2019-12-03 03:10:04 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:15:01.067: INFO: At 2019-12-03 03:10:05 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Created: Created container webserver Dec 3 03:15:01.067: INFO: At 2019-12-03 03:10:06 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Started: Started container webserver Dec 3 03:15:01.106: INFO: POD NODE PHASE GRACE CONDITIONS Dec 3 03:15:01.107: INFO: netserver-0 bootstrap-e2e-minion-group-3k6d Pending [{PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:00 +0000 UTC }] Dec 3 03:15:01.107: INFO: netserver-1 bootstrap-e2e-minion-group-4kfl Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:00 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:17 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:00 +0000 UTC }] Dec 3 03:15:01.107: INFO: netserver-2 bootstrap-e2e-minion-group-5z63 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:00 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:14 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:14 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:00 +0000 UTC }] Dec 3 03:15:01.107: INFO: netserver-3 bootstrap-e2e-minion-group-f8g7 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:00 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:25 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:25 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:00 +0000 UTC }] Dec 3 03:15:01.107: INFO: Dec 3 03:15:01.150: INFO: Logging node info for node bootstrap-e2e-master Dec 3 03:15:01.187: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master /api/v1/nodes/bootstrap-e2e-master 64f6954b-0039-46a9-bde3-dcd825532c16 34871 0 2019-12-03 02:56:38 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3876802560 0} {<nil>} 3785940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3614658560 0} {<nil>} 3529940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.39.205,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5736e6f149167618f71cd530dafef4cc,SystemUUID:5736e6f1-4916-7618-f71c-d530dafef4cc,BootID:113c1994-21fb-4e64-a041-99c12a1d120b,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3-0],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:212299081,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:200712199,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:110449186,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:3e315022a842d782a28e729720f21091dde21f1efea28868d65ec595ad871616 k8s.gcr.io/kube-addon-manager:v9.0.2],SizeBytes:83076028,},ContainerImage{Names:[k8s.gcr.io/etcd-empty-dir-cleanup@sha256:484662e55e0705caed26c6fb8632097457f43ce685756531da7a76319a7dcee1 k8s.gcr.io/etcd-empty-dir-cleanup:3.4.3.0],SizeBytes:77408900,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:76121176,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:01.188: INFO: Logging kubelet events for node bootstrap-e2e-master Dec 3 03:15:01.230: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Dec 3 03:15:01.289: INFO: etcd-server-events-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.289: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:15:01.289: INFO: etcd-server-bootstrap-e2e-master started at 2019-12-03 02:57:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.289: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:15:01.289: INFO: kube-apiserver-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.289: INFO: Container kube-apiserver ready: true, restart count 0 Dec 3 03:15:01.289: INFO: kube-scheduler-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.289: INFO: Container kube-scheduler ready: true, restart count 0 Dec 3 03:15:01.289: INFO: l7-lb-controller-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.289: INFO: Container l7-lb-controller ready: true, restart count 2 Dec 3 03:15:01.289: INFO: fluentd-gcp-v3.2.0-r5wvv started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:01.289: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:01.289: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:01.289: INFO: metadata-proxy-v0.1-b2xdn started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:01.289: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:01.289: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:01.289: INFO: etcd-empty-dir-cleanup-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.289: INFO: Container etcd-empty-dir-cleanup ready: true, restart count 0 Dec 3 03:15:01.289: INFO: kube-addon-manager-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.289: INFO: Container kube-addon-manager ready: true, restart count 0 Dec 3 03:15:01.289: INFO: kube-controller-manager-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.289: INFO: Container kube-controller-manager ready: true, restart count 0 Dec 3 03:15:01.440: INFO: Latency metrics for node bootstrap-e2e-master Dec 3 03:15:01.440: INFO: Logging node info for node bootstrap-e2e-minion-group-3k6d Dec 3 03:15:01.481: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3k6d /api/v1/nodes/bootstrap-e2e-minion-group-3k6d 27be8cb7-3aa4-4522-ac85-20da26bd0631 37099 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3k6d kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3k6d topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-6015":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-9792":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-8555":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-9542":"bootstrap-e2e-minion-group-3k6d","csi-mock-csi-mock-volumes-3632":"csi-mock-csi-mock-volumes-3632","csi-mock-csi-mock-volumes-8963":"csi-mock-csi-mock-volumes-8963","csi-mock-csi-mock-volumes-9932":"csi-mock-csi-mock-volumes-9932"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-3k6d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.230.19.255,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:323aa9707db5a0349fc3829baed3d8ee,SystemUUID:323aa970-7db5-a034-9fc3-829baed3d8ee,BootID:35d11602-3a27-4158-8abd-6152101be7c6,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/fluentd-gcp-scaler@sha256:4f28f10fb89506768910b858f7a18ffb996824a16d70d5ac895e49687df9ff58 k8s.gcr.io/fluentd-gcp-scaler:0.5.2],SizeBytes:90498960,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:13513083,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[busybox@sha256:679b1c1058c1f2dc59a3ee70eed986a88811c0205c8ceea57cec5f22d2c3fbb1 busybox:latest],SizeBytes:1219790,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:01.482: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3k6d Dec 3 03:15:01.533: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3k6d Dec 3 03:15:01.574: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3k6d: the server is currently unable to handle the request (get nodes bootstrap-e2e-minion-group-3k6d:10250) Dec 3 03:15:01.574: INFO: Logging node info for node bootstrap-e2e-minion-group-4kfl Dec 3 03:15:01.613: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-4kfl /api/v1/nodes/bootstrap-e2e-minion-group-4kfl dd9963b5-5d66-49cc-af35-0cb8c13d5de7 37998 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-4kfl kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-4kfl topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1470":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-ephemeral-9740":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-2571":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-7815":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-volume-398":"bootstrap-e2e-minion-group-4kfl","csi-mock-csi-mock-volumes-2306":"csi-mock-csi-mock-volumes-2306","csi-mock-csi-mock-volumes-2465":"csi-mock-csi-mock-volumes-2465","csi-mock-csi-mock-volumes-5287":"csi-mock-csi-mock-volumes-5287","csi-mock-csi-mock-volumes-9659":"csi-mock-csi-mock-volumes-9659"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-4kfl,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:56 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:56 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:56 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:56 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.13.80,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:30b63c524b868d3087050fb30234d2f7,SystemUUID:30b63c52-4b86-8d30-8705-0fb30234d2f7,BootID:03f4e451-9446-49a9-9e0b-32e618ab9497,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 gluster/glusterdynamic-provisioner:v1.0],SizeBytes:373281573,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/heapster-amd64@sha256:9fae0af136ce0cf4f88393b3670f7139ffc464692060c374d2ae748e13144521 k8s.gcr.io/heapster-amd64:v1.6.0-beta.1],SizeBytes:76016169,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/snapshot-controller@sha256:b3c1c484ffe4f0bbf000bda93fb745e1b3899b08d605a08581426a1963dd3e8a quay.io/k8scsi/snapshot-controller:v2.0.0-rc2],SizeBytes:47222712,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/metadata-concealment@sha256:e38f92502f6f6a175fb15b5ce2d02229d465b419d4a643f5999a0f88ee170dcc gcr.io/kubernetes-e2e-test-images/metadata-concealment:1.2],SizeBytes:5124686,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/gce-pd/bootstrap-e2e-dynamic-pvc-28b24f22-305c-4e9b-9b83-4a958ed99598],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/gce-pd/bootstrap-e2e-dynamic-pvc-28b24f22-305c-4e9b-9b83-4a958ed99598,DevicePath:/dev/disk/by-id/google-bootstrap-e2e-dynamic-pvc-28b24f22-305c-4e9b-9b83-4a958ed99598,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:01.614: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-4kfl Dec 3 03:15:01.658: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-4kfl Dec 3 03:15:01.711: INFO: kube-proxy-bootstrap-e2e-minion-group-4kfl started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.711: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:15:01.711: INFO: netserver-1 started at 2019-12-03 03:10:00 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.711: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:01.711: INFO: netserver-1 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.711: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:01.711: INFO: netserver-1 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.711: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:01.711: INFO: pod-projected-configmaps-d4074869-baff-43d6-8b1c-556e7d340550 started at 2019-12-03 03:14:50 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.711: INFO: Container projected-configmap-volume-test ready: false, restart count 0 Dec 3 03:15:01.711: INFO: fluentd-gcp-v3.2.0-8n4lg started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:01.711: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:01.711: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:01.711: INFO: heapster-v1.6.0-beta.1-56cb44959-szz2b started at 2019-12-03 02:57:02 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:01.711: INFO: Container heapster ready: true, restart count 0 Dec 3 03:15:01.711: INFO: Container heapster-nanny ready: true, restart count 0 Dec 3 03:15:01.711: INFO: volume-snapshot-controller-0 started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.711: INFO: Container volume-snapshot-controller ready: true, restart count 0 Dec 3 03:15:01.711: INFO: netserver-1 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.711: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:01.711: INFO: netserver-1 started at 2019-12-03 03:10:01 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.711: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:01.711: INFO: netserver-1 started at 2019-12-03 03:10:32 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.711: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:01.711: INFO: pod-subpath-test-gcepd-dynamicpv-nm8g started at 2019-12-03 03:14:49 +0000 UTC (1+1 container statuses recorded) Dec 3 03:15:01.711: INFO: Init container init-volume-gcepd-dynamicpv-nm8g ready: true, restart count 0 Dec 3 03:15:01.711: INFO: Container test-container-subpath-gcepd-dynamicpv-nm8g ready: false, restart count 0 Dec 3 03:15:01.711: INFO: metadata-proxy-v0.1-8x5ch started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:01.711: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:01.711: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:01.711: INFO: test-webserver-c6a57e65-6bd0-49ca-91ec-4de611743d50 started at 2019-12-03 03:14:55 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:01.711: INFO: Container test-webserver ready: true, restart count 0 Dec 3 03:15:01.900: INFO: Latency metrics for node bootstrap-e2e-minion-group-4kfl Dec 3 03:15:01.900: INFO: Logging node info for node bootstrap-e2e-minion-group-5z63 Dec 3 03:15:01.939: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-5z63 /api/v1/nodes/bootstrap-e2e-minion-group-5z63 80c242ff-92d9-4147-9224-53017c8034c4 37958 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-5z63 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-5z63 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7831":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3055":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3427":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-6545":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-755":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-9008":"bootstrap-e2e-minion-group-5z63","csi-hostpath-volume-expand-9229":"bootstrap-e2e-minion-group-5z63","csi-mock-csi-mock-volumes-2016":"csi-mock-csi-mock-volumes-2016","csi-mock-csi-mock-volumes-6472":"csi-mock-csi-mock-volumes-6472"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-5z63,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.135.120,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9bc851f45efbabdf9b8ebd2b559e5c3e,SystemUUID:9bc851f4-5efb-abdf-9b8e-bd2b559e5c3e,BootID:8e50611c-7834-4dbe-bffa-e61943723514,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[k8s.gcr.io/event-exporter@sha256:ab71028f7cbc851d273bb00449e30ab743d4e3be21ed2093299f718b42df0748 k8s.gcr.io/event-exporter:v0.3.1],SizeBytes:51445475,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:1d49fb3b108e6b42542e4a9b056dee308f06f88824326cde1636eea0472b799d k8s.gcr.io/prometheus-to-sd:v0.7.2],SizeBytes:42314030,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-3427^6d4b52bf-157a-11ea-8520-72234df9033e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-3427^6d4b52bf-157a-11ea-8520-72234df9033e,DevicePath:,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:01.940: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-5z63 Dec 3 03:15:01.989: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-5z63 Dec 3 03:15:02.041: INFO: csi-hostpathplugin-0 started at 2019-12-03 03:14:41 +0000 UTC (0+3 container statuses recorded) Dec 3 03:15:02.041: INFO: Container hostpath ready: true, restart count 0 Dec 3 03:15:02.041: INFO: Container liveness-probe ready: true, restart count 0 Dec 3 03:15:02.041: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 3 03:15:02.041: INFO: netserver-2 started at 2019-12-03 03:10:32 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.041: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.041: INFO: csi-hostpath-provisioner-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.041: INFO: Container csi-provisioner ready: true, restart count 0 Dec 3 03:15:02.041: INFO: netserver-2 started at 2019-12-03 03:10:01 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.041: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.041: INFO: csi-hostpath-attacher-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.041: INFO: Container csi-attacher ready: true, restart count 0 Dec 3 03:15:02.041: INFO: event-exporter-v0.3.1-747b47fcd-v9x29 started at 2019-12-03 02:56:59 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:02.041: INFO: Container event-exporter ready: true, restart count 0 Dec 3 03:15:02.041: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:02.042: INFO: netserver-2 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.042: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.042: INFO: netserver-2 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.042: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.042: INFO: pod-subpath-test-local-preprovisionedpv-ck7d started at 2019-12-03 03:15:01 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.042: INFO: Container test-container-subpath-local-preprovisionedpv-ck7d ready: false, restart count 0 Dec 3 03:15:02.042: INFO: ss2-1 started at 2019-12-03 03:09:36 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.042: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.042: INFO: csi-hostpath-resizer-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.042: INFO: Container csi-resizer ready: true, restart count 0 Dec 3 03:15:02.042: INFO: kube-dns-autoscaler-65bc6d4889-kjnhr started at 2019-12-03 03:03:02 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.042: INFO: Container autoscaler ready: true, restart count 0 Dec 3 03:15:02.042: INFO: csi-snapshotter-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.042: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 3 03:15:02.042: INFO: metadata-proxy-v0.1-gvbgq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:02.042: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:02.042: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:02.042: INFO: hostexec-bootstrap-e2e-minion-group-5z63-fbg6h started at 2019-12-03 03:14:52 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.042: INFO: Container agnhost ready: true, restart count 0 Dec 3 03:15:02.042: INFO: kube-proxy-bootstrap-e2e-minion-group-5z63 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.042: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:15:02.042: INFO: fluentd-gcp-v3.2.0-mzjbq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:02.042: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:02.042: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:02.042: INFO: inline-volume-tester-zmz7g started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.042: INFO: Container csi-volume-tester ready: true, restart count 0 Dec 3 03:15:02.042: INFO: netserver-2 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.042: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.042: INFO: netserver-2 started at 2019-12-03 03:10:00 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.042: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.630: INFO: Latency metrics for node bootstrap-e2e-minion-group-5z63 Dec 3 03:15:02.630: INFO: Logging node info for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:02.673: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-f8g7 /api/v1/nodes/bootstrap-e2e-minion-group-f8g7 0ae3612d-6f1b-43b7-ac42-d209b2c53997 38042 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-f8g7 kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-5136 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-f8g7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2646":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-provisioning-6116":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volume-expand-7110":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-1617":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-5822":"bootstrap-e2e-minion-group-f8g7","csi-mock-csi-mock-volumes-447":"csi-mock-csi-mock-volumes-447","csi-mock-csi-mock-volumes-4534":"csi-mock-csi-mock-volumes-4534","csi-mock-csi-mock-volumes-5485":"csi-mock-csi-mock-volumes-5485","csi-mock-csi-mock-volumes-6096":"csi-mock-csi-mock-volumes-6096","csi-mock-csi-mock-volumes-8158":"csi-mock-csi-mock-volumes-8158"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-f8g7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:00 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:00 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:00 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:15:00 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.230.75.62,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:343d3fec9626aaffa54d1b2394118877,SystemUUID:343d3fec-9626-aaff-a54d-1b2394118877,BootID:266805a2-3169-4ee5-8194-05b64e8d9864,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1],SizeBytes:121711221,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10],SizeBytes:61365829,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:39944451,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-447^4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-447^4,DevicePath:,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:02.674: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:02.725: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:02.779: INFO: netserver-3 started at 2019-12-03 03:10:01 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.779: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.779: INFO: pvc-volume-tester-57cch started at 2019-12-03 03:14:55 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.779: INFO: Container volume-tester ready: false, restart count 0 Dec 3 03:15:02.779: INFO: metrics-server-v0.3.6-7d96444597-lmbw7 started at 2019-12-03 02:57:03 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:02.779: INFO: Container metrics-server ready: true, restart count 0 Dec 3 03:15:02.779: INFO: Container metrics-server-nanny ready: true, restart count 0 Dec 3 03:15:02.779: INFO: netserver-3 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.779: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.779: INFO: csi-mockplugin-attacher-0 started at 2019-12-03 03:14:48 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.779: INFO: Container csi-attacher ready: true, restart count 0 Dec 3 03:15:02.779: INFO: netserver-3 started at 2019-12-03 03:10:00 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.779: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.779: INFO: netserver-3 started at 2019-12-03 03:10:32 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.779: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.779: INFO: pod-secrets-d5a30c98-13bb-4c17-aac0-d4d74fe60b60 started at 2019-12-03 03:14:15 +0000 UTC (0+3 container statuses recorded) Dec 3 03:15:02.779: INFO: Container creates-volume-test ready: true, restart count 0 Dec 3 03:15:02.779: INFO: Container dels-volume-test ready: true, restart count 0 Dec 3 03:15:02.779: INFO: Container upds-volume-test ready: true, restart count 0 Dec 3 03:15:02.779: INFO: fluentd-gcp-v3.2.0-wv2h4 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:02.779: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:02.779: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:02.779: INFO: coredns-65567c7b57-8thvw started at 2019-12-03 02:57:10 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.779: INFO: Container coredns ready: true, restart count 0 Dec 3 03:15:02.779: INFO: ss2-2 started at 2019-12-03 03:09:16 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.779: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.779: INFO: netserver-3 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.779: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.779: INFO: kubernetes-dashboard-7778f8b456-lrmfl started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.779: INFO: Container kubernetes-dashboard ready: true, restart count 0 Dec 3 03:15:02.779: INFO: kube-proxy-bootstrap-e2e-minion-group-f8g7 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.779: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:15:02.779: INFO: metadata-proxy-v0.1-dmvr8 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:02.779: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:02.779: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:02.779: INFO: netserver-3 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.779: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.779: INFO: csi-mockplugin-0 started at 2019-12-03 03:14:48 +0000 UTC (0+3 container statuses recorded) Dec 3 03:15:02.779: INFO: Container csi-provisioner ready: true, restart count 0 Dec 3 03:15:02.779: INFO: Container driver-registrar ready: true, restart count 0 Dec 3 03:15:02.779: INFO: Container mock ready: true, restart count 0 Dec 3 03:15:02.993: INFO: Latency metrics for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:02.993: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "pod-network-test-9772" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sNetworking\sGranular\sChecks\:\sPods\sshould\sfunction\sfor\snode\-pod\scommunication\:\shttp\s\[LinuxOnly\]\s\[NodeConformance\]\s\[Conformance\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:721 Dec 3 03:15:02.095: Unexpected error: <*errors.errorString | 0xc00009f960>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:664from junit_13.xml
[BeforeEach] [sig-network] Networking /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Creating a kubernetes client Dec 3 03:10:00.528: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename pod-network-test �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in pod-network-test-9622 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should function for node-pod communication: http [LinuxOnly] [NodeConformance] [Conformance] /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:721 �[1mSTEP�[0m: Performing setup for networking test in namespace pod-network-test-9622 �[1mSTEP�[0m: creating a selector �[1mSTEP�[0m: Creating the service pods in kubernetes Dec 3 03:10:01.425: INFO: Waiting up to 10m0s for all (but 0) nodes to be schedulable Dec 3 03:15:02.095: FAIL: Unexpected error: <*errors.errorString | 0xc00009f960>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).createNetProxyPods(0xc001befba0, 0x4a5ba8b, 0x9, 0xc0032274d0, 0x0, 0xc0032274d0, 0xc0032df230) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:664 +0x4d0 k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).setupCore(0xc001befba0, 0xc0032274d0) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:599 +0x78 k8s.io/kubernetes/test/e2e/framework/network.NewCoreNetworkingTestConfig(0xc00073ca00, 0x1, 0xc005ac57a0) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:96 +0x134 k8s.io/kubernetes/test/e2e/common.glob..func16.1.3() /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/networking.go:70 +0x41 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001d10a00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:110 +0x30a k8s.io/kubernetes/test/e2e.TestE2E(0xc001d10a00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:112 +0x2b testing.tRunner(0xc001d10a00, 0x4c381c8) /usr/local/go/src/testing/testing.go:909 +0xc9 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:960 +0x350 [AfterEach] [sig-network] Networking /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:152 �[1mSTEP�[0m: Collecting events from namespace "pod-network-test-9622". �[1mSTEP�[0m: Found 13 events. Dec 3 03:15:02.134: INFO: At 2019-12-03 03:10:01 +0000 UTC - event for netserver-0: {default-scheduler } Scheduled: Successfully assigned pod-network-test-9622/netserver-0 to bootstrap-e2e-minion-group-3k6d Dec 3 03:15:02.134: INFO: At 2019-12-03 03:10:01 +0000 UTC - event for netserver-1: {default-scheduler } Scheduled: Successfully assigned pod-network-test-9622/netserver-1 to bootstrap-e2e-minion-group-4kfl Dec 3 03:15:02.134: INFO: At 2019-12-03 03:10:01 +0000 UTC - event for netserver-2: {default-scheduler } Scheduled: Successfully assigned pod-network-test-9622/netserver-2 to bootstrap-e2e-minion-group-5z63 Dec 3 03:15:02.134: INFO: At 2019-12-03 03:10:01 +0000 UTC - event for netserver-3: {default-scheduler } Scheduled: Successfully assigned pod-network-test-9622/netserver-3 to bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:02.134: INFO: At 2019-12-03 03:10:02 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:15:02.134: INFO: At 2019-12-03 03:10:02 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Created: Created container webserver Dec 3 03:15:02.134: INFO: At 2019-12-03 03:10:03 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Started: Started container webserver Dec 3 03:15:02.135: INFO: At 2019-12-03 03:10:04 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:15:02.135: INFO: At 2019-12-03 03:10:04 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Created: Created container webserver Dec 3 03:15:02.135: INFO: At 2019-12-03 03:10:05 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Started: Started container webserver Dec 3 03:15:02.135: INFO: At 2019-12-03 03:10:06 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:15:02.135: INFO: At 2019-12-03 03:10:06 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Created: Created container webserver Dec 3 03:15:02.135: INFO: At 2019-12-03 03:10:07 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Started: Started container webserver Dec 3 03:15:02.174: INFO: POD NODE PHASE GRACE CONDITIONS Dec 3 03:15:02.174: INFO: netserver-0 bootstrap-e2e-minion-group-3k6d Pending [{PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:01 +0000 UTC }] Dec 3 03:15:02.174: INFO: netserver-1 bootstrap-e2e-minion-group-4kfl Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:01 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:17 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:01 +0000 UTC }] Dec 3 03:15:02.174: INFO: netserver-2 bootstrap-e2e-minion-group-5z63 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:01 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:18 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:18 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:01 +0000 UTC }] Dec 3 03:15:02.174: INFO: netserver-3 bootstrap-e2e-minion-group-f8g7 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:01 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:21 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:01 +0000 UTC }] Dec 3 03:15:02.174: INFO: Dec 3 03:15:02.218: INFO: Logging node info for node bootstrap-e2e-master Dec 3 03:15:02.257: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master /api/v1/nodes/bootstrap-e2e-master 64f6954b-0039-46a9-bde3-dcd825532c16 34871 0 2019-12-03 02:56:38 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3876802560 0} {<nil>} 3785940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3614658560 0} {<nil>} 3529940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.39.205,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5736e6f149167618f71cd530dafef4cc,SystemUUID:5736e6f1-4916-7618-f71c-d530dafef4cc,BootID:113c1994-21fb-4e64-a041-99c12a1d120b,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3-0],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:212299081,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:200712199,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:110449186,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:3e315022a842d782a28e729720f21091dde21f1efea28868d65ec595ad871616 k8s.gcr.io/kube-addon-manager:v9.0.2],SizeBytes:83076028,},ContainerImage{Names:[k8s.gcr.io/etcd-empty-dir-cleanup@sha256:484662e55e0705caed26c6fb8632097457f43ce685756531da7a76319a7dcee1 k8s.gcr.io/etcd-empty-dir-cleanup:3.4.3.0],SizeBytes:77408900,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:76121176,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:02.258: INFO: Logging kubelet events for node bootstrap-e2e-master Dec 3 03:15:02.300: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Dec 3 03:15:02.358: INFO: metadata-proxy-v0.1-b2xdn started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:02.358: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:02.358: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:02.358: INFO: etcd-empty-dir-cleanup-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.358: INFO: Container etcd-empty-dir-cleanup ready: true, restart count 0 Dec 3 03:15:02.358: INFO: etcd-server-events-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.358: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:15:02.358: INFO: etcd-server-bootstrap-e2e-master started at 2019-12-03 02:57:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.358: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:15:02.358: INFO: kube-apiserver-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.358: INFO: Container kube-apiserver ready: true, restart count 0 Dec 3 03:15:02.358: INFO: kube-scheduler-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.358: INFO: Container kube-scheduler ready: true, restart count 0 Dec 3 03:15:02.358: INFO: l7-lb-controller-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.358: INFO: Container l7-lb-controller ready: true, restart count 2 Dec 3 03:15:02.358: INFO: fluentd-gcp-v3.2.0-r5wvv started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:02.358: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:02.358: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:02.358: INFO: kube-controller-manager-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.358: INFO: Container kube-controller-manager ready: true, restart count 0 Dec 3 03:15:02.358: INFO: kube-addon-manager-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.358: INFO: Container kube-addon-manager ready: true, restart count 0 Dec 3 03:15:02.542: INFO: Latency metrics for node bootstrap-e2e-master Dec 3 03:15:02.542: INFO: Logging node info for node bootstrap-e2e-minion-group-3k6d Dec 3 03:15:02.582: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3k6d /api/v1/nodes/bootstrap-e2e-minion-group-3k6d 27be8cb7-3aa4-4522-ac85-20da26bd0631 37099 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3k6d kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3k6d topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-6015":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-9792":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-8555":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-9542":"bootstrap-e2e-minion-group-3k6d","csi-mock-csi-mock-volumes-3632":"csi-mock-csi-mock-volumes-3632","csi-mock-csi-mock-volumes-8963":"csi-mock-csi-mock-volumes-8963","csi-mock-csi-mock-volumes-9932":"csi-mock-csi-mock-volumes-9932"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-3k6d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.230.19.255,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:323aa9707db5a0349fc3829baed3d8ee,SystemUUID:323aa970-7db5-a034-9fc3-829baed3d8ee,BootID:35d11602-3a27-4158-8abd-6152101be7c6,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/fluentd-gcp-scaler@sha256:4f28f10fb89506768910b858f7a18ffb996824a16d70d5ac895e49687df9ff58 k8s.gcr.io/fluentd-gcp-scaler:0.5.2],SizeBytes:90498960,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:13513083,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[busybox@sha256:679b1c1058c1f2dc59a3ee70eed986a88811c0205c8ceea57cec5f22d2c3fbb1 busybox:latest],SizeBytes:1219790,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:02.583: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3k6d Dec 3 03:15:02.627: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3k6d Dec 3 03:15:02.671: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3k6d: the server is currently unable to handle the request (get nodes bootstrap-e2e-minion-group-3k6d:10250) Dec 3 03:15:02.671: INFO: Logging node info for node bootstrap-e2e-minion-group-4kfl Dec 3 03:15:02.715: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-4kfl /api/v1/nodes/bootstrap-e2e-minion-group-4kfl dd9963b5-5d66-49cc-af35-0cb8c13d5de7 37998 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-4kfl kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-4kfl topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1470":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-ephemeral-9740":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-2571":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-7815":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-volume-398":"bootstrap-e2e-minion-group-4kfl","csi-mock-csi-mock-volumes-2306":"csi-mock-csi-mock-volumes-2306","csi-mock-csi-mock-volumes-2465":"csi-mock-csi-mock-volumes-2465","csi-mock-csi-mock-volumes-5287":"csi-mock-csi-mock-volumes-5287","csi-mock-csi-mock-volumes-9659":"csi-mock-csi-mock-volumes-9659"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-4kfl,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:56 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:56 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:56 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:56 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.13.80,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:30b63c524b868d3087050fb30234d2f7,SystemUUID:30b63c52-4b86-8d30-8705-0fb30234d2f7,BootID:03f4e451-9446-49a9-9e0b-32e618ab9497,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 gluster/glusterdynamic-provisioner:v1.0],SizeBytes:373281573,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/heapster-amd64@sha256:9fae0af136ce0cf4f88393b3670f7139ffc464692060c374d2ae748e13144521 k8s.gcr.io/heapster-amd64:v1.6.0-beta.1],SizeBytes:76016169,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/snapshot-controller@sha256:b3c1c484ffe4f0bbf000bda93fb745e1b3899b08d605a08581426a1963dd3e8a quay.io/k8scsi/snapshot-controller:v2.0.0-rc2],SizeBytes:47222712,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/metadata-concealment@sha256:e38f92502f6f6a175fb15b5ce2d02229d465b419d4a643f5999a0f88ee170dcc gcr.io/kubernetes-e2e-test-images/metadata-concealment:1.2],SizeBytes:5124686,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/gce-pd/bootstrap-e2e-dynamic-pvc-28b24f22-305c-4e9b-9b83-4a958ed99598],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/gce-pd/bootstrap-e2e-dynamic-pvc-28b24f22-305c-4e9b-9b83-4a958ed99598,DevicePath:/dev/disk/by-id/google-bootstrap-e2e-dynamic-pvc-28b24f22-305c-4e9b-9b83-4a958ed99598,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:02.716: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-4kfl Dec 3 03:15:02.768: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-4kfl Dec 3 03:15:02.821: INFO: netserver-1 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.821: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.821: INFO: fluentd-gcp-v3.2.0-8n4lg started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:02.821: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:02.821: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:02.821: INFO: heapster-v1.6.0-beta.1-56cb44959-szz2b started at 2019-12-03 02:57:02 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:02.821: INFO: Container heapster ready: true, restart count 0 Dec 3 03:15:02.821: INFO: Container heapster-nanny ready: true, restart count 0 Dec 3 03:15:02.821: INFO: volume-snapshot-controller-0 started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.821: INFO: Container volume-snapshot-controller ready: true, restart count 0 Dec 3 03:15:02.821: INFO: netserver-1 started at 2019-12-03 03:10:01 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.821: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.821: INFO: netserver-1 started at 2019-12-03 03:10:32 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.821: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.821: INFO: pod-subpath-test-gcepd-dynamicpv-nm8g started at 2019-12-03 03:14:49 +0000 UTC (1+1 container statuses recorded) Dec 3 03:15:02.821: INFO: Init container init-volume-gcepd-dynamicpv-nm8g ready: true, restart count 0 Dec 3 03:15:02.821: INFO: Container test-container-subpath-gcepd-dynamicpv-nm8g ready: false, restart count 0 Dec 3 03:15:02.821: INFO: metadata-proxy-v0.1-8x5ch started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:02.821: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:02.821: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:02.821: INFO: test-webserver-c6a57e65-6bd0-49ca-91ec-4de611743d50 started at 2019-12-03 03:14:55 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.821: INFO: Container test-webserver ready: true, restart count 0 Dec 3 03:15:02.821: INFO: netserver-1 started at 2019-12-03 03:10:00 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.821: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.821: INFO: kube-proxy-bootstrap-e2e-minion-group-4kfl started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.821: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:15:02.821: INFO: netserver-1 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.821: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:02.821: INFO: netserver-1 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:02.821: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:03.000: INFO: Latency metrics for node bootstrap-e2e-minion-group-4kfl Dec 3 03:15:03.000: INFO: Logging node info for node bootstrap-e2e-minion-group-5z63 Dec 3 03:15:03.052: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-5z63 /api/v1/nodes/bootstrap-e2e-minion-group-5z63 80c242ff-92d9-4147-9224-53017c8034c4 37958 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-5z63 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-5z63 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7831":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3055":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3427":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-6545":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-755":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-9008":"bootstrap-e2e-minion-group-5z63","csi-hostpath-volume-expand-9229":"bootstrap-e2e-minion-group-5z63","csi-mock-csi-mock-volumes-2016":"csi-mock-csi-mock-volumes-2016","csi-mock-csi-mock-volumes-6472":"csi-mock-csi-mock-volumes-6472"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-5z63,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.135.120,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9bc851f45efbabdf9b8ebd2b559e5c3e,SystemUUID:9bc851f4-5efb-abdf-9b8e-bd2b559e5c3e,BootID:8e50611c-7834-4dbe-bffa-e61943723514,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[k8s.gcr.io/event-exporter@sha256:ab71028f7cbc851d273bb00449e30ab743d4e3be21ed2093299f718b42df0748 k8s.gcr.io/event-exporter:v0.3.1],SizeBytes:51445475,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:1d49fb3b108e6b42542e4a9b056dee308f06f88824326cde1636eea0472b799d k8s.gcr.io/prometheus-to-sd:v0.7.2],SizeBytes:42314030,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-3427^6d4b52bf-157a-11ea-8520-72234df9033e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-3427^6d4b52bf-157a-11ea-8520-72234df9033e,DevicePath:,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:03.053: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-5z63 Dec 3 03:15:03.103: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-5z63 Dec 3 03:15:03.151: INFO: metadata-proxy-v0.1-gvbgq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:03.151: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:03.151: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:03.151: INFO: netserver-2 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.151: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:03.151: INFO: hostexec-bootstrap-e2e-minion-group-5z63-fbg6h started at 2019-12-03 03:14:52 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.151: INFO: Container agnhost ready: true, restart count 0 Dec 3 03:15:03.151: INFO: kube-proxy-bootstrap-e2e-minion-group-5z63 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.151: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:15:03.151: INFO: fluentd-gcp-v3.2.0-mzjbq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:03.151: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:03.151: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:03.151: INFO: inline-volume-tester-zmz7g started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.151: INFO: Container csi-volume-tester ready: true, restart count 0 Dec 3 03:15:03.151: INFO: netserver-2 started at 2019-12-03 03:10:00 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.151: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:03.151: INFO: csi-hostpathplugin-0 started at 2019-12-03 03:14:41 +0000 UTC (0+3 container statuses recorded) Dec 3 03:15:03.151: INFO: Container hostpath ready: true, restart count 0 Dec 3 03:15:03.151: INFO: Container liveness-probe ready: true, restart count 0 Dec 3 03:15:03.151: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 3 03:15:03.151: INFO: netserver-2 started at 2019-12-03 03:10:32 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.151: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:03.151: INFO: csi-hostpath-provisioner-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.151: INFO: Container csi-provisioner ready: true, restart count 0 Dec 3 03:15:03.151: INFO: netserver-2 started at 2019-12-03 03:10:01 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.151: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:03.151: INFO: csi-hostpath-attacher-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.151: INFO: Container csi-attacher ready: true, restart count 0 Dec 3 03:15:03.151: INFO: event-exporter-v0.3.1-747b47fcd-v9x29 started at 2019-12-03 02:56:59 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:03.151: INFO: Container event-exporter ready: true, restart count 0 Dec 3 03:15:03.151: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:03.151: INFO: netserver-2 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.151: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:03.151: INFO: netserver-2 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.151: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:03.151: INFO: pod-subpath-test-local-preprovisionedpv-ck7d started at 2019-12-03 03:15:01 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.151: INFO: Container test-container-subpath-local-preprovisionedpv-ck7d ready: false, restart count 0 Dec 3 03:15:03.151: INFO: csi-snapshotter-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.151: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 3 03:15:03.151: INFO: ss2-1 started at 2019-12-03 03:09:36 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.151: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:03.151: INFO: csi-hostpath-resizer-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.151: INFO: Container csi-resizer ready: true, restart count 0 Dec 3 03:15:03.151: INFO: kube-dns-autoscaler-65bc6d4889-kjnhr started at 2019-12-03 03:03:02 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.151: INFO: Container autoscaler ready: true, restart count 0 Dec 3 03:15:03.351: INFO: Latency metrics for node bootstrap-e2e-minion-group-5z63 Dec 3 03:15:03.351: INFO: Logging node info for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:03.390: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-f8g7 /api/v1/nodes/bootstrap-e2e-minion-group-f8g7 0ae3612d-6f1b-43b7-ac42-d209b2c53997 38042 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-f8g7 kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-5136 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-f8g7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2646":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-provisioning-6116":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volume-expand-7110":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-1617":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-5822":"bootstrap-e2e-minion-group-f8g7","csi-mock-csi-mock-volumes-447":"csi-mock-csi-mock-volumes-447","csi-mock-csi-mock-volumes-4534":"csi-mock-csi-mock-volumes-4534","csi-mock-csi-mock-volumes-5485":"csi-mock-csi-mock-volumes-5485","csi-mock-csi-mock-volumes-6096":"csi-mock-csi-mock-volumes-6096","csi-mock-csi-mock-volumes-8158":"csi-mock-csi-mock-volumes-8158"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-f8g7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:00 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:00 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:00 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:15:00 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.230.75.62,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:343d3fec9626aaffa54d1b2394118877,SystemUUID:343d3fec-9626-aaff-a54d-1b2394118877,BootID:266805a2-3169-4ee5-8194-05b64e8d9864,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1],SizeBytes:121711221,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10],SizeBytes:61365829,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:39944451,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-447^4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-447^4,DevicePath:,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:03.390: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:03.433: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:03.481: INFO: pod-secrets-d5a30c98-13bb-4c17-aac0-d4d74fe60b60 started at 2019-12-03 03:14:15 +0000 UTC (0+3 container statuses recorded) Dec 3 03:15:03.481: INFO: Container creates-volume-test ready: true, restart count 0 Dec 3 03:15:03.481: INFO: Container dels-volume-test ready: true, restart count 0 Dec 3 03:15:03.481: INFO: Container upds-volume-test ready: true, restart count 0 Dec 3 03:15:03.481: INFO: netserver-3 started at 2019-12-03 03:10:32 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.481: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:03.481: INFO: coredns-65567c7b57-8thvw started at 2019-12-03 02:57:10 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.481: INFO: Container coredns ready: true, restart count 0 Dec 3 03:15:03.481: INFO: ss2-2 started at 2019-12-03 03:09:16 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.481: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:03.481: INFO: netserver-3 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.481: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:03.481: INFO: fluentd-gcp-v3.2.0-wv2h4 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:03.481: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:03.481: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:03.481: INFO: kubernetes-dashboard-7778f8b456-lrmfl started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.481: INFO: Container kubernetes-dashboard ready: true, restart count 0 Dec 3 03:15:03.481: INFO: netserver-3 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.481: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:03.481: INFO: csi-mockplugin-0 started at 2019-12-03 03:14:48 +0000 UTC (0+3 container statuses recorded) Dec 3 03:15:03.481: INFO: Container csi-provisioner ready: true, restart count 0 Dec 3 03:15:03.481: INFO: Container driver-registrar ready: true, restart count 0 Dec 3 03:15:03.481: INFO: Container mock ready: true, restart count 0 Dec 3 03:15:03.481: INFO: kube-proxy-bootstrap-e2e-minion-group-f8g7 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.481: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:15:03.481: INFO: metadata-proxy-v0.1-dmvr8 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:03.481: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:03.481: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:03.481: INFO: netserver-3 started at 2019-12-03 03:10:01 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.481: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:03.481: INFO: pvc-volume-tester-57cch started at 2019-12-03 03:14:55 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.481: INFO: Container volume-tester ready: false, restart count 0 Dec 3 03:15:03.481: INFO: csi-mockplugin-attacher-0 started at 2019-12-03 03:14:48 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.481: INFO: Container csi-attacher ready: true, restart count 0 Dec 3 03:15:03.481: INFO: netserver-3 started at 2019-12-03 03:10:00 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.481: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:03.481: INFO: metrics-server-v0.3.6-7d96444597-lmbw7 started at 2019-12-03 02:57:03 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:03.481: INFO: Container metrics-server ready: true, restart count 0 Dec 3 03:15:03.481: INFO: Container metrics-server-nanny ready: true, restart count 0 Dec 3 03:15:03.481: INFO: netserver-3 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:03.481: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:03.812: INFO: Latency metrics for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:03.812: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "pod-network-test-9622" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sNetworking\sGranular\sChecks\:\sServices\sshould\sbe\sable\sto\shandle\slarge\srequests\:\sudp$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:306 Dec 3 03:15:33.190: Unexpected error: <*errors.errorString | 0xc00009f970>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:664from junit_11.xml
{"msg":"PASSED [sig-instrumentation] MetricsGrabber should grab all metrics from a ControllerManager.","total":-1,"completed":26,"skipped":160,"failed":0} [BeforeEach] [sig-network] Networking /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Creating a kubernetes client Dec 3 03:10:32.057: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename nettest �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in nettest-6608 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Networking /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:93 �[1mSTEP�[0m: Executing a successful http request from the external internet [It] should be able to handle large requests: udp /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:306 �[1mSTEP�[0m: Performing setup for networking test in namespace nettest-6608 �[1mSTEP�[0m: creating a selector �[1mSTEP�[0m: Creating the service pods in kubernetes Dec 3 03:10:32.612: INFO: Waiting up to 10m0s for all (but 0) nodes to be schedulable Dec 3 03:15:33.190: FAIL: Unexpected error: <*errors.errorString | 0xc00009f970>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).createNetProxyPods(0xc0022188f0, 0x4a5ba8b, 0x9, 0xc002846f30, 0x0, 0x110, 0xc002826900) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:664 +0x4d0 k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).setupCore(0xc0022188f0, 0xc002846f30) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:599 +0x78 k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).setup(0xc0022188f0, 0xc002846f30) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:610 +0x50 k8s.io/kubernetes/test/e2e/framework/network.NewNetworkingTestConfig(0xc000b2cc80, 0xc000b30c40) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:88 +0x130 k8s.io/kubernetes/test/e2e/network.glob..func15.6.14() /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:307 +0x3c k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00238a100) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:110 +0x30a k8s.io/kubernetes/test/e2e.TestE2E(0xc00238a100) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:112 +0x2b testing.tRunner(0xc00238a100, 0x4c381c8) /usr/local/go/src/testing/testing.go:909 +0xc9 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:960 +0x350 [AfterEach] [sig-network] Networking /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:152 �[1mSTEP�[0m: Collecting events from namespace "nettest-6608". �[1mSTEP�[0m: Found 17 events. Dec 3 03:15:33.251: INFO: At 2019-12-03 03:10:32 +0000 UTC - event for netserver-0: {default-scheduler } Scheduled: Successfully assigned nettest-6608/netserver-0 to bootstrap-e2e-minion-group-3k6d Dec 3 03:15:33.251: INFO: At 2019-12-03 03:10:32 +0000 UTC - event for netserver-1: {default-scheduler } Scheduled: Successfully assigned nettest-6608/netserver-1 to bootstrap-e2e-minion-group-4kfl Dec 3 03:15:33.251: INFO: At 2019-12-03 03:10:32 +0000 UTC - event for netserver-2: {default-scheduler } Scheduled: Successfully assigned nettest-6608/netserver-2 to bootstrap-e2e-minion-group-5z63 Dec 3 03:15:33.251: INFO: At 2019-12-03 03:10:32 +0000 UTC - event for netserver-3: {default-scheduler } Scheduled: Successfully assigned nettest-6608/netserver-3 to bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:33.251: INFO: At 2019-12-03 03:10:34 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:15:33.251: INFO: At 2019-12-03 03:10:34 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Created: Created container webserver Dec 3 03:15:33.251: INFO: At 2019-12-03 03:10:34 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Created: Created container webserver Dec 3 03:15:33.251: INFO: At 2019-12-03 03:10:34 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:15:33.251: INFO: At 2019-12-03 03:10:35 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Started: Started container webserver Dec 3 03:15:33.251: INFO: At 2019-12-03 03:10:35 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Started: Started container webserver Dec 3 03:15:33.251: INFO: At 2019-12-03 03:10:36 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Created: Created container webserver Dec 3 03:15:33.251: INFO: At 2019-12-03 03:10:36 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:15:33.251: INFO: At 2019-12-03 03:10:37 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Started: Started container webserver Dec 3 03:15:33.251: INFO: At 2019-12-03 03:15:09 +0000 UTC - event for netserver-0: {kubelet bootstrap-e2e-minion-group-3k6d} FailedMount: MountVolume.SetUp failed for volume "default-token-c4k9h" : failed to sync secret cache: timed out waiting for the condition Dec 3 03:15:33.251: INFO: At 2019-12-03 03:15:21 +0000 UTC - event for netserver-0: {kubelet bootstrap-e2e-minion-group-3k6d} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:15:33.251: INFO: At 2019-12-03 03:15:22 +0000 UTC - event for netserver-0: {kubelet bootstrap-e2e-minion-group-3k6d} Created: Created container webserver Dec 3 03:15:33.251: INFO: At 2019-12-03 03:15:25 +0000 UTC - event for netserver-0: {kubelet bootstrap-e2e-minion-group-3k6d} Started: Started container webserver Dec 3 03:15:33.308: INFO: POD NODE PHASE GRACE CONDITIONS Dec 3 03:15:33.308: INFO: netserver-0 bootstrap-e2e-minion-group-3k6d Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:15:08 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:15:08 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:15:08 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:32 +0000 UTC }] Dec 3 03:15:33.308: INFO: netserver-1 bootstrap-e2e-minion-group-4kfl Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:32 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:49 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:49 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:32 +0000 UTC }] Dec 3 03:15:33.308: INFO: netserver-2 bootstrap-e2e-minion-group-5z63 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:32 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:46 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:46 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:32 +0000 UTC }] Dec 3 03:15:33.308: INFO: netserver-3 bootstrap-e2e-minion-group-f8g7 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:32 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:48 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:48 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:10:32 +0000 UTC }] Dec 3 03:15:33.308: INFO: Dec 3 03:15:33.374: INFO: Logging node info for node bootstrap-e2e-master Dec 3 03:15:33.429: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master /api/v1/nodes/bootstrap-e2e-master 64f6954b-0039-46a9-bde3-dcd825532c16 34871 0 2019-12-03 02:56:38 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3876802560 0} {<nil>} 3785940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3614658560 0} {<nil>} 3529940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.39.205,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5736e6f149167618f71cd530dafef4cc,SystemUUID:5736e6f1-4916-7618-f71c-d530dafef4cc,BootID:113c1994-21fb-4e64-a041-99c12a1d120b,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3-0],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:212299081,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:200712199,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:110449186,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:3e315022a842d782a28e729720f21091dde21f1efea28868d65ec595ad871616 k8s.gcr.io/kube-addon-manager:v9.0.2],SizeBytes:83076028,},ContainerImage{Names:[k8s.gcr.io/etcd-empty-dir-cleanup@sha256:484662e55e0705caed26c6fb8632097457f43ce685756531da7a76319a7dcee1 k8s.gcr.io/etcd-empty-dir-cleanup:3.4.3.0],SizeBytes:77408900,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:76121176,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:33.429: INFO: Logging kubelet events for node bootstrap-e2e-master Dec 3 03:15:33.490: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Dec 3 03:15:33.573: INFO: kube-controller-manager-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:33.573: INFO: Container kube-controller-manager ready: true, restart count 0 Dec 3 03:15:33.573: INFO: kube-addon-manager-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:33.573: INFO: Container kube-addon-manager ready: true, restart count 0 Dec 3 03:15:33.573: INFO: etcd-server-bootstrap-e2e-master started at 2019-12-03 02:57:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:33.573: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:15:33.573: INFO: kube-apiserver-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:33.573: INFO: Container kube-apiserver ready: true, restart count 0 Dec 3 03:15:33.573: INFO: kube-scheduler-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:33.573: INFO: Container kube-scheduler ready: true, restart count 0 Dec 3 03:15:33.573: INFO: l7-lb-controller-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:33.573: INFO: Container l7-lb-controller ready: true, restart count 2 Dec 3 03:15:33.573: INFO: fluentd-gcp-v3.2.0-r5wvv started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:33.573: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:33.573: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:33.573: INFO: metadata-proxy-v0.1-b2xdn started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:33.573: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:33.573: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:33.573: INFO: etcd-empty-dir-cleanup-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:33.573: INFO: Container etcd-empty-dir-cleanup ready: true, restart count 0 Dec 3 03:15:33.573: INFO: etcd-server-events-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:33.573: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:15:33.798: INFO: Latency metrics for node bootstrap-e2e-master Dec 3 03:15:33.798: INFO: Logging node info for node bootstrap-e2e-minion-group-3k6d Dec 3 03:15:33.898: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3k6d /api/v1/nodes/bootstrap-e2e-minion-group-3k6d 27be8cb7-3aa4-4522-ac85-20da26bd0631 38528 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3k6d kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3k6d topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-6015":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-9792":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-8555":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-9542":"bootstrap-e2e-minion-group-3k6d","csi-mock-csi-mock-volumes-3632":"csi-mock-csi-mock-volumes-3632","csi-mock-csi-mock-volumes-8963":"csi-mock-csi-mock-volumes-8963","csi-mock-csi-mock-volumes-9932":"csi-mock-csi-mock-volumes-9932"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-3k6d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 03:15:24 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 03:15:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.230.19.255,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:323aa9707db5a0349fc3829baed3d8ee,SystemUUID:323aa970-7db5-a034-9fc3-829baed3d8ee,BootID:35d11602-3a27-4158-8abd-6152101be7c6,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/fluentd-gcp-scaler@sha256:4f28f10fb89506768910b858f7a18ffb996824a16d70d5ac895e49687df9ff58 k8s.gcr.io/fluentd-gcp-scaler:0.5.2],SizeBytes:90498960,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:13513083,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[busybox@sha256:679b1c1058c1f2dc59a3ee70eed986a88811c0205c8ceea57cec5f22d2c3fbb1 busybox:latest],SizeBytes:1219790,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:33.899: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3k6d Dec 3 03:15:33.958: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3k6d Dec 3 03:15:34.057: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-pgtvj started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:15:34.057: INFO: fluentd-gcp-v3.2.0-lf9js started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:34.057: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:34.057: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:34.057: INFO: pod-subpath-test-local-preprovisionedpv-k687 started at 2019-12-03 03:15:07 +0000 UTC (0+0 container statuses recorded) Dec 3 03:15:34.057: INFO: pod-ephm-test-projected-8z62 started at 2019-12-03 03:09:17 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container test-container-subpath-projected-8z62 ready: false, restart count 0 Dec 3 03:15:34.057: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container webserver ready: false, restart count 0 Dec 3 03:15:34.057: INFO: metadata-proxy-v0.1-8w2f8 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:34.057: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:34.057: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:34.057: INFO: csi-mockplugin-resizer-0 started at 2019-12-03 03:08:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container csi-resizer ready: true, restart count 0 Dec 3 03:15:34.057: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-674td started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:15:34.057: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container webserver ready: false, restart count 0 Dec 3 03:15:34.057: INFO: pod-subpath-test-hostpath-8sl4 started at 2019-12-03 03:15:08 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:34.057: INFO: Container test-container-subpath-hostpath-8sl4 ready: false, restart count 0 Dec 3 03:15:34.057: INFO: Container test-container-volume-hostpath-8sl4 ready: false, restart count 0 Dec 3 03:15:34.057: INFO: kube-proxy-bootstrap-e2e-minion-group-3k6d started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:15:34.057: INFO: coredns-65567c7b57-zlk2x started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container coredns ready: true, restart count 0 Dec 3 03:15:34.057: INFO: pvc-volume-tester-fnspg started at 2019-12-03 03:08:16 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container volume-tester ready: false, restart count 0 Dec 3 03:15:34.057: INFO: netserver-0 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container webserver ready: false, restart count 0 Dec 3 03:15:34.057: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-2ml27 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:15:34.057: INFO: hostpath-symlink-prep-provisioning-6108 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container init-volume-provisioning-6108 ready: false, restart count 0 Dec 3 03:15:34.057: INFO: fluentd-gcp-scaler-76d9c77b4d-lfhqr started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container fluentd-gcp-scaler ready: true, restart count 0 Dec 3 03:15:34.057: INFO: csi-mockplugin-0 started at 2019-12-03 03:08:07 +0000 UTC (0+3 container statuses recorded) Dec 3 03:15:34.057: INFO: Container csi-provisioner ready: true, restart count 0 Dec 3 03:15:34.057: INFO: Container driver-registrar ready: true, restart count 0 Dec 3 03:15:34.057: INFO: Container mock ready: true, restart count 0 Dec 3 03:15:34.057: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-cm9mn started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:15:34.057: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-h7lmx started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:15:34.057: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-829zq started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:15:34.057: INFO: local-client started at 2019-12-03 03:09:34 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container local-client ready: false, restart count 0 Dec 3 03:15:34.057: INFO: test-webserver-10e80124-1f4b-415c-b0d5-b7ae23929fc2 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.057: INFO: Container test-webserver ready: false, restart count 0 Dec 3 03:15:34.058: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.058: INFO: Container webserver ready: false, restart count 0 Dec 3 03:15:34.058: INFO: ss2-0 started at 2019-12-03 03:09:10 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.058: INFO: Container webserver ready: false, restart count 0 Dec 3 03:15:34.058: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-zcn2s started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.058: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:15:34.058: INFO: netserver-0 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.058: INFO: Container webserver ready: false, restart count 0 Dec 3 03:15:34.058: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.058: INFO: Container webserver ready: false, restart count 0 Dec 3 03:15:34.058: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-d2wr8 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.058: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:15:34.058: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-d9z7m started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.058: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:15:34.058: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-gn4cf started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.058: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:15:34.058: INFO: l7-default-backend-678889f899-kfz7v started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.058: INFO: Container default-http-backend ready: true, restart count 0 Dec 3 03:15:34.058: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-ls8bj started at 2019-12-03 03:09:37 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.058: INFO: Container agnhost ready: true, restart count 0 Dec 3 03:15:34.277: INFO: Latency metrics for node bootstrap-e2e-minion-group-3k6d Dec 3 03:15:34.277: INFO: Logging node info for node bootstrap-e2e-minion-group-4kfl Dec 3 03:15:34.323: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-4kfl /api/v1/nodes/bootstrap-e2e-minion-group-4kfl dd9963b5-5d66-49cc-af35-0cb8c13d5de7 38588 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-4kfl kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-4kfl topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1470":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-ephemeral-9740":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-2571":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-7815":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-volume-398":"bootstrap-e2e-minion-group-4kfl","csi-mock-csi-mock-volumes-2306":"csi-mock-csi-mock-volumes-2306","csi-mock-csi-mock-volumes-2465":"csi-mock-csi-mock-volumes-2465","csi-mock-csi-mock-volumes-5287":"csi-mock-csi-mock-volumes-5287","csi-mock-csi-mock-volumes-9659":"csi-mock-csi-mock-volumes-9659"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-4kfl,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 03:15:26 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:06 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:06 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:06 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:15:06 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.13.80,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:30b63c524b868d3087050fb30234d2f7,SystemUUID:30b63c52-4b86-8d30-8705-0fb30234d2f7,BootID:03f4e451-9446-49a9-9e0b-32e618ab9497,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 gluster/glusterdynamic-provisioner:v1.0],SizeBytes:373281573,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/heapster-amd64@sha256:9fae0af136ce0cf4f88393b3670f7139ffc464692060c374d2ae748e13144521 k8s.gcr.io/heapster-amd64:v1.6.0-beta.1],SizeBytes:76016169,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/snapshot-controller@sha256:b3c1c484ffe4f0bbf000bda93fb745e1b3899b08d605a08581426a1963dd3e8a quay.io/k8scsi/snapshot-controller:v2.0.0-rc2],SizeBytes:47222712,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/metadata-concealment@sha256:e38f92502f6f6a175fb15b5ce2d02229d465b419d4a643f5999a0f88ee170dcc gcr.io/kubernetes-e2e-test-images/metadata-concealment:1.2],SizeBytes:5124686,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:34.324: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-4kfl Dec 3 03:15:34.401: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-4kfl Dec 3 03:15:34.448: INFO: nfs-server started at 2019-12-03 03:15:06 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.448: INFO: Container nfs-server ready: true, restart count 0 Dec 3 03:15:34.448: INFO: pvc-tester-xbh4q started at 2019-12-03 03:15:31 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.448: INFO: Container write-pod ready: false, restart count 0 Dec 3 03:15:34.448: INFO: fluentd-gcp-v3.2.0-8n4lg started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:34.448: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:34.448: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:34.448: INFO: heapster-v1.6.0-beta.1-56cb44959-szz2b started at 2019-12-03 02:57:02 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:34.448: INFO: Container heapster ready: true, restart count 0 Dec 3 03:15:34.448: INFO: Container heapster-nanny ready: true, restart count 0 Dec 3 03:15:34.448: INFO: volume-snapshot-controller-0 started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.448: INFO: Container volume-snapshot-controller ready: true, restart count 0 Dec 3 03:15:34.448: INFO: netserver-1 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.448: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:34.448: INFO: netserver-1 started at 2019-12-03 03:10:32 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.448: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:34.448: INFO: metadata-proxy-v0.1-8x5ch started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:34.449: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:34.449: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:34.449: INFO: test-webserver-c6a57e65-6bd0-49ca-91ec-4de611743d50 started at 2019-12-03 03:14:55 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.449: INFO: Container test-webserver ready: true, restart count 0 Dec 3 03:15:34.449: INFO: kube-proxy-bootstrap-e2e-minion-group-4kfl started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.449: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:15:34.449: INFO: netserver-1 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.449: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:34.449: INFO: netserver-1 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.449: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:34.638: INFO: Latency metrics for node bootstrap-e2e-minion-group-4kfl Dec 3 03:15:34.638: INFO: Logging node info for node bootstrap-e2e-minion-group-5z63 Dec 3 03:15:34.681: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-5z63 /api/v1/nodes/bootstrap-e2e-minion-group-5z63 80c242ff-92d9-4147-9224-53017c8034c4 38778 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-5z63 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-5z63 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7831":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3055":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3427":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-6545":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-755":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-9008":"bootstrap-e2e-minion-group-5z63","csi-hostpath-volume-expand-7531":"bootstrap-e2e-minion-group-5z63","csi-hostpath-volume-expand-9229":"bootstrap-e2e-minion-group-5z63","csi-mock-csi-mock-volumes-2016":"csi-mock-csi-mock-volumes-2016","csi-mock-csi-mock-volumes-6472":"csi-mock-csi-mock-volumes-6472"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-5z63,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 03:15:28 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.135.120,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9bc851f45efbabdf9b8ebd2b559e5c3e,SystemUUID:9bc851f4-5efb-abdf-9b8e-bd2b559e5c3e,BootID:8e50611c-7834-4dbe-bffa-e61943723514,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[k8s.gcr.io/event-exporter@sha256:ab71028f7cbc851d273bb00449e30ab743d4e3be21ed2093299f718b42df0748 k8s.gcr.io/event-exporter:v0.3.1],SizeBytes:51445475,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:1d49fb3b108e6b42542e4a9b056dee308f06f88824326cde1636eea0472b799d k8s.gcr.io/prometheus-to-sd:v0.7.2],SizeBytes:42314030,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-3427^6d4b52bf-157a-11ea-8520-72234df9033e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-3427^6d4b52bf-157a-11ea-8520-72234df9033e,DevicePath:,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:34.682: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-5z63 Dec 3 03:15:34.746: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-5z63 Dec 3 03:15:34.805: INFO: csi-hostpath-provisioner-0 started at 2019-12-03 03:15:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.805: INFO: Container csi-provisioner ready: false, restart count 0 Dec 3 03:15:34.805: INFO: csi-hostpathplugin-0 started at 2019-12-03 03:14:41 +0000 UTC (0+3 container statuses recorded) Dec 3 03:15:34.805: INFO: Container hostpath ready: true, restart count 0 Dec 3 03:15:34.805: INFO: Container liveness-probe ready: true, restart count 0 Dec 3 03:15:34.805: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 3 03:15:34.805: INFO: csi-hostpath-resizer-0 started at 2019-12-03 03:15:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.805: INFO: Container csi-resizer ready: false, restart count 0 Dec 3 03:15:34.805: INFO: netserver-2 started at 2019-12-03 03:10:32 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.805: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:34.805: INFO: csi-hostpath-provisioner-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.805: INFO: Container csi-provisioner ready: true, restart count 0 Dec 3 03:15:34.805: INFO: netserver-2 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.805: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:34.805: INFO: csi-snapshotter-0 started at 2019-12-03 03:15:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.805: INFO: Container csi-snapshotter ready: false, restart count 0 Dec 3 03:15:34.805: INFO: csi-hostpath-attacher-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.806: INFO: Container csi-attacher ready: true, restart count 0 Dec 3 03:15:34.806: INFO: event-exporter-v0.3.1-747b47fcd-v9x29 started at 2019-12-03 02:56:59 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:34.806: INFO: Container event-exporter ready: true, restart count 0 Dec 3 03:15:34.806: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:34.806: INFO: netserver-2 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.806: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:34.806: INFO: kube-dns-autoscaler-65bc6d4889-kjnhr started at 2019-12-03 03:03:02 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.806: INFO: Container autoscaler ready: true, restart count 0 Dec 3 03:15:34.806: INFO: csi-snapshotter-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.806: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 3 03:15:34.806: INFO: ss2-1 started at 2019-12-03 03:09:36 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.806: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:34.806: INFO: csi-hostpath-resizer-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.806: INFO: Container csi-resizer ready: true, restart count 0 Dec 3 03:15:34.806: INFO: csi-hostpath-attacher-0 started at 2019-12-03 03:15:31 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.806: INFO: Container csi-attacher ready: false, restart count 0 Dec 3 03:15:34.806: INFO: metadata-proxy-v0.1-gvbgq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:34.806: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:34.806: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:34.806: INFO: csi-hostpathplugin-0 started at 2019-12-03 03:15:28 +0000 UTC (0+3 container statuses recorded) Dec 3 03:15:34.806: INFO: Container hostpath ready: false, restart count 0 Dec 3 03:15:34.806: INFO: Container liveness-probe ready: false, restart count 0 Dec 3 03:15:34.806: INFO: Container node-driver-registrar ready: false, restart count 0 Dec 3 03:15:34.806: INFO: netserver-2 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.806: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:34.806: INFO: kube-proxy-bootstrap-e2e-minion-group-5z63 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:34.806: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:15:34.806: INFO: fluentd-gcp-v3.2.0-mzjbq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:34.806: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:34.806: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:36.096: INFO: Latency metrics for node bootstrap-e2e-minion-group-5z63 Dec 3 03:15:36.096: INFO: Logging node info for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:36.148: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-f8g7 /api/v1/nodes/bootstrap-e2e-minion-group-f8g7 0ae3612d-6f1b-43b7-ac42-d209b2c53997 38796 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-f8g7 kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-5136 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-f8g7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2646":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-provisioning-6116":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volume-expand-7110":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-1617":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-5822":"bootstrap-e2e-minion-group-f8g7","csi-mock-csi-mock-volumes-447":"csi-mock-csi-mock-volumes-447","csi-mock-csi-mock-volumes-4534":"csi-mock-csi-mock-volumes-4534","csi-mock-csi-mock-volumes-5485":"csi-mock-csi-mock-volumes-5485","csi-mock-csi-mock-volumes-6096":"csi-mock-csi-mock-volumes-6096","csi-mock-csi-mock-volumes-8158":"csi-mock-csi-mock-volumes-8158"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-f8g7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 03:15:31 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:10 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:10 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:10 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:15:10 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.230.75.62,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:343d3fec9626aaffa54d1b2394118877,SystemUUID:343d3fec-9626-aaff-a54d-1b2394118877,BootID:266805a2-3169-4ee5-8194-05b64e8d9864,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1],SizeBytes:121711221,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10],SizeBytes:61365829,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:39944451,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:36.148: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:36.204: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:36.260: INFO: metrics-server-v0.3.6-7d96444597-lmbw7 started at 2019-12-03 02:57:03 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:36.260: INFO: Container metrics-server ready: true, restart count 0 Dec 3 03:15:36.260: INFO: Container metrics-server-nanny ready: true, restart count 0 Dec 3 03:15:36.260: INFO: netserver-3 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:36.260: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:36.260: INFO: csi-mockplugin-attacher-0 started at 2019-12-03 03:14:48 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:36.260: INFO: Container csi-attacher ready: false, restart count 0 Dec 3 03:15:36.260: INFO: netserver-3 started at 2019-12-03 03:10:32 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:36.260: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:36.260: INFO: pod-secrets-d5a30c98-13bb-4c17-aac0-d4d74fe60b60 started at 2019-12-03 03:14:15 +0000 UTC (0+3 container statuses recorded) Dec 3 03:15:36.260: INFO: Container creates-volume-test ready: false, restart count 0 Dec 3 03:15:36.260: INFO: Container dels-volume-test ready: false, restart count 0 Dec 3 03:15:36.260: INFO: Container upds-volume-test ready: false, restart count 0 Dec 3 03:15:36.260: INFO: fluentd-gcp-v3.2.0-wv2h4 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:36.260: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:36.260: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:36.260: INFO: coredns-65567c7b57-8thvw started at 2019-12-03 02:57:10 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:36.260: INFO: Container coredns ready: true, restart count 0 Dec 3 03:15:36.260: INFO: ss2-2 started at 2019-12-03 03:09:16 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:36.260: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:36.260: INFO: netserver-3 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:36.260: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:36.260: INFO: kubernetes-dashboard-7778f8b456-lrmfl started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:36.260: INFO: Container kubernetes-dashboard ready: true, restart count 0 Dec 3 03:15:36.260: INFO: kube-proxy-bootstrap-e2e-minion-group-f8g7 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:36.260: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:15:36.260: INFO: metadata-proxy-v0.1-dmvr8 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:36.260: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:36.260: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:36.260: INFO: netserver-3 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:36.260: INFO: Container webserver ready: true, restart count 0 Dec 3 03:15:36.485: INFO: Latency metrics for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:15:36.485: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "nettest-6608" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sNetworking\sGranular\sChecks\:\sServices\sshould\sfunction\sfor\sclient\sIP\sbased\ssession\saffinity\:\shttp\s\[LinuxOnly\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:264 Dec 3 03:17:29.038: Unexpected error: <*errors.errorString | 0xc0000d3950>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:664from junit_19.xml
[BeforeEach] [sig-network] Networking /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Creating a kubernetes client Dec 3 03:12:27.087: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename nettest �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in nettest-3102 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Networking /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:93 �[1mSTEP�[0m: Executing a successful http request from the external internet [It] should function for client IP based session affinity: http [LinuxOnly] /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:264 �[1mSTEP�[0m: Performing setup for networking test in namespace nettest-3102 �[1mSTEP�[0m: creating a selector �[1mSTEP�[0m: Creating the service pods in kubernetes Dec 3 03:12:28.409: INFO: Waiting up to 10m0s for all (but 0) nodes to be schedulable Dec 3 03:17:29.038: FAIL: Unexpected error: <*errors.errorString | 0xc0000d3950>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).createNetProxyPods(0xc0009b0d00, 0x4a5ba8b, 0x9, 0xc002a4e120, 0x0, 0x110, 0xc001b8f8c0) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:664 +0x4d0 k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).setupCore(0xc0009b0d00, 0xc002a4e120) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:599 +0x78 k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).setup(0xc0009b0d00, 0xc002a4e120) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:610 +0x50 k8s.io/kubernetes/test/e2e/framework/network.NewNetworkingTestConfig(0xc000e3d180, 0xc00262df00) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:88 +0x130 k8s.io/kubernetes/test/e2e/network.glob..func15.6.11() /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:265 +0x3c k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002af6100) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:110 +0x30a k8s.io/kubernetes/test/e2e.TestE2E(0xc002af6100) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:112 +0x2b testing.tRunner(0xc002af6100, 0x4c381c8) /usr/local/go/src/testing/testing.go:909 +0xc9 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:960 +0x350 [AfterEach] [sig-network] Networking /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:152 �[1mSTEP�[0m: Collecting events from namespace "nettest-3102". �[1mSTEP�[0m: Found 16 events. Dec 3 03:17:29.080: INFO: At 2019-12-03 03:12:28 +0000 UTC - event for netserver-0: {default-scheduler } Scheduled: Successfully assigned nettest-3102/netserver-0 to bootstrap-e2e-minion-group-3k6d Dec 3 03:17:29.080: INFO: At 2019-12-03 03:12:28 +0000 UTC - event for netserver-1: {default-scheduler } Scheduled: Successfully assigned nettest-3102/netserver-1 to bootstrap-e2e-minion-group-4kfl Dec 3 03:17:29.080: INFO: At 2019-12-03 03:12:28 +0000 UTC - event for netserver-2: {default-scheduler } Scheduled: Successfully assigned nettest-3102/netserver-2 to bootstrap-e2e-minion-group-5z63 Dec 3 03:17:29.080: INFO: At 2019-12-03 03:12:28 +0000 UTC - event for netserver-3: {default-scheduler } Scheduled: Successfully assigned nettest-3102/netserver-3 to bootstrap-e2e-minion-group-f8g7 Dec 3 03:17:29.080: INFO: At 2019-12-03 03:12:29 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:17:29.080: INFO: At 2019-12-03 03:12:29 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Created: Created container webserver Dec 3 03:17:29.080: INFO: At 2019-12-03 03:12:30 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Started: Started container webserver Dec 3 03:17:29.080: INFO: At 2019-12-03 03:12:30 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Created: Created container webserver Dec 3 03:17:29.080: INFO: At 2019-12-03 03:12:30 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Started: Started container webserver Dec 3 03:17:29.080: INFO: At 2019-12-03 03:12:30 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:17:29.080: INFO: At 2019-12-03 03:12:31 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Started: Started container webserver Dec 3 03:17:29.080: INFO: At 2019-12-03 03:12:31 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:17:29.080: INFO: At 2019-12-03 03:12:31 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Created: Created container webserver Dec 3 03:17:29.080: INFO: At 2019-12-03 03:15:23 +0000 UTC - event for netserver-0: {kubelet bootstrap-e2e-minion-group-3k6d} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:17:29.080: INFO: At 2019-12-03 03:15:23 +0000 UTC - event for netserver-0: {kubelet bootstrap-e2e-minion-group-3k6d} Created: Created container webserver Dec 3 03:17:29.080: INFO: At 2019-12-03 03:15:26 +0000 UTC - event for netserver-0: {kubelet bootstrap-e2e-minion-group-3k6d} Started: Started container webserver Dec 3 03:17:29.119: INFO: POD NODE PHASE GRACE CONDITIONS Dec 3 03:17:29.119: INFO: netserver-0 bootstrap-e2e-minion-group-3k6d Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:15:08 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:15:08 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:15:08 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:28 +0000 UTC }] Dec 3 03:17:29.119: INFO: netserver-1 bootstrap-e2e-minion-group-4kfl Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:28 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:41 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:41 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:28 +0000 UTC }] Dec 3 03:17:29.119: INFO: netserver-2 bootstrap-e2e-minion-group-5z63 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:28 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:43 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:43 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:28 +0000 UTC }] Dec 3 03:17:29.119: INFO: netserver-3 bootstrap-e2e-minion-group-f8g7 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:28 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:47 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:47 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:28 +0000 UTC }] Dec 3 03:17:29.119: INFO: Dec 3 03:17:29.163: INFO: Logging node info for node bootstrap-e2e-master Dec 3 03:17:29.201: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master /api/v1/nodes/bootstrap-e2e-master 64f6954b-0039-46a9-bde3-dcd825532c16 39563 0 2019-12-03 02:56:38 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3876802560 0} {<nil>} 3785940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3614658560 0} {<nil>} 3529940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:17:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:17:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:17:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:17:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.39.205,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5736e6f149167618f71cd530dafef4cc,SystemUUID:5736e6f1-4916-7618-f71c-d530dafef4cc,BootID:113c1994-21fb-4e64-a041-99c12a1d120b,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3-0],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:212299081,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:200712199,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:110449186,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:3e315022a842d782a28e729720f21091dde21f1efea28868d65ec595ad871616 k8s.gcr.io/kube-addon-manager:v9.0.2],SizeBytes:83076028,},ContainerImage{Names:[k8s.gcr.io/etcd-empty-dir-cleanup@sha256:484662e55e0705caed26c6fb8632097457f43ce685756531da7a76319a7dcee1 k8s.gcr.io/etcd-empty-dir-cleanup:3.4.3.0],SizeBytes:77408900,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:76121176,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:17:29.202: INFO: Logging kubelet events for node bootstrap-e2e-master Dec 3 03:17:29.244: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Dec 3 03:17:29.302: INFO: kube-controller-manager-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.302: INFO: Container kube-controller-manager ready: true, restart count 0 Dec 3 03:17:29.302: INFO: kube-addon-manager-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.302: INFO: Container kube-addon-manager ready: true, restart count 0 Dec 3 03:17:29.302: INFO: etcd-empty-dir-cleanup-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.302: INFO: Container etcd-empty-dir-cleanup ready: true, restart count 0 Dec 3 03:17:29.302: INFO: etcd-server-events-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.302: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:17:29.302: INFO: etcd-server-bootstrap-e2e-master started at 2019-12-03 02:57:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.302: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:17:29.302: INFO: kube-apiserver-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.302: INFO: Container kube-apiserver ready: true, restart count 0 Dec 3 03:17:29.302: INFO: kube-scheduler-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.302: INFO: Container kube-scheduler ready: true, restart count 0 Dec 3 03:17:29.302: INFO: l7-lb-controller-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.302: INFO: Container l7-lb-controller ready: true, restart count 2 Dec 3 03:17:29.302: INFO: fluentd-gcp-v3.2.0-r5wvv started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:29.302: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:17:29.302: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:29.302: INFO: metadata-proxy-v0.1-b2xdn started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:29.302: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:17:29.302: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:29.456: INFO: Latency metrics for node bootstrap-e2e-master Dec 3 03:17:29.456: INFO: Logging node info for node bootstrap-e2e-minion-group-3k6d Dec 3 03:17:29.496: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3k6d /api/v1/nodes/bootstrap-e2e-minion-group-3k6d 27be8cb7-3aa4-4522-ac85-20da26bd0631 38528 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3k6d kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3k6d topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-6015":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-9792":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-8555":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-9542":"bootstrap-e2e-minion-group-3k6d","csi-mock-csi-mock-volumes-3632":"csi-mock-csi-mock-volumes-3632","csi-mock-csi-mock-volumes-8963":"csi-mock-csi-mock-volumes-8963","csi-mock-csi-mock-volumes-9932":"csi-mock-csi-mock-volumes-9932"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-3k6d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 03:15:24 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 03:15:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.230.19.255,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:323aa9707db5a0349fc3829baed3d8ee,SystemUUID:323aa970-7db5-a034-9fc3-829baed3d8ee,BootID:35d11602-3a27-4158-8abd-6152101be7c6,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/fluentd-gcp-scaler@sha256:4f28f10fb89506768910b858f7a18ffb996824a16d70d5ac895e49687df9ff58 k8s.gcr.io/fluentd-gcp-scaler:0.5.2],SizeBytes:90498960,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:13513083,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[busybox@sha256:679b1c1058c1f2dc59a3ee70eed986a88811c0205c8ceea57cec5f22d2c3fbb1 busybox:latest],SizeBytes:1219790,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:17:29.496: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3k6d Dec 3 03:17:29.540: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3k6d Dec 3 03:17:29.591: INFO: ss2-0 started at 2019-12-03 03:09:10 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.591: INFO: Container webserver ready: false, restart count 0 Dec 3 03:17:29.591: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-zcn2s started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.591: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:29.591: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.591: INFO: Container webserver ready: false, restart count 0 Dec 3 03:17:29.591: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.591: INFO: Container webserver ready: false, restart count 0 Dec 3 03:17:29.591: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-d2wr8 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.591: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:29.591: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-d9z7m started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.591: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:29.591: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-gn4cf started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.591: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:29.591: INFO: l7-default-backend-678889f899-kfz7v started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.591: INFO: Container default-http-backend ready: true, restart count 0 Dec 3 03:17:29.591: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-ls8bj started at 2019-12-03 03:09:37 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.591: INFO: Container agnhost ready: true, restart count 0 Dec 3 03:17:29.591: INFO: netserver-0 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.591: INFO: Container webserver ready: false, restart count 0 Dec 3 03:17:29.591: INFO: fluentd-gcp-v3.2.0-lf9js started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:29.591: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:17:29.591: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:29.591: INFO: pod-subpath-test-local-preprovisionedpv-k687 started at 2019-12-03 03:15:07 +0000 UTC (0+0 container statuses recorded) Dec 3 03:17:29.591: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-pgtvj started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.591: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:29.591: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.591: INFO: Container webserver ready: false, restart count 0 Dec 3 03:17:29.591: INFO: metadata-proxy-v0.1-8w2f8 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:29.591: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:17:29.591: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:29.591: INFO: csi-mockplugin-resizer-0 started at 2019-12-03 03:08:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.591: INFO: Container csi-resizer ready: true, restart count 0 Dec 3 03:17:29.591: INFO: pod-ephm-test-projected-8z62 started at 2019-12-03 03:09:17 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.591: INFO: Container test-container-subpath-projected-8z62 ready: false, restart count 0 Dec 3 03:17:29.591: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-674td started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.591: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:29.591: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.592: INFO: Container webserver ready: false, restart count 0 Dec 3 03:17:29.592: INFO: kube-proxy-bootstrap-e2e-minion-group-3k6d started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.592: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:17:29.592: INFO: coredns-65567c7b57-zlk2x started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.592: INFO: Container coredns ready: true, restart count 0 Dec 3 03:17:29.592: INFO: pod-subpath-test-hostpath-8sl4 started at 2019-12-03 03:15:08 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:29.592: INFO: Container test-container-subpath-hostpath-8sl4 ready: false, restart count 0 Dec 3 03:17:29.592: INFO: Container test-container-volume-hostpath-8sl4 ready: false, restart count 0 Dec 3 03:17:29.592: INFO: netserver-0 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.592: INFO: Container webserver ready: false, restart count 0 Dec 3 03:17:29.592: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-2ml27 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.592: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:29.592: INFO: hostpath-symlink-prep-provisioning-6108 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.592: INFO: Container init-volume-provisioning-6108 ready: false, restart count 0 Dec 3 03:17:29.592: INFO: fluentd-gcp-scaler-76d9c77b4d-lfhqr started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.592: INFO: Container fluentd-gcp-scaler ready: true, restart count 0 Dec 3 03:17:29.592: INFO: csi-mockplugin-0 started at 2019-12-03 03:08:07 +0000 UTC (0+3 container statuses recorded) Dec 3 03:17:29.592: INFO: Container csi-provisioner ready: true, restart count 0 Dec 3 03:17:29.592: INFO: Container driver-registrar ready: true, restart count 0 Dec 3 03:17:29.592: INFO: Container mock ready: true, restart count 0 Dec 3 03:17:29.592: INFO: pvc-volume-tester-fnspg started at 2019-12-03 03:08:16 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.592: INFO: Container volume-tester ready: false, restart count 0 Dec 3 03:17:29.592: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-h7lmx started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.592: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:29.592: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-829zq started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.592: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:29.592: INFO: local-client started at 2019-12-03 03:09:34 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.592: INFO: Container local-client ready: false, restart count 0 Dec 3 03:17:29.592: INFO: test-webserver-10e80124-1f4b-415c-b0d5-b7ae23929fc2 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.592: INFO: Container test-webserver ready: false, restart count 0 Dec 3 03:17:29.592: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-cm9mn started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.592: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:29.756: INFO: Latency metrics for node bootstrap-e2e-minion-group-3k6d Dec 3 03:17:29.756: INFO: Logging node info for node bootstrap-e2e-minion-group-4kfl Dec 3 03:17:29.796: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-4kfl /api/v1/nodes/bootstrap-e2e-minion-group-4kfl dd9963b5-5d66-49cc-af35-0cb8c13d5de7 39086 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-4kfl kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-4kfl topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1470":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-ephemeral-9740":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-2571":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-7815":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-volume-398":"bootstrap-e2e-minion-group-4kfl","csi-mock-csi-mock-volumes-2306":"csi-mock-csi-mock-volumes-2306","csi-mock-csi-mock-volumes-2465":"csi-mock-csi-mock-volumes-2465","csi-mock-csi-mock-volumes-5287":"csi-mock-csi-mock-volumes-5287","csi-mock-csi-mock-volumes-9659":"csi-mock-csi-mock-volumes-9659"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-4kfl,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 03:15:26 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:06 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:06 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:06 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:16:06 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.13.80,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:30b63c524b868d3087050fb30234d2f7,SystemUUID:30b63c52-4b86-8d30-8705-0fb30234d2f7,BootID:03f4e451-9446-49a9-9e0b-32e618ab9497,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 gluster/glusterdynamic-provisioner:v1.0],SizeBytes:373281573,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/heapster-amd64@sha256:9fae0af136ce0cf4f88393b3670f7139ffc464692060c374d2ae748e13144521 k8s.gcr.io/heapster-amd64:v1.6.0-beta.1],SizeBytes:76016169,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/snapshot-controller@sha256:b3c1c484ffe4f0bbf000bda93fb745e1b3899b08d605a08581426a1963dd3e8a quay.io/k8scsi/snapshot-controller:v2.0.0-rc2],SizeBytes:47222712,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/metadata-concealment@sha256:e38f92502f6f6a175fb15b5ce2d02229d465b419d4a643f5999a0f88ee170dcc gcr.io/kubernetes-e2e-test-images/metadata-concealment:1.2],SizeBytes:5124686,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:17:29.797: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-4kfl Dec 3 03:17:29.850: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-4kfl Dec 3 03:17:29.908: INFO: netserver-1 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.909: INFO: Container webserver ready: true, restart count 0 Dec 3 03:17:29.909: INFO: volume-snapshot-controller-0 started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.909: INFO: Container volume-snapshot-controller ready: true, restart count 0 Dec 3 03:17:29.909: INFO: netserver-1 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.909: INFO: Container webserver ready: true, restart count 0 Dec 3 03:17:29.909: INFO: fluentd-gcp-v3.2.0-8n4lg started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:29.909: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:17:29.909: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:29.909: INFO: heapster-v1.6.0-beta.1-56cb44959-szz2b started at 2019-12-03 02:57:02 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:29.910: INFO: Container heapster ready: true, restart count 0 Dec 3 03:17:29.910: INFO: Container heapster-nanny ready: true, restart count 0 Dec 3 03:17:29.910: INFO: metadata-proxy-v0.1-8x5ch started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:29.910: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:17:29.910: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:29.910: INFO: test-webserver-c6a57e65-6bd0-49ca-91ec-4de611743d50 started at 2019-12-03 03:14:55 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.910: INFO: Container test-webserver ready: true, restart count 0 Dec 3 03:17:29.910: INFO: kube-proxy-bootstrap-e2e-minion-group-4kfl started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:29.910: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:17:30.080: INFO: Latency metrics for node bootstrap-e2e-minion-group-4kfl Dec 3 03:17:30.080: INFO: Logging node info for node bootstrap-e2e-minion-group-5z63 Dec 3 03:17:30.122: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-5z63 /api/v1/nodes/bootstrap-e2e-minion-group-5z63 80c242ff-92d9-4147-9224-53017c8034c4 39273 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-5z63 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-5z63 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7831":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3055":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3427":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-6545":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-755":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-9008":"bootstrap-e2e-minion-group-5z63","csi-hostpath-volume-expand-7531":"bootstrap-e2e-minion-group-5z63","csi-hostpath-volume-expand-9229":"bootstrap-e2e-minion-group-5z63","csi-mock-csi-mock-volumes-2016":"csi-mock-csi-mock-volumes-2016","csi-mock-csi-mock-volumes-6472":"csi-mock-csi-mock-volumes-6472"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-5z63,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 03:15:28 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.135.120,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9bc851f45efbabdf9b8ebd2b559e5c3e,SystemUUID:9bc851f4-5efb-abdf-9b8e-bd2b559e5c3e,BootID:8e50611c-7834-4dbe-bffa-e61943723514,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[k8s.gcr.io/event-exporter@sha256:ab71028f7cbc851d273bb00449e30ab743d4e3be21ed2093299f718b42df0748 k8s.gcr.io/event-exporter:v0.3.1],SizeBytes:51445475,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:1d49fb3b108e6b42542e4a9b056dee308f06f88824326cde1636eea0472b799d k8s.gcr.io/prometheus-to-sd:v0.7.2],SizeBytes:42314030,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-3427^6d4b52bf-157a-11ea-8520-72234df9033e],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:17:30.123: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-5z63 Dec 3 03:17:30.193: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-5z63 Dec 3 03:17:30.243: INFO: event-exporter-v0.3.1-747b47fcd-v9x29 started at 2019-12-03 02:56:59 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:30.243: INFO: Container event-exporter ready: true, restart count 0 Dec 3 03:17:30.243: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:30.243: INFO: netserver-2 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:30.243: INFO: Container webserver ready: true, restart count 0 Dec 3 03:17:30.243: INFO: ss2-1 started at 2019-12-03 03:09:36 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:30.243: INFO: Container webserver ready: true, restart count 0 Dec 3 03:17:30.243: INFO: kube-dns-autoscaler-65bc6d4889-kjnhr started at 2019-12-03 03:03:02 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:30.243: INFO: Container autoscaler ready: true, restart count 0 Dec 3 03:17:30.243: INFO: metadata-proxy-v0.1-gvbgq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:30.243: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:17:30.243: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:30.243: INFO: kube-proxy-bootstrap-e2e-minion-group-5z63 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:30.243: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:17:30.243: INFO: fluentd-gcp-v3.2.0-mzjbq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:30.243: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:17:30.243: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:30.243: INFO: netserver-2 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:30.243: INFO: Container webserver ready: true, restart count 0 Dec 3 03:17:30.418: INFO: Latency metrics for node bootstrap-e2e-minion-group-5z63 Dec 3 03:17:30.418: INFO: Logging node info for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:17:30.458: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-f8g7 /api/v1/nodes/bootstrap-e2e-minion-group-f8g7 0ae3612d-6f1b-43b7-ac42-d209b2c53997 39292 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-f8g7 kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-5136 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-f8g7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2646":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-provisioning-6116":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volume-expand-7110":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-1617":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-5822":"bootstrap-e2e-minion-group-f8g7","csi-mock-csi-mock-volumes-447":"csi-mock-csi-mock-volumes-447","csi-mock-csi-mock-volumes-4534":"csi-mock-csi-mock-volumes-4534","csi-mock-csi-mock-volumes-5485":"csi-mock-csi-mock-volumes-5485","csi-mock-csi-mock-volumes-6096":"csi-mock-csi-mock-volumes-6096","csi-mock-csi-mock-volumes-8158":"csi-mock-csi-mock-volumes-8158"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-f8g7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 03:15:31 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:16:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.230.75.62,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:343d3fec9626aaffa54d1b2394118877,SystemUUID:343d3fec-9626-aaff-a54d-1b2394118877,BootID:266805a2-3169-4ee5-8194-05b64e8d9864,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1],SizeBytes:121711221,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10],SizeBytes:61365829,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:39944451,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:17:30.459: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:17:30.503: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-f8g7 Dec 3 03:17:30.550: INFO: kubernetes-dashboard-7778f8b456-lrmfl started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:30.550: INFO: Container kubernetes-dashboard ready: true, restart count 0 Dec 3 03:17:30.550: INFO: kube-proxy-bootstrap-e2e-minion-group-f8g7 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:30.550: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:17:30.550: INFO: metadata-proxy-v0.1-dmvr8 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:30.550: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:17:30.550: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:30.550: INFO: netserver-3 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:30.550: INFO: Container webserver ready: true, restart count 0 Dec 3 03:17:30.550: INFO: metrics-server-v0.3.6-7d96444597-lmbw7 started at 2019-12-03 02:57:03 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:30.550: INFO: Container metrics-server ready: true, restart count 0 Dec 3 03:17:30.550: INFO: Container metrics-server-nanny ready: true, restart count 0 Dec 3 03:17:30.550: INFO: netserver-3 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:30.550: INFO: Container webserver ready: true, restart count 0 Dec 3 03:17:30.550: INFO: fluentd-gcp-v3.2.0-wv2h4 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:30.550: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:17:30.550: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:30.550: INFO: coredns-65567c7b57-8thvw started at 2019-12-03 02:57:10 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:30.550: INFO: Container coredns ready: true, restart count 0 Dec 3 03:17:30.550: INFO: ss2-2 started at 2019-12-03 03:09:16 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:30.550: INFO: Container webserver ready: true, restart count 0 Dec 3 03:17:30.822: INFO: Latency metrics for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:17:30.822: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "nettest-3102" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sNetworking\sGranular\sChecks\:\sServices\sshould\sfunction\sfor\sendpoint\-Service\:\shttp$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:199 Dec 3 03:16:05.886: Unexpected error: <*errors.errorString | 0xc0000d3950>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:664from junit_26.xml
{"msg":"PASSED [sig-storage] Mounted volume expand Should verify mounted devices can be resized","total":-1,"completed":24,"skipped":77,"failed":0} [BeforeEach] [sig-network] Networking /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Creating a kubernetes client Dec 3 03:11:04.949: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename nettest �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in nettest-5616 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Networking /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:93 �[1mSTEP�[0m: Executing a successful http request from the external internet [It] should function for endpoint-Service: http /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:199 �[1mSTEP�[0m: Performing setup for networking test in namespace nettest-5616 �[1mSTEP�[0m: creating a selector �[1mSTEP�[0m: Creating the service pods in kubernetes Dec 3 03:11:05.463: INFO: Waiting up to 10m0s for all (but 0) nodes to be schedulable Dec 3 03:16:05.886: FAIL: Unexpected error: <*errors.errorString | 0xc0000d3950>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).createNetProxyPods(0xc000e9c8f0, 0x4a5ba8b, 0x9, 0xc0027ad0e0, 0x0, 0x110, 0xc00284e000) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:664 +0x4d0 k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).setupCore(0xc000e9c8f0, 0xc0027ad0e0) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:599 +0x78 k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).setup(0xc000e9c8f0, 0xc0027ad0e0) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:610 +0x50 k8s.io/kubernetes/test/e2e/framework/network.NewNetworkingTestConfig(0xc000a7a500, 0x0) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:88 +0x130 k8s.io/kubernetes/test/e2e/network.glob..func15.6.5() /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:200 +0x3c k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0001cc500) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:110 +0x30a k8s.io/kubernetes/test/e2e.TestE2E(0xc0001cc500) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:112 +0x2b testing.tRunner(0xc0001cc500, 0x4c381c8) /usr/local/go/src/testing/testing.go:909 +0xc9 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:960 +0x350 [AfterEach] [sig-network] Networking /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:152 �[1mSTEP�[0m: Collecting events from namespace "nettest-5616". �[1mSTEP�[0m: Found 17 events. Dec 3 03:16:05.928: INFO: At 2019-12-03 03:11:05 +0000 UTC - event for netserver-0: {default-scheduler } Scheduled: Successfully assigned nettest-5616/netserver-0 to bootstrap-e2e-minion-group-3k6d Dec 3 03:16:05.928: INFO: At 2019-12-03 03:11:05 +0000 UTC - event for netserver-1: {default-scheduler } Scheduled: Successfully assigned nettest-5616/netserver-1 to bootstrap-e2e-minion-group-4kfl Dec 3 03:16:05.928: INFO: At 2019-12-03 03:11:05 +0000 UTC - event for netserver-2: {default-scheduler } Scheduled: Successfully assigned nettest-5616/netserver-2 to bootstrap-e2e-minion-group-5z63 Dec 3 03:16:05.928: INFO: At 2019-12-03 03:11:05 +0000 UTC - event for netserver-3: {default-scheduler } Scheduled: Successfully assigned nettest-5616/netserver-3 to bootstrap-e2e-minion-group-f8g7 Dec 3 03:16:05.928: INFO: At 2019-12-03 03:11:06 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:16:05.928: INFO: At 2019-12-03 03:11:06 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Created: Created container webserver Dec 3 03:16:05.928: INFO: At 2019-12-03 03:11:06 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Started: Started container webserver Dec 3 03:16:05.928: INFO: At 2019-12-03 03:11:07 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:16:05.928: INFO: At 2019-12-03 03:11:07 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Created: Created container webserver Dec 3 03:16:05.928: INFO: At 2019-12-03 03:11:07 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Started: Started container webserver Dec 3 03:16:05.928: INFO: At 2019-12-03 03:11:07 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:16:05.928: INFO: At 2019-12-03 03:11:07 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Created: Created container webserver Dec 3 03:16:05.928: INFO: At 2019-12-03 03:11:08 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Started: Started container webserver Dec 3 03:16:05.928: INFO: At 2019-12-03 03:15:09 +0000 UTC - event for netserver-0: {kubelet bootstrap-e2e-minion-group-3k6d} FailedMount: MountVolume.SetUp failed for volume "default-token-kw4dq" : failed to sync secret cache: timed out waiting for the condition Dec 3 03:16:05.928: INFO: At 2019-12-03 03:15:24 +0000 UTC - event for netserver-0: {kubelet bootstrap-e2e-minion-group-3k6d} Created: Created container webserver Dec 3 03:16:05.928: INFO: At 2019-12-03 03:15:24 +0000 UTC - event for netserver-0: {kubelet bootstrap-e2e-minion-group-3k6d} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:16:05.928: INFO: At 2019-12-03 03:15:26 +0000 UTC - event for netserver-0: {kubelet bootstrap-e2e-minion-group-3k6d} Started: Started container webserver Dec 3 03:16:05.968: INFO: POD NODE PHASE GRACE CONDITIONS Dec 3 03:16:05.968: INFO: netserver-0 bootstrap-e2e-minion-group-3k6d Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:15:08 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:15:08 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:15:08 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:11:05 +0000 UTC }] Dec 3 03:16:05.968: INFO: netserver-1 bootstrap-e2e-minion-group-4kfl Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:11:05 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:11:17 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:11:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:11:05 +0000 UTC }] Dec 3 03:16:05.968: INFO: netserver-2 bootstrap-e2e-minion-group-5z63 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:11:05 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:11:17 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:11:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:11:05 +0000 UTC }] Dec 3 03:16:05.968: INFO: netserver-3 bootstrap-e2e-minion-group-f8g7 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:11:05 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:11:19 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:11:19 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:11:05 +0000 UTC }] Dec 3 03:16:05.968: INFO: Dec 3 03:16:06.014: INFO: Logging node info for node bootstrap-e2e-master Dec 3 03:16:06.052: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master /api/v1/nodes/bootstrap-e2e-master 64f6954b-0039-46a9-bde3-dcd825532c16 34871 0 2019-12-03 02:56:38 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3876802560 0} {<nil>} 3785940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3614658560 0} {<nil>} 3529940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.39.205,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5736e6f149167618f71cd530dafef4cc,SystemUUID:5736e6f1-4916-7618-f71c-d530dafef4cc,BootID:113c1994-21fb-4e64-a041-99c12a1d120b,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3-0],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:212299081,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:200712199,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:110449186,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:3e315022a842d782a28e729720f21091dde21f1efea28868d65ec595ad871616 k8s.gcr.io/kube-addon-manager:v9.0.2],SizeBytes:83076028,},ContainerImage{Names:[k8s.gcr.io/etcd-empty-dir-cleanup@sha256:484662e55e0705caed26c6fb8632097457f43ce685756531da7a76319a7dcee1 k8s.gcr.io/etcd-empty-dir-cleanup:3.4.3.0],SizeBytes:77408900,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:76121176,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:16:06.053: INFO: Logging kubelet events for node bootstrap-e2e-master Dec 3 03:16:06.096: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Dec 3 03:16:06.151: INFO: kube-controller-manager-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.151: INFO: Container kube-controller-manager ready: true, restart count 0 Dec 3 03:16:06.151: INFO: kube-addon-manager-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.151: INFO: Container kube-addon-manager ready: true, restart count 0 Dec 3 03:16:06.151: INFO: fluentd-gcp-v3.2.0-r5wvv started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:06.151: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:16:06.151: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:06.151: INFO: metadata-proxy-v0.1-b2xdn started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:06.151: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:16:06.151: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:06.151: INFO: etcd-empty-dir-cleanup-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.151: INFO: Container etcd-empty-dir-cleanup ready: true, restart count 0 Dec 3 03:16:06.151: INFO: etcd-server-events-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.151: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:16:06.151: INFO: etcd-server-bootstrap-e2e-master started at 2019-12-03 02:57:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.151: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:16:06.151: INFO: kube-apiserver-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.151: INFO: Container kube-apiserver ready: true, restart count 0 Dec 3 03:16:06.151: INFO: kube-scheduler-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.151: INFO: Container kube-scheduler ready: true, restart count 0 Dec 3 03:16:06.151: INFO: l7-lb-controller-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.151: INFO: Container l7-lb-controller ready: true, restart count 2 Dec 3 03:16:06.298: INFO: Latency metrics for node bootstrap-e2e-master Dec 3 03:16:06.298: INFO: Logging node info for node bootstrap-e2e-minion-group-3k6d Dec 3 03:16:06.340: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3k6d /api/v1/nodes/bootstrap-e2e-minion-group-3k6d 27be8cb7-3aa4-4522-ac85-20da26bd0631 38528 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3k6d kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3k6d topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-6015":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-9792":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-8555":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-9542":"bootstrap-e2e-minion-group-3k6d","csi-mock-csi-mock-volumes-3632":"csi-mock-csi-mock-volumes-3632","csi-mock-csi-mock-volumes-8963":"csi-mock-csi-mock-volumes-8963","csi-mock-csi-mock-volumes-9932":"csi-mock-csi-mock-volumes-9932"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-3k6d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 03:15:24 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 03:15:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.230.19.255,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:323aa9707db5a0349fc3829baed3d8ee,SystemUUID:323aa970-7db5-a034-9fc3-829baed3d8ee,BootID:35d11602-3a27-4158-8abd-6152101be7c6,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/fluentd-gcp-scaler@sha256:4f28f10fb89506768910b858f7a18ffb996824a16d70d5ac895e49687df9ff58 k8s.gcr.io/fluentd-gcp-scaler:0.5.2],SizeBytes:90498960,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:13513083,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[busybox@sha256:679b1c1058c1f2dc59a3ee70eed986a88811c0205c8ceea57cec5f22d2c3fbb1 busybox:latest],SizeBytes:1219790,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:16:06.340: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3k6d Dec 3 03:16:06.384: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3k6d Dec 3 03:16:06.469: INFO: hostpath-symlink-prep-provisioning-6108 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container init-volume-provisioning-6108 ready: false, restart count 0 Dec 3 03:16:06.469: INFO: fluentd-gcp-scaler-76d9c77b4d-lfhqr started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container fluentd-gcp-scaler ready: true, restart count 0 Dec 3 03:16:06.469: INFO: csi-mockplugin-0 started at 2019-12-03 03:08:07 +0000 UTC (0+3 container statuses recorded) Dec 3 03:16:06.469: INFO: Container csi-provisioner ready: true, restart count 0 Dec 3 03:16:06.469: INFO: Container driver-registrar ready: true, restart count 0 Dec 3 03:16:06.469: INFO: Container mock ready: true, restart count 0 Dec 3 03:16:06.469: INFO: pvc-volume-tester-fnspg started at 2019-12-03 03:08:16 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container volume-tester ready: false, restart count 0 Dec 3 03:16:06.469: INFO: netserver-0 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container webserver ready: false, restart count 0 Dec 3 03:16:06.469: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-2ml27 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:06.469: INFO: local-client started at 2019-12-03 03:09:34 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container local-client ready: false, restart count 0 Dec 3 03:16:06.469: INFO: test-webserver-10e80124-1f4b-415c-b0d5-b7ae23929fc2 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container test-webserver ready: false, restart count 0 Dec 3 03:16:06.469: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-cm9mn started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:06.469: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-h7lmx started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:06.469: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-829zq started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:06.469: INFO: ss2-0 started at 2019-12-03 03:09:10 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container webserver ready: false, restart count 0 Dec 3 03:16:06.469: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-zcn2s started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:06.469: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container webserver ready: false, restart count 0 Dec 3 03:16:06.469: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-d9z7m started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:06.469: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-gn4cf started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:06.469: INFO: l7-default-backend-678889f899-kfz7v started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container default-http-backend ready: true, restart count 0 Dec 3 03:16:06.469: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-ls8bj started at 2019-12-03 03:09:37 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container agnhost ready: true, restart count 0 Dec 3 03:16:06.469: INFO: netserver-0 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container webserver ready: false, restart count 0 Dec 3 03:16:06.469: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container webserver ready: false, restart count 0 Dec 3 03:16:06.469: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-d2wr8 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:06.469: INFO: fluentd-gcp-v3.2.0-lf9js started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:06.469: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:16:06.469: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:06.469: INFO: pod-subpath-test-local-preprovisionedpv-k687 started at 2019-12-03 03:15:07 +0000 UTC (0+0 container statuses recorded) Dec 3 03:16:06.469: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-pgtvj started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:06.469: INFO: metadata-proxy-v0.1-8w2f8 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:06.469: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:16:06.469: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:06.469: INFO: csi-mockplugin-resizer-0 started at 2019-12-03 03:08:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container csi-resizer ready: true, restart count 0 Dec 3 03:16:06.469: INFO: pod-ephm-test-projected-8z62 started at 2019-12-03 03:09:17 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container test-container-subpath-projected-8z62 ready: false, restart count 0 Dec 3 03:16:06.469: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container webserver ready: false, restart count 0 Dec 3 03:16:06.469: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-674td started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:06.469: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container webserver ready: false, restart count 0 Dec 3 03:16:06.469: INFO: kube-proxy-bootstrap-e2e-minion-group-3k6d started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:16:06.469: INFO: coredns-65567c7b57-zlk2x started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.469: INFO: Container coredns ready: true, restart count 0 Dec 3 03:16:06.469: INFO: pod-subpath-test-hostpath-8sl4 started at 2019-12-03 03:15:08 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:06.469: INFO: Container test-container-subpath-hostpath-8sl4 ready: false, restart count 0 Dec 3 03:16:06.469: INFO: Container test-container-volume-hostpath-8sl4 ready: false, restart count 0 Dec 3 03:16:06.622: INFO: Latency metrics for node bootstrap-e2e-minion-group-3k6d Dec 3 03:16:06.622: INFO: Logging node info for node bootstrap-e2e-minion-group-4kfl Dec 3 03:16:06.661: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-4kfl /api/v1/nodes/bootstrap-e2e-minion-group-4kfl dd9963b5-5d66-49cc-af35-0cb8c13d5de7 38981 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-4kfl kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-4kfl topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1470":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-ephemeral-9740":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-2571":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-7815":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-volume-398":"bootstrap-e2e-minion-group-4kfl","csi-mock-csi-mock-volumes-2306":"csi-mock-csi-mock-volumes-2306","csi-mock-csi-mock-volumes-2465":"csi-mock-csi-mock-volumes-2465","csi-mock-csi-mock-volumes-5287":"csi-mock-csi-mock-volumes-5287","csi-mock-csi-mock-volumes-9659":"csi-mock-csi-mock-volumes-9659"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-4kfl,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 03:15:26 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:46 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:46 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:46 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:15:46 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.13.80,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:30b63c524b868d3087050fb30234d2f7,SystemUUID:30b63c52-4b86-8d30-8705-0fb30234d2f7,BootID:03f4e451-9446-49a9-9e0b-32e618ab9497,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 gluster/glusterdynamic-provisioner:v1.0],SizeBytes:373281573,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/heapster-amd64@sha256:9fae0af136ce0cf4f88393b3670f7139ffc464692060c374d2ae748e13144521 k8s.gcr.io/heapster-amd64:v1.6.0-beta.1],SizeBytes:76016169,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/snapshot-controller@sha256:b3c1c484ffe4f0bbf000bda93fb745e1b3899b08d605a08581426a1963dd3e8a quay.io/k8scsi/snapshot-controller:v2.0.0-rc2],SizeBytes:47222712,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/metadata-concealment@sha256:e38f92502f6f6a175fb15b5ce2d02229d465b419d4a643f5999a0f88ee170dcc gcr.io/kubernetes-e2e-test-images/metadata-concealment:1.2],SizeBytes:5124686,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/gce-pd/bootstrap-e2e-d8c80c24-10bd-46ce-93af-35f28d85784c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/gce-pd/bootstrap-e2e-d8c80c24-10bd-46ce-93af-35f28d85784c,DevicePath:/dev/disk/by-id/google-bootstrap-e2e-d8c80c24-10bd-46ce-93af-35f28d85784c,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:16:06.662: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-4kfl Dec 3 03:16:06.707: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-4kfl Dec 3 03:16:06.752: INFO: metadata-proxy-v0.1-8x5ch started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:06.752: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:16:06.752: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:06.752: INFO: test-webserver-c6a57e65-6bd0-49ca-91ec-4de611743d50 started at 2019-12-03 03:14:55 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.753: INFO: Container test-webserver ready: true, restart count 0 Dec 3 03:16:06.753: INFO: kube-proxy-bootstrap-e2e-minion-group-4kfl started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.753: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:16:06.753: INFO: netserver-1 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.753: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:06.753: INFO: netserver-1 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.753: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:06.753: INFO: fluentd-gcp-v3.2.0-8n4lg started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:06.753: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:16:06.753: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:06.753: INFO: heapster-v1.6.0-beta.1-56cb44959-szz2b started at 2019-12-03 02:57:02 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:06.753: INFO: Container heapster ready: true, restart count 0 Dec 3 03:16:06.753: INFO: Container heapster-nanny ready: true, restart count 0 Dec 3 03:16:06.753: INFO: volume-snapshot-controller-0 started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.753: INFO: Container volume-snapshot-controller ready: true, restart count 0 Dec 3 03:16:06.753: INFO: netserver-1 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:06.753: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:06.909: INFO: Latency metrics for node bootstrap-e2e-minion-group-4kfl Dec 3 03:16:06.909: INFO: Logging node info for node bootstrap-e2e-minion-group-5z63 Dec 3 03:16:06.949: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-5z63 /api/v1/nodes/bootstrap-e2e-minion-group-5z63 80c242ff-92d9-4147-9224-53017c8034c4 38778 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-5z63 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-5z63 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7831":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3055":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3427":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-6545":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-755":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-9008":"bootstrap-e2e-minion-group-5z63","csi-hostpath-volume-expand-7531":"bootstrap-e2e-minion-group-5z63","csi-hostpath-volume-expand-9229":"bootstrap-e2e-minion-group-5z63","csi-mock-csi-mock-volumes-2016":"csi-mock-csi-mock-volumes-2016","csi-mock-csi-mock-volumes-6472":"csi-mock-csi-mock-volumes-6472"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-5z63,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 03:15:28 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.135.120,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9bc851f45efbabdf9b8ebd2b559e5c3e,SystemUUID:9bc851f4-5efb-abdf-9b8e-bd2b559e5c3e,BootID:8e50611c-7834-4dbe-bffa-e61943723514,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[k8s.gcr.io/event-exporter@sha256:ab71028f7cbc851d273bb00449e30ab743d4e3be21ed2093299f718b42df0748 k8s.gcr.io/event-exporter:v0.3.1],SizeBytes:51445475,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:1d49fb3b108e6b42542e4a9b056dee308f06f88824326cde1636eea0472b799d k8s.gcr.io/prometheus-to-sd:v0.7.2],SizeBytes:42314030,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-3427^6d4b52bf-157a-11ea-8520-72234df9033e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-3427^6d4b52bf-157a-11ea-8520-72234df9033e,DevicePath:,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:16:06.950: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-5z63 Dec 3 03:16:06.995: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-5z63 Dec 3 03:16:07.042: INFO: kube-proxy-bootstrap-e2e-minion-group-5z63 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.042: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:16:07.042: INFO: fluentd-gcp-v3.2.0-mzjbq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:07.042: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:16:07.042: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:07.042: INFO: netserver-2 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.042: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:07.042: INFO: csi-hostpath-provisioner-0 started at 2019-12-03 03:15:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.042: INFO: Container csi-provisioner ready: true, restart count 0 Dec 3 03:16:07.042: INFO: csi-hostpath-resizer-0 started at 2019-12-03 03:15:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.042: INFO: Container csi-resizer ready: true, restart count 0 Dec 3 03:16:07.042: INFO: event-exporter-v0.3.1-747b47fcd-v9x29 started at 2019-12-03 02:56:59 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:07.042: INFO: Container event-exporter ready: true, restart count 0 Dec 3 03:16:07.042: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:07.042: INFO: netserver-2 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.042: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:07.042: INFO: netserver-2 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.042: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:07.042: INFO: csi-snapshotter-0 started at 2019-12-03 03:15:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.042: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 3 03:16:07.042: INFO: ss2-1 started at 2019-12-03 03:09:36 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.042: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:07.042: INFO: kube-dns-autoscaler-65bc6d4889-kjnhr started at 2019-12-03 03:03:02 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.042: INFO: Container autoscaler ready: true, restart count 0 Dec 3 03:16:07.042: INFO: metadata-proxy-v0.1-gvbgq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:07.042: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:16:07.042: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:07.042: INFO: csi-hostpathplugin-0 started at 2019-12-03 03:15:28 +0000 UTC (0+3 container statuses recorded) Dec 3 03:16:07.042: INFO: Container hostpath ready: true, restart count 0 Dec 3 03:16:07.042: INFO: Container liveness-probe ready: true, restart count 0 Dec 3 03:16:07.042: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 3 03:16:07.042: INFO: csi-hostpath-attacher-0 started at 2019-12-03 03:15:31 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.042: INFO: Container csi-attacher ready: true, restart count 0 Dec 3 03:16:07.222: INFO: Latency metrics for node bootstrap-e2e-minion-group-5z63 Dec 3 03:16:07.222: INFO: Logging node info for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:16:07.261: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-f8g7 /api/v1/nodes/bootstrap-e2e-minion-group-f8g7 0ae3612d-6f1b-43b7-ac42-d209b2c53997 38796 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-f8g7 kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-5136 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-f8g7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2646":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-provisioning-6116":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volume-expand-7110":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-1617":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-5822":"bootstrap-e2e-minion-group-f8g7","csi-mock-csi-mock-volumes-447":"csi-mock-csi-mock-volumes-447","csi-mock-csi-mock-volumes-4534":"csi-mock-csi-mock-volumes-4534","csi-mock-csi-mock-volumes-5485":"csi-mock-csi-mock-volumes-5485","csi-mock-csi-mock-volumes-6096":"csi-mock-csi-mock-volumes-6096","csi-mock-csi-mock-volumes-8158":"csi-mock-csi-mock-volumes-8158"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-f8g7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 03:15:31 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:10 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:10 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:10 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:15:10 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.230.75.62,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:343d3fec9626aaffa54d1b2394118877,SystemUUID:343d3fec-9626-aaff-a54d-1b2394118877,BootID:266805a2-3169-4ee5-8194-05b64e8d9864,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1],SizeBytes:121711221,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10],SizeBytes:61365829,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:39944451,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:16:07.262: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:16:07.312: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-f8g7 Dec 3 03:16:07.360: INFO: coredns-65567c7b57-8thvw started at 2019-12-03 02:57:10 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.360: INFO: Container coredns ready: true, restart count 0 Dec 3 03:16:07.360: INFO: ss2-2 started at 2019-12-03 03:09:16 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.360: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:07.360: INFO: netserver-3 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.360: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:07.360: INFO: fluentd-gcp-v3.2.0-wv2h4 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:07.360: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:16:07.360: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:07.360: INFO: kubernetes-dashboard-7778f8b456-lrmfl started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.360: INFO: Container kubernetes-dashboard ready: true, restart count 0 Dec 3 03:16:07.360: INFO: metadata-proxy-v0.1-dmvr8 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:07.360: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:16:07.360: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:07.360: INFO: netserver-3 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.360: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:07.360: INFO: kube-proxy-bootstrap-e2e-minion-group-f8g7 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.360: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:16:07.360: INFO: netserver-3 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.360: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:07.360: INFO: metrics-server-v0.3.6-7d96444597-lmbw7 started at 2019-12-03 02:57:03 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:07.360: INFO: Container metrics-server ready: true, restart count 0 Dec 3 03:16:07.360: INFO: Container metrics-server-nanny ready: true, restart count 0 Dec 3 03:16:07.360: INFO: gcepd-client started at 2019-12-03 03:16:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:07.360: INFO: Container gcepd-client ready: false, restart count 0 Dec 3 03:16:07.549: INFO: Latency metrics for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:16:07.549: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "nettest-5616" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sNetworking\sGranular\sChecks\:\sServices\sshould\sfunction\sfor\spod\-Service\:\shttp$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:163 Dec 3 03:17:56.316: Unexpected error: <*errors.errorString | 0xc0000db950>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:664from junit_04.xml
{"msg":"PASSED [sig-node] ConfigMap should be consumable via the environment [NodeConformance] [Conformance]","total":-1,"completed":31,"skipped":149,"failed":0} [BeforeEach] [sig-network] Networking /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Creating a kubernetes client Dec 3 03:12:55.116: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename nettest �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in nettest-7023 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Networking /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:93 �[1mSTEP�[0m: Executing a successful http request from the external internet [It] should function for pod-Service: http /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:163 �[1mSTEP�[0m: Performing setup for networking test in namespace nettest-7023 �[1mSTEP�[0m: creating a selector �[1mSTEP�[0m: Creating the service pods in kubernetes Dec 3 03:12:55.796: INFO: Waiting up to 10m0s for all (but 0) nodes to be schedulable Dec 3 03:17:56.316: FAIL: Unexpected error: <*errors.errorString | 0xc0000db950>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).createNetProxyPods(0xc000a304e0, 0x4a5ba8b, 0x9, 0xc00284a750, 0x0, 0x110, 0xc003106120) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:664 +0x4d0 k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).setupCore(0xc000a304e0, 0xc00284a750) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:599 +0x78 k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).setup(0xc000a304e0, 0xc00284a750) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:610 +0x50 k8s.io/kubernetes/test/e2e/framework/network.NewNetworkingTestConfig(0xc000a40dc0, 0xc003456000) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/network/utils.go:88 +0x130 k8s.io/kubernetes/test/e2e/network.glob..func15.6.1() /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:164 +0x3c k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0023fc100) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:110 +0x30a k8s.io/kubernetes/test/e2e.TestE2E(0xc0023fc100) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:112 +0x2b testing.tRunner(0xc0023fc100, 0x4c381c8) /usr/local/go/src/testing/testing.go:909 +0xc9 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:960 +0x350 [AfterEach] [sig-network] Networking /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:152 �[1mSTEP�[0m: Collecting events from namespace "nettest-7023". �[1mSTEP�[0m: Found 16 events. Dec 3 03:17:56.357: INFO: At 2019-12-03 03:12:56 +0000 UTC - event for netserver-0: {default-scheduler } Scheduled: Successfully assigned nettest-7023/netserver-0 to bootstrap-e2e-minion-group-3k6d Dec 3 03:17:56.357: INFO: At 2019-12-03 03:12:56 +0000 UTC - event for netserver-1: {default-scheduler } Scheduled: Successfully assigned nettest-7023/netserver-1 to bootstrap-e2e-minion-group-4kfl Dec 3 03:17:56.357: INFO: At 2019-12-03 03:12:56 +0000 UTC - event for netserver-2: {default-scheduler } Scheduled: Successfully assigned nettest-7023/netserver-2 to bootstrap-e2e-minion-group-5z63 Dec 3 03:17:56.357: INFO: At 2019-12-03 03:12:56 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:17:56.357: INFO: At 2019-12-03 03:12:56 +0000 UTC - event for netserver-3: {default-scheduler } Scheduled: Successfully assigned nettest-7023/netserver-3 to bootstrap-e2e-minion-group-f8g7 Dec 3 03:17:56.357: INFO: At 2019-12-03 03:12:57 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:17:56.357: INFO: At 2019-12-03 03:12:57 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Created: Created container webserver Dec 3 03:17:56.357: INFO: At 2019-12-03 03:12:57 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Created: Created container webserver Dec 3 03:17:56.357: INFO: At 2019-12-03 03:12:57 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Started: Started container webserver Dec 3 03:17:56.357: INFO: At 2019-12-03 03:12:57 +0000 UTC - event for netserver-2: {kubelet bootstrap-e2e-minion-group-5z63} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:17:56.357: INFO: At 2019-12-03 03:12:57 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Started: Started container webserver Dec 3 03:17:56.357: INFO: At 2019-12-03 03:12:57 +0000 UTC - event for netserver-3: {kubelet bootstrap-e2e-minion-group-f8g7} Created: Created container webserver Dec 3 03:17:56.357: INFO: At 2019-12-03 03:12:59 +0000 UTC - event for netserver-1: {kubelet bootstrap-e2e-minion-group-4kfl} Started: Started container webserver Dec 3 03:17:56.357: INFO: At 2019-12-03 03:15:21 +0000 UTC - event for netserver-0: {kubelet bootstrap-e2e-minion-group-3k6d} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine Dec 3 03:17:56.357: INFO: At 2019-12-03 03:15:22 +0000 UTC - event for netserver-0: {kubelet bootstrap-e2e-minion-group-3k6d} Created: Created container webserver Dec 3 03:17:56.357: INFO: At 2019-12-03 03:15:25 +0000 UTC - event for netserver-0: {kubelet bootstrap-e2e-minion-group-3k6d} Started: Started container webserver Dec 3 03:17:56.397: INFO: POD NODE PHASE GRACE CONDITIONS Dec 3 03:17:56.397: INFO: netserver-0 bootstrap-e2e-minion-group-3k6d Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:15:08 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:15:08 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:15:08 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:56 +0000 UTC }] Dec 3 03:17:56.397: INFO: netserver-1 bootstrap-e2e-minion-group-4kfl Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:56 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:13:11 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:13:11 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:56 +0000 UTC }] Dec 3 03:17:56.397: INFO: netserver-2 bootstrap-e2e-minion-group-5z63 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:56 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:13:10 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:13:10 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:56 +0000 UTC }] Dec 3 03:17:56.397: INFO: netserver-3 bootstrap-e2e-minion-group-f8g7 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:56 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:13:11 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:13:11 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:12:56 +0000 UTC }] Dec 3 03:17:56.397: INFO: Dec 3 03:17:56.446: INFO: Logging node info for node bootstrap-e2e-master Dec 3 03:17:56.490: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master /api/v1/nodes/bootstrap-e2e-master 64f6954b-0039-46a9-bde3-dcd825532c16 39563 0 2019-12-03 02:56:38 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3876802560 0} {<nil>} 3785940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3614658560 0} {<nil>} 3529940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:17:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:17:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:17:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:17:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.39.205,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5736e6f149167618f71cd530dafef4cc,SystemUUID:5736e6f1-4916-7618-f71c-d530dafef4cc,BootID:113c1994-21fb-4e64-a041-99c12a1d120b,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3-0],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:212299081,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:200712199,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:110449186,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:3e315022a842d782a28e729720f21091dde21f1efea28868d65ec595ad871616 k8s.gcr.io/kube-addon-manager:v9.0.2],SizeBytes:83076028,},ContainerImage{Names:[k8s.gcr.io/etcd-empty-dir-cleanup@sha256:484662e55e0705caed26c6fb8632097457f43ce685756531da7a76319a7dcee1 k8s.gcr.io/etcd-empty-dir-cleanup:3.4.3.0],SizeBytes:77408900,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:76121176,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:17:56.491: INFO: Logging kubelet events for node bootstrap-e2e-master Dec 3 03:17:56.543: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Dec 3 03:17:56.602: INFO: metadata-proxy-v0.1-b2xdn started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:56.602: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:17:56.602: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:56.602: INFO: etcd-empty-dir-cleanup-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.602: INFO: Container etcd-empty-dir-cleanup ready: true, restart count 0 Dec 3 03:17:56.602: INFO: etcd-server-events-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.602: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:17:56.602: INFO: etcd-server-bootstrap-e2e-master started at 2019-12-03 02:57:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.602: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:17:56.602: INFO: kube-apiserver-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.602: INFO: Container kube-apiserver ready: true, restart count 0 Dec 3 03:17:56.602: INFO: kube-scheduler-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.602: INFO: Container kube-scheduler ready: true, restart count 0 Dec 3 03:17:56.602: INFO: l7-lb-controller-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.602: INFO: Container l7-lb-controller ready: true, restart count 2 Dec 3 03:17:56.602: INFO: fluentd-gcp-v3.2.0-r5wvv started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:56.602: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:17:56.602: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:56.602: INFO: kube-controller-manager-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.602: INFO: Container kube-controller-manager ready: true, restart count 0 Dec 3 03:17:56.602: INFO: kube-addon-manager-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.602: INFO: Container kube-addon-manager ready: true, restart count 0 Dec 3 03:17:56.771: INFO: Latency metrics for node bootstrap-e2e-master Dec 3 03:17:56.771: INFO: Logging node info for node bootstrap-e2e-minion-group-3k6d Dec 3 03:17:56.811: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3k6d /api/v1/nodes/bootstrap-e2e-minion-group-3k6d 27be8cb7-3aa4-4522-ac85-20da26bd0631 38528 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3k6d kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3k6d topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-6015":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-9792":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-8555":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-9542":"bootstrap-e2e-minion-group-3k6d","csi-mock-csi-mock-volumes-3632":"csi-mock-csi-mock-volumes-3632","csi-mock-csi-mock-volumes-8963":"csi-mock-csi-mock-volumes-8963","csi-mock-csi-mock-volumes-9932":"csi-mock-csi-mock-volumes-9932"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-3k6d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 03:15:24 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 03:15:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.230.19.255,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:323aa9707db5a0349fc3829baed3d8ee,SystemUUID:323aa970-7db5-a034-9fc3-829baed3d8ee,BootID:35d11602-3a27-4158-8abd-6152101be7c6,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/fluentd-gcp-scaler@sha256:4f28f10fb89506768910b858f7a18ffb996824a16d70d5ac895e49687df9ff58 k8s.gcr.io/fluentd-gcp-scaler:0.5.2],SizeBytes:90498960,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:13513083,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[busybox@sha256:679b1c1058c1f2dc59a3ee70eed986a88811c0205c8ceea57cec5f22d2c3fbb1 busybox:latest],SizeBytes:1219790,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:17:56.812: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3k6d Dec 3 03:17:56.861: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3k6d Dec 3 03:17:56.949: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-674td started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:56.949: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container webserver ready: false, restart count 0 Dec 3 03:17:56.949: INFO: pod-subpath-test-hostpath-8sl4 started at 2019-12-03 03:15:08 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:56.949: INFO: Container test-container-subpath-hostpath-8sl4 ready: false, restart count 0 Dec 3 03:17:56.949: INFO: Container test-container-volume-hostpath-8sl4 ready: false, restart count 0 Dec 3 03:17:56.949: INFO: kube-proxy-bootstrap-e2e-minion-group-3k6d started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:17:56.949: INFO: coredns-65567c7b57-zlk2x started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container coredns ready: true, restart count 0 Dec 3 03:17:56.949: INFO: pvc-volume-tester-fnspg started at 2019-12-03 03:08:16 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container volume-tester ready: false, restart count 0 Dec 3 03:17:56.949: INFO: netserver-0 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container webserver ready: false, restart count 0 Dec 3 03:17:56.949: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-2ml27 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:56.949: INFO: hostpath-symlink-prep-provisioning-6108 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container init-volume-provisioning-6108 ready: false, restart count 0 Dec 3 03:17:56.949: INFO: fluentd-gcp-scaler-76d9c77b4d-lfhqr started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container fluentd-gcp-scaler ready: true, restart count 0 Dec 3 03:17:56.949: INFO: csi-mockplugin-0 started at 2019-12-03 03:08:07 +0000 UTC (0+3 container statuses recorded) Dec 3 03:17:56.949: INFO: Container csi-provisioner ready: true, restart count 0 Dec 3 03:17:56.949: INFO: Container driver-registrar ready: true, restart count 0 Dec 3 03:17:56.949: INFO: Container mock ready: true, restart count 0 Dec 3 03:17:56.949: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-cm9mn started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:56.949: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-h7lmx started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:56.949: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-829zq started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:56.949: INFO: local-client started at 2019-12-03 03:09:34 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container local-client ready: false, restart count 0 Dec 3 03:17:56.949: INFO: test-webserver-10e80124-1f4b-415c-b0d5-b7ae23929fc2 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container test-webserver ready: false, restart count 0 Dec 3 03:17:56.949: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container webserver ready: false, restart count 0 Dec 3 03:17:56.949: INFO: ss2-0 started at 2019-12-03 03:09:10 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container webserver ready: false, restart count 0 Dec 3 03:17:56.949: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-zcn2s started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:56.949: INFO: netserver-0 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container webserver ready: false, restart count 0 Dec 3 03:17:56.949: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container webserver ready: false, restart count 0 Dec 3 03:17:56.949: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-d2wr8 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:56.949: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-d9z7m started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:56.949: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-gn4cf started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:56.949: INFO: l7-default-backend-678889f899-kfz7v started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container default-http-backend ready: true, restart count 0 Dec 3 03:17:56.949: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-ls8bj started at 2019-12-03 03:09:37 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container agnhost ready: true, restart count 0 Dec 3 03:17:56.949: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-pgtvj started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:17:56.949: INFO: fluentd-gcp-v3.2.0-lf9js started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:56.949: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:17:56.949: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:56.949: INFO: pod-subpath-test-local-preprovisionedpv-k687 started at 2019-12-03 03:15:07 +0000 UTC (0+0 container statuses recorded) Dec 3 03:17:56.949: INFO: pod-ephm-test-projected-8z62 started at 2019-12-03 03:09:17 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container test-container-subpath-projected-8z62 ready: false, restart count 0 Dec 3 03:17:56.949: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container webserver ready: false, restart count 0 Dec 3 03:17:56.949: INFO: metadata-proxy-v0.1-8w2f8 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:56.949: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:17:56.949: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:56.949: INFO: csi-mockplugin-resizer-0 started at 2019-12-03 03:08:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:56.949: INFO: Container csi-resizer ready: true, restart count 0 Dec 3 03:17:57.136: INFO: Latency metrics for node bootstrap-e2e-minion-group-3k6d Dec 3 03:17:57.136: INFO: Logging node info for node bootstrap-e2e-minion-group-4kfl Dec 3 03:17:57.175: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-4kfl /api/v1/nodes/bootstrap-e2e-minion-group-4kfl dd9963b5-5d66-49cc-af35-0cb8c13d5de7 39086 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-4kfl kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-4kfl topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1470":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-ephemeral-9740":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-2571":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-7815":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-volume-398":"bootstrap-e2e-minion-group-4kfl","csi-mock-csi-mock-volumes-2306":"csi-mock-csi-mock-volumes-2306","csi-mock-csi-mock-volumes-2465":"csi-mock-csi-mock-volumes-2465","csi-mock-csi-mock-volumes-5287":"csi-mock-csi-mock-volumes-5287","csi-mock-csi-mock-volumes-9659":"csi-mock-csi-mock-volumes-9659"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-4kfl,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 03:15:26 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:06 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:06 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:06 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:16:06 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.13.80,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:30b63c524b868d3087050fb30234d2f7,SystemUUID:30b63c52-4b86-8d30-8705-0fb30234d2f7,BootID:03f4e451-9446-49a9-9e0b-32e618ab9497,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 gluster/glusterdynamic-provisioner:v1.0],SizeBytes:373281573,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/heapster-amd64@sha256:9fae0af136ce0cf4f88393b3670f7139ffc464692060c374d2ae748e13144521 k8s.gcr.io/heapster-amd64:v1.6.0-beta.1],SizeBytes:76016169,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/snapshot-controller@sha256:b3c1c484ffe4f0bbf000bda93fb745e1b3899b08d605a08581426a1963dd3e8a quay.io/k8scsi/snapshot-controller:v2.0.0-rc2],SizeBytes:47222712,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/metadata-concealment@sha256:e38f92502f6f6a175fb15b5ce2d02229d465b419d4a643f5999a0f88ee170dcc gcr.io/kubernetes-e2e-test-images/metadata-concealment:1.2],SizeBytes:5124686,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:17:57.176: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-4kfl Dec 3 03:17:57.218: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-4kfl Dec 3 03:17:57.262: INFO: netserver-1 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:57.262: INFO: Container webserver ready: true, restart count 0 Dec 3 03:17:57.262: INFO: fluentd-gcp-v3.2.0-8n4lg started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:57.262: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:17:57.262: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:57.262: INFO: heapster-v1.6.0-beta.1-56cb44959-szz2b started at 2019-12-03 02:57:02 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:57.262: INFO: Container heapster ready: true, restart count 0 Dec 3 03:17:57.262: INFO: Container heapster-nanny ready: true, restart count 0 Dec 3 03:17:57.262: INFO: volume-snapshot-controller-0 started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:57.262: INFO: Container volume-snapshot-controller ready: true, restart count 0 Dec 3 03:17:57.262: INFO: metadata-proxy-v0.1-8x5ch started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:57.262: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:17:57.262: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:57.262: INFO: test-webserver-c6a57e65-6bd0-49ca-91ec-4de611743d50 started at 2019-12-03 03:14:55 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:57.262: INFO: Container test-webserver ready: true, restart count 0 Dec 3 03:17:57.262: INFO: kube-proxy-bootstrap-e2e-minion-group-4kfl started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:57.262: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:17:57.423: INFO: Latency metrics for node bootstrap-e2e-minion-group-4kfl Dec 3 03:17:57.423: INFO: Logging node info for node bootstrap-e2e-minion-group-5z63 Dec 3 03:17:57.464: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-5z63 /api/v1/nodes/bootstrap-e2e-minion-group-5z63 80c242ff-92d9-4147-9224-53017c8034c4 39273 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-5z63 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-5z63 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7831":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3055":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3427":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-6545":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-755":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-9008":"bootstrap-e2e-minion-group-5z63","csi-hostpath-volume-expand-7531":"bootstrap-e2e-minion-group-5z63","csi-hostpath-volume-expand-9229":"bootstrap-e2e-minion-group-5z63","csi-mock-csi-mock-volumes-2016":"csi-mock-csi-mock-volumes-2016","csi-mock-csi-mock-volumes-6472":"csi-mock-csi-mock-volumes-6472"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-5z63,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 03:15:28 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.135.120,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9bc851f45efbabdf9b8ebd2b559e5c3e,SystemUUID:9bc851f4-5efb-abdf-9b8e-bd2b559e5c3e,BootID:8e50611c-7834-4dbe-bffa-e61943723514,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[k8s.gcr.io/event-exporter@sha256:ab71028f7cbc851d273bb00449e30ab743d4e3be21ed2093299f718b42df0748 k8s.gcr.io/event-exporter:v0.3.1],SizeBytes:51445475,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:1d49fb3b108e6b42542e4a9b056dee308f06f88824326cde1636eea0472b799d k8s.gcr.io/prometheus-to-sd:v0.7.2],SizeBytes:42314030,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-3427^6d4b52bf-157a-11ea-8520-72234df9033e],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:17:57.465: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-5z63 Dec 3 03:17:57.508: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-5z63 Dec 3 03:17:57.552: INFO: kube-dns-autoscaler-65bc6d4889-kjnhr started at 2019-12-03 03:03:02 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:57.552: INFO: Container autoscaler ready: true, restart count 0 Dec 3 03:17:57.552: INFO: ss2-1 started at 2019-12-03 03:09:36 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:57.553: INFO: Container webserver ready: true, restart count 0 Dec 3 03:17:57.553: INFO: metadata-proxy-v0.1-gvbgq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:57.553: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:17:57.553: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:57.553: INFO: netserver-2 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:57.553: INFO: Container webserver ready: true, restart count 0 Dec 3 03:17:57.553: INFO: kube-proxy-bootstrap-e2e-minion-group-5z63 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:57.553: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:17:57.553: INFO: fluentd-gcp-v3.2.0-mzjbq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:57.553: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:17:57.553: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:57.553: INFO: event-exporter-v0.3.1-747b47fcd-v9x29 started at 2019-12-03 02:56:59 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:57.553: INFO: Container event-exporter ready: true, restart count 0 Dec 3 03:17:57.553: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:57.733: INFO: Latency metrics for node bootstrap-e2e-minion-group-5z63 Dec 3 03:17:57.733: INFO: Logging node info for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:17:57.773: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-f8g7 /api/v1/nodes/bootstrap-e2e-minion-group-f8g7 0ae3612d-6f1b-43b7-ac42-d209b2c53997 39292 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-f8g7 kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-5136 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-f8g7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2646":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-provisioning-6116":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volume-expand-7110":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-1617":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-5822":"bootstrap-e2e-minion-group-f8g7","csi-mock-csi-mock-volumes-447":"csi-mock-csi-mock-volumes-447","csi-mock-csi-mock-volumes-4534":"csi-mock-csi-mock-volumes-4534","csi-mock-csi-mock-volumes-5485":"csi-mock-csi-mock-volumes-5485","csi-mock-csi-mock-volumes-6096":"csi-mock-csi-mock-volumes-6096","csi-mock-csi-mock-volumes-8158":"csi-mock-csi-mock-volumes-8158"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-f8g7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 03:15:31 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:16:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.230.75.62,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:343d3fec9626aaffa54d1b2394118877,SystemUUID:343d3fec-9626-aaff-a54d-1b2394118877,BootID:266805a2-3169-4ee5-8194-05b64e8d9864,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1],SizeBytes:121711221,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10],SizeBytes:61365829,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:39944451,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:17:57.773: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:17:57.817: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-f8g7 Dec 3 03:17:57.863: INFO: kube-proxy-bootstrap-e2e-minion-group-f8g7 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:57.863: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:17:57.863: INFO: metadata-proxy-v0.1-dmvr8 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:57.863: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:17:57.863: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:57.863: INFO: netserver-3 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:57.863: INFO: Container webserver ready: true, restart count 0 Dec 3 03:17:57.863: INFO: metrics-server-v0.3.6-7d96444597-lmbw7 started at 2019-12-03 02:57:03 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:57.863: INFO: Container metrics-server ready: true, restart count 0 Dec 3 03:17:57.863: INFO: Container metrics-server-nanny ready: true, restart count 0 Dec 3 03:17:57.863: INFO: fluentd-gcp-v3.2.0-wv2h4 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:17:57.863: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:17:57.863: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:17:57.863: INFO: coredns-65567c7b57-8thvw started at 2019-12-03 02:57:10 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:57.863: INFO: Container coredns ready: true, restart count 0 Dec 3 03:17:57.863: INFO: ss2-2 started at 2019-12-03 03:09:16 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:57.863: INFO: Container webserver ready: true, restart count 0 Dec 3 03:17:57.863: INFO: kubernetes-dashboard-7778f8b456-lrmfl started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:17:57.863: INFO: Container kubernetes-dashboard ready: true, restart count 0 Dec 3 03:17:58.039: INFO: Latency metrics for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:17:58.039: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "nettest-7023" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sCSI\smock\svolume\sCSI\sonline\svolume\sexpansion\sshould\sexpand\svolume\swithout\srestarting\spod\sif\sattach\=off\,\snodeExpansion\=on$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:545 Dec 3 03:16:51.856: while cleaning up after test Unexpected error: <errors.aggregate | len:1, cap:1>: [ { s: "pod \"pvc-volume-tester-fnspg\" was not deleted: timed out waiting for the condition", }, ] pod "pvc-volume-tester-fnspg" was not deleted: timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:236from junit_20.xml
[BeforeEach] [sig-storage] CSI mock volume /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Creating a kubernetes client Dec 3 03:08:05.060: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename csi-mock-volumes �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in csi-mock-volumes-9932 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should expand volume without restarting pod if attach=off, nodeExpansion=on /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:545 �[1mSTEP�[0m: deploying csi mock driver Dec 3 03:08:05.816: INFO: creating *v1.ServiceAccount: csi-mock-volumes-9932/csi-attacher Dec 3 03:08:05.889: INFO: creating *v1.ClusterRole: external-attacher-runner-csi-mock-volumes-9932 Dec 3 03:08:05.889: INFO: Define cluster role external-attacher-runner-csi-mock-volumes-9932 Dec 3 03:08:05.944: INFO: creating *v1.ClusterRoleBinding: csi-attacher-role-csi-mock-volumes-9932 Dec 3 03:08:05.988: INFO: creating *v1.Role: csi-mock-volumes-9932/external-attacher-cfg-csi-mock-volumes-9932 Dec 3 03:08:06.029: INFO: creating *v1.RoleBinding: csi-mock-volumes-9932/csi-attacher-role-cfg Dec 3 03:08:06.098: INFO: creating *v1.ServiceAccount: csi-mock-volumes-9932/csi-provisioner Dec 3 03:08:06.154: INFO: creating *v1.ClusterRole: external-provisioner-runner-csi-mock-volumes-9932 Dec 3 03:08:06.154: INFO: Define cluster role external-provisioner-runner-csi-mock-volumes-9932 Dec 3 03:08:06.208: INFO: creating *v1.ClusterRoleBinding: csi-provisioner-role-csi-mock-volumes-9932 Dec 3 03:08:06.258: INFO: creating *v1.Role: csi-mock-volumes-9932/external-provisioner-cfg-csi-mock-volumes-9932 Dec 3 03:08:06.309: INFO: creating *v1.RoleBinding: csi-mock-volumes-9932/csi-provisioner-role-cfg Dec 3 03:08:06.376: INFO: creating *v1.ServiceAccount: csi-mock-volumes-9932/csi-resizer Dec 3 03:08:06.422: INFO: creating *v1.ClusterRole: external-resizer-runner-csi-mock-volumes-9932 Dec 3 03:08:06.422: INFO: Define cluster role external-resizer-runner-csi-mock-volumes-9932 Dec 3 03:08:06.467: INFO: creating *v1.ClusterRoleBinding: csi-resizer-role-csi-mock-volumes-9932 Dec 3 03:08:06.510: INFO: creating *v1.Role: csi-mock-volumes-9932/external-resizer-cfg-csi-mock-volumes-9932 Dec 3 03:08:06.557: INFO: creating *v1.RoleBinding: csi-mock-volumes-9932/csi-resizer-role-cfg Dec 3 03:08:06.607: INFO: creating *v1.ServiceAccount: csi-mock-volumes-9932/csi-mock Dec 3 03:08:06.659: INFO: creating *v1.ClusterRoleBinding: csi-controller-attacher-role-csi-mock-volumes-9932 Dec 3 03:08:06.717: INFO: creating *v1.ClusterRoleBinding: csi-controller-provisioner-role-csi-mock-volumes-9932 Dec 3 03:08:06.768: INFO: creating *v1.ClusterRoleBinding: csi-controller-cluster-driver-registrar-role-csi-mock-volumes-9932 Dec 3 03:08:06.810: INFO: creating *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-csi-mock-volumes-9932 Dec 3 03:08:06.853: INFO: creating *v1.ClusterRoleBinding: csi-controller-resizer-role-csi-mock-volumes-9932 Dec 3 03:08:06.891: INFO: creating *v1.StorageClass: csi-mock-sc-csi-mock-volumes-9932 Dec 3 03:08:06.929: INFO: creating *v1.StatefulSet: csi-mock-volumes-9932/csi-mockplugin Dec 3 03:08:06.985: INFO: creating *v1beta1.CSIDriver: csi-mock-csi-mock-volumes-9932 Dec 3 03:08:07.122: INFO: creating *v1.StatefulSet: csi-mock-volumes-9932/csi-mockplugin-resizer Dec 3 03:08:07.270: INFO: waiting up to 4m0s for CSIDriver "csi-mock-csi-mock-volumes-9932" �[1mSTEP�[0m: Creating pod Dec 3 03:08:07.657: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil Dec 3 03:08:07.794: INFO: Waiting up to 5m0s for PersistentVolumeClaims [pvc-d4fs4] to have phase Bound Dec 3 03:08:07.995: INFO: PersistentVolumeClaim pvc-d4fs4 found but phase is Pending instead of Bound. Dec 3 03:08:10.097: INFO: PersistentVolumeClaim pvc-d4fs4 found but phase is Pending instead of Bound. Dec 3 03:08:12.220: INFO: PersistentVolumeClaim pvc-d4fs4 found but phase is Pending instead of Bound. Dec 3 03:08:14.479: INFO: PersistentVolumeClaim pvc-d4fs4 found but phase is Pending instead of Bound. Dec 3 03:08:16.600: INFO: PersistentVolumeClaim pvc-d4fs4 found and phase=Bound (8.806625625s) �[1mSTEP�[0m: Expanding current pvc �[1mSTEP�[0m: Waiting for persistent volume resize to finish �[1mSTEP�[0m: Waiting for PVC resize to finish �[1mSTEP�[0m: Deleting pod pvc-volume-tester-fnspg Dec 3 03:09:46.546: INFO: Deleting pod "pvc-volume-tester-fnspg" in namespace "csi-mock-volumes-9932" Dec 3 03:09:46.873: INFO: Wait up to 5m0s for pod "pvc-volume-tester-fnspg" to be fully deleted �[1mSTEP�[0m: Deleting claim pvc-d4fs4 Dec 3 03:14:47.555: INFO: Waiting up to 2m0s for PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd to get deleted Dec 3 03:14:47.653: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (97.391572ms) Dec 3 03:14:49.786: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (2.230694355s) Dec 3 03:14:51.854: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (4.299045738s) Dec 3 03:14:53.905: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (6.349362328s) WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused Dec 3 03:14:55.957: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (8.401362254s) WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused Dec 3 03:14:58.007: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (10.451523544s) WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused Dec 3 03:15:00.071: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (12.51625132s) WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused Dec 3 03:15:02.157: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (14.602048484s) WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused Dec 3 03:15:04.253: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (16.698050541s) WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/driver-registrar: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/driver-registrar?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/mock: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/mock?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-resizer-0/csi-resizer: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-resizer-0/csi-resizer?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused WARNING: pod log: csi-mockplugin-0/csi-provisioner: Get https://10.138.0.3:10250/containerLogs/csi-mock-volumes-9932/csi-mockplugin-0/csi-provisioner?follow=true: dial tcp 10.138.0.3:10250: connect: connection refused Dec 3 03:15:06.291: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (18.735673481s) Dec 3 03:15:08.328: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (20.773083926s) Dec 3 03:15:10.399: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (22.844211334s) Dec 3 03:15:12.486: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (24.93114401s) Dec 3 03:15:14.614: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (27.058862381s) Dec 3 03:15:16.980: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (29.42527638s) Dec 3 03:15:19.135: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (31.579941026s) Dec 3 03:15:22.194: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (34.638982815s) Dec 3 03:15:24.381: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (36.826047189s) Dec 3 03:15:26.537: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (38.982044381s) Dec 3 03:15:28.998: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (41.442992482s) Dec 3 03:15:31.088: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (43.532974069s) Dec 3 03:15:33.190: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (45.635022805s) Dec 3 03:15:35.243: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (47.68780676s) Dec 3 03:15:37.280: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (49.724985538s) Dec 3 03:15:39.319: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (51.764179421s) Dec 3 03:15:41.355: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (53.800098645s) Dec 3 03:15:43.433: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (55.878161589s) Dec 3 03:15:45.472: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (57.917163014s) Dec 3 03:15:47.511: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (59.95608713s) Dec 3 03:15:49.554: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m1.999116054s) Dec 3 03:15:51.609: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m4.053864799s) Dec 3 03:15:53.654: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m6.098986357s) Dec 3 03:15:55.701: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m8.146225641s) Dec 3 03:15:57.739: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m10.184167137s) Dec 3 03:15:59.811: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m12.256179323s) Dec 3 03:16:01.859: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m14.304208015s) Dec 3 03:16:03.905: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m16.350077393s) Dec 3 03:16:05.958: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m18.402533288s) Dec 3 03:16:08.055: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m20.499547524s) Dec 3 03:16:10.108: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m22.553104411s) Dec 3 03:16:12.145: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m24.589301775s) Dec 3 03:16:14.206: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m26.650605738s) Dec 3 03:16:16.258: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m28.703125312s) Dec 3 03:16:18.356: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m30.801091883s) Dec 3 03:16:20.404: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m32.848326432s) Dec 3 03:16:22.454: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m34.898635372s) Dec 3 03:16:24.503: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m36.948024673s) Dec 3 03:16:26.554: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m38.998526085s) Dec 3 03:16:28.605: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m41.049687694s) Dec 3 03:16:30.653: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m43.098020054s) Dec 3 03:16:32.704: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m45.148312878s) Dec 3 03:16:34.753: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m47.19810821s) Dec 3 03:16:36.803: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m49.247892575s) Dec 3 03:16:38.855: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m51.299411191s) Dec 3 03:16:40.957: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m53.40221756s) Dec 3 03:16:43.007: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m55.451529814s) Dec 3 03:16:45.135: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m57.580087117s) Dec 3 03:16:47.205: INFO: PersistentVolume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd found and phase=Bound (1m59.650079209s) �[1mSTEP�[0m: Deleting storageclass csi-mock-volumes-9932-sc �[1mSTEP�[0m: Cleaning up resources �[1mSTEP�[0m: uninstalling csi mock driver Dec 3 03:16:49.260: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-9932/csi-attacher Dec 3 03:16:49.361: INFO: deleting *v1.ClusterRole: external-attacher-runner-csi-mock-volumes-9932 Dec 3 03:16:49.458: INFO: deleting *v1.ClusterRoleBinding: csi-attacher-role-csi-mock-volumes-9932 Dec 3 03:16:49.561: INFO: deleting *v1.Role: csi-mock-volumes-9932/external-attacher-cfg-csi-mock-volumes-9932 Dec 3 03:16:49.664: INFO: deleting *v1.RoleBinding: csi-mock-volumes-9932/csi-attacher-role-cfg Dec 3 03:16:49.761: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-9932/csi-provisioner Dec 3 03:16:49.863: INFO: deleting *v1.ClusterRole: external-provisioner-runner-csi-mock-volumes-9932 Dec 3 03:16:49.988: INFO: deleting *v1.ClusterRoleBinding: csi-provisioner-role-csi-mock-volumes-9932 Dec 3 03:16:50.061: INFO: deleting *v1.Role: csi-mock-volumes-9932/external-provisioner-cfg-csi-mock-volumes-9932 Dec 3 03:16:50.168: INFO: deleting *v1.RoleBinding: csi-mock-volumes-9932/csi-provisioner-role-cfg Dec 3 03:16:50.259: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-9932/csi-resizer Dec 3 03:16:50.358: INFO: deleting *v1.ClusterRole: external-resizer-runner-csi-mock-volumes-9932 Dec 3 03:16:50.459: INFO: deleting *v1.ClusterRoleBinding: csi-resizer-role-csi-mock-volumes-9932 Dec 3 03:16:50.559: INFO: deleting *v1.Role: csi-mock-volumes-9932/external-resizer-cfg-csi-mock-volumes-9932 Dec 3 03:16:50.661: INFO: deleting *v1.RoleBinding: csi-mock-volumes-9932/csi-resizer-role-cfg Dec 3 03:16:50.761: INFO: deleting *v1.ServiceAccount: csi-mock-volumes-9932/csi-mock Dec 3 03:16:50.857: INFO: deleting *v1.ClusterRoleBinding: csi-controller-attacher-role-csi-mock-volumes-9932 Dec 3 03:16:50.961: INFO: deleting *v1.ClusterRoleBinding: csi-controller-provisioner-role-csi-mock-volumes-9932 Dec 3 03:16:51.062: INFO: deleting *v1.ClusterRoleBinding: csi-controller-cluster-driver-registrar-role-csi-mock-volumes-9932 Dec 3 03:16:51.160: INFO: deleting *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-csi-mock-volumes-9932 Dec 3 03:16:51.261: INFO: deleting *v1.ClusterRoleBinding: csi-controller-resizer-role-csi-mock-volumes-9932 Dec 3 03:16:51.362: INFO: deleting *v1.StorageClass: csi-mock-sc-csi-mock-volumes-9932 Dec 3 03:16:51.474: INFO: deleting *v1.StatefulSet: csi-mock-volumes-9932/csi-mockplugin Dec 3 03:16:51.559: INFO: deleting *v1beta1.CSIDriver: csi-mock-csi-mock-volumes-9932 Dec 3 03:16:51.676: INFO: deleting *v1.StatefulSet: csi-mock-volumes-9932/csi-mockplugin-resizer WARNING: pod log: pvc-volume-tester-fnspg/volume-tester: context canceled Dec 3 03:16:51.856: FAIL: while cleaning up after test Unexpected error: <errors.aggregate | len:1, cap:1>: [ { s: "pod \"pvc-volume-tester-fnspg\" was not deleted: timed out waiting for the condition", }, ] pod "pvc-volume-tester-fnspg" was not deleted: timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage.glob..func1.4() /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:236 +0x817 k8s.io/kubernetes/test/e2e/storage.glob..func1.9.1() /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:588 +0x9b0 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002874100) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:110 +0x30a k8s.io/kubernetes/test/e2e.TestE2E(0xc002874100) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:112 +0x2b testing.tRunner(0xc002874100, 0x4c381c8) /usr/local/go/src/testing/testing.go:909 +0xc9 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:960 +0x350 [AfterEach] [sig-storage] CSI mock volume /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:152 �[1mSTEP�[0m: Collecting events from namespace "csi-mock-volumes-9932". �[1mSTEP�[0m: Found 28 events. Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:07 +0000 UTC - event for csi-mockplugin: {statefulset-controller } SuccessfulCreate: create Pod csi-mockplugin-0 in StatefulSet csi-mockplugin successful Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:07 +0000 UTC - event for csi-mockplugin-resizer: {statefulset-controller } SuccessfulCreate: create Pod csi-mockplugin-resizer-0 in StatefulSet csi-mockplugin-resizer successful Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:07 +0000 UTC - event for pvc-d4fs4: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "csi-mock-csi-mock-volumes-9932" or manually created by system administrator Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:10 +0000 UTC - event for csi-mockplugin-0: {kubelet bootstrap-e2e-minion-group-3k6d} Pulling: Pulling image "quay.io/k8scsi/csi-provisioner:v1.4.0-rc1" Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:11 +0000 UTC - event for csi-mockplugin-0: {kubelet bootstrap-e2e-minion-group-3k6d} Pulled: Successfully pulled image "quay.io/k8scsi/csi-provisioner:v1.4.0-rc1" Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:11 +0000 UTC - event for csi-mockplugin-0: {kubelet bootstrap-e2e-minion-group-3k6d} Created: Created container csi-provisioner Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:11 +0000 UTC - event for csi-mockplugin-resizer-0: {kubelet bootstrap-e2e-minion-group-3k6d} Pulling: Pulling image "quay.io/k8scsi/csi-resizer:v0.1.0" Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:12 +0000 UTC - event for csi-mockplugin-0: {kubelet bootstrap-e2e-minion-group-3k6d} Started: Started container csi-provisioner Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:12 +0000 UTC - event for csi-mockplugin-0: {kubelet bootstrap-e2e-minion-group-3k6d} Pulling: Pulling image "quay.io/k8scsi/csi-node-driver-registrar:v1.1.0" Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:12 +0000 UTC - event for csi-mockplugin-resizer-0: {kubelet bootstrap-e2e-minion-group-3k6d} Created: Created container csi-resizer Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:12 +0000 UTC - event for csi-mockplugin-resizer-0: {kubelet bootstrap-e2e-minion-group-3k6d} Pulled: Successfully pulled image "quay.io/k8scsi/csi-resizer:v0.1.0" Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:12 +0000 UTC - event for csi-mockplugin-resizer-0: {kubelet bootstrap-e2e-minion-group-3k6d} Started: Started container csi-resizer Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:13 +0000 UTC - event for csi-mockplugin-0: {kubelet bootstrap-e2e-minion-group-3k6d} Created: Created container driver-registrar Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:13 +0000 UTC - event for csi-mockplugin-0: {kubelet bootstrap-e2e-minion-group-3k6d} Pulled: Successfully pulled image "quay.io/k8scsi/csi-node-driver-registrar:v1.1.0" Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:14 +0000 UTC - event for csi-mockplugin-0: {kubelet bootstrap-e2e-minion-group-3k6d} Created: Created container mock Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:14 +0000 UTC - event for csi-mockplugin-0: {kubelet bootstrap-e2e-minion-group-3k6d} Pulled: Container image "quay.io/k8scsi/mock-driver:v2.1.0" already present on machine Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:14 +0000 UTC - event for csi-mockplugin-0: {kubelet bootstrap-e2e-minion-group-3k6d} Started: Started container driver-registrar Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:14 +0000 UTC - event for csi-mockplugin-0: {kubelet bootstrap-e2e-minion-group-3k6d} Started: Started container mock Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:15 +0000 UTC - event for pvc-d4fs4: {csi-mock-csi-mock-volumes-9932_csi-mockplugin-0_18f6e161-839c-4dda-b63a-468eeb0e2c5a } Provisioning: External provisioner is provisioning volume for claim "csi-mock-volumes-9932/pvc-d4fs4" Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:24 +0000 UTC - event for pvc-volume-tester-fnspg: {kubelet bootstrap-e2e-minion-group-3k6d} Pulled: Container image "k8s.gcr.io/pause:3.1" already present on machine Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:25 +0000 UTC - event for pvc-volume-tester-fnspg: {kubelet bootstrap-e2e-minion-group-3k6d} Created: Created container volume-tester Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:26 +0000 UTC - event for pvc-volume-tester-fnspg: {kubelet bootstrap-e2e-minion-group-3k6d} Started: Started container volume-tester Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:33 +0000 UTC - event for pvc-d4fs4: {volume_expand } ExternalExpanding: Ignoring the PVC: didn't find a plugin capable of expanding the volume; waiting for an external controller to process this PVC. Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:34 +0000 UTC - event for pvc-d4fs4: {external-resizer csi-mock-csi-mock-volumes-9932 } Resizing: External resizer is resizing volume pvc-323a7bab-aa13-4970-bd00-c0181b837ffd Dec 3 03:16:51.906: INFO: At 2019-12-03 03:08:34 +0000 UTC - event for pvc-d4fs4: {external-resizer csi-mock-csi-mock-volumes-9932 } FileSystemResizeRequired: Require file system resize of volume on node Dec 3 03:16:51.906: INFO: At 2019-12-03 03:09:45 +0000 UTC - event for pvc-d4fs4: {kubelet bootstrap-e2e-minion-group-3k6d} FileSystemResizeSuccessful: MountVolume.NodeExpandVolume succeeded for volume "pvc-323a7bab-aa13-4970-bd00-c0181b837ffd" Dec 3 03:16:51.906: INFO: At 2019-12-03 03:09:45 +0000 UTC - event for pvc-volume-tester-fnspg: {kubelet bootstrap-e2e-minion-group-3k6d} FileSystemResizeSuccessful: MountVolume.NodeExpandVolume succeeded for volume "pvc-323a7bab-aa13-4970-bd00-c0181b837ffd" Dec 3 03:16:51.906: INFO: At 2019-12-03 03:09:46 +0000 UTC - event for pvc-volume-tester-fnspg: {kubelet bootstrap-e2e-minion-group-3k6d} Killing: Stopping container volume-tester Dec 3 03:16:51.958: INFO: POD NODE PHASE GRACE CONDITIONS Dec 3 03:16:51.958: INFO: csi-mockplugin-0 bootstrap-e2e-minion-group-3k6d Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:08:07 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:08:15 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:08:15 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:08:07 +0000 UTC }] Dec 3 03:16:51.958: INFO: csi-mockplugin-resizer-0 bootstrap-e2e-minion-group-3k6d Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:08:07 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:08:14 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:08:14 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:08:07 +0000 UTC }] Dec 3 03:16:51.958: INFO: pvc-volume-tester-fnspg bootstrap-e2e-minion-group-3k6d Pending 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:08:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:09:50 +0000 UTC ContainersNotReady containers with unready status: [volume-tester]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:09:50 +0000 UTC ContainersNotReady containers with unready status: [volume-tester]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:08:16 +0000 UTC }] Dec 3 03:16:51.958: INFO: Dec 3 03:16:52.012: INFO: Logging node info for node bootstrap-e2e-master Dec 3 03:16:52.056: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master /api/v1/nodes/bootstrap-e2e-master 64f6954b-0039-46a9-bde3-dcd825532c16 34871 0 2019-12-03 02:56:38 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3876802560 0} {<nil>} 3785940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3614658560 0} {<nil>} 3529940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.39.205,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5736e6f149167618f71cd530dafef4cc,SystemUUID:5736e6f1-4916-7618-f71c-d530dafef4cc,BootID:113c1994-21fb-4e64-a041-99c12a1d120b,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3-0],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:212299081,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:200712199,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:110449186,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:3e315022a842d782a28e729720f21091dde21f1efea28868d65ec595ad871616 k8s.gcr.io/kube-addon-manager:v9.0.2],SizeBytes:83076028,},ContainerImage{Names:[k8s.gcr.io/etcd-empty-dir-cleanup@sha256:484662e55e0705caed26c6fb8632097457f43ce685756531da7a76319a7dcee1 k8s.gcr.io/etcd-empty-dir-cleanup:3.4.3.0],SizeBytes:77408900,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:76121176,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:16:52.057: INFO: Logging kubelet events for node bootstrap-e2e-master Dec 3 03:16:52.116: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Dec 3 03:16:52.175: INFO: kube-scheduler-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.176: INFO: Container kube-scheduler ready: true, restart count 0 Dec 3 03:16:52.176: INFO: l7-lb-controller-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.176: INFO: Container l7-lb-controller ready: true, restart count 2 Dec 3 03:16:52.176: INFO: fluentd-gcp-v3.2.0-r5wvv started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:52.176: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:16:52.176: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:52.176: INFO: metadata-proxy-v0.1-b2xdn started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:52.176: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:16:52.176: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:52.176: INFO: etcd-empty-dir-cleanup-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.176: INFO: Container etcd-empty-dir-cleanup ready: true, restart count 0 Dec 3 03:16:52.176: INFO: etcd-server-events-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.176: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:16:52.176: INFO: etcd-server-bootstrap-e2e-master started at 2019-12-03 02:57:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.176: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:16:52.176: INFO: kube-apiserver-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.176: INFO: Container kube-apiserver ready: true, restart count 0 Dec 3 03:16:52.176: INFO: kube-controller-manager-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.176: INFO: Container kube-controller-manager ready: true, restart count 0 Dec 3 03:16:52.176: INFO: kube-addon-manager-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.176: INFO: Container kube-addon-manager ready: true, restart count 0 Dec 3 03:16:52.331: INFO: Latency metrics for node bootstrap-e2e-master Dec 3 03:16:52.331: INFO: Logging node info for node bootstrap-e2e-minion-group-3k6d Dec 3 03:16:52.368: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3k6d /api/v1/nodes/bootstrap-e2e-minion-group-3k6d 27be8cb7-3aa4-4522-ac85-20da26bd0631 38528 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3k6d kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3k6d topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-6015":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-9792":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-8555":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-9542":"bootstrap-e2e-minion-group-3k6d","csi-mock-csi-mock-volumes-3632":"csi-mock-csi-mock-volumes-3632","csi-mock-csi-mock-volumes-8963":"csi-mock-csi-mock-volumes-8963","csi-mock-csi-mock-volumes-9932":"csi-mock-csi-mock-volumes-9932"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-3k6d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:24 +0000 UTC,LastTransitionTime:2019-12-03 03:15:24 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:15:07 +0000 UTC,LastTransitionTime:2019-12-03 03:15:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.230.19.255,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:323aa9707db5a0349fc3829baed3d8ee,SystemUUID:323aa970-7db5-a034-9fc3-829baed3d8ee,BootID:35d11602-3a27-4158-8abd-6152101be7c6,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/fluentd-gcp-scaler@sha256:4f28f10fb89506768910b858f7a18ffb996824a16d70d5ac895e49687df9ff58 k8s.gcr.io/fluentd-gcp-scaler:0.5.2],SizeBytes:90498960,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:13513083,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[busybox@sha256:679b1c1058c1f2dc59a3ee70eed986a88811c0205c8ceea57cec5f22d2c3fbb1 busybox:latest],SizeBytes:1219790,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:16:52.369: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3k6d Dec 3 03:16:52.408: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3k6d Dec 3 03:16:52.470: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-674td started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:52.470: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container webserver ready: false, restart count 0 Dec 3 03:16:52.470: INFO: kube-proxy-bootstrap-e2e-minion-group-3k6d started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:16:52.470: INFO: coredns-65567c7b57-zlk2x started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container coredns ready: true, restart count 0 Dec 3 03:16:52.470: INFO: pod-subpath-test-hostpath-8sl4 started at 2019-12-03 03:15:08 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:52.470: INFO: Container test-container-subpath-hostpath-8sl4 ready: false, restart count 0 Dec 3 03:16:52.470: INFO: Container test-container-volume-hostpath-8sl4 ready: false, restart count 0 Dec 3 03:16:52.470: INFO: fluentd-gcp-scaler-76d9c77b4d-lfhqr started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container fluentd-gcp-scaler ready: true, restart count 0 Dec 3 03:16:52.470: INFO: csi-mockplugin-0 started at 2019-12-03 03:08:07 +0000 UTC (0+3 container statuses recorded) Dec 3 03:16:52.470: INFO: Container csi-provisioner ready: true, restart count 0 Dec 3 03:16:52.470: INFO: Container driver-registrar ready: true, restart count 0 Dec 3 03:16:52.470: INFO: Container mock ready: true, restart count 0 Dec 3 03:16:52.470: INFO: pvc-volume-tester-fnspg started at 2019-12-03 03:08:16 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container volume-tester ready: false, restart count 0 Dec 3 03:16:52.470: INFO: netserver-0 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container webserver ready: false, restart count 0 Dec 3 03:16:52.470: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-2ml27 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:52.470: INFO: hostpath-symlink-prep-provisioning-6108 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container init-volume-provisioning-6108 ready: false, restart count 0 Dec 3 03:16:52.470: INFO: local-client started at 2019-12-03 03:09:34 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container local-client ready: false, restart count 0 Dec 3 03:16:52.470: INFO: test-webserver-10e80124-1f4b-415c-b0d5-b7ae23929fc2 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container test-webserver ready: false, restart count 0 Dec 3 03:16:52.470: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-cm9mn started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:52.470: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-h7lmx started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:52.470: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-829zq started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:52.470: INFO: ss2-0 started at 2019-12-03 03:09:10 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container webserver ready: false, restart count 0 Dec 3 03:16:52.470: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-zcn2s started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:52.470: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container webserver ready: false, restart count 0 Dec 3 03:16:52.470: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-gn4cf started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:52.470: INFO: l7-default-backend-678889f899-kfz7v started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container default-http-backend ready: true, restart count 0 Dec 3 03:16:52.470: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-ls8bj started at 2019-12-03 03:09:37 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container agnhost ready: true, restart count 0 Dec 3 03:16:52.470: INFO: netserver-0 started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container webserver ready: false, restart count 0 Dec 3 03:16:52.470: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container webserver ready: false, restart count 0 Dec 3 03:16:52.470: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-d2wr8 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:52.470: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-d9z7m started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:52.470: INFO: fluentd-gcp-v3.2.0-lf9js started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:52.470: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:16:52.470: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:52.470: INFO: pod-subpath-test-local-preprovisionedpv-k687 started at 2019-12-03 03:15:07 +0000 UTC (0+0 container statuses recorded) Dec 3 03:16:52.470: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-pgtvj started at 2019-12-03 03:15:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:16:52.470: INFO: metadata-proxy-v0.1-8w2f8 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:52.470: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:16:52.470: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:52.470: INFO: csi-mockplugin-resizer-0 started at 2019-12-03 03:08:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.470: INFO: Container csi-resizer ready: true, restart count 0 Dec 3 03:16:52.471: INFO: pod-ephm-test-projected-8z62 started at 2019-12-03 03:09:17 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.471: INFO: Container test-container-subpath-projected-8z62 ready: false, restart count 0 Dec 3 03:16:52.471: INFO: netserver-0 started at 2019-12-03 03:15:08 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.471: INFO: Container webserver ready: false, restart count 0 Dec 3 03:16:52.654: INFO: Latency metrics for node bootstrap-e2e-minion-group-3k6d Dec 3 03:16:52.655: INFO: Logging node info for node bootstrap-e2e-minion-group-4kfl Dec 3 03:16:52.693: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-4kfl /api/v1/nodes/bootstrap-e2e-minion-group-4kfl dd9963b5-5d66-49cc-af35-0cb8c13d5de7 39086 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-4kfl kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-4kfl topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1470":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-ephemeral-9740":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-2571":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-7815":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-volume-398":"bootstrap-e2e-minion-group-4kfl","csi-mock-csi-mock-volumes-2306":"csi-mock-csi-mock-volumes-2306","csi-mock-csi-mock-volumes-2465":"csi-mock-csi-mock-volumes-2465","csi-mock-csi-mock-volumes-5287":"csi-mock-csi-mock-volumes-5287","csi-mock-csi-mock-volumes-9659":"csi-mock-csi-mock-volumes-9659"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-4kfl,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:27 +0000 UTC,LastTransitionTime:2019-12-03 03:15:26 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:06 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:06 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:06 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:16:06 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.13.80,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:30b63c524b868d3087050fb30234d2f7,SystemUUID:30b63c52-4b86-8d30-8705-0fb30234d2f7,BootID:03f4e451-9446-49a9-9e0b-32e618ab9497,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 gluster/glusterdynamic-provisioner:v1.0],SizeBytes:373281573,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/heapster-amd64@sha256:9fae0af136ce0cf4f88393b3670f7139ffc464692060c374d2ae748e13144521 k8s.gcr.io/heapster-amd64:v1.6.0-beta.1],SizeBytes:76016169,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/snapshot-controller@sha256:b3c1c484ffe4f0bbf000bda93fb745e1b3899b08d605a08581426a1963dd3e8a quay.io/k8scsi/snapshot-controller:v2.0.0-rc2],SizeBytes:47222712,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/metadata-concealment@sha256:e38f92502f6f6a175fb15b5ce2d02229d465b419d4a643f5999a0f88ee170dcc gcr.io/kubernetes-e2e-test-images/metadata-concealment:1.2],SizeBytes:5124686,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:16:52.693: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-4kfl Dec 3 03:16:52.744: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-4kfl Dec 3 03:16:52.791: INFO: netserver-1 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.791: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:52.791: INFO: fluentd-gcp-v3.2.0-8n4lg started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:52.791: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:16:52.791: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:52.791: INFO: heapster-v1.6.0-beta.1-56cb44959-szz2b started at 2019-12-03 02:57:02 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:52.791: INFO: Container heapster ready: true, restart count 0 Dec 3 03:16:52.791: INFO: Container heapster-nanny ready: true, restart count 0 Dec 3 03:16:52.791: INFO: volume-snapshot-controller-0 started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.791: INFO: Container volume-snapshot-controller ready: true, restart count 0 Dec 3 03:16:52.791: INFO: metadata-proxy-v0.1-8x5ch started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:52.791: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:16:52.791: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:52.791: INFO: test-webserver-c6a57e65-6bd0-49ca-91ec-4de611743d50 started at 2019-12-03 03:14:55 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.791: INFO: Container test-webserver ready: true, restart count 0 Dec 3 03:16:52.791: INFO: kube-proxy-bootstrap-e2e-minion-group-4kfl started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.791: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:16:52.791: INFO: netserver-1 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:52.791: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:52.948: INFO: Latency metrics for node bootstrap-e2e-minion-group-4kfl Dec 3 03:16:52.948: INFO: Logging node info for node bootstrap-e2e-minion-group-5z63 Dec 3 03:16:53.007: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-5z63 /api/v1/nodes/bootstrap-e2e-minion-group-5z63 80c242ff-92d9-4147-9224-53017c8034c4 39273 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-5z63 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-5z63 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7831":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3055":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3427":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-6545":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-755":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-9008":"bootstrap-e2e-minion-group-5z63","csi-hostpath-volume-expand-7531":"bootstrap-e2e-minion-group-5z63","csi-hostpath-volume-expand-9229":"bootstrap-e2e-minion-group-5z63","csi-mock-csi-mock-volumes-2016":"csi-mock-csi-mock-volumes-2016","csi-mock-csi-mock-volumes-6472":"csi-mock-csi-mock-volumes-6472"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-5z63,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 03:15:28 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:29 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:54 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.135.120,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9bc851f45efbabdf9b8ebd2b559e5c3e,SystemUUID:9bc851f4-5efb-abdf-9b8e-bd2b559e5c3e,BootID:8e50611c-7834-4dbe-bffa-e61943723514,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[k8s.gcr.io/event-exporter@sha256:ab71028f7cbc851d273bb00449e30ab743d4e3be21ed2093299f718b42df0748 k8s.gcr.io/event-exporter:v0.3.1],SizeBytes:51445475,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:1d49fb3b108e6b42542e4a9b056dee308f06f88824326cde1636eea0472b799d k8s.gcr.io/prometheus-to-sd:v0.7.2],SizeBytes:42314030,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-3427^6d4b52bf-157a-11ea-8520-72234df9033e],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:16:53.007: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-5z63 Dec 3 03:16:53.052: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-5z63 Dec 3 03:16:53.096: INFO: netserver-2 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:53.096: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:53.096: INFO: event-exporter-v0.3.1-747b47fcd-v9x29 started at 2019-12-03 02:56:59 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:53.096: INFO: Container event-exporter ready: true, restart count 0 Dec 3 03:16:53.096: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:53.096: INFO: kube-dns-autoscaler-65bc6d4889-kjnhr started at 2019-12-03 03:03:02 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:53.096: INFO: Container autoscaler ready: true, restart count 0 Dec 3 03:16:53.096: INFO: ss2-1 started at 2019-12-03 03:09:36 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:53.096: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:53.096: INFO: metadata-proxy-v0.1-gvbgq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:53.096: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:16:53.096: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:53.096: INFO: fluentd-gcp-v3.2.0-mzjbq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:53.096: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:16:53.096: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:53.096: INFO: netserver-2 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:53.096: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:53.096: INFO: kube-proxy-bootstrap-e2e-minion-group-5z63 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:53.096: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:16:53.260: INFO: Latency metrics for node bootstrap-e2e-minion-group-5z63 Dec 3 03:16:53.260: INFO: Logging node info for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:16:53.296: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-f8g7 /api/v1/nodes/bootstrap-e2e-minion-group-f8g7 0ae3612d-6f1b-43b7-ac42-d209b2c53997 39292 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-f8g7 kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-5136 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-f8g7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2646":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-provisioning-6116":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volume-expand-7110":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-1617":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-5822":"bootstrap-e2e-minion-group-f8g7","csi-mock-csi-mock-volumes-447":"csi-mock-csi-mock-volumes-447","csi-mock-csi-mock-volumes-4534":"csi-mock-csi-mock-volumes-4534","csi-mock-csi-mock-volumes-5485":"csi-mock-csi-mock-volumes-5485","csi-mock-csi-mock-volumes-6096":"csi-mock-csi-mock-volumes-6096","csi-mock-csi-mock-volumes-8158":"csi-mock-csi-mock-volumes-8158"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-f8g7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 03:15:31 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:15:32 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:16:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:16:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.230.75.62,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:343d3fec9626aaffa54d1b2394118877,SystemUUID:343d3fec-9626-aaff-a54d-1b2394118877,BootID:266805a2-3169-4ee5-8194-05b64e8d9864,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1],SizeBytes:121711221,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10],SizeBytes:61365829,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:39944451,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:16:53.297: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:16:53.336: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-f8g7 Dec 3 03:16:53.379: INFO: fluentd-gcp-v3.2.0-wv2h4 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:53.379: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:16:53.379: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:53.379: INFO: coredns-65567c7b57-8thvw started at 2019-12-03 02:57:10 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:53.379: INFO: Container coredns ready: true, restart count 0 Dec 3 03:16:53.379: INFO: ss2-2 started at 2019-12-03 03:09:16 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:53.379: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:53.379: INFO: netserver-3 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:53.379: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:53.379: INFO: kubernetes-dashboard-7778f8b456-lrmfl started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:53.379: INFO: Container kubernetes-dashboard ready: true, restart count 0 Dec 3 03:16:53.379: INFO: kube-proxy-bootstrap-e2e-minion-group-f8g7 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:53.379: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:16:53.379: INFO: metadata-proxy-v0.1-dmvr8 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:53.379: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:16:53.379: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:16:53.379: INFO: netserver-3 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:16:53.379: INFO: Container webserver ready: true, restart count 0 Dec 3 03:16:53.379: INFO: metrics-server-v0.3.6-7d96444597-lmbw7 started at 2019-12-03 02:57:03 +0000 UTC (0+2 container statuses recorded) Dec 3 03:16:53.379: INFO: Container metrics-server ready: true, restart count 0 Dec 3 03:16:53.379: INFO: Container metrics-server-nanny ready: true, restart count 0 Dec 3 03:16:53.546: INFO: Latency metrics for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:16:53.546: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "csi-mock-volumes-9932" for this suite.
Find pvc-volume-tester-fnspg mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sEphemeralstorage\sWhen\spod\srefers\sto\snon\-existent\sephemeral\sstorage\sshould\sallow\sdeletion\sof\spod\swith\sinvalid\svolume\s\:\sprojected$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/ephemeral_volume.go:55 Dec 3 03:14:47.739: Unexpected error: <*errors.errorString | 0xc002c448e0>: { s: "pod \"pod-ephm-test-projected-8z62\" was not deleted: timed out waiting for the condition", } pod "pod-ephm-test-projected-8z62" was not deleted: timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/ephemeral_volume.go:63from junit_25.xml
[BeforeEach] [sig-storage] Ephemeralstorage /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Creating a kubernetes client Dec 3 03:09:16.247: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename pv �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in pv-9041 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Ephemeralstorage /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/ephemeral_volume.go:49 [It] should allow deletion of pod with invalid volume : projected /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/ephemeral_volume.go:55 Dec 3 03:09:47.204: INFO: Deleting pod "pv-9041"/"pod-ephm-test-projected-8z62" Dec 3 03:09:47.204: INFO: Deleting pod "pod-ephm-test-projected-8z62" in namespace "pv-9041" Dec 3 03:09:47.522: INFO: Wait up to 5m0s for pod "pod-ephm-test-projected-8z62" to be fully deleted Dec 3 03:14:47.739: FAIL: Unexpected error: <*errors.errorString | 0xc002c448e0>: { s: "pod \"pod-ephm-test-projected-8z62\" was not deleted: timed out waiting for the condition", } pod "pod-ephm-test-projected-8z62" was not deleted: timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage.glob..func5.2.1() /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/ephemeral_volume.go:63 +0x22c k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0010fb200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:110 +0x30a k8s.io/kubernetes/test/e2e.TestE2E(0xc0010fb200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:112 +0x2b testing.tRunner(0xc0010fb200, 0x4c381c8) /usr/local/go/src/testing/testing.go:909 +0xc9 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:960 +0x350 [AfterEach] [sig-storage] Ephemeralstorage /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:152 �[1mSTEP�[0m: Collecting events from namespace "pv-9041". �[1mSTEP�[0m: Found 3 events. Dec 3 03:14:47.788: INFO: At 2019-12-03 03:09:17 +0000 UTC - event for pod-ephm-test-projected-8z62: {default-scheduler } Scheduled: Successfully assigned pv-9041/pod-ephm-test-projected-8z62 to bootstrap-e2e-minion-group-3k6d Dec 3 03:14:47.788: INFO: At 2019-12-03 03:09:17 +0000 UTC - event for pod-ephm-test-projected-8z62: {kubelet bootstrap-e2e-minion-group-3k6d} FailedMount: MountVolume.SetUp failed for volume "test-volume" : secret "secret-pod-ephm-test" not found Dec 3 03:14:47.788: INFO: At 2019-12-03 03:11:20 +0000 UTC - event for pod-ephm-test-projected-8z62: {kubelet bootstrap-e2e-minion-group-3k6d} FailedMount: Unable to attach or mount volumes: unmounted volumes=[test-volume default-token-tqppp], unattached volumes=[test-volume default-token-tqppp]: timed out waiting for the condition Dec 3 03:14:47.825: INFO: POD NODE PHASE GRACE CONDITIONS Dec 3 03:14:47.825: INFO: pod-ephm-test-projected-8z62 bootstrap-e2e-minion-group-3k6d Pending 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:09:17 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:09:17 +0000 UTC ContainersNotReady containers with unready status: [test-container-subpath-projected-8z62]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:09:17 +0000 UTC ContainersNotReady containers with unready status: [test-container-subpath-projected-8z62]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-12-03 03:09:17 +0000 UTC }] Dec 3 03:14:47.825: INFO: Dec 3 03:14:47.866: INFO: Logging node info for node bootstrap-e2e-master Dec 3 03:14:47.912: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master /api/v1/nodes/bootstrap-e2e-master 64f6954b-0039-46a9-bde3-dcd825532c16 34871 0 2019-12-03 02:56:38 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3876802560 0} {<nil>} 3785940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3614658560 0} {<nil>} 3529940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.39.205,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5736e6f149167618f71cd530dafef4cc,SystemUUID:5736e6f1-4916-7618-f71c-d530dafef4cc,BootID:113c1994-21fb-4e64-a041-99c12a1d120b,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3-0],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:212299081,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:200712199,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:110449186,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:3e315022a842d782a28e729720f21091dde21f1efea28868d65ec595ad871616 k8s.gcr.io/kube-addon-manager:v9.0.2],SizeBytes:83076028,},ContainerImage{Names:[k8s.gcr.io/etcd-empty-dir-cleanup@sha256:484662e55e0705caed26c6fb8632097457f43ce685756531da7a76319a7dcee1 k8s.gcr.io/etcd-empty-dir-cleanup:3.4.3.0],SizeBytes:77408900,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:76121176,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:14:47.912: INFO: Logging kubelet events for node bootstrap-e2e-master Dec 3 03:14:47.981: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Dec 3 03:14:48.036: INFO: kube-controller-manager-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.036: INFO: Container kube-controller-manager ready: true, restart count 0 Dec 3 03:14:48.036: INFO: kube-addon-manager-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.036: INFO: Container kube-addon-manager ready: true, restart count 0 Dec 3 03:14:48.036: INFO: etcd-server-bootstrap-e2e-master started at 2019-12-03 02:57:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.036: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:14:48.036: INFO: kube-apiserver-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.036: INFO: Container kube-apiserver ready: true, restart count 0 Dec 3 03:14:48.036: INFO: kube-scheduler-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.036: INFO: Container kube-scheduler ready: true, restart count 0 Dec 3 03:14:48.036: INFO: l7-lb-controller-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.036: INFO: Container l7-lb-controller ready: true, restart count 2 Dec 3 03:14:48.036: INFO: fluentd-gcp-v3.2.0-r5wvv started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:14:48.036: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:14:48.036: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:14:48.036: INFO: metadata-proxy-v0.1-b2xdn started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:14:48.036: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:14:48.036: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:14:48.036: INFO: etcd-empty-dir-cleanup-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.036: INFO: Container etcd-empty-dir-cleanup ready: true, restart count 0 Dec 3 03:14:48.036: INFO: etcd-server-events-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.036: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:14:48.173: INFO: Latency metrics for node bootstrap-e2e-master Dec 3 03:14:48.173: INFO: Logging node info for node bootstrap-e2e-minion-group-3k6d Dec 3 03:14:48.208: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3k6d /api/v1/nodes/bootstrap-e2e-minion-group-3k6d 27be8cb7-3aa4-4522-ac85-20da26bd0631 37099 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3k6d kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3k6d topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-6015":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-9792":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-8555":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-9542":"bootstrap-e2e-minion-group-3k6d","csi-mock-csi-mock-volumes-3632":"csi-mock-csi-mock-volumes-3632","csi-mock-csi-mock-volumes-8963":"csi-mock-csi-mock-volumes-8963","csi-mock-csi-mock-volumes-9932":"csi-mock-csi-mock-volumes-9932"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-3k6d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.230.19.255,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:323aa9707db5a0349fc3829baed3d8ee,SystemUUID:323aa970-7db5-a034-9fc3-829baed3d8ee,BootID:35d11602-3a27-4158-8abd-6152101be7c6,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/fluentd-gcp-scaler@sha256:4f28f10fb89506768910b858f7a18ffb996824a16d70d5ac895e49687df9ff58 k8s.gcr.io/fluentd-gcp-scaler:0.5.2],SizeBytes:90498960,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:13513083,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[busybox@sha256:679b1c1058c1f2dc59a3ee70eed986a88811c0205c8ceea57cec5f22d2c3fbb1 busybox:latest],SizeBytes:1219790,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:14:48.209: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3k6d Dec 3 03:14:48.249: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3k6d Dec 3 03:14:48.298: INFO: fluentd-gcp-scaler-76d9c77b4d-lfhqr started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.298: INFO: Container fluentd-gcp-scaler ready: true, restart count 0 Dec 3 03:14:48.298: INFO: externalsvc-d8gv6 started at 2019-12-03 03:09:17 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.298: INFO: Container externalsvc ready: false, restart count 0 Dec 3 03:14:48.298: INFO: l7-default-backend-678889f899-kfz7v started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.298: INFO: Container default-http-backend ready: true, restart count 0 Dec 3 03:14:48.298: INFO: dns-test-756c6678-d708-4381-86fb-9cb95354f6b0 started at 2019-12-03 03:09:24 +0000 UTC (0+3 container statuses recorded) Dec 3 03:14:48.298: INFO: Container jessie-querier ready: true, restart count 0 Dec 3 03:14:48.298: INFO: Container querier ready: true, restart count 0 Dec 3 03:14:48.298: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:48.298: INFO: pod-ephm-test-projected-8z62 started at 2019-12-03 03:09:17 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.298: INFO: Container test-container-subpath-projected-8z62 ready: false, restart count 0 Dec 3 03:14:48.298: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-ls8bj started at 2019-12-03 03:09:37 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.298: INFO: Container agnhost ready: true, restart count 0 Dec 3 03:14:48.298: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-dfvhr started at 2019-12-03 03:08:34 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.298: INFO: Container agnhost ready: true, restart count 0 Dec 3 03:14:48.298: INFO: csi-mockplugin-resizer-0 started at 2019-12-03 03:08:07 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.298: INFO: Container csi-resizer ready: true, restart count 0 Dec 3 03:14:48.298: INFO: fluentd-gcp-v3.2.0-lf9js started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:14:48.298: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:14:48.298: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:14:48.298: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-v67gv started at 2019-12-03 03:09:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.299: INFO: Container agnhost ready: true, restart count 0 Dec 3 03:14:48.299: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-mwtsj started at 2019-12-03 03:09:36 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.299: INFO: Container agnhost ready: true, restart count 0 Dec 3 03:14:48.299: INFO: local-client started at 2019-12-03 03:09:34 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.299: INFO: Container local-client ready: false, restart count 0 Dec 3 03:14:48.299: INFO: pvc-volume-tester-fnspg started at 2019-12-03 03:08:16 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.299: INFO: Container volume-tester ready: false, restart count 0 Dec 3 03:14:48.299: INFO: security-context-1ba8a180-1de3-4a41-9725-e1542d359c62 started at 2019-12-03 03:09:47 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.299: INFO: Container write-pod ready: false, restart count 0 Dec 3 03:14:48.299: INFO: kube-proxy-bootstrap-e2e-minion-group-3k6d started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.299: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:14:48.299: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-zz7fn started at 2019-12-03 03:09:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.299: INFO: Container agnhost ready: true, restart count 0 Dec 3 03:14:48.299: INFO: ss2-0 started at 2019-12-03 03:09:10 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.299: INFO: Container webserver ready: false, restart count 0 Dec 3 03:14:48.299: INFO: netserver-0 started at 2019-12-03 03:09:13 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.299: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:48.299: INFO: hostexec-bootstrap-e2e-minion-group-3k6d-4djl8 started at 2019-12-03 03:09:48 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.299: INFO: Container agnhost ready: false, restart count 0 Dec 3 03:14:48.299: INFO: metadata-proxy-v0.1-8w2f8 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:14:48.299: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:14:48.299: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:14:48.299: INFO: coredns-65567c7b57-zlk2x started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.299: INFO: Container coredns ready: true, restart count 0 Dec 3 03:14:48.299: INFO: security-context-d3b4b6a3-7722-4013-8b0c-e421cadb1aed started at 2019-12-03 03:09:36 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.299: INFO: Container write-pod ready: true, restart count 0 Dec 3 03:14:48.299: INFO: security-context-8eebced2-8b7e-4b67-9ded-c43b12955582 started at 2019-12-03 03:09:36 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.299: INFO: Container write-pod ready: true, restart count 0 Dec 3 03:14:48.299: INFO: csi-mockplugin-0 started at 2019-12-03 03:08:07 +0000 UTC (0+3 container statuses recorded) Dec 3 03:14:48.299: INFO: Container csi-provisioner ready: true, restart count 0 Dec 3 03:14:48.299: INFO: Container driver-registrar ready: true, restart count 0 Dec 3 03:14:48.299: INFO: Container mock ready: true, restart count 0 Dec 3 03:14:48.450: INFO: Latency metrics for node bootstrap-e2e-minion-group-3k6d Dec 3 03:14:48.450: INFO: Logging node info for node bootstrap-e2e-minion-group-4kfl Dec 3 03:14:48.485: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-4kfl /api/v1/nodes/bootstrap-e2e-minion-group-4kfl dd9963b5-5d66-49cc-af35-0cb8c13d5de7 35590 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-4kfl kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-4kfl topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1470":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-ephemeral-9740":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-2571":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-7815":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-volume-398":"bootstrap-e2e-minion-group-4kfl","csi-mock-csi-mock-volumes-2306":"csi-mock-csi-mock-volumes-2306","csi-mock-csi-mock-volumes-2465":"csi-mock-csi-mock-volumes-2465","csi-mock-csi-mock-volumes-5287":"csi-mock-csi-mock-volumes-5287","csi-mock-csi-mock-volumes-9659":"csi-mock-csi-mock-volumes-9659"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-4kfl,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:35 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:35 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:35 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:12:35 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.13.80,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:30b63c524b868d3087050fb30234d2f7,SystemUUID:30b63c52-4b86-8d30-8705-0fb30234d2f7,BootID:03f4e451-9446-49a9-9e0b-32e618ab9497,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 gluster/glusterdynamic-provisioner:v1.0],SizeBytes:373281573,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/heapster-amd64@sha256:9fae0af136ce0cf4f88393b3670f7139ffc464692060c374d2ae748e13144521 k8s.gcr.io/heapster-amd64:v1.6.0-beta.1],SizeBytes:76016169,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/snapshot-controller@sha256:b3c1c484ffe4f0bbf000bda93fb745e1b3899b08d605a08581426a1963dd3e8a quay.io/k8scsi/snapshot-controller:v2.0.0-rc2],SizeBytes:47222712,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/metadata-concealment@sha256:e38f92502f6f6a175fb15b5ce2d02229d465b419d4a643f5999a0f88ee170dcc gcr.io/kubernetes-e2e-test-images/metadata-concealment:1.2],SizeBytes:5124686,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:14:48.486: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-4kfl Dec 3 03:14:48.537: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-4kfl Dec 3 03:14:48.577: INFO: metadata-proxy-v0.1-8x5ch started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:14:48.577: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:14:48.577: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:14:48.577: INFO: kube-proxy-bootstrap-e2e-minion-group-4kfl started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.577: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:14:48.577: INFO: netserver-1 started at 2019-12-03 03:10:00 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.577: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:48.577: INFO: netserver-1 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.577: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:48.577: INFO: netserver-1 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.577: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:48.577: INFO: fluentd-gcp-v3.2.0-8n4lg started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:14:48.577: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:14:48.577: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:14:48.577: INFO: heapster-v1.6.0-beta.1-56cb44959-szz2b started at 2019-12-03 02:57:02 +0000 UTC (0+2 container statuses recorded) Dec 3 03:14:48.577: INFO: Container heapster ready: true, restart count 0 Dec 3 03:14:48.577: INFO: Container heapster-nanny ready: true, restart count 0 Dec 3 03:14:48.577: INFO: volume-snapshot-controller-0 started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.577: INFO: Container volume-snapshot-controller ready: true, restart count 0 Dec 3 03:14:48.577: INFO: netserver-1 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.577: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:48.577: INFO: netserver-1 started at 2019-12-03 03:10:01 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.577: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:48.577: INFO: netserver-1 started at 2019-12-03 03:10:32 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.577: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:48.726: INFO: Latency metrics for node bootstrap-e2e-minion-group-4kfl Dec 3 03:14:48.726: INFO: Logging node info for node bootstrap-e2e-minion-group-5z63 Dec 3 03:14:48.761: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-5z63 /api/v1/nodes/bootstrap-e2e-minion-group-5z63 80c242ff-92d9-4147-9224-53017c8034c4 37616 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-5z63 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-5z63 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7831":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3055":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-3427":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-6545":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-755":"bootstrap-e2e-minion-group-5z63","csi-hostpath-provisioning-9008":"bootstrap-e2e-minion-group-5z63","csi-hostpath-volume-expand-9229":"bootstrap-e2e-minion-group-5z63","csi-mock-csi-mock-volumes-2016":"csi-mock-csi-mock-volumes-2016","csi-mock-csi-mock-volumes-6472":"csi-mock-csi-mock-volumes-6472"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-5z63,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:40 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:33 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:33 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:33 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:33 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.135.120,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-5z63.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9bc851f45efbabdf9b8ebd2b559e5c3e,SystemUUID:9bc851f4-5efb-abdf-9b8e-bd2b559e5c3e,BootID:8e50611c-7834-4dbe-bffa-e61943723514,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[k8s.gcr.io/event-exporter@sha256:ab71028f7cbc851d273bb00449e30ab743d4e3be21ed2093299f718b42df0748 k8s.gcr.io/event-exporter:v0.3.1],SizeBytes:51445475,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:1d49fb3b108e6b42542e4a9b056dee308f06f88824326cde1636eea0472b799d k8s.gcr.io/prometheus-to-sd:v0.7.2],SizeBytes:42314030,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-3427^6d4b52bf-157a-11ea-8520-72234df9033e kubernetes.io/gce-pd/bootstrap-e2e-dynamic-pvc-76c15ac2-4042-4e66-bdec-a5c420d7863e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-3427^6d4b52bf-157a-11ea-8520-72234df9033e,DevicePath:,},AttachedVolume{Name:kubernetes.io/gce-pd/bootstrap-e2e-dynamic-pvc-76c15ac2-4042-4e66-bdec-a5c420d7863e,DevicePath:/dev/disk/by-id/google-bootstrap-e2e-dynamic-pvc-76c15ac2-4042-4e66-bdec-a5c420d7863e,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:14:48.762: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-5z63 Dec 3 03:14:48.804: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-5z63 Dec 3 03:14:48.922: INFO: ss2-1 started at 2019-12-03 03:09:36 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.922: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:48.922: INFO: csi-hostpath-resizer-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.922: INFO: Container csi-resizer ready: true, restart count 0 Dec 3 03:14:48.922: INFO: kube-dns-autoscaler-65bc6d4889-kjnhr started at 2019-12-03 03:03:02 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.922: INFO: Container autoscaler ready: true, restart count 0 Dec 3 03:14:48.922: INFO: csi-snapshotter-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.922: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 3 03:14:48.922: INFO: metadata-proxy-v0.1-gvbgq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:14:48.922: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:14:48.922: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:14:48.922: INFO: kube-proxy-bootstrap-e2e-minion-group-5z63 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.922: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:14:48.922: INFO: fluentd-gcp-v3.2.0-mzjbq started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:14:48.922: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:14:48.922: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:14:48.922: INFO: inline-volume-tester-zmz7g started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.922: INFO: Container csi-volume-tester ready: false, restart count 0 Dec 3 03:14:48.922: INFO: netserver-2 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.922: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:48.922: INFO: netserver-2 started at 2019-12-03 03:10:00 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.922: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:48.922: INFO: execpod9rwjm started at 2019-12-03 03:14:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.922: INFO: Container agnhost-pause ready: true, restart count 0 Dec 3 03:14:48.922: INFO: csi-hostpathplugin-0 started at 2019-12-03 03:14:41 +0000 UTC (0+3 container statuses recorded) Dec 3 03:14:48.922: INFO: Container hostpath ready: true, restart count 0 Dec 3 03:14:48.922: INFO: Container liveness-probe ready: true, restart count 0 Dec 3 03:14:48.922: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 3 03:14:48.922: INFO: netserver-2 started at 2019-12-03 03:10:32 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.922: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:48.922: INFO: csi-hostpath-provisioner-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.922: INFO: Container csi-provisioner ready: true, restart count 0 Dec 3 03:14:48.922: INFO: netserver-2 started at 2019-12-03 03:10:01 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.922: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:48.922: INFO: event-exporter-v0.3.1-747b47fcd-v9x29 started at 2019-12-03 02:56:59 +0000 UTC (0+2 container statuses recorded) Dec 3 03:14:48.922: INFO: Container event-exporter ready: true, restart count 0 Dec 3 03:14:48.922: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:14:48.922: INFO: netserver-2 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.922: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:48.922: INFO: netserver-2 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.922: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:48.922: INFO: pod-subpath-test-gcepd-dynamicpv-6b7h started at 2019-12-03 03:14:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.922: INFO: Container test-container-subpath-gcepd-dynamicpv-6b7h ready: false, restart count 0 Dec 3 03:14:48.922: INFO: csi-hostpath-attacher-0 started at 2019-12-03 03:14:41 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:48.922: INFO: Container csi-attacher ready: true, restart count 0 Dec 3 03:14:49.169: INFO: Latency metrics for node bootstrap-e2e-minion-group-5z63 Dec 3 03:14:49.169: INFO: Logging node info for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:14:49.207: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-f8g7 /api/v1/nodes/bootstrap-e2e-minion-group-f8g7 0ae3612d-6f1b-43b7-ac42-d209b2c53997 37069 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-f8g7 kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-5136 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-f8g7 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2646":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-provisioning-6116":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volume-expand-7110":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-1617":"bootstrap-e2e-minion-group-f8g7","csi-hostpath-volumemode-5822":"bootstrap-e2e-minion-group-f8g7","csi-mock-csi-mock-volumes-4534":"csi-mock-csi-mock-volumes-4534","csi-mock-csi-mock-volumes-5485":"csi-mock-csi-mock-volumes-5485","csi-mock-csi-mock-volumes-6096":"csi-mock-csi-mock-volumes-6096","csi-mock-csi-mock-volumes-8158":"csi-mock-csi-mock-volumes-8158"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-f8g7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:38 +0000 UTC,LastTransitionTime:2019-12-03 02:56:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:30 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:30 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:30 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:30 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.6,},NodeAddress{Type:ExternalIP,Address:35.230.75.62,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-f8g7.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:343d3fec9626aaffa54d1b2394118877,SystemUUID:343d3fec-9626-aaff-a54d-1b2394118877,BootID:266805a2-3169-4ee5-8194-05b64e8d9864,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kubernetes-dashboard-amd64@sha256:0ae6b69432e78069c5ce2bcde0fe409c5c4d6f0f4d9cd50a17974fea38898747 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1],SizeBytes:121711221,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10],SizeBytes:61365829,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1],SizeBytes:40067731,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:39944451,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:2114a2f70d34fa2821fb7f9bf373be5f44c8cbfeb6097fb5ba8eaf73cd38b72a k8s.gcr.io/addon-resizer:1.8.6],SizeBytes:37928220,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:13090050,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:14:49.207: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:14:49.256: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-f8g7 Dec 3 03:14:49.303: INFO: kubernetes-dashboard-7778f8b456-lrmfl started at 2019-12-03 02:57:03 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:49.303: INFO: Container kubernetes-dashboard ready: true, restart count 0 Dec 3 03:14:49.303: INFO: kube-proxy-bootstrap-e2e-minion-group-f8g7 started at 2019-12-03 02:56:33 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:49.303: INFO: Container kube-proxy ready: true, restart count 0 Dec 3 03:14:49.303: INFO: metadata-proxy-v0.1-dmvr8 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:14:49.303: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:14:49.303: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:14:49.303: INFO: netserver-3 started at 2019-12-03 03:12:56 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:49.303: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:49.303: INFO: csi-mockplugin-0 started at 2019-12-03 03:14:48 +0000 UTC (0+3 container statuses recorded) Dec 3 03:14:49.303: INFO: Container csi-provisioner ready: false, restart count 0 Dec 3 03:14:49.303: INFO: Container driver-registrar ready: false, restart count 0 Dec 3 03:14:49.303: INFO: Container mock ready: false, restart count 0 Dec 3 03:14:49.303: INFO: netserver-3 started at 2019-12-03 03:10:01 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:49.303: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:49.303: INFO: metrics-server-v0.3.6-7d96444597-lmbw7 started at 2019-12-03 02:57:03 +0000 UTC (0+2 container statuses recorded) Dec 3 03:14:49.303: INFO: Container metrics-server ready: true, restart count 0 Dec 3 03:14:49.303: INFO: Container metrics-server-nanny ready: true, restart count 0 Dec 3 03:14:49.303: INFO: netserver-3 started at 2019-12-03 03:11:05 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:49.303: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:49.303: INFO: csi-mockplugin-attacher-0 started at 2019-12-03 03:14:48 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:49.303: INFO: Container csi-attacher ready: false, restart count 0 Dec 3 03:14:49.303: INFO: netserver-3 started at 2019-12-03 03:10:00 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:49.303: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:49.303: INFO: netserver-3 started at 2019-12-03 03:10:32 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:49.303: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:49.303: INFO: pod-secrets-d5a30c98-13bb-4c17-aac0-d4d74fe60b60 started at 2019-12-03 03:14:15 +0000 UTC (0+3 container statuses recorded) Dec 3 03:14:49.303: INFO: Container creates-volume-test ready: true, restart count 0 Dec 3 03:14:49.303: INFO: Container dels-volume-test ready: true, restart count 0 Dec 3 03:14:49.303: INFO: Container upds-volume-test ready: true, restart count 0 Dec 3 03:14:49.303: INFO: netserver-3 started at 2019-12-03 03:12:28 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:49.303: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:49.303: INFO: fluentd-gcp-v3.2.0-wv2h4 started at 2019-12-03 02:56:34 +0000 UTC (0+2 container statuses recorded) Dec 3 03:14:49.303: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:14:49.303: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:14:49.303: INFO: coredns-65567c7b57-8thvw started at 2019-12-03 02:57:10 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:49.303: INFO: Container coredns ready: true, restart count 0 Dec 3 03:14:49.303: INFO: ss2-2 started at 2019-12-03 03:09:16 +0000 UTC (0+1 container statuses recorded) Dec 3 03:14:49.303: INFO: Container webserver ready: true, restart count 0 Dec 3 03:14:49.617: INFO: Latency metrics for node bootstrap-e2e-minion-group-f8g7 Dec 3 03:14:49.617: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "pv-9041" for this suite.
Find pod-ephm-test-projected-8z62 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sIn\-tree\sVolumes\s\[Driver\:\sgcepd\]\s\[Testpattern\:\sPre\-provisioned\sPV\s\(block\svolmode\)\]\svolumes\sshould\sstore\sdata$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:150 Dec 3 03:15:03.922: Error getting Kubelet bootstrap-e2e-minion-group-3k6d metrics: the server is currently unable to handle the request (get nodes bootstrap-e2e-minion-group-3k6d:10250) Unexpected error: <*errors.StatusError | 0xc000a90dc0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "the server is currently unable to handle the request (get nodes bootstrap-e2e-minion-group-3k6d:10250)", Reason: "ServiceUnavailable", Details: { Name: "bootstrap-e2e-minion-group-3k6d:10250", Group: "", Kind: "nodes", UID: "", Causes: [ { Type: "UnexpectedServerResponse", Message: "Error trying to reach service: 'dial tcp 10.138.0.3:10250: connect: connection refused'", Field: "", }, ], RetryAfterSeconds: 0, }, Code: 503, }, } the server is currently unable to handle the request (get nodes bootstrap-e2e-minion-group-3k6d:10250) occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:604
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:101 [BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Creating a kubernetes client Dec 3 03:15:03.185: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename volume �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in volume-5527 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should store data /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:150 Dec 3 03:15:03.678: INFO: Node name not specified for getVolumeOpCounts, falling back to listing nodes from API Server Dec 3 03:15:03.922: FAIL: Error getting Kubelet bootstrap-e2e-minion-group-3k6d metrics: the server is currently unable to handle the request (get nodes bootstrap-e2e-minion-group-3k6d:10250) Unexpected error: <*errors.StatusError | 0xc000a90dc0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "the server is currently unable to handle the request (get nodes bootstrap-e2e-minion-group-3k6d:10250)", Reason: "ServiceUnavailable", Details: { Name: "bootstrap-e2e-minion-group-3k6d:10250", Group: "", Kind: "nodes", UID: "", Causes: [ { Type: "UnexpectedServerResponse", Message: "Error trying to reach service: 'dial tcp 10.138.0.3:10250: connect: connection refused'", Field: "", }, ], RetryAfterSeconds: 0, }, Code: 503, }, } the server is currently unable to handle the request (get nodes bootstrap-e2e-minion-group-3k6d:10250) occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.getVolumeOpCounts(0x542cb00, 0xc0021b1a20, 0xc002f23bf0, 0x27, 0x15) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:604 +0x5f9 k8s.io/kubernetes/test/e2e/storage/testsuites.getMigrationVolumeOpCounts(0x542cb00, 0xc0021b1a20, 0x4a89bce, 0x14, 0x100000a67, 0xc0007f2a00) /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:639 +0x1ad k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).defineTests.func1() /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:129 +0x110 k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).defineTests.func3() /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:155 +0xc2 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0001d8400) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:110 +0x30a k8s.io/kubernetes/test/e2e.TestE2E(0xc0001d8400) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:112 +0x2b testing.tRunner(0xc0001d8400, 0x4c381c8) /usr/local/go/src/testing/testing.go:909 +0xc9 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:960 +0x350 [AfterEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:152 �[1mSTEP�[0m: Collecting events from namespace "volume-5527". �[1mSTEP�[0m: Found 0 events. Dec 3 03:15:03.999: INFO: POD NODE PHASE GRACE CONDITIONS Dec 3 03:15:03.999: INFO: Dec 3 03:15:04.043: INFO: Logging node info for node bootstrap-e2e-master Dec 3 03:15:04.095: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master /api/v1/nodes/bootstrap-e2e-master 64f6954b-0039-46a9-bde3-dcd825532c16 34871 0 2019-12-03 02:56:38 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16684785664 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3876802560 0} {<nil>} 3785940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{15016307073 0} {<nil>} 15016307073 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3614658560 0} {<nil>} 3529940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:12:26 +0000 UTC,LastTransitionTime:2019-12-03 02:56:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.39.205,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5736e6f149167618f71cd530dafef4cc,SystemUUID:5736e6f1-4916-7618-f71c-d530dafef4cc,BootID:113c1994-21fb-4e64-a041-99c12a1d120b,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3-0],SizeBytes:288426917,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:212299081,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:200712199,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:110449186,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:3e315022a842d782a28e729720f21091dde21f1efea28868d65ec595ad871616 k8s.gcr.io/kube-addon-manager:v9.0.2],SizeBytes:83076028,},ContainerImage{Names:[k8s.gcr.io/etcd-empty-dir-cleanup@sha256:484662e55e0705caed26c6fb8632097457f43ce685756531da7a76319a7dcee1 k8s.gcr.io/etcd-empty-dir-cleanup:3.4.3.0],SizeBytes:77408900,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:76121176,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:04.096: INFO: Logging kubelet events for node bootstrap-e2e-master Dec 3 03:15:04.143: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Dec 3 03:15:04.192: INFO: kube-controller-manager-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.193: INFO: Container kube-controller-manager ready: true, restart count 0 Dec 3 03:15:04.193: INFO: kube-addon-manager-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.193: INFO: Container kube-addon-manager ready: true, restart count 0 Dec 3 03:15:04.193: INFO: metadata-proxy-v0.1-b2xdn started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:04.193: INFO: Container metadata-proxy ready: true, restart count 0 Dec 3 03:15:04.193: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:04.193: INFO: etcd-empty-dir-cleanup-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.193: INFO: Container etcd-empty-dir-cleanup ready: true, restart count 0 Dec 3 03:15:04.193: INFO: etcd-server-events-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.193: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:15:04.193: INFO: etcd-server-bootstrap-e2e-master started at 2019-12-03 02:57:30 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.193: INFO: Container etcd-container ready: true, restart count 0 Dec 3 03:15:04.193: INFO: kube-apiserver-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.193: INFO: Container kube-apiserver ready: true, restart count 0 Dec 3 03:15:04.193: INFO: kube-scheduler-bootstrap-e2e-master started at 2019-12-03 02:55:44 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.193: INFO: Container kube-scheduler ready: true, restart count 0 Dec 3 03:15:04.193: INFO: l7-lb-controller-bootstrap-e2e-master started at 2019-12-03 02:56:09 +0000 UTC (0+1 container statuses recorded) Dec 3 03:15:04.193: INFO: Container l7-lb-controller ready: true, restart count 2 Dec 3 03:15:04.193: INFO: fluentd-gcp-v3.2.0-r5wvv started at 2019-12-03 02:56:38 +0000 UTC (0+2 container statuses recorded) Dec 3 03:15:04.193: INFO: Container fluentd-gcp ready: true, restart count 0 Dec 3 03:15:04.193: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 3 03:15:04.337: INFO: Latency metrics for node bootstrap-e2e-master Dec 3 03:15:04.337: INFO: Logging node info for node bootstrap-e2e-minion-group-3k6d Dec 3 03:15:04.377: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3k6d /api/v1/nodes/bootstrap-e2e-minion-group-3k6d 27be8cb7-3aa4-4522-ac85-20da26bd0631 37099 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3k6d kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3k6d topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-6015":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-9792":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-8555":"bootstrap-e2e-minion-group-3k6d","csi-hostpath-volume-expand-9542":"bootstrap-e2e-minion-group-3k6d","csi-mock-csi-mock-volumes-3632":"csi-mock-csi-mock-volumes-3632","csi-mock-csi-mock-volumes-8963":"csi-mock-csi-mock-volumes-8963","csi-mock-csi-mock-volumes-9932":"csi-mock-csi-mock-volumes-9932"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-3k6d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:41 +0000 UTC,LastTransitionTime:2019-12-03 02:56:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:31 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.230.19.255,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3k6d.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:323aa9707db5a0349fc3829baed3d8ee,SystemUUID:323aa970-7db5-a034-9fc3-829baed3d8ee,BootID:35d11602-3a27-4158-8abd-6152101be7c6,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6b287d4ffa4],SizeBytes:130140635,},ContainerImage{Names:[httpd@sha256:dfb792aa3fed0694d8361ec066c592381e9bdff508292eceedd1ce28fb020f71 httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:6feb0ea7b0967367da66e8d58ba813fde32bdb92f63bfc21a9e170d211539db4 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/fluentd-gcp-scaler@sha256:4f28f10fb89506768910b858f7a18ffb996824a16d70d5ac895e49687df9ff58 k8s.gcr.io/fluentd-gcp-scaler:0.5.2],SizeBytes:90498960,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:52800335,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:32b849c66869e0491116a333af3a7cafe226639d975818dfdb4d58fd7028a0b8 quay.io/k8scsi/csi-provisioner:v1.5.0-rc1],SizeBytes:50962879,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:48e9d3c4147ab5e4e070677a352f807a17e0f6bcf4cb19b8c34f6bfadf87781b quay.io/k8scsi/csi-snapshotter:v2.0.0-rc2],SizeBytes:50515643,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:d3e2c5fb1d887bed2e6e8f931c65209b16cf7c28b40eaf7812268f9839908790 quay.io/k8scsi/csi-attacher:v2.0.0],SizeBytes:46143101,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:eff2d6a215efd9450d90796265fc4d8832a54a3a098df06edae6ff3a5072b08f quay.io/k8scsi/csi-resizer:v0.3.0],SizeBytes:46014212,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:41861013,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:7ec975f167d815311a7136c32e70735f0d00b73781365df1befd46ed35bd4fe7 k8s.gcr.io/coredns:1.6.5],SizeBytes:41578211,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:2f80c87a67122448bd60c778dd26d4067e1f48d1ea3fefe9f92b8cd1961acfa0 quay.io/k8scsi/hostpathplugin:v1.3.0-rc1],SizeBytes:28736864,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:89cdb2a20bdec89b75e2fbd82a67567ea90b719524990e772f2704b19757188d quay.io/k8scsi/csi-node-driver-registrar:v1.2.0],SizeBytes:17057647,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:13513083,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:11337839,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[busybox@sha256:679b1c1058c1f2dc59a3ee70eed986a88811c0205c8ceea57cec5f22d2c3fbb1 busybox:latest],SizeBytes:1219790,},ContainerImage{Names:[busybox@sha256:e004c2cc521c95383aebb1fb5893719aa7a8eae2e7a71f316a4410784edb00a9 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Dec 3 03:15:04.377: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3k6d Dec 3 03:15:04.437: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3k6d Dec 3 03:15:04.478: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3k6d: the server is currently unable to handle the request (get nodes bootstrap-e2e-minion-group-3k6d:10250) Dec 3 03:15:04.478: INFO: Logging node info for node bootstrap-e2e-minion-group-4kfl Dec 3 03:15:04.522: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-4kfl /api/v1/nodes/bootstrap-e2e-minion-group-4kfl dd9963b5-5d66-49cc-af35-0cb8c13d5de7 37998 0 2019-12-03 02:56:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-4kfl kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-4kfl topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1470":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-ephemeral-9740":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-2571":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-provisioning-7815":"bootstrap-e2e-minion-group-4kfl","csi-hostpath-volume-398":"bootstrap-e2e-minion-group-4kfl","csi-mock-csi-mock-volumes-2306":"csi-mock-csi-mock-volumes-2306","csi-mock-csi-mock-volumes-2465":"csi-mock-csi-mock-volumes-2465","csi-mock-csi-mock-volumes-5287":"csi-mock-csi-mock-volumes-5287","csi-mock-csi-mock-volumes-9659":"csi-mock-csi-mock-volumes-9659"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-upgrade/us-west1-b/bootstrap-e2e-minion-group-4kfl,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7840251904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91117161526 0} {<nil>} 91117161526 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7578107904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2019-12-03 03:11:36 +0000 UTC,LastTransitionTime:2019-12-03 02:56:34 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-12-03 02:56:53 +0000 UTC,LastTransitionTime:2019-12-03 02:56:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:56 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:56 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-12-03 03:14:56 +0000 UTC,LastTransitionTime:2019-12-03 02:56:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-12-03 03:14:56 +0000 UTC,LastTransitionTime:2019-12-03 02:56:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.13.80,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-4kfl.c.k8s-jkns-gce-upgrade.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:30b63c524b868d3087050fb30234d2f7,SystemUUID:30b63c52-4b86-8d30-8705-0fb30234d2f7,BootID:03f4e451-9446-49a9-9e0b-32e618ab9497,KernelVersion:4.19.76+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:docker://19.3.1,KubeletVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,KubeProxyVersion:v1.18.0-alpha.0.1350+57b6b287d4ffa4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 gluster/glusterdynamic-provisioner:v1.0],SizeBytes:373281573,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:332011484,},ContainerImage{Names:[gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:810aadac042cee96db99d94cec2436482b886774681b44bb141254edda5e3cdf gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.17],SizeBytes:238318516,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[fedora@sha256:8fa60b88e2a7eac8460b9c0104b877f1aa0cea7fbc03c701b7e545dacccfb433 fedora:latest],SizeBytes:194281245,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.18.0-alpha.0.1350_57b6